2024-05-16T22:14:58.790 INFO:root:teuthology version: 0.0.1.dev272+g08ca118 2024-05-16T22:14:58.790 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-05-16_22:05:38-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7709888 --name pdonnell-2024-05-16_22:05:38-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi --verbose --description fs:fscrypt/{begin/{0-install 1-ceph 2-logrotate 3-modules} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down osd pg-warn pg_health} tasks/{0-client 1-tests/fscrypt-common}} -- /home/teuthworker/archive/pdonnell-2024-05-16_22:05:38-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7709888/orig.config.yaml 2024-05-16T22:14:58.836 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-16T22:14:58.926 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-05-16_22:05:38-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7709888 branch: wip-pdonnell-testing-20240515.023933-debug description: fs:fscrypt/{begin/{0-install 1-ceph 2-logrotate 3-modules} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down osd pg-warn pg_health} tasks/{0-client 1-tests/fscrypt-common}} email: pdonnell@redhat.com first_in_suite: false job_id: '7709888' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: pdonnell-2024-05-16_22:05:38-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240515.023933-debug ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - Reduced data availability - Degraded data redundancy - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 43296076bed1da2423ef68e9230eab60284d4c31 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 43296076bed1da2423ef68e9230eab60284d4c31 extra_system_packages: deb: - fscrypt rpm: - fscrypt kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: i64602 sha1: 4d9eb97fa160d2c19d1436d63c7ffea8b5461de0 owner: scheduled_pdonnell@teuthology priority: 65 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 seed: 4756 sha1: 43296076bed1da2423ef68e9230eab60284d4c31 sleep_before_teardown: 0 suite: fs:fscrypt suite_branch: i64602 suite_path: /home/teuthworker/src/github.com_batrick_ceph_4d9eb97fa160d2c19d1436d63c7ffea8b5461de0/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph.git suite_sha1: 4d9eb97fa160d2c19d1436d63c7ffea8b5461de0 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi044.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAt5rcUO4Y7SferHnsS0xP4UK1u8AcDvnsU3NbSFYtsAlZnr3NsT5mWskvl8O+kjXaJQNqYGpgdM5kfJK3hO6WQ= smithi070.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDIXx6UZPtPph7S+DeRygWR+koZsxIHdJq7YABiIz+4yDx3pjYMMeRPWCVJVaU0fBVs04k4oN9uXnKFJCrJU0pY= smithi196.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCc/414NTDfFM39WmJCX7+FMCG01VdK0WrgTsS7qdBV17NP6D6e5c3R2XPeHh/CUFQOdO5usm+glmupjtMzVU1g= task: null tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - full_sequential_finally: - sleep: duration: 3600 - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_fscrypt teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end - if not is_kupstream() then reject() end teuthology_branch: install-override-extra_system_packages teuthology_sha1: 08ca1187b5d019c0ae6c90488c6c9faaace42185 timestamp: 2024-05-16_22:05:38 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-16T22:14:58.926 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_4d9eb97fa160d2c19d1436d63c7ffea8b5461de0/qa; will attempt to use it 2024-05-16T22:14:58.927 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_4d9eb97fa160d2c19d1436d63c7ffea8b5461de0/qa/tasks 2024-05-16T22:14:58.927 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-16T22:14:58.929 INFO:teuthology.task.internal:Checking packages... 2024-05-16T22:14:58.969 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '43296076bed1da2423ef68e9230eab60284d4c31' 2024-05-16T22:14:58.969 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-16T22:14:58.969 INFO:teuthology.packaging:ref: None 2024-05-16T22:14:58.969 INFO:teuthology.packaging:tag: None 2024-05-16T22:14:58.969 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240515.023933-debug 2024-05-16T22:14:58.969 INFO:teuthology.packaging:sha1: 43296076bed1da2423ef68e9230eab60284d4c31 2024-05-16T22:14:58.969 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240515.023933-debug 2024-05-16T22:14:59.250 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3709.g43296076 2024-05-16T22:14:59.252 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-16T22:14:59.258 INFO:teuthology.task.internal:no buildpackages task found 2024-05-16T22:14:59.259 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-16T22:14:59.274 INFO:teuthology.task.internal:Saving configuration 2024-05-16T22:14:59.291 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-16T22:14:59.296 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-16T22:14:59.320 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi044.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-16_22:05:38-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7709888', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-16 22:09:59.393927', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAt5rcUO4Y7SferHnsS0xP4UK1u8AcDvnsU3NbSFYtsAlZnr3NsT5mWskvl8O+kjXaJQNqYGpgdM5kfJK3hO6WQ='} 2024-05-16T22:14:59.344 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi070.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-16_22:05:38-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7709888', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-16 22:09:59.395568', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDIXx6UZPtPph7S+DeRygWR+koZsxIHdJq7YABiIz+4yDx3pjYMMeRPWCVJVaU0fBVs04k4oN9uXnKFJCrJU0pY='} 2024-05-16T22:14:59.366 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi196.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-16_22:05:38-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7709888', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-16 22:09:59.396889', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCc/414NTDfFM39WmJCX7+FMCG01VdK0WrgTsS7qdBV17NP6D6e5c3R2XPeHh/CUFQOdO5usm+glmupjtMzVU1g='} 2024-05-16T22:14:59.366 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-16T22:14:59.372 INFO:teuthology.task.internal:roles: ubuntu@smithi044.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2024-05-16T22:14:59.373 INFO:teuthology.task.internal:roles: ubuntu@smithi070.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-05-16T22:14:59.373 INFO:teuthology.task.internal:roles: ubuntu@smithi196.front.sepia.ceph.com - ['client.0'] 2024-05-16T22:14:59.373 INFO:teuthology.run_tasks:Running task console_log... 2024-05-16T22:14:59.459 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8d11c9fac0>, signals=[15]) 2024-05-16T22:14:59.459 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-16T22:14:59.465 INFO:teuthology.task.internal:Opening connections... 2024-05-16T22:14:59.466 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi044.front.sepia.ceph.com 2024-05-16T22:14:59.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-16T22:14:59.541 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi070.front.sepia.ceph.com 2024-05-16T22:14:59.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-16T22:14:59.613 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi196.front.sepia.ceph.com 2024-05-16T22:14:59.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-16T22:14:59.688 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-16T22:14:59.695 DEBUG:teuthology.orchestra.run.smithi044:> uname -m 2024-05-16T22:14:59.714 INFO:teuthology.orchestra.run.smithi044.stdout:x86_64 2024-05-16T22:14:59.714 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release 2024-05-16T22:14:59.772 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="CentOS Stream" 2024-05-16T22:14:59.772 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="9" 2024-05-16T22:14:59.772 INFO:teuthology.orchestra.run.smithi044.stdout:ID="centos" 2024-05-16T22:14:59.772 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE="rhel fedora" 2024-05-16T22:14:59.773 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="9" 2024-05-16T22:14:59.773 INFO:teuthology.orchestra.run.smithi044.stdout:PLATFORM_ID="platform:el9" 2024-05-16T22:14:59.773 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-16T22:14:59.773 INFO:teuthology.orchestra.run.smithi044.stdout:ANSI_COLOR="0;31" 2024-05-16T22:14:59.773 INFO:teuthology.orchestra.run.smithi044.stdout:LOGO="fedora-logo-icon" 2024-05-16T22:14:59.773 INFO:teuthology.orchestra.run.smithi044.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-16T22:14:59.773 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://centos.org/" 2024-05-16T22:14:59.773 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-16T22:14:59.773 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-16T22:14:59.773 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-16T22:14:59.774 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server 2024-05-16T22:14:59.798 DEBUG:teuthology.orchestra.run.smithi070:> uname -m 2024-05-16T22:14:59.816 INFO:teuthology.orchestra.run.smithi070.stdout:x86_64 2024-05-16T22:14:59.816 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release 2024-05-16T22:14:59.873 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="CentOS Stream" 2024-05-16T22:14:59.873 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="9" 2024-05-16T22:14:59.873 INFO:teuthology.orchestra.run.smithi070.stdout:ID="centos" 2024-05-16T22:14:59.873 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE="rhel fedora" 2024-05-16T22:14:59.873 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="9" 2024-05-16T22:14:59.873 INFO:teuthology.orchestra.run.smithi070.stdout:PLATFORM_ID="platform:el9" 2024-05-16T22:14:59.874 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-16T22:14:59.874 INFO:teuthology.orchestra.run.smithi070.stdout:ANSI_COLOR="0;31" 2024-05-16T22:14:59.874 INFO:teuthology.orchestra.run.smithi070.stdout:LOGO="fedora-logo-icon" 2024-05-16T22:14:59.874 INFO:teuthology.orchestra.run.smithi070.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-16T22:14:59.874 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://centos.org/" 2024-05-16T22:14:59.874 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-16T22:14:59.874 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-16T22:14:59.874 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-16T22:14:59.874 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2024-05-16T22:14:59.898 DEBUG:teuthology.orchestra.run.smithi196:> uname -m 2024-05-16T22:14:59.916 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64 2024-05-16T22:14:59.916 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release 2024-05-16T22:14:59.973 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="CentOS Stream" 2024-05-16T22:14:59.973 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="9" 2024-05-16T22:14:59.973 INFO:teuthology.orchestra.run.smithi196.stdout:ID="centos" 2024-05-16T22:14:59.973 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="rhel fedora" 2024-05-16T22:14:59.973 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="9" 2024-05-16T22:14:59.973 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el9" 2024-05-16T22:14:59.973 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-16T22:14:59.973 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31" 2024-05-16T22:14:59.974 INFO:teuthology.orchestra.run.smithi196.stdout:LOGO="fedora-logo-icon" 2024-05-16T22:14:59.974 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-16T22:14:59.974 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://centos.org/" 2024-05-16T22:14:59.974 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-16T22:14:59.974 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-16T22:14:59.974 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-16T22:14:59.974 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2024-05-16T22:14:59.998 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-16T22:15:00.006 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-16T22:15:00.012 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-16T22:15:00.012 DEBUG:teuthology.orchestra.run.smithi044:> test '!' -e /home/ubuntu/cephtest 2024-05-16T22:15:00.015 DEBUG:teuthology.orchestra.run.smithi070:> test '!' -e /home/ubuntu/cephtest 2024-05-16T22:15:00.017 DEBUG:teuthology.orchestra.run.smithi196:> test '!' -e /home/ubuntu/cephtest 2024-05-16T22:15:00.033 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-16T22:15:00.039 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-16T22:15:00.039 DEBUG:teuthology.orchestra.run.smithi044:> test -z $(ls -A /var/lib/ceph) 2024-05-16T22:15:00.073 DEBUG:teuthology.orchestra.run.smithi070:> test -z $(ls -A /var/lib/ceph) 2024-05-16T22:15:00.075 DEBUG:teuthology.orchestra.run.smithi196:> test -z $(ls -A /var/lib/ceph) 2024-05-16T22:15:00.172 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-16T22:15:00.254 INFO:teuthology.run_tasks:Running task kernel... 2024-05-16T22:15:00.268 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-05-16T22:15:00.268 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-05-16T22:15:00.268 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-05-16T22:15:00.269 DEBUG:teuthology.orchestra.run.smithi196:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-16T22:15:00.285 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-16T22:15:00.286 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-05-16T22:15:00.614 DEBUG:teuthology.task.kernel:sha1 for client.0 is 42e114f04cb046558abf08b436bd2a0497043042 2024-05-16T22:15:00.614 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "42e114f04cb046558abf08b436bd2a0497043042"... 2024-05-16T22:15:00.615 DEBUG:teuthology.orchestra.run.smithi196:> uname -r 2024-05-16T22:15:00.632 INFO:teuthology.orchestra.run.smithi196.stdout:5.14.0-437.el9.x86_64 2024-05-16T22:15:00.632 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 42e114f04cb046558abf08b436bd2a0497043042 2024-05-16T22:15:00.632 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-16T22:15:00.633 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum upgrade -y linux-firmware 2024-05-16T22:15:04.827 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 9 - BaseOS 3.2 MB/s | 8.1 MB 00:02 2024-05-16T22:15:12.368 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 9 - AppStream 3.0 MB/s | 19 MB 00:06 2024-05-16T22:15:16.410 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.2 MB 00:00 2024-05-16T22:15:17.869 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 9 - Extras packages 54 kB/s | 16 kB 00:00 2024-05-16T22:15:19.362 INFO:teuthology.orchestra.run.smithi196.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-05-16T22:15:24.478 INFO:teuthology.orchestra.run.smithi196.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-05-16T22:15:26.616 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2024-05-16T22:15:26.617 INFO:teuthology.orchestra.run.smithi196.stdout:Nothing to do. 2024-05-16T22:15:26.618 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2024-05-16T22:15:26.721 INFO:teuthology.task.kernel:Downloading kernel 42e114f04cb046558abf08b436bd2a0497043042 on client.0... 2024-05-16T22:15:26.721 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=42e114f04cb046558abf08b436bd2a0497043042 2024-05-16T22:15:26.866 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/42e114f04cb046558abf08b436bd2a0497043042/centos/9/flavors/default/x86_64/ 2024-05-16T22:15:26.866 DEBUG:teuthology.orchestra.run.smithi196:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g42e114f04cb0-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/42e114f04cb046558abf08b436bd2a0497043042/centos/9/flavors/default/x86_64/ --input-file=- 2024-05-16T22:15:26.868 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi196.front.sepia.ceph.com to complete... 2024-05-16T22:15:38.993 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16 22:15:38 URL:https://2.chacra.ceph.com/r/kernel/testing/42e114f04cb046558abf08b436bd2a0497043042/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g42e114f04cb0-1.x86_64.rpm [357254834/357254834] -> "/tmp/kernel.x86_64.rpm" [1] 2024-05-16T22:15:38.993 INFO:teuthology.orchestra.run.smithi196.stderr:FINISHED --2024-05-16 22:15:38-- 2024-05-16T22:15:38.993 INFO:teuthology.orchestra.run.smithi196.stderr:Total wall clock time: 12s 2024-05-16T22:15:38.993 INFO:teuthology.orchestra.run.smithi196.stderr:Downloaded: 1 files, 341M in 12s (28.8 MB/s) 2024-05-16T22:15:38.996 INFO:teuthology.task.kernel:Installing kernel 42e114f04cb046558abf08b436bd2a0497043042 on client.0... 2024-05-16T22:15:38.997 DEBUG:teuthology.orchestra.run.smithi196:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-05-16T22:15:41.241 INFO:teuthology.orchestra.run.smithi196.stdout:Verifying... ######################################## 2024-05-16T22:15:41.418 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing... ######################################## 2024-05-16T22:15:41.529 INFO:teuthology.orchestra.run.smithi196.stdout:Updating / installing... 2024-05-16T22:15:49.490 INFO:teuthology.orchestra.run.smithi196.stdout:kernel-6.9.0_rc3_g42e114f04cb0-1 ######################################## 2024-05-16T22:16:28.769 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi196.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-05-16T22:16:28.770 DEBUG:teuthology.orchestra.run.smithi196:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-05-16T22:16:28.843 INFO:teuthology.orchestra.run.smithi196.stdout:/boot/System.map-6.9.0-rc3-g42e114f04cb0 2024-05-16T22:16:28.843 INFO:teuthology.orchestra.run.smithi196.stdout:/boot/config-6.9.0-rc3-g42e114f04cb0 2024-05-16T22:16:28.843 INFO:teuthology.orchestra.run.smithi196.stdout:/boot/vmlinuz-6.9.0-rc3-g42e114f04cb0 2024-05-16T22:16:28.843 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/System.map 2024-05-16T22:16:28.843 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/config 2024-05-16T22:16:28.843 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel 2024-05-16T22:16:28.843 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch 2024-05-16T22:16:28.843 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86 2024-05-16T22:16:28.843 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto 2024-05-16T22:16:28.843 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-16T22:16:28.843 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-16T22:16:28.843 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-16T22:16:28.843 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-16T22:16:28.844 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-16T22:16:28.844 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-16T22:16:28.844 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-16T22:16:28.844 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/crc32c-intel.ko 2024-05-16T22:16:28.844 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-16T22:16:28.844 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-16T22:16:28.844 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-16T22:16:28.844 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-16T22:16:28.844 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-16T22:16:28.844 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-16T22:16:28.844 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-16T22:16:28.844 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-16T22:16:28.844 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-16T22:16:28.844 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-16T22:16:28.845 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-16T22:16:28.845 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-16T22:16:28.845 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/kernel 2024-05-16T22:16:28.845 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/kernel/cpu 2024-05-16T22:16:28.845 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/kernel/cpu/mce 2024-05-16T22:16:28.845 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-16T22:16:28.845 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/kvm 2024-05-16T22:16:28.845 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-16T22:16:28.845 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-16T22:16:28.845 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/kvm/kvm.ko 2024-05-16T22:16:28.845 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto 2024-05-16T22:16:28.845 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/ansi_cprng.ko 2024-05-16T22:16:28.845 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/anubis.ko 2024-05-16T22:16:28.845 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/arc4.ko 2024-05-16T22:16:28.845 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/async_tx 2024-05-16T22:16:28.846 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/async_tx/async_memcpy.ko 2024-05-16T22:16:28.846 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/async_tx/async_pq.ko 2024-05-16T22:16:28.846 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-16T22:16:28.846 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/async_tx/async_tx.ko 2024-05-16T22:16:28.846 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/async_tx/async_xor.ko 2024-05-16T22:16:28.846 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/async_tx/raid6test.ko 2024-05-16T22:16:28.846 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/authenc.ko 2024-05-16T22:16:28.846 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/authencesn.ko 2024-05-16T22:16:28.846 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/blake2b_generic.ko 2024-05-16T22:16:28.846 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/blowfish_common.ko 2024-05-16T22:16:28.846 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/blowfish_generic.ko 2024-05-16T22:16:28.846 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/camellia_generic.ko 2024-05-16T22:16:28.846 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/cast5_generic.ko 2024-05-16T22:16:28.847 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/cast6_generic.ko 2024-05-16T22:16:28.847 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/cast_common.ko 2024-05-16T22:16:28.847 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/ccm.ko 2024-05-16T22:16:28.847 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/cmac.ko 2024-05-16T22:16:28.847 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/crc32_generic.ko 2024-05-16T22:16:28.847 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/crypto_engine.ko 2024-05-16T22:16:28.847 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/crypto_user.ko 2024-05-16T22:16:28.847 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/cts.ko 2024-05-16T22:16:28.847 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/des_generic.ko 2024-05-16T22:16:28.847 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/dh_generic.ko 2024-05-16T22:16:28.847 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/echainiv.ko 2024-05-16T22:16:28.847 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/essiv.ko 2024-05-16T22:16:28.847 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/fcrypt.ko 2024-05-16T22:16:28.847 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/khazad.ko 2024-05-16T22:16:28.848 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/lz4.ko 2024-05-16T22:16:28.848 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/lz4hc.ko 2024-05-16T22:16:28.848 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/md4.ko 2024-05-16T22:16:28.848 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/michael_mic.ko 2024-05-16T22:16:28.848 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/pcbc.ko 2024-05-16T22:16:28.848 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/pcrypt.ko 2024-05-16T22:16:28.848 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/rmd160.ko 2024-05-16T22:16:28.848 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/seed.ko 2024-05-16T22:16:28.848 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/serpent_generic.ko 2024-05-16T22:16:28.848 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/tcrypt.ko 2024-05-16T22:16:28.848 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/tea.ko 2024-05-16T22:16:28.848 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/twofish_common.ko 2024-05-16T22:16:28.848 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/twofish_generic.ko 2024-05-16T22:16:28.848 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/vmac.ko 2024-05-16T22:16:28.849 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/wp512.ko 2024-05-16T22:16:28.849 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/xcbc.ko 2024-05-16T22:16:28.849 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/xor.ko 2024-05-16T22:16:28.849 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/xxhash_generic.ko 2024-05-16T22:16:28.849 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers 2024-05-16T22:16:28.849 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/acpi 2024-05-16T22:16:28.849 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-16T22:16:28.849 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/acpi/acpi_pad.ko 2024-05-16T22:16:28.849 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/acpi/ec_sys.ko 2024-05-16T22:16:28.849 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/acpi/platform_profile.ko 2024-05-16T22:16:28.849 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/acpi/sbs.ko 2024-05-16T22:16:28.849 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/acpi/sbshc.ko 2024-05-16T22:16:28.849 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/acpi/video.ko 2024-05-16T22:16:28.849 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata 2024-05-16T22:16:28.850 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/acard-ahci.ko 2024-05-16T22:16:28.850 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/ahci_platform.ko 2024-05-16T22:16:28.850 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/ata_generic.ko 2024-05-16T22:16:28.850 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/libahci_platform.ko 2024-05-16T22:16:28.850 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_acpi.ko 2024-05-16T22:16:28.850 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_ali.ko 2024-05-16T22:16:28.850 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_amd.ko 2024-05-16T22:16:28.850 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_artop.ko 2024-05-16T22:16:28.850 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_atiixp.ko 2024-05-16T22:16:28.850 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_atp867x.ko 2024-05-16T22:16:28.850 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_cmd640.ko 2024-05-16T22:16:28.850 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_cmd64x.ko 2024-05-16T22:16:28.850 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_cypress.ko 2024-05-16T22:16:28.851 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_efar.ko 2024-05-16T22:16:28.851 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_hpt366.ko 2024-05-16T22:16:28.851 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_hpt37x.ko 2024-05-16T22:16:28.851 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-16T22:16:28.851 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-16T22:16:28.851 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_it8213.ko 2024-05-16T22:16:28.851 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_it821x.ko 2024-05-16T22:16:28.851 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_jmicron.ko 2024-05-16T22:16:28.851 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_marvell.ko 2024-05-16T22:16:28.851 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_mpiix.ko 2024-05-16T22:16:28.851 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_netcell.ko 2024-05-16T22:16:28.851 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_ninja32.ko 2024-05-16T22:16:28.851 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_ns87410.ko 2024-05-16T22:16:28.851 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_ns87415.ko 2024-05-16T22:16:28.852 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_oldpiix.ko 2024-05-16T22:16:28.852 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_opti.ko 2024-05-16T22:16:28.852 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_optidma.ko 2024-05-16T22:16:28.852 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_pcmcia.ko 2024-05-16T22:16:28.852 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-16T22:16:28.852 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-16T22:16:28.852 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_piccolo.ko 2024-05-16T22:16:28.852 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_rdc.ko 2024-05-16T22:16:28.852 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_sch.ko 2024-05-16T22:16:28.852 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_serverworks.ko 2024-05-16T22:16:28.852 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_sil680.ko 2024-05-16T22:16:28.852 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_sis.ko 2024-05-16T22:16:28.852 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_sl82c105.ko 2024-05-16T22:16:28.852 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_triflex.ko 2024-05-16T22:16:28.852 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_via.ko 2024-05-16T22:16:28.852 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pdc_adma.ko 2024-05-16T22:16:28.853 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/sata_inic162x.ko 2024-05-16T22:16:28.853 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/sata_mv.ko 2024-05-16T22:16:28.853 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/sata_nv.ko 2024-05-16T22:16:28.853 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/sata_promise.ko 2024-05-16T22:16:28.853 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/sata_qstor.ko 2024-05-16T22:16:28.853 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/sata_sil.ko 2024-05-16T22:16:28.853 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/sata_sil24.ko 2024-05-16T22:16:28.853 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/sata_sis.ko 2024-05-16T22:16:28.853 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/sata_svw.ko 2024-05-16T22:16:28.853 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/sata_sx4.ko 2024-05-16T22:16:28.853 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/sata_uli.ko 2024-05-16T22:16:28.853 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/sata_via.ko 2024-05-16T22:16:28.853 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/sata_vsc.ko 2024-05-16T22:16:28.853 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/auxdisplay 2024-05-16T22:16:28.853 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/auxdisplay/ks0108.ko 2024-05-16T22:16:28.854 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/base 2024-05-16T22:16:28.854 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/base/regmap 2024-05-16T22:16:28.854 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/base/regmap/regmap-i2c.ko 2024-05-16T22:16:28.854 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/base/regmap/regmap-mmio.ko 2024-05-16T22:16:28.854 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/bcma 2024-05-16T22:16:28.854 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/bcma/bcma.ko 2024-05-16T22:16:28.854 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block 2024-05-16T22:16:28.854 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/aoe 2024-05-16T22:16:28.854 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/aoe/aoe.ko 2024-05-16T22:16:28.854 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/brd.ko 2024-05-16T22:16:28.854 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/drbd 2024-05-16T22:16:28.854 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/drbd/drbd.ko 2024-05-16T22:16:28.854 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/floppy.ko 2024-05-16T22:16:28.855 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/loop.ko 2024-05-16T22:16:28.855 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/mtip32xx 2024-05-16T22:16:28.855 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-16T22:16:28.855 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/nbd.ko 2024-05-16T22:16:28.855 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/null_blk 2024-05-16T22:16:28.855 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/null_blk/null_blk.ko 2024-05-16T22:16:28.855 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/pktcdvd.ko 2024-05-16T22:16:28.855 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/rbd.ko 2024-05-16T22:16:28.855 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/virtio_blk.ko 2024-05-16T22:16:28.855 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/xen-blkback 2024-05-16T22:16:28.855 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-16T22:16:28.855 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/xen-blkfront.ko 2024-05-16T22:16:28.855 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/zram 2024-05-16T22:16:28.855 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/zram/zram.ko 2024-05-16T22:16:28.856 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char 2024-05-16T22:16:28.856 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/hangcheck-timer.ko 2024-05-16T22:16:28.856 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/hw_random 2024-05-16T22:16:28.856 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-16T22:16:28.856 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-16T22:16:28.856 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-16T22:16:28.856 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/hw_random/via-rng.ko 2024-05-16T22:16:28.856 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-16T22:16:28.856 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/ipmi 2024-05-16T22:16:28.856 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-16T22:16:28.856 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-16T22:16:28.856 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-16T22:16:28.856 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-16T22:16:28.856 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-16T22:16:28.856 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-16T22:16:28.857 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/lp.ko 2024-05-16T22:16:28.857 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/mwave 2024-05-16T22:16:28.857 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/mwave/mwave.ko 2024-05-16T22:16:28.857 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/ppdev.ko 2024-05-16T22:16:28.857 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/tlclk.ko 2024-05-16T22:16:28.857 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/tpm 2024-05-16T22:16:28.857 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/tpm/tpm.ko 2024-05-16T22:16:28.857 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-16T22:16:28.857 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-16T22:16:28.857 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-16T22:16:28.857 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/tpm/tpm_tis.ko 2024-05-16T22:16:28.857 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-05-16T22:16:28.857 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/uv_mmtimer.ko 2024-05-16T22:16:28.857 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/virtio_console.ko 2024-05-16T22:16:28.857 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/cpufreq 2024-05-16T22:16:28.857 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-05-16T22:16:28.858 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-16T22:16:28.858 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-16T22:16:28.858 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-05-16T22:16:28.858 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/cpufreq/powernow-k8.ko 2024-05-16T22:16:28.858 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-16T22:16:28.858 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/crypto 2024-05-16T22:16:28.858 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/crypto/ccp 2024-05-16T22:16:28.858 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-16T22:16:28.858 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/crypto/ccp/ccp.ko 2024-05-16T22:16:28.858 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/crypto/intel 2024-05-16T22:16:28.858 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/crypto/intel/qat 2024-05-16T22:16:28.858 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/crypto/intel/qat/qat_common 2024-05-16T22:16:28.858 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-16T22:16:28.859 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-05-16T22:16:28.859 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-16T22:16:28.859 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/crypto/padlock-aes.ko 2024-05-16T22:16:28.859 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/crypto/padlock-sha.ko 2024-05-16T22:16:28.859 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/crypto/virtio 2024-05-16T22:16:28.859 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-16T22:16:28.859 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/dca 2024-05-16T22:16:28.859 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/dca/dca.ko 2024-05-16T22:16:28.859 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/devfreq 2024-05-16T22:16:28.859 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-05-16T22:16:28.859 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/dma 2024-05-16T22:16:28.859 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/dma/dw 2024-05-16T22:16:28.859 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-16T22:16:28.859 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/dma/ioat 2024-05-16T22:16:28.859 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-16T22:16:28.859 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/edac 2024-05-16T22:16:28.860 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/edac/amd64_edac.ko 2024-05-16T22:16:28.860 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/edac/e752x_edac.ko 2024-05-16T22:16:28.860 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/edac/edac_mce_amd.ko 2024-05-16T22:16:28.860 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/edac/i3000_edac.ko 2024-05-16T22:16:28.860 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/edac/i3200_edac.ko 2024-05-16T22:16:28.860 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/edac/i5100_edac.ko 2024-05-16T22:16:28.860 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/edac/i5400_edac.ko 2024-05-16T22:16:28.860 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/edac/i7300_edac.ko 2024-05-16T22:16:28.860 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/edac/i7core_edac.ko 2024-05-16T22:16:28.860 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/edac/i82975x_edac.ko 2024-05-16T22:16:28.860 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/edac/ie31200_edac.ko 2024-05-16T22:16:28.860 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/edac/sb_edac.ko 2024-05-16T22:16:28.860 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/edac/x38_edac.ko 2024-05-16T22:16:28.860 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/firmware 2024-05-16T22:16:28.861 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/firmware/edd.ko 2024-05-16T22:16:28.861 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-16T22:16:28.861 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/gpio 2024-05-16T22:16:28.861 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/gpio/gpio-ich.ko 2024-05-16T22:16:28.861 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-16T22:16:28.861 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid 2024-05-16T22:16:28.861 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-appleir.ko 2024-05-16T22:16:28.861 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-aureal.ko 2024-05-16T22:16:28.861 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-axff.ko 2024-05-16T22:16:28.861 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-dr.ko 2024-05-16T22:16:28.861 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-elecom.ko 2024-05-16T22:16:28.861 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-elo.ko 2024-05-16T22:16:28.861 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-emsff.ko 2024-05-16T22:16:28.861 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-gaff.ko 2024-05-16T22:16:28.861 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-gt683r.ko 2024-05-16T22:16:28.862 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-gyration.ko 2024-05-16T22:16:28.862 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-16T22:16:28.862 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-16T22:16:28.862 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-holtekff.ko 2024-05-16T22:16:28.862 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-hyperv.ko 2024-05-16T22:16:28.862 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-icade.ko 2024-05-16T22:16:28.862 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-keytouch.ko 2024-05-16T22:16:28.862 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-kye.ko 2024-05-16T22:16:28.862 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-lcpower.ko 2024-05-16T22:16:28.862 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-led.ko 2024-05-16T22:16:28.862 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-lenovo.ko 2024-05-16T22:16:28.862 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-16T22:16:28.862 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-16T22:16:28.863 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-multitouch.ko 2024-05-16T22:16:28.863 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-ortek.ko 2024-05-16T22:16:28.863 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-penmount.ko 2024-05-16T22:16:28.863 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-petalynx.ko 2024-05-16T22:16:28.863 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-picolcd.ko 2024-05-16T22:16:28.863 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-pl.ko 2024-05-16T22:16:28.863 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-plantronics.ko 2024-05-16T22:16:28.863 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-primax.ko 2024-05-16T22:16:28.863 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-rmi.ko 2024-05-16T22:16:28.863 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-16T22:16:28.863 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-roccat-common.ko 2024-05-16T22:16:28.863 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-16T22:16:28.863 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-16T22:16:28.863 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-16T22:16:28.863 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-16T22:16:28.864 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-16T22:16:28.864 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-16T22:16:28.864 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-16T22:16:28.864 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-16T22:16:28.864 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-16T22:16:28.864 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-roccat.ko 2024-05-16T22:16:28.864 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-saitek.ko 2024-05-16T22:16:28.864 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-samsung.ko 2024-05-16T22:16:28.864 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-16T22:16:28.864 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-sjoy.ko 2024-05-16T22:16:28.864 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-sony.ko 2024-05-16T22:16:28.864 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-speedlink.ko 2024-05-16T22:16:28.864 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-steelseries.ko 2024-05-16T22:16:28.864 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-sunplus.ko 2024-05-16T22:16:28.865 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-16T22:16:28.865 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-tivo.ko 2024-05-16T22:16:28.865 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-tmff.ko 2024-05-16T22:16:28.865 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-topseed.ko 2024-05-16T22:16:28.865 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-twinhan.ko 2024-05-16T22:16:28.865 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-uclogic.ko 2024-05-16T22:16:28.865 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-waltop.ko 2024-05-16T22:16:28.865 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-wiimote.ko 2024-05-16T22:16:28.865 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-xinmo.ko 2024-05-16T22:16:28.865 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-zpff.ko 2024-05-16T22:16:28.865 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-zydacron.ko 2024-05-16T22:16:28.865 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/uhid.ko 2024-05-16T22:16:28.865 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/wacom.ko 2024-05-16T22:16:28.865 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hv 2024-05-16T22:16:28.866 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hv/hv_balloon.ko 2024-05-16T22:16:28.866 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hv/hv_utils.ko 2024-05-16T22:16:28.866 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hv/hv_vmbus.ko 2024-05-16T22:16:28.866 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon 2024-05-16T22:16:28.866 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/abituguru.ko 2024-05-16T22:16:28.866 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/abituguru3.ko 2024-05-16T22:16:28.866 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-16T22:16:28.866 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/ad7414.ko 2024-05-16T22:16:28.866 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/ad7418.ko 2024-05-16T22:16:28.866 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/adc128d818.ko 2024-05-16T22:16:28.866 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/adm1025.ko 2024-05-16T22:16:28.866 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/adm1026.ko 2024-05-16T22:16:28.866 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/adm1029.ko 2024-05-16T22:16:28.866 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/adm1031.ko 2024-05-16T22:16:28.866 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/adm9240.ko 2024-05-16T22:16:28.867 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/ads7828.ko 2024-05-16T22:16:28.867 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/adt7410.ko 2024-05-16T22:16:28.867 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/adt7411.ko 2024-05-16T22:16:28.867 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/adt7462.ko 2024-05-16T22:16:28.867 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/adt7470.ko 2024-05-16T22:16:28.867 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/adt7475.ko 2024-05-16T22:16:28.867 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/adt7x10.ko 2024-05-16T22:16:28.867 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/amc6821.ko 2024-05-16T22:16:28.867 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/applesmc.ko 2024-05-16T22:16:28.867 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/asb100.ko 2024-05-16T22:16:28.867 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/asc7621.ko 2024-05-16T22:16:28.867 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-16T22:16:28.867 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/atxp1.ko 2024-05-16T22:16:28.867 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/coretemp.ko 2024-05-16T22:16:28.867 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-16T22:16:28.867 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/dme1737.ko 2024-05-16T22:16:28.868 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/ds1621.ko 2024-05-16T22:16:28.868 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/ds620.ko 2024-05-16T22:16:28.868 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/emc1403.ko 2024-05-16T22:16:28.868 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/emc6w201.ko 2024-05-16T22:16:28.868 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/f71805f.ko 2024-05-16T22:16:28.868 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/f71882fg.ko 2024-05-16T22:16:28.868 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/f75375s.ko 2024-05-16T22:16:28.868 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/fam15h_power.ko 2024-05-16T22:16:28.868 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/fschmd.ko 2024-05-16T22:16:28.868 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/g760a.ko 2024-05-16T22:16:28.868 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/g762.ko 2024-05-16T22:16:28.868 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/gl518sm.ko 2024-05-16T22:16:28.868 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/gl520sm.ko 2024-05-16T22:16:28.868 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-16T22:16:28.868 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/i5500_temp.ko 2024-05-16T22:16:28.869 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/i5k_amb.ko 2024-05-16T22:16:28.869 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/ibmaem.ko 2024-05-16T22:16:28.869 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/ibmpex.ko 2024-05-16T22:16:28.869 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/ina209.ko 2024-05-16T22:16:28.869 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/ina2xx.ko 2024-05-16T22:16:28.869 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/it87.ko 2024-05-16T22:16:28.869 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/k10temp.ko 2024-05-16T22:16:28.869 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/k8temp.ko 2024-05-16T22:16:28.869 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/lineage-pem.ko 2024-05-16T22:16:28.869 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/lm63.ko 2024-05-16T22:16:28.869 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/lm73.ko 2024-05-16T22:16:28.869 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/lm75.ko 2024-05-16T22:16:28.869 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/lm77.ko 2024-05-16T22:16:28.869 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/lm78.ko 2024-05-16T22:16:28.870 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/lm80.ko 2024-05-16T22:16:28.870 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/lm83.ko 2024-05-16T22:16:28.870 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/lm85.ko 2024-05-16T22:16:28.870 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/lm87.ko 2024-05-16T22:16:28.870 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/lm90.ko 2024-05-16T22:16:28.870 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/lm92.ko 2024-05-16T22:16:28.870 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/lm93.ko 2024-05-16T22:16:28.870 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/lm95234.ko 2024-05-16T22:16:28.870 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/lm95241.ko 2024-05-16T22:16:28.870 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/lm95245.ko 2024-05-16T22:16:28.870 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/ltc2945.ko 2024-05-16T22:16:28.870 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/ltc4151.ko 2024-05-16T22:16:28.870 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/ltc4215.ko 2024-05-16T22:16:28.870 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/ltc4222.ko 2024-05-16T22:16:28.871 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/ltc4245.ko 2024-05-16T22:16:28.871 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/ltc4260.ko 2024-05-16T22:16:28.871 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/ltc4261.ko 2024-05-16T22:16:28.871 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/max16065.ko 2024-05-16T22:16:28.871 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/max1619.ko 2024-05-16T22:16:28.871 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/max1668.ko 2024-05-16T22:16:28.871 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/max197.ko 2024-05-16T22:16:28.871 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/max6639.ko 2024-05-16T22:16:28.871 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/max6650.ko 2024-05-16T22:16:28.871 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/max6697.ko 2024-05-16T22:16:28.871 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/mcp3021.ko 2024-05-16T22:16:28.871 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/nct6683.ko 2024-05-16T22:16:28.871 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/nct6775-core.ko 2024-05-16T22:16:28.871 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/nct6775.ko 2024-05-16T22:16:28.871 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/nct7802.ko 2024-05-16T22:16:28.872 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/pc87360.ko 2024-05-16T22:16:28.872 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/pc87427.ko 2024-05-16T22:16:28.872 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/pcf8591.ko 2024-05-16T22:16:28.872 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/pmbus 2024-05-16T22:16:28.872 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-16T22:16:28.872 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-16T22:16:28.872 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-16T22:16:28.872 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-16T22:16:28.872 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-16T22:16:28.872 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-16T22:16:28.872 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-16T22:16:28.872 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-16T22:16:28.872 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-16T22:16:28.872 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-16T22:16:28.872 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-16T22:16:28.873 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-16T22:16:28.873 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/powr1220.ko 2024-05-16T22:16:28.873 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/sch5627.ko 2024-05-16T22:16:28.873 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/sch5636.ko 2024-05-16T22:16:28.873 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-16T22:16:28.873 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/sht15.ko 2024-05-16T22:16:28.873 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/sht21.ko 2024-05-16T22:16:28.873 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/shtc1.ko 2024-05-16T22:16:28.873 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/sis5595.ko 2024-05-16T22:16:28.873 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/smsc47b397.ko 2024-05-16T22:16:28.873 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/smsc47m1.ko 2024-05-16T22:16:28.873 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/smsc47m192.ko 2024-05-16T22:16:28.873 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/thmc50.ko 2024-05-16T22:16:28.873 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/tmp102.ko 2024-05-16T22:16:28.873 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/tmp103.ko 2024-05-16T22:16:28.874 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/tmp401.ko 2024-05-16T22:16:28.874 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/tmp421.ko 2024-05-16T22:16:28.874 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/via-cputemp.ko 2024-05-16T22:16:28.874 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/via686a.ko 2024-05-16T22:16:28.874 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/vt1211.ko 2024-05-16T22:16:28.874 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/vt8231.ko 2024-05-16T22:16:28.874 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/w83627ehf.ko 2024-05-16T22:16:28.874 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/w83627hf.ko 2024-05-16T22:16:28.874 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/w83781d.ko 2024-05-16T22:16:28.874 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/w83791d.ko 2024-05-16T22:16:28.874 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/w83792d.ko 2024-05-16T22:16:28.874 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/w83793.ko 2024-05-16T22:16:28.874 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/w83795.ko 2024-05-16T22:16:28.874 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/w83l785ts.ko 2024-05-16T22:16:28.875 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/w83l786ng.ko 2024-05-16T22:16:28.875 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c 2024-05-16T22:16:28.875 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/algos 2024-05-16T22:16:28.875 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-16T22:16:28.875 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-16T22:16:28.875 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses 2024-05-16T22:16:28.875 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-16T22:16:28.875 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-16T22:16:28.875 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-16T22:16:28.875 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-16T22:16:28.875 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-16T22:16:28.875 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-16T22:16:28.875 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-16T22:16:28.875 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-16T22:16:28.875 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-16T22:16:28.876 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-16T22:16:28.876 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-16T22:16:28.876 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-16T22:16:28.876 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-16T22:16:28.876 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-16T22:16:28.876 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-16T22:16:28.876 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-16T22:16:28.876 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-16T22:16:28.876 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-16T22:16:28.876 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-16T22:16:28.876 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-16T22:16:28.876 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-16T22:16:28.876 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-16T22:16:28.876 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-16T22:16:28.876 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/i2c-dev.ko 2024-05-16T22:16:28.877 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/i2c-mux.ko 2024-05-16T22:16:28.877 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-05-16T22:16:28.877 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/i2c-smbus.ko 2024-05-16T22:16:28.877 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/i2c-stub.ko 2024-05-16T22:16:28.877 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband 2024-05-16T22:16:28.877 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/core 2024-05-16T22:16:28.877 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-16T22:16:28.877 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/core/ib_core.ko 2024-05-16T22:16:28.877 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-16T22:16:28.877 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-16T22:16:28.877 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-16T22:16:28.877 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-16T22:16:28.877 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-16T22:16:28.877 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/hw 2024-05-16T22:16:28.877 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/hw/cxgb4 2024-05-16T22:16:28.877 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-16T22:16:28.878 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/hw/mlx4 2024-05-16T22:16:28.878 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-16T22:16:28.878 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/hw/mlx5 2024-05-16T22:16:28.878 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-16T22:16:28.878 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/hw/mthca 2024-05-16T22:16:28.878 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-16T22:16:28.878 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/ulp 2024-05-16T22:16:28.878 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/ulp/ipoib 2024-05-16T22:16:28.878 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-16T22:16:28.878 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/ulp/iser 2024-05-16T22:16:28.878 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-16T22:16:28.878 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/ulp/isert 2024-05-16T22:16:28.878 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-16T22:16:28.878 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/ulp/srp 2024-05-16T22:16:28.878 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-16T22:16:28.879 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/ulp/srpt 2024-05-16T22:16:28.879 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-16T22:16:28.879 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input 2024-05-16T22:16:28.879 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/gameport 2024-05-16T22:16:28.879 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-16T22:16:28.879 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-16T22:16:28.879 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/gameport/gameport.ko 2024-05-16T22:16:28.879 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/joydev.ko 2024-05-16T22:16:28.879 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/keyboard 2024-05-16T22:16:28.879 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-16T22:16:28.879 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/mouse 2024-05-16T22:16:28.879 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/mouse/appletouch.ko 2024-05-16T22:16:28.879 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/mouse/bcm5974.ko 2024-05-16T22:16:28.879 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/mouse/cyapatp.ko 2024-05-16T22:16:28.879 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-16T22:16:28.880 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/mouse/sermouse.ko 2024-05-16T22:16:28.880 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-16T22:16:28.880 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-16T22:16:28.880 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-16T22:16:28.880 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/rmi4 2024-05-16T22:16:28.880 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-16T22:16:28.880 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/serio 2024-05-16T22:16:28.880 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/serio/altera_ps2.ko 2024-05-16T22:16:28.880 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/serio/arc_ps2.ko 2024-05-16T22:16:28.880 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-16T22:16:28.880 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/serio/serio_raw.ko 2024-05-16T22:16:28.880 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/sparse-keymap.ko 2024-05-16T22:16:28.880 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/leds 2024-05-16T22:16:28.880 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/leds/leds-blinkm.ko 2024-05-16T22:16:28.880 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/leds/leds-lm3530.ko 2024-05-16T22:16:28.881 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/leds/leds-lp3944.ko 2024-05-16T22:16:28.881 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/leds/leds-ss4200.ko 2024-05-16T22:16:28.881 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/leds/trigger 2024-05-16T22:16:28.881 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-16T22:16:28.881 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-16T22:16:28.881 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-16T22:16:28.881 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-16T22:16:28.881 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-16T22:16:28.881 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-16T22:16:28.881 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-16T22:16:28.881 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-16T22:16:28.881 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-16T22:16:28.881 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md 2024-05-16T22:16:28.881 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/bcache 2024-05-16T22:16:28.881 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/bcache/bcache.ko 2024-05-16T22:16:28.882 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/dm-bio-prison.ko 2024-05-16T22:16:28.882 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/dm-cache-smq.ko 2024-05-16T22:16:28.882 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/dm-cache.ko 2024-05-16T22:16:28.882 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/dm-crypt.ko 2024-05-16T22:16:28.882 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/dm-delay.ko 2024-05-16T22:16:28.882 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/dm-flakey.ko 2024-05-16T22:16:28.882 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/dm-log-userspace.ko 2024-05-16T22:16:28.882 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/dm-multipath.ko 2024-05-16T22:16:28.882 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/dm-queue-length.ko 2024-05-16T22:16:28.882 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/dm-raid.ko 2024-05-16T22:16:28.882 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/dm-round-robin.ko 2024-05-16T22:16:28.882 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/dm-service-time.ko 2024-05-16T22:16:28.882 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/dm-switch.ko 2024-05-16T22:16:28.882 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/dm-thin-pool.ko 2024-05-16T22:16:28.882 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/dm-verity.ko 2024-05-16T22:16:28.882 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/persistent-data 2024-05-16T22:16:28.883 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-16T22:16:28.883 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/raid0.ko 2024-05-16T22:16:28.883 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/raid1.ko 2024-05-16T22:16:28.883 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/raid10.ko 2024-05-16T22:16:28.883 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/raid456.ko 2024-05-16T22:16:28.883 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/message 2024-05-16T22:16:28.883 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/message/fusion 2024-05-16T22:16:28.883 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/message/fusion/mptbase.ko 2024-05-16T22:16:28.883 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/message/fusion/mptctl.ko 2024-05-16T22:16:28.883 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/message/fusion/mptfc.ko 2024-05-16T22:16:28.883 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/message/fusion/mptlan.ko 2024-05-16T22:16:28.883 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/message/fusion/mptsas.ko 2024-05-16T22:16:28.883 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/message/fusion/mptscsih.ko 2024-05-16T22:16:28.883 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/message/fusion/mptspi.ko 2024-05-16T22:16:28.883 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/mfd 2024-05-16T22:16:28.884 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/mfd/lpc_ich.ko 2024-05-16T22:16:28.884 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/mfd/lpc_sch.ko 2024-05-16T22:16:28.884 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/mfd/mfd-core.ko 2024-05-16T22:16:28.884 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/mfd/sm501.ko 2024-05-16T22:16:28.884 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/mfd/viperboard.ko 2024-05-16T22:16:28.884 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/mfd/vx855.ko 2024-05-16T22:16:28.884 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/mfd/wl1273-core.ko 2024-05-16T22:16:28.884 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc 2024-05-16T22:16:28.884 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/altera-stapl 2024-05-16T22:16:28.884 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-16T22:16:28.884 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/apds9802als.ko 2024-05-16T22:16:28.884 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/apds990x.ko 2024-05-16T22:16:28.884 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/bh1770glc.ko 2024-05-16T22:16:28.884 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/cb710 2024-05-16T22:16:28.884 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/cb710/cb710.ko 2024-05-16T22:16:28.885 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/eeprom 2024-05-16T22:16:28.885 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/eeprom/at24.ko 2024-05-16T22:16:28.885 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-16T22:16:28.885 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/eeprom/max6875.ko 2024-05-16T22:16:28.885 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/enclosure.ko 2024-05-16T22:16:28.885 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/hpilo.ko 2024-05-16T22:16:28.885 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/isl29003.ko 2024-05-16T22:16:28.885 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/isl29020.ko 2024-05-16T22:16:28.885 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/lis3lv02d 2024-05-16T22:16:28.885 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-16T22:16:28.885 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-16T22:16:28.885 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/mei 2024-05-16T22:16:28.885 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/mei/mei-me.ko 2024-05-16T22:16:28.885 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/mei/mei-txe.ko 2024-05-16T22:16:28.885 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/mei/mei.ko 2024-05-16T22:16:28.886 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/sgi-gru 2024-05-16T22:16:28.886 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/sgi-gru/gru.ko 2024-05-16T22:16:28.886 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/sgi-xp 2024-05-16T22:16:28.886 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/sgi-xp/xp.ko 2024-05-16T22:16:28.886 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/sgi-xp/xpc.ko 2024-05-16T22:16:28.886 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-05-16T22:16:28.886 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/tifm_7xx1.ko 2024-05-16T22:16:28.886 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/tifm_core.ko 2024-05-16T22:16:28.886 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/tsl2550.ko 2024-05-16T22:16:28.886 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/vmw_balloon.ko 2024-05-16T22:16:28.886 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/vmw_vmci 2024-05-16T22:16:28.886 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-16T22:16:28.886 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net 2024-05-16T22:16:28.886 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/bonding 2024-05-16T22:16:28.887 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/bonding/bonding.ko 2024-05-16T22:16:28.887 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/dsa 2024-05-16T22:16:28.887 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/dsa/b53 2024-05-16T22:16:28.887 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-16T22:16:28.887 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-16T22:16:28.887 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-16T22:16:28.887 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/dsa/mv88e6xxx 2024-05-16T22:16:28.887 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-16T22:16:28.887 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/dummy.ko 2024-05-16T22:16:28.887 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/eql.ko 2024-05-16T22:16:28.887 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet 2024-05-16T22:16:28.887 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/3com 2024-05-16T22:16:28.887 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-16T22:16:28.887 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-16T22:16:28.887 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-16T22:16:28.888 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-16T22:16:28.888 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/8390 2024-05-16T22:16:28.888 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-16T22:16:28.888 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-16T22:16:28.888 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-16T22:16:28.888 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-16T22:16:28.888 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/adaptec 2024-05-16T22:16:28.888 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-16T22:16:28.888 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/agere 2024-05-16T22:16:28.888 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-16T22:16:28.888 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/alteon 2024-05-16T22:16:28.888 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-16T22:16:28.888 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/altera 2024-05-16T22:16:28.888 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-16T22:16:28.888 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/amd 2024-05-16T22:16:28.889 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-16T22:16:28.889 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-16T22:16:28.889 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-16T22:16:28.889 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/atheros 2024-05-16T22:16:28.889 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/atheros/alx 2024-05-16T22:16:28.889 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-16T22:16:28.889 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/atheros/atl1c 2024-05-16T22:16:28.889 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-16T22:16:28.889 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/atheros/atl1e 2024-05-16T22:16:28.889 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-16T22:16:28.889 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/atheros/atlx 2024-05-16T22:16:28.889 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-16T22:16:28.889 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-16T22:16:28.889 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/broadcom 2024-05-16T22:16:28.889 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-16T22:16:28.890 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-16T22:16:28.890 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-05-16T22:16:28.890 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-16T22:16:28.890 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-16T22:16:28.890 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/broadcom/genet 2024-05-16T22:16:28.890 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-16T22:16:28.890 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-16T22:16:28.890 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/brocade 2024-05-16T22:16:28.890 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/brocade/bna 2024-05-16T22:16:28.890 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-16T22:16:28.890 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/chelsio 2024-05-16T22:16:28.890 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/chelsio/cxgb 2024-05-16T22:16:28.890 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-16T22:16:28.890 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-05-16T22:16:28.890 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-16T22:16:28.891 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-05-16T22:16:28.891 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-16T22:16:28.891 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-05-16T22:16:28.891 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-16T22:16:28.891 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-05-16T22:16:28.891 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-16T22:16:28.891 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/cisco 2024-05-16T22:16:28.891 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/cisco/enic 2024-05-16T22:16:28.891 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-16T22:16:28.891 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/dec 2024-05-16T22:16:28.891 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/dec/tulip 2024-05-16T22:16:28.891 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-16T22:16:28.891 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-16T22:16:28.891 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-16T22:16:28.891 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-16T22:16:28.892 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-16T22:16:28.892 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-16T22:16:28.892 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/dlink 2024-05-16T22:16:28.892 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-16T22:16:28.892 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-16T22:16:28.892 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/dnet.ko 2024-05-16T22:16:28.892 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/emulex 2024-05-16T22:16:28.892 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/emulex/benet 2024-05-16T22:16:28.892 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-16T22:16:28.892 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/ethoc.ko 2024-05-16T22:16:28.892 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/fealnx.ko 2024-05-16T22:16:28.892 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel 2024-05-16T22:16:28.892 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-16T22:16:28.892 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/e1000 2024-05-16T22:16:28.892 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-16T22:16:28.893 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/e1000e 2024-05-16T22:16:28.893 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-16T22:16:28.893 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/fm10k 2024-05-16T22:16:28.893 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-16T22:16:28.893 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/i40e 2024-05-16T22:16:28.893 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-16T22:16:28.893 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/iavf 2024-05-16T22:16:28.893 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-16T22:16:28.893 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/igb 2024-05-16T22:16:28.893 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-16T22:16:28.893 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/igbvf 2024-05-16T22:16:28.893 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-16T22:16:28.893 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/ixgbe 2024-05-16T22:16:28.893 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-16T22:16:28.894 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/ixgbevf 2024-05-16T22:16:28.894 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-16T22:16:28.894 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/jme.ko 2024-05-16T22:16:28.894 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/marvell 2024-05-16T22:16:28.894 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-16T22:16:28.894 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-16T22:16:28.894 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-16T22:16:28.894 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/mellanox 2024-05-16T22:16:28.894 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/mellanox/mlx4 2024-05-16T22:16:28.894 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-16T22:16:28.894 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-16T22:16:28.894 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/mellanox/mlx5 2024-05-16T22:16:28.894 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-05-16T22:16:28.894 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-16T22:16:28.894 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/micrel 2024-05-16T22:16:28.895 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-16T22:16:28.895 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/myricom 2024-05-16T22:16:28.895 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/myricom/myri10ge 2024-05-16T22:16:28.895 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-16T22:16:28.895 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/natsemi 2024-05-16T22:16:28.895 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-16T22:16:28.895 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-16T22:16:28.895 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/neterion 2024-05-16T22:16:28.895 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-16T22:16:28.895 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/nvidia 2024-05-16T22:16:28.895 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-16T22:16:28.895 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/packetengines 2024-05-16T22:16:28.895 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-16T22:16:28.895 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-16T22:16:28.895 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/qlogic 2024-05-16T22:16:28.895 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/qlogic/netxen 2024-05-16T22:16:28.896 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-16T22:16:28.896 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-16T22:16:28.896 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-05-16T22:16:28.896 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-16T22:16:28.896 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/rdc 2024-05-16T22:16:28.896 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-16T22:16:28.896 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/realtek 2024-05-16T22:16:28.896 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-16T22:16:28.896 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-16T22:16:28.896 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-16T22:16:28.896 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-16T22:16:28.896 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/rocker 2024-05-16T22:16:28.896 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-05-16T22:16:28.896 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/sfc 2024-05-16T22:16:28.896 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-16T22:16:28.896 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/silan 2024-05-16T22:16:28.897 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-16T22:16:28.897 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/sis 2024-05-16T22:16:28.897 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-16T22:16:28.897 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-16T22:16:28.897 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/smsc 2024-05-16T22:16:28.897 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-16T22:16:28.897 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-16T22:16:28.897 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-16T22:16:28.897 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-16T22:16:28.897 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/stmicro 2024-05-16T22:16:28.897 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/stmicro/stmmac 2024-05-16T22:16:28.897 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-16T22:16:28.897 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-16T22:16:28.897 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/sun 2024-05-16T22:16:28.898 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-16T22:16:28.898 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-16T22:16:28.898 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-16T22:16:28.898 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-16T22:16:28.898 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/tehuti 2024-05-16T22:16:28.898 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-16T22:16:28.898 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/ti 2024-05-16T22:16:28.898 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-16T22:16:28.898 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/via 2024-05-16T22:16:28.898 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-16T22:16:28.898 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-16T22:16:28.898 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/wiznet 2024-05-16T22:16:28.898 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-16T22:16:28.898 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-16T22:16:28.898 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/xircom 2024-05-16T22:16:28.899 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-16T22:16:28.899 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/geneve.ko 2024-05-16T22:16:28.899 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/hyperv 2024-05-16T22:16:28.899 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-16T22:16:28.899 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ieee802154 2024-05-16T22:16:28.899 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-16T22:16:28.899 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ifb.ko 2024-05-16T22:16:28.899 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ipvlan 2024-05-16T22:16:28.899 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-16T22:16:28.899 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/macvlan.ko 2024-05-16T22:16:28.899 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/macvtap.ko 2024-05-16T22:16:28.899 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/mdio 2024-05-16T22:16:28.899 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/mdio.ko 2024-05-16T22:16:28.899 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-16T22:16:28.899 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-16T22:16:28.900 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-16T22:16:28.900 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/mii.ko 2024-05-16T22:16:28.900 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/net_failover.ko 2024-05-16T22:16:28.900 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/netconsole.ko 2024-05-16T22:16:28.900 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/nlmon.ko 2024-05-16T22:16:28.900 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/pcs 2024-05-16T22:16:28.900 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-16T22:16:28.900 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-16T22:16:28.900 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy 2024-05-16T22:16:28.900 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/amd.ko 2024-05-16T22:16:28.900 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-16T22:16:28.900 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-05-16T22:16:28.900 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-16T22:16:28.900 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/bcm87xx.ko 2024-05-16T22:16:28.900 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/broadcom.ko 2024-05-16T22:16:28.901 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/cicada.ko 2024-05-16T22:16:28.901 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/davicom.ko 2024-05-16T22:16:28.901 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/dp83640.ko 2024-05-16T22:16:28.901 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/et1011c.ko 2024-05-16T22:16:28.901 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/icplus.ko 2024-05-16T22:16:28.901 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/lxt.ko 2024-05-16T22:16:28.901 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/marvell.ko 2024-05-16T22:16:28.901 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/micrel.ko 2024-05-16T22:16:28.901 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/national.ko 2024-05-16T22:16:28.901 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/phylink.ko 2024-05-16T22:16:28.901 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/qsemi.ko 2024-05-16T22:16:28.901 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/realtek.ko 2024-05-16T22:16:28.901 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/smsc.ko 2024-05-16T22:16:28.901 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/ste10Xp.ko 2024-05-16T22:16:28.901 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/vitesse.ko 2024-05-16T22:16:28.902 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ppp 2024-05-16T22:16:28.902 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-16T22:16:28.902 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ppp/ppp_async.ko 2024-05-16T22:16:28.902 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-16T22:16:28.902 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ppp/ppp_generic.ko 2024-05-16T22:16:28.902 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-16T22:16:28.902 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-16T22:16:28.902 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ppp/pppoe.ko 2024-05-16T22:16:28.902 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ppp/pppox.ko 2024-05-16T22:16:28.902 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ppp/pptp.ko 2024-05-16T22:16:28.902 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/slip 2024-05-16T22:16:28.902 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/slip/slhc.ko 2024-05-16T22:16:28.902 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/slip/slip.ko 2024-05-16T22:16:28.903 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/sungem_phy.ko 2024-05-16T22:16:28.903 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/tap.ko 2024-05-16T22:16:28.903 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/team 2024-05-16T22:16:28.903 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/team/team.ko 2024-05-16T22:16:28.903 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-16T22:16:28.903 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-16T22:16:28.903 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-16T22:16:28.903 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/team/team_mode_random.ko 2024-05-16T22:16:28.903 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-16T22:16:28.903 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/tun.ko 2024-05-16T22:16:28.903 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/veth.ko 2024-05-16T22:16:28.903 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/virtio_net.ko 2024-05-16T22:16:28.903 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/vmxnet3 2024-05-16T22:16:28.903 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-16T22:16:28.904 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/vxlan 2024-05-16T22:16:28.904 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/vxlan/vxlan.ko 2024-05-16T22:16:28.904 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/xen-netback 2024-05-16T22:16:28.904 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-16T22:16:28.904 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/xen-netfront.ko 2024-05-16T22:16:28.904 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ntb 2024-05-16T22:16:28.904 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ntb/ntb.ko 2024-05-16T22:16:28.904 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/nvme 2024-05-16T22:16:28.904 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/nvme/host 2024-05-16T22:16:28.904 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/nvme/host/nvme-core.ko 2024-05-16T22:16:28.904 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/nvme/host/nvme.ko 2024-05-16T22:16:28.904 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/parport 2024-05-16T22:16:28.904 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/parport/parport.ko 2024-05-16T22:16:28.904 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/parport/parport_cs.ko 2024-05-16T22:16:28.904 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/parport/parport_pc.ko 2024-05-16T22:16:28.904 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/parport/parport_serial.ko 2024-05-16T22:16:28.905 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pci 2024-05-16T22:16:28.905 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pci/hotplug 2024-05-16T22:16:28.905 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-16T22:16:28.905 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pci/pcie 2024-05-16T22:16:28.905 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pci/pcie/aer_inject.ko 2024-05-16T22:16:28.905 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pci/xen-pcifront.ko 2024-05-16T22:16:28.905 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pcmcia 2024-05-16T22:16:28.905 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pcmcia/i82092.ko 2024-05-16T22:16:28.905 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pcmcia/pd6729.ko 2024-05-16T22:16:28.905 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-16T22:16:28.905 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pinctrl 2024-05-16T22:16:28.905 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pinctrl/intel 2024-05-16T22:16:28.905 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-16T22:16:28.905 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform 2024-05-16T22:16:28.905 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86 2024-05-16T22:16:28.906 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-16T22:16:28.906 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/acerhdf.ko 2024-05-16T22:16:28.906 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-16T22:16:28.906 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-16T22:16:28.906 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-16T22:16:28.906 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-16T22:16:28.906 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-16T22:16:28.906 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-16T22:16:28.906 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-16T22:16:28.906 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-16T22:16:28.906 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-16T22:16:28.906 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/hdaps.ko 2024-05-16T22:16:28.906 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/intel 2024-05-16T22:16:28.906 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-16T22:16:28.906 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/intel_ips.ko 2024-05-16T22:16:28.907 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-16T22:16:28.907 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-16T22:16:28.907 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-16T22:16:28.907 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-16T22:16:28.907 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-16T22:16:28.907 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-16T22:16:28.907 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-16T22:16:28.907 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-16T22:16:28.907 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-16T22:16:28.907 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/wmi.ko 2024-05-16T22:16:28.907 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/powercap 2024-05-16T22:16:28.907 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-16T22:16:28.907 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-16T22:16:28.907 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pps 2024-05-16T22:16:28.907 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pps/clients 2024-05-16T22:16:28.907 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-16T22:16:28.908 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-16T22:16:28.908 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pps/clients/pps_parport.ko 2024-05-16T22:16:28.908 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pps/pps_core.ko 2024-05-16T22:16:28.908 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ptp 2024-05-16T22:16:28.908 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ptp/ptp.ko 2024-05-16T22:16:28.908 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ptp/ptp_kvm.ko 2024-05-16T22:16:28.908 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ras 2024-05-16T22:16:28.908 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ras/amd 2024-05-16T22:16:28.908 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ras/amd/atl 2024-05-16T22:16:28.908 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-16T22:16:28.908 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ras/amd/fmpm.ko 2024-05-16T22:16:28.908 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc 2024-05-16T22:16:28.908 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-16T22:16:28.908 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-16T22:16:28.909 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-16T22:16:28.909 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-16T22:16:28.909 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-16T22:16:28.909 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-16T22:16:28.909 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-16T22:16:28.909 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-16T22:16:28.909 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-16T22:16:28.909 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-16T22:16:28.909 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-em3027.ko 2024-05-16T22:16:28.909 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-16T22:16:28.909 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-16T22:16:28.909 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-16T22:16:28.909 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-16T22:16:28.909 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-16T22:16:28.909 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-16T22:16:28.909 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-max6900.ko 2024-05-16T22:16:28.910 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-16T22:16:28.910 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-16T22:16:28.910 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-16T22:16:28.910 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-16T22:16:28.910 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-16T22:16:28.910 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-16T22:16:28.910 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-16T22:16:28.910 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-16T22:16:28.910 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-16T22:16:28.910 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-16T22:16:28.910 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-16T22:16:28.910 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-16T22:16:28.910 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-x1205.ko 2024-05-16T22:16:28.911 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi 2024-05-16T22:16:28.911 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/3w-9xxx.ko 2024-05-16T22:16:28.911 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/3w-sas.ko 2024-05-16T22:16:28.911 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/3w-xxxx.ko 2024-05-16T22:16:28.911 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/BusLogic.ko 2024-05-16T22:16:28.911 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/a100u2w.ko 2024-05-16T22:16:28.911 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/aacraid 2024-05-16T22:16:28.911 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-16T22:16:28.911 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/advansys.ko 2024-05-16T22:16:28.911 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/aic7xxx 2024-05-16T22:16:28.911 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-16T22:16:28.911 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-16T22:16:28.911 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/am53c974.ko 2024-05-16T22:16:28.911 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/arcmsr 2024-05-16T22:16:28.911 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-16T22:16:28.912 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/atp870u.ko 2024-05-16T22:16:28.912 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/be2iscsi 2024-05-16T22:16:28.912 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-16T22:16:28.912 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/bfa 2024-05-16T22:16:28.912 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/bfa/bfa.ko 2024-05-16T22:16:28.912 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/bnx2fc 2024-05-16T22:16:28.912 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-16T22:16:28.912 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/bnx2i 2024-05-16T22:16:28.912 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-16T22:16:28.912 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/ch.ko 2024-05-16T22:16:28.912 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/csiostor 2024-05-16T22:16:28.912 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-16T22:16:28.912 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/cxgbi 2024-05-16T22:16:28.912 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/cxgbi/cxgb3i 2024-05-16T22:16:28.912 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-16T22:16:28.913 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/cxgbi/cxgb4i 2024-05-16T22:16:28.913 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-16T22:16:28.913 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-16T22:16:28.913 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/dc395x.ko 2024-05-16T22:16:28.913 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/device_handler 2024-05-16T22:16:28.913 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-05-16T22:16:28.913 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-05-16T22:16:28.913 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-05-16T22:16:28.913 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-05-16T22:16:28.913 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/dmx3191d.ko 2024-05-16T22:16:28.913 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/esas2r 2024-05-16T22:16:28.913 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-16T22:16:28.913 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/esp_scsi.ko 2024-05-16T22:16:28.913 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/fcoe 2024-05-16T22:16:28.913 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-16T22:16:28.914 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-16T22:16:28.914 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/fnic 2024-05-16T22:16:28.914 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/fnic/fnic.ko 2024-05-16T22:16:28.914 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/hpsa.ko 2024-05-16T22:16:28.914 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/hptiop.ko 2024-05-16T22:16:28.914 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/hv_storvsc.ko 2024-05-16T22:16:28.914 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/initio.ko 2024-05-16T22:16:28.914 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/ipr.ko 2024-05-16T22:16:28.914 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/ips.ko 2024-05-16T22:16:28.914 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/isci 2024-05-16T22:16:28.914 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/isci/isci.ko 2024-05-16T22:16:28.914 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-16T22:16:28.914 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-16T22:16:28.914 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/libfc 2024-05-16T22:16:28.914 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/libfc/libfc.ko 2024-05-16T22:16:28.914 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/libiscsi.ko 2024-05-16T22:16:28.915 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-16T22:16:28.915 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/libsas 2024-05-16T22:16:28.915 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/libsas/libsas.ko 2024-05-16T22:16:28.915 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/lpfc 2024-05-16T22:16:28.915 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-16T22:16:28.915 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/megaraid 2024-05-16T22:16:28.915 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/megaraid.ko 2024-05-16T22:16:28.915 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-16T22:16:28.915 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-16T22:16:28.915 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-16T22:16:28.915 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/mpt3sas 2024-05-16T22:16:28.915 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-16T22:16:28.915 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/mvsas 2024-05-16T22:16:28.915 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-16T22:16:28.915 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/mvumi.ko 2024-05-16T22:16:28.916 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/pm8001 2024-05-16T22:16:28.916 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-16T22:16:28.916 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/pmcraid.ko 2024-05-16T22:16:28.916 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/qla1280.ko 2024-05-16T22:16:28.916 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/qla2xxx 2024-05-16T22:16:28.916 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-16T22:16:28.916 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-16T22:16:28.916 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/qla4xxx 2024-05-16T22:16:28.916 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-16T22:16:28.916 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/raid_class.ko 2024-05-16T22:16:28.916 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/scsi_debug.ko 2024-05-16T22:16:28.916 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-16T22:16:28.916 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-16T22:16:28.916 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-16T22:16:28.916 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-16T22:16:28.917 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-16T22:16:28.917 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/ses.ko 2024-05-16T22:16:28.917 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/st.ko 2024-05-16T22:16:28.917 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/stex.ko 2024-05-16T22:16:28.917 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/sym53c8xx_2 2024-05-16T22:16:28.917 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-16T22:16:28.917 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/virtio_scsi.ko 2024-05-16T22:16:28.917 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-16T22:16:28.917 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/wd719x.ko 2024-05-16T22:16:28.917 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ssb 2024-05-16T22:16:28.917 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ssb/ssb.ko 2024-05-16T22:16:28.917 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/target 2024-05-16T22:16:28.917 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/target/iscsi 2024-05-16T22:16:28.917 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-16T22:16:28.917 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/target/loopback 2024-05-16T22:16:28.917 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-16T22:16:28.918 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/target/target_core_file.ko 2024-05-16T22:16:28.918 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/target/target_core_iblock.ko 2024-05-16T22:16:28.918 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/target/target_core_mod.ko 2024-05-16T22:16:28.918 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/target/target_core_pscsi.ko 2024-05-16T22:16:28.918 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/target/target_core_user.ko 2024-05-16T22:16:28.918 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/target/tcm_fc 2024-05-16T22:16:28.918 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-16T22:16:28.918 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal 2024-05-16T22:16:28.918 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel 2024-05-16T22:16:28.918 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/int340x_thermal 2024-05-16T22:16:28.918 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-16T22:16:28.918 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-16T22:16:28.918 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-16T22:16:28.918 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-16T22:16:28.918 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-16T22:16:28.919 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-16T22:16:28.919 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-16T22:16:28.919 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-16T22:16:28.919 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-16T22:16:28.919 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-16T22:16:28.919 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-16T22:16:28.919 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-16T22:16:28.919 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-16T22:16:28.919 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-16T22:16:28.919 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-16T22:16:28.919 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-16T22:16:28.919 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-16T22:16:28.919 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-16T22:16:28.919 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/tty 2024-05-16T22:16:28.919 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/tty/ipwireless 2024-05-16T22:16:28.920 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-16T22:16:28.920 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/tty/n_gsm.ko 2024-05-16T22:16:28.920 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/tty/n_hdlc.ko 2024-05-16T22:16:28.920 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/tty/nozomi.ko 2024-05-16T22:16:28.920 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/tty/serial 2024-05-16T22:16:28.920 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/tty/serial/8250 2024-05-16T22:16:28.920 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-16T22:16:28.920 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/tty/serial/arc_uart.ko 2024-05-16T22:16:28.920 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/tty/serial/jsm 2024-05-16T22:16:28.920 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-16T22:16:28.920 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ufs 2024-05-16T22:16:28.920 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ufs/core 2024-05-16T22:16:28.920 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-16T22:16:28.920 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ufs/host 2024-05-16T22:16:28.921 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-16T22:16:28.921 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/uio 2024-05-16T22:16:28.921 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/uio/uio.ko 2024-05-16T22:16:28.921 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/uio/uio_aec.ko 2024-05-16T22:16:28.921 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/uio/uio_cif.ko 2024-05-16T22:16:28.921 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/uio/uio_pci_generic.ko 2024-05-16T22:16:28.921 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/uio/uio_sercos3.ko 2024-05-16T22:16:28.921 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb 2024-05-16T22:16:28.921 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/class 2024-05-16T22:16:28.921 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/class/cdc-acm.ko 2024-05-16T22:16:28.921 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-16T22:16:28.921 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/class/usblp.ko 2024-05-16T22:16:28.921 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/class/usbtmc.ko 2024-05-16T22:16:28.921 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/host 2024-05-16T22:16:28.922 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-16T22:16:28.922 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/image 2024-05-16T22:16:28.922 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/image/mdc800.ko 2024-05-16T22:16:28.922 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/image/microtek.ko 2024-05-16T22:16:28.922 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc 2024-05-16T22:16:28.922 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/adutux.ko 2024-05-16T22:16:28.922 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/appledisplay.ko 2024-05-16T22:16:28.922 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/emi26.ko 2024-05-16T22:16:28.922 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/emi62.ko 2024-05-16T22:16:28.922 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/ezusb.ko 2024-05-16T22:16:28.922 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/idmouse.ko 2024-05-16T22:16:28.922 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/iowarrior.ko 2024-05-16T22:16:28.923 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-16T22:16:28.923 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/ldusb.ko 2024-05-16T22:16:28.923 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/legousbtower.ko 2024-05-16T22:16:28.923 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/sisusbvga 2024-05-16T22:16:28.923 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-16T22:16:28.923 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-16T22:16:28.923 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/usb3503.ko 2024-05-16T22:16:28.923 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/usblcd.ko 2024-05-16T22:16:28.923 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-16T22:16:28.923 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/uss720.ko 2024-05-16T22:16:28.923 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/yurex.ko 2024-05-16T22:16:28.923 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/phy 2024-05-16T22:16:28.923 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/phy/phy-generic.ko 2024-05-16T22:16:28.923 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial 2024-05-16T22:16:28.924 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/aircable.ko 2024-05-16T22:16:28.924 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/ark3116.ko 2024-05-16T22:16:28.924 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-16T22:16:28.924 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/ch341.ko 2024-05-16T22:16:28.924 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/cp210x.ko 2024-05-16T22:16:28.924 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/cyberjack.ko 2024-05-16T22:16:28.924 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-16T22:16:28.924 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-16T22:16:28.924 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/empeg.ko 2024-05-16T22:16:28.924 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-16T22:16:28.924 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-16T22:16:28.924 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-16T22:16:28.924 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/io_ti.ko 2024-05-16T22:16:28.924 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/ipaq.ko 2024-05-16T22:16:28.925 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/ipw.ko 2024-05-16T22:16:28.925 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/ir-usb.ko 2024-05-16T22:16:28.925 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-16T22:16:28.925 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/keyspan.ko 2024-05-16T22:16:28.925 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-16T22:16:28.925 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-16T22:16:28.925 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-16T22:16:28.925 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/mct_u232.ko 2024-05-16T22:16:28.925 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/mos7720.ko 2024-05-16T22:16:28.925 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/mos7840.ko 2024-05-16T22:16:28.925 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/navman.ko 2024-05-16T22:16:28.925 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/omninet.ko 2024-05-16T22:16:28.925 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/opticon.ko 2024-05-16T22:16:28.925 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/option.ko 2024-05-16T22:16:28.925 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/oti6858.ko 2024-05-16T22:16:28.926 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/pl2303.ko 2024-05-16T22:16:28.926 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/qcaux.ko 2024-05-16T22:16:28.926 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/qcserial.ko 2024-05-16T22:16:28.926 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/quatech2.ko 2024-05-16T22:16:28.926 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/safe_serial.ko 2024-05-16T22:16:28.926 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/sierra.ko 2024-05-16T22:16:28.926 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-16T22:16:28.926 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/ssu100.ko 2024-05-16T22:16:28.926 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/symbolserial.ko 2024-05-16T22:16:28.926 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-16T22:16:28.926 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-16T22:16:28.926 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/usb_debug.ko 2024-05-16T22:16:28.926 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-16T22:16:28.927 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/visor.ko 2024-05-16T22:16:28.927 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/whiteheat.ko 2024-05-16T22:16:28.927 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-16T22:16:28.927 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/storage 2024-05-16T22:16:28.927 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/storage/uas.ko 2024-05-16T22:16:28.927 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-16T22:16:28.927 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-16T22:16:28.927 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-16T22:16:28.927 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-16T22:16:28.927 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-16T22:16:28.927 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-16T22:16:28.927 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-16T22:16:28.927 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/storage/ums-karma.ko 2024-05-16T22:16:28.927 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-16T22:16:28.927 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-16T22:16:28.928 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-16T22:16:28.928 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-16T22:16:28.928 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-16T22:16:28.928 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/storage/usb-storage.ko 2024-05-16T22:16:28.928 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/usbip 2024-05-16T22:16:28.928 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-16T22:16:28.928 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-16T22:16:28.928 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-16T22:16:28.928 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/vfio 2024-05-16T22:16:28.928 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/vfio/pci 2024-05-16T22:16:28.928 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-16T22:16:28.928 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-16T22:16:28.928 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/vfio/vfio.ko 2024-05-16T22:16:28.928 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-16T22:16:28.928 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/vhost 2024-05-16T22:16:28.929 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/vhost/vhost.ko 2024-05-16T22:16:28.929 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-16T22:16:28.929 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/vhost/vhost_net.ko 2024-05-16T22:16:28.929 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/vhost/vhost_scsi.ko 2024-05-16T22:16:28.929 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/video 2024-05-16T22:16:28.929 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/video/backlight 2024-05-16T22:16:28.929 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/video/backlight/apple_bl.ko 2024-05-16T22:16:28.929 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/video/backlight/lcd.ko 2024-05-16T22:16:28.929 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-16T22:16:28.929 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/virtio 2024-05-16T22:16:28.929 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/virtio/virtio.ko 2024-05-16T22:16:28.929 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/virtio/virtio_balloon.ko 2024-05-16T22:16:28.929 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/virtio/virtio_mmio.ko 2024-05-16T22:16:28.929 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/virtio/virtio_pci.ko 2024-05-16T22:16:28.930 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-05-16T22:16:28.930 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-05-16T22:16:28.930 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/virtio/virtio_ring.ko 2024-05-16T22:16:28.930 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1 2024-05-16T22:16:28.930 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1/masters 2024-05-16T22:16:28.930 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1/masters/ds2482.ko 2024-05-16T22:16:28.930 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1/masters/ds2490.ko 2024-05-16T22:16:28.930 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1/slaves 2024-05-16T22:16:28.930 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-16T22:16:28.930 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-16T22:16:28.930 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-16T22:16:28.930 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-16T22:16:28.930 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-16T22:16:28.930 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-16T22:16:28.931 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-16T22:16:28.931 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-16T22:16:28.931 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-16T22:16:28.931 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-16T22:16:28.931 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-16T22:16:28.931 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1/wire.ko 2024-05-16T22:16:28.931 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog 2024-05-16T22:16:28.931 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-16T22:16:28.931 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-16T22:16:28.931 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-16T22:16:28.931 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/hpwdt.ko 2024-05-16T22:16:28.931 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/i6300esb.ko 2024-05-16T22:16:28.931 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-16T22:16:28.931 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-16T22:16:28.931 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/ib700wdt.ko 2024-05-16T22:16:28.932 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/ibmasr.ko 2024-05-16T22:16:28.932 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-16T22:16:28.932 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-16T22:16:28.932 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/it87_wdt.ko 2024-05-16T22:16:28.932 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/machzwd.ko 2024-05-16T22:16:28.932 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/nv_tco.ko 2024-05-16T22:16:28.932 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-16T22:16:28.932 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-16T22:16:28.932 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-16T22:16:28.932 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-16T22:16:28.932 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/softdog.ko 2024-05-16T22:16:28.932 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-16T22:16:28.932 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/via_wdt.ko 2024-05-16T22:16:28.932 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-16T22:16:28.932 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-16T22:16:28.933 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-16T22:16:28.933 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/wdt_pci.ko 2024-05-16T22:16:28.933 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/xen_wdt.ko 2024-05-16T22:16:28.933 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/xen 2024-05-16T22:16:28.933 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/xen/xen-acpi-processor.ko 2024-05-16T22:16:28.933 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/xen/xen-evtchn.ko 2024-05-16T22:16:28.933 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/xen/xen-gntalloc.ko 2024-05-16T22:16:28.933 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/xen/xen-gntdev.ko 2024-05-16T22:16:28.933 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/xen/xen-pciback 2024-05-16T22:16:28.933 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-16T22:16:28.933 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/xen/xen-privcmd.ko 2024-05-16T22:16:28.933 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/xen/xenfs 2024-05-16T22:16:28.933 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-16T22:16:28.933 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs 2024-05-16T22:16:28.934 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/9p 2024-05-16T22:16:28.934 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/9p/9p.ko 2024-05-16T22:16:28.934 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/affs 2024-05-16T22:16:28.934 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/affs/affs.ko 2024-05-16T22:16:28.934 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/befs 2024-05-16T22:16:28.934 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/befs/befs.ko 2024-05-16T22:16:28.934 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/binfmt_misc.ko 2024-05-16T22:16:28.934 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/btrfs 2024-05-16T22:16:28.934 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/btrfs/btrfs.ko 2024-05-16T22:16:28.934 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/cachefiles 2024-05-16T22:16:28.934 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/cachefiles/cachefiles.ko 2024-05-16T22:16:28.934 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ceph 2024-05-16T22:16:28.934 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ceph/ceph.ko 2024-05-16T22:16:28.934 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/coda 2024-05-16T22:16:28.934 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/coda/coda.ko 2024-05-16T22:16:28.935 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/cramfs 2024-05-16T22:16:28.935 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/cramfs/cramfs.ko 2024-05-16T22:16:28.935 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/dlm 2024-05-16T22:16:28.935 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/dlm/dlm.ko 2024-05-16T22:16:28.935 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ecryptfs 2024-05-16T22:16:28.935 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ecryptfs/ecryptfs.ko 2024-05-16T22:16:28.935 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/f2fs 2024-05-16T22:16:28.935 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/f2fs/f2fs.ko 2024-05-16T22:16:28.935 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/fat 2024-05-16T22:16:28.935 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/fat/fat.ko 2024-05-16T22:16:28.935 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/fat/msdos.ko 2024-05-16T22:16:28.935 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/fat/vfat.ko 2024-05-16T22:16:28.935 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/fuse 2024-05-16T22:16:28.935 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/fuse/cuse.ko 2024-05-16T22:16:28.935 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/fuse/fuse.ko 2024-05-16T22:16:28.936 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/gfs2 2024-05-16T22:16:28.936 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/gfs2/gfs2.ko 2024-05-16T22:16:28.936 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/hfs 2024-05-16T22:16:28.936 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/hfs/hfs.ko 2024-05-16T22:16:28.936 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/hfsplus 2024-05-16T22:16:28.936 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/hfsplus/hfsplus.ko 2024-05-16T22:16:28.936 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/isofs 2024-05-16T22:16:28.936 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/isofs/isofs.ko 2024-05-16T22:16:28.936 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/jfs 2024-05-16T22:16:28.936 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/jfs/jfs.ko 2024-05-16T22:16:28.936 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/lockd 2024-05-16T22:16:28.936 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/lockd/lockd.ko 2024-05-16T22:16:28.936 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/minix 2024-05-16T22:16:28.936 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/minix/minix.ko 2024-05-16T22:16:28.936 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/netfs 2024-05-16T22:16:28.937 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/netfs/netfs.ko 2024-05-16T22:16:28.937 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nfs 2024-05-16T22:16:28.937 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nfs/blocklayout 2024-05-16T22:16:28.937 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-16T22:16:28.937 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nfs/filelayout 2024-05-16T22:16:28.937 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-16T22:16:28.937 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nfs/flexfilelayout 2024-05-16T22:16:28.937 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-16T22:16:28.937 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nfs/nfs.ko 2024-05-16T22:16:28.937 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nfs/nfsv3.ko 2024-05-16T22:16:28.937 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nfs/nfsv4.ko 2024-05-16T22:16:28.937 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nfs_common 2024-05-16T22:16:28.937 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nfs_common/grace.ko 2024-05-16T22:16:28.937 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nfs_common/nfs_acl.ko 2024-05-16T22:16:28.937 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nfsd 2024-05-16T22:16:28.937 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nfsd/nfsd.ko 2024-05-16T22:16:28.938 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nilfs2 2024-05-16T22:16:28.938 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nilfs2/nilfs2.ko 2024-05-16T22:16:28.938 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls 2024-05-16T22:16:28.938 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/mac-celtic.ko 2024-05-16T22:16:28.938 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/mac-centeuro.ko 2024-05-16T22:16:28.938 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/mac-croatian.ko 2024-05-16T22:16:28.938 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/mac-cyrillic.ko 2024-05-16T22:16:28.938 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/mac-gaelic.ko 2024-05-16T22:16:28.938 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/mac-greek.ko 2024-05-16T22:16:28.938 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/mac-iceland.ko 2024-05-16T22:16:28.938 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/mac-inuit.ko 2024-05-16T22:16:28.938 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/mac-roman.ko 2024-05-16T22:16:28.938 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/mac-romanian.ko 2024-05-16T22:16:28.938 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/mac-turkish.ko 2024-05-16T22:16:28.938 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp1250.ko 2024-05-16T22:16:28.939 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp1251.ko 2024-05-16T22:16:28.939 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp1255.ko 2024-05-16T22:16:28.939 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp737.ko 2024-05-16T22:16:28.939 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp775.ko 2024-05-16T22:16:28.939 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp850.ko 2024-05-16T22:16:28.939 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp852.ko 2024-05-16T22:16:28.939 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp855.ko 2024-05-16T22:16:28.939 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp857.ko 2024-05-16T22:16:28.939 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp860.ko 2024-05-16T22:16:28.939 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp861.ko 2024-05-16T22:16:28.939 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp862.ko 2024-05-16T22:16:28.939 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp863.ko 2024-05-16T22:16:28.939 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp864.ko 2024-05-16T22:16:28.939 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp865.ko 2024-05-16T22:16:28.939 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp866.ko 2024-05-16T22:16:28.940 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp869.ko 2024-05-16T22:16:28.940 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp874.ko 2024-05-16T22:16:28.940 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp932.ko 2024-05-16T22:16:28.940 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp936.ko 2024-05-16T22:16:28.940 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp949.ko 2024-05-16T22:16:28.940 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp950.ko 2024-05-16T22:16:28.940 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_euc-jp.ko 2024-05-16T22:16:28.940 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_iso8859-1.ko 2024-05-16T22:16:28.940 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_iso8859-13.ko 2024-05-16T22:16:28.940 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_iso8859-14.ko 2024-05-16T22:16:28.940 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_iso8859-15.ko 2024-05-16T22:16:28.940 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_iso8859-2.ko 2024-05-16T22:16:28.940 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_iso8859-3.ko 2024-05-16T22:16:28.940 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_iso8859-4.ko 2024-05-16T22:16:28.941 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_iso8859-5.ko 2024-05-16T22:16:28.941 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_iso8859-6.ko 2024-05-16T22:16:28.941 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_iso8859-7.ko 2024-05-16T22:16:28.941 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_iso8859-9.ko 2024-05-16T22:16:28.941 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_koi8-r.ko 2024-05-16T22:16:28.941 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_koi8-ru.ko 2024-05-16T22:16:28.941 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_koi8-u.ko 2024-05-16T22:16:28.941 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-16T22:16:28.941 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_utf8.ko 2024-05-16T22:16:28.941 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ocfs2 2024-05-16T22:16:28.941 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ocfs2/cluster 2024-05-16T22:16:28.941 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-16T22:16:28.941 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ocfs2/dlm 2024-05-16T22:16:28.941 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-16T22:16:28.941 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ocfs2/dlmfs 2024-05-16T22:16:28.941 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-16T22:16:28.942 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ocfs2/ocfs2.ko 2024-05-16T22:16:28.942 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-16T22:16:28.942 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-16T22:16:28.942 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-16T22:16:28.942 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/overlayfs 2024-05-16T22:16:28.942 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/overlayfs/overlay.ko 2024-05-16T22:16:28.942 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/pstore 2024-05-16T22:16:28.942 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/pstore/ramoops.ko 2024-05-16T22:16:28.942 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/reiserfs 2024-05-16T22:16:28.942 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/reiserfs/reiserfs.ko 2024-05-16T22:16:28.942 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/romfs 2024-05-16T22:16:28.942 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/romfs/romfs.ko 2024-05-16T22:16:28.942 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/smb 2024-05-16T22:16:28.942 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/smb/client 2024-05-16T22:16:28.943 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/smb/client/cifs.ko 2024-05-16T22:16:28.943 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/smb/common 2024-05-16T22:16:28.943 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/smb/common/cifs_arc4.ko 2024-05-16T22:16:28.943 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/smb/common/cifs_md4.ko 2024-05-16T22:16:28.943 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/squashfs 2024-05-16T22:16:28.943 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/squashfs/squashfs.ko 2024-05-16T22:16:28.943 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/sysv 2024-05-16T22:16:28.943 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/sysv/sysv.ko 2024-05-16T22:16:28.943 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/udf 2024-05-16T22:16:28.943 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/udf/udf.ko 2024-05-16T22:16:28.943 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ufs 2024-05-16T22:16:28.943 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ufs/ufs.ko 2024-05-16T22:16:28.943 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/xfs 2024-05-16T22:16:28.943 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/xfs/xfs.ko 2024-05-16T22:16:28.943 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/kernel 2024-05-16T22:16:28.943 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/kernel/rcu 2024-05-16T22:16:28.944 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/kernel/rcu/rcutorture.ko 2024-05-16T22:16:28.944 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/kernel/torture.ko 2024-05-16T22:16:28.944 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/kernel/trace 2024-05-16T22:16:28.944 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-05-16T22:16:28.944 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib 2024-05-16T22:16:28.944 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/asn1_encoder.ko 2024-05-16T22:16:28.944 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/crc-itu-t.ko 2024-05-16T22:16:28.944 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/crc8.ko 2024-05-16T22:16:28.944 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/crypto 2024-05-16T22:16:28.944 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/crypto/libarc4.ko 2024-05-16T22:16:28.944 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/crypto/libdes.ko 2024-05-16T22:16:28.944 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/libcrc32c.ko 2024-05-16T22:16:28.944 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/lru_cache.ko 2024-05-16T22:16:28.944 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/lz4 2024-05-16T22:16:28.944 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/lz4/lz4_compress.ko 2024-05-16T22:16:28.945 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/lz4/lz4hc_compress.ko 2024-05-16T22:16:28.945 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/math 2024-05-16T22:16:28.945 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/math/cordic.ko 2024-05-16T22:16:28.945 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/raid6 2024-05-16T22:16:28.945 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/raid6/raid6_pq.ko 2024-05-16T22:16:28.945 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/reed_solomon 2024-05-16T22:16:28.945 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-16T22:16:28.945 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/ts_bm.ko 2024-05-16T22:16:28.945 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/ts_fsm.ko 2024-05-16T22:16:28.945 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/ts_kmp.ko 2024-05-16T22:16:28.945 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/zstd 2024-05-16T22:16:28.945 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/zstd/zstd_compress.ko 2024-05-16T22:16:28.945 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/mm 2024-05-16T22:16:28.945 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/mm/hwpoison-inject.ko 2024-05-16T22:16:28.945 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net 2024-05-16T22:16:28.945 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/6lowpan 2024-05-16T22:16:28.946 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/6lowpan/6lowpan.ko 2024-05-16T22:16:28.946 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/6lowpan/nhc_dest.ko 2024-05-16T22:16:28.946 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/6lowpan/nhc_fragment.ko 2024-05-16T22:16:28.946 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/6lowpan/nhc_hop.ko 2024-05-16T22:16:28.946 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-16T22:16:28.946 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/6lowpan/nhc_mobility.ko 2024-05-16T22:16:28.946 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/6lowpan/nhc_routing.ko 2024-05-16T22:16:28.946 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/6lowpan/nhc_udp.ko 2024-05-16T22:16:28.946 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/802 2024-05-16T22:16:28.946 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/802/garp.ko 2024-05-16T22:16:28.946 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/802/mrp.ko 2024-05-16T22:16:28.946 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/802/p8022.ko 2024-05-16T22:16:28.946 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/802/psnap.ko 2024-05-16T22:16:28.946 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/802/stp.ko 2024-05-16T22:16:28.946 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/8021q 2024-05-16T22:16:28.947 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/8021q/8021q.ko 2024-05-16T22:16:28.947 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/9p 2024-05-16T22:16:28.947 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/9p/9pnet.ko 2024-05-16T22:16:28.947 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/9p/9pnet_fd.ko 2024-05-16T22:16:28.947 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/9p/9pnet_rdma.ko 2024-05-16T22:16:28.947 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/9p/9pnet_virtio.ko 2024-05-16T22:16:28.947 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/batman-adv 2024-05-16T22:16:28.947 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/batman-adv/batman-adv.ko 2024-05-16T22:16:28.947 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge 2024-05-16T22:16:28.947 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/br_netfilter.ko 2024-05-16T22:16:28.947 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/bridge.ko 2024-05-16T22:16:28.947 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter 2024-05-16T22:16:28.947 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-16T22:16:28.947 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-16T22:16:28.947 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-16T22:16:28.947 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-16T22:16:28.948 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-16T22:16:28.948 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-16T22:16:28.948 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-16T22:16:28.948 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-16T22:16:28.948 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-16T22:16:28.948 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-16T22:16:28.948 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-16T22:16:28.948 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-16T22:16:28.948 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-16T22:16:28.948 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-16T22:16:28.948 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-16T22:16:28.948 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-16T22:16:28.948 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-16T22:16:28.948 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-16T22:16:28.948 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-16T22:16:28.949 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-16T22:16:28.949 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebtables.ko 2024-05-16T22:16:28.949 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-05-16T22:16:28.949 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-16T22:16:28.949 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-16T22:16:28.949 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ceph 2024-05-16T22:16:28.949 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ceph/libceph.ko 2024-05-16T22:16:28.949 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/core 2024-05-16T22:16:28.949 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/core/failover.ko 2024-05-16T22:16:28.949 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/core/pktgen.ko 2024-05-16T22:16:28.949 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/dccp 2024-05-16T22:16:28.949 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/dccp/dccp.ko 2024-05-16T22:16:28.949 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/dccp/dccp_diag.ko 2024-05-16T22:16:28.949 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/dccp/dccp_ipv4.ko 2024-05-16T22:16:28.949 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/dccp/dccp_ipv6.ko 2024-05-16T22:16:28.949 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/dns_resolver 2024-05-16T22:16:28.950 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/dns_resolver/dns_resolver.ko 2024-05-16T22:16:28.950 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/dsa 2024-05-16T22:16:28.950 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/dsa/dsa_core.ko 2024-05-16T22:16:28.950 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/dsa/tag_brcm.ko 2024-05-16T22:16:28.950 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/dsa/tag_dsa.ko 2024-05-16T22:16:28.950 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/dsa/tag_none.ko 2024-05-16T22:16:28.950 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/dsa/tag_trailer.ko 2024-05-16T22:16:28.950 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ieee802154 2024-05-16T22:16:28.950 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ieee802154/6lowpan 2024-05-16T22:16:28.950 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-16T22:16:28.950 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ieee802154/ieee802154.ko 2024-05-16T22:16:28.950 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-16T22:16:28.950 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4 2024-05-16T22:16:28.950 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/ah4.ko 2024-05-16T22:16:28.950 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/esp4.ko 2024-05-16T22:16:28.951 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/fou.ko 2024-05-16T22:16:28.951 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/gre.ko 2024-05-16T22:16:28.951 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/inet_diag.ko 2024-05-16T22:16:28.951 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/ip_gre.ko 2024-05-16T22:16:28.951 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/ip_tunnel.ko 2024-05-16T22:16:28.951 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/ip_vti.ko 2024-05-16T22:16:28.951 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/ipcomp.ko 2024-05-16T22:16:28.951 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/ipip.ko 2024-05-16T22:16:28.951 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter 2024-05-16T22:16:28.951 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-16T22:16:28.951 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-16T22:16:28.951 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-16T22:16:28.951 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-16T22:16:28.951 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-16T22:16:28.951 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-16T22:16:28.951 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-16T22:16:28.952 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-16T22:16:28.952 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-16T22:16:28.952 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-16T22:16:28.952 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-16T22:16:28.952 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-16T22:16:28.952 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-16T22:16:28.952 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-16T22:16:28.952 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-16T22:16:28.952 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-16T22:16:28.952 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-16T22:16:28.952 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-16T22:16:28.952 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-16T22:16:28.952 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-16T22:16:28.952 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-16T22:16:28.953 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/tcp_bic.ko 2024-05-16T22:16:28.953 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/tcp_dctcp.ko 2024-05-16T22:16:28.953 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/tcp_diag.ko 2024-05-16T22:16:28.953 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/tcp_highspeed.ko 2024-05-16T22:16:28.953 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/tcp_htcp.ko 2024-05-16T22:16:28.953 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/tcp_hybla.ko 2024-05-16T22:16:28.953 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/tcp_illinois.ko 2024-05-16T22:16:28.953 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/tcp_lp.ko 2024-05-16T22:16:28.953 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/tcp_scalable.ko 2024-05-16T22:16:28.953 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/tcp_vegas.ko 2024-05-16T22:16:28.953 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/tcp_veno.ko 2024-05-16T22:16:28.953 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/tcp_westwood.ko 2024-05-16T22:16:28.953 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/tcp_yeah.ko 2024-05-16T22:16:28.953 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/tunnel4.ko 2024-05-16T22:16:28.954 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/udp_diag.ko 2024-05-16T22:16:28.954 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/udp_tunnel.ko 2024-05-16T22:16:28.954 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-16T22:16:28.954 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6 2024-05-16T22:16:28.954 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/ah6.ko 2024-05-16T22:16:28.954 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/esp6.ko 2024-05-16T22:16:28.954 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/fou6.ko 2024-05-16T22:16:28.954 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/ip6_tunnel.ko 2024-05-16T22:16:28.954 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-16T22:16:28.954 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/ip6_vti.ko 2024-05-16T22:16:28.954 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/ipcomp6.ko 2024-05-16T22:16:28.954 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter 2024-05-16T22:16:28.954 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-16T22:16:28.954 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-16T22:16:28.954 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-16T22:16:28.955 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-16T22:16:28.955 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-16T22:16:28.955 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-16T22:16:28.955 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-16T22:16:28.955 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-16T22:16:28.955 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-16T22:16:28.955 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-16T22:16:28.955 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-16T22:16:28.955 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-16T22:16:28.955 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-16T22:16:28.955 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-16T22:16:28.955 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-16T22:16:28.955 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-16T22:16:28.955 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-16T22:16:28.955 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-16T22:16:28.956 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-16T22:16:28.956 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-16T22:16:28.956 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-16T22:16:28.956 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-16T22:16:28.956 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-16T22:16:28.956 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-16T22:16:28.956 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/sit.ko 2024-05-16T22:16:28.956 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/tunnel6.ko 2024-05-16T22:16:28.956 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-16T22:16:28.956 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/key 2024-05-16T22:16:28.956 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/key/af_key.ko 2024-05-16T22:16:28.956 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/l2tp 2024-05-16T22:16:28.956 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/l2tp/l2tp_core.ko 2024-05-16T22:16:28.956 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-16T22:16:28.957 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/l2tp/l2tp_eth.ko 2024-05-16T22:16:28.957 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/l2tp/l2tp_ip.ko 2024-05-16T22:16:28.957 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/l2tp/l2tp_ip6.ko 2024-05-16T22:16:28.957 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/l2tp/l2tp_netlink.ko 2024-05-16T22:16:28.957 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/l2tp/l2tp_ppp.ko 2024-05-16T22:16:28.957 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/llc 2024-05-16T22:16:28.957 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/llc/llc.ko 2024-05-16T22:16:28.957 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/mac802154 2024-05-16T22:16:28.957 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/mac802154/mac802154.ko 2024-05-16T22:16:28.957 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/mpls 2024-05-16T22:16:28.957 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/mpls/mpls_gso.ko 2024-05-16T22:16:28.957 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter 2024-05-16T22:16:28.957 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset 2024-05-16T22:16:28.957 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset/ip_set.ko 2024-05-16T22:16:28.957 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-16T22:16:28.957 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-16T22:16:28.958 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-16T22:16:28.958 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-16T22:16:28.958 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-16T22:16:28.958 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-16T22:16:28.958 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-16T22:16:28.958 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-16T22:16:28.958 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-16T22:16:28.958 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-16T22:16:28.958 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-16T22:16:28.958 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-16T22:16:28.958 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-16T22:16:28.958 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-16T22:16:28.958 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-16T22:16:28.959 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipvs 2024-05-16T22:16:28.959 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-16T22:16:28.959 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-16T22:16:28.959 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-16T22:16:28.959 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-16T22:16:28.959 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-16T22:16:28.959 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-16T22:16:28.959 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-16T22:16:28.959 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-16T22:16:28.959 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-16T22:16:28.959 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-16T22:16:28.959 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-16T22:16:28.959 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-16T22:16:28.959 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-16T22:16:28.960 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-16T22:16:28.960 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_conncount.ko 2024-05-16T22:16:28.960 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_conntrack.ko 2024-05-16T22:16:28.960 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-16T22:16:28.960 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-16T22:16:28.960 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-16T22:16:28.960 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-16T22:16:28.960 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-16T22:16:28.960 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-16T22:16:28.960 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-16T22:16:28.960 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-16T22:16:28.960 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-16T22:16:28.960 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-16T22:16:28.960 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-16T22:16:28.961 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-16T22:16:28.961 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-16T22:16:28.961 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_flow_table.ko 2024-05-16T22:16:28.961 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-16T22:16:28.961 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_log_syslog.ko 2024-05-16T22:16:28.961 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_nat.ko 2024-05-16T22:16:28.961 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-16T22:16:28.961 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-16T22:16:28.961 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_nat_irc.ko 2024-05-16T22:16:28.961 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_nat_sip.ko 2024-05-16T22:16:28.961 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-16T22:16:28.961 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-16T22:16:28.961 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_tables.ko 2024-05-16T22:16:28.961 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nfnetlink.ko 2024-05-16T22:16:28.961 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-16T22:16:28.962 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nfnetlink_log.ko 2024-05-16T22:16:28.962 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-16T22:16:28.962 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-16T22:16:28.962 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_chain_nat.ko 2024-05-16T22:16:28.962 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_compat.ko 2024-05-16T22:16:28.962 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_ct.ko 2024-05-16T22:16:28.962 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-16T22:16:28.962 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_fib.ko 2024-05-16T22:16:28.962 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-16T22:16:28.962 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_hash.ko 2024-05-16T22:16:28.962 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_limit.ko 2024-05-16T22:16:28.962 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_log.ko 2024-05-16T22:16:28.962 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_masq.ko 2024-05-16T22:16:28.962 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_nat.ko 2024-05-16T22:16:28.963 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_numgen.ko 2024-05-16T22:16:28.963 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_queue.ko 2024-05-16T22:16:28.963 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_quota.ko 2024-05-16T22:16:28.963 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_redir.ko 2024-05-16T22:16:28.963 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_reject.ko 2024-05-16T22:16:28.963 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_reject_inet.ko 2024-05-16T22:16:28.963 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_socket.ko 2024-05-16T22:16:28.963 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_tunnel.ko 2024-05-16T22:16:28.963 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_AUDIT.ko 2024-05-16T22:16:28.963 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-16T22:16:28.963 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-16T22:16:28.963 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-16T22:16:28.963 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_CT.ko 2024-05-16T22:16:28.964 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_DSCP.ko 2024-05-16T22:16:28.964 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_HL.ko 2024-05-16T22:16:28.964 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_HMARK.ko 2024-05-16T22:16:28.964 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-16T22:16:28.964 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_LED.ko 2024-05-16T22:16:28.964 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_LOG.ko 2024-05-16T22:16:28.964 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-16T22:16:28.964 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_NETMAP.ko 2024-05-16T22:16:28.964 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_NFLOG.ko 2024-05-16T22:16:28.964 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-16T22:16:28.964 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_RATEEST.ko 2024-05-16T22:16:28.964 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-16T22:16:28.964 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_SECMARK.ko 2024-05-16T22:16:28.964 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-16T22:16:28.964 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-16T22:16:28.965 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_TEE.ko 2024-05-16T22:16:28.965 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_TPROXY.ko 2024-05-16T22:16:28.965 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_TRACE.ko 2024-05-16T22:16:28.965 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_addrtype.ko 2024-05-16T22:16:28.965 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_bpf.ko 2024-05-16T22:16:28.965 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_cgroup.ko 2024-05-16T22:16:28.965 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_cluster.ko 2024-05-16T22:16:28.965 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_comment.ko 2024-05-16T22:16:28.965 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_connbytes.ko 2024-05-16T22:16:28.965 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_connlabel.ko 2024-05-16T22:16:28.965 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_connlimit.ko 2024-05-16T22:16:28.965 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_connmark.ko 2024-05-16T22:16:28.965 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_conntrack.ko 2024-05-16T22:16:28.966 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_cpu.ko 2024-05-16T22:16:28.966 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_dccp.ko 2024-05-16T22:16:28.966 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_devgroup.ko 2024-05-16T22:16:28.966 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_dscp.ko 2024-05-16T22:16:28.966 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_ecn.ko 2024-05-16T22:16:28.966 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_esp.ko 2024-05-16T22:16:28.966 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_hashlimit.ko 2024-05-16T22:16:28.966 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_helper.ko 2024-05-16T22:16:28.966 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_hl.ko 2024-05-16T22:16:28.966 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_ipcomp.ko 2024-05-16T22:16:28.966 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_iprange.ko 2024-05-16T22:16:28.966 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_ipvs.ko 2024-05-16T22:16:28.966 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_l2tp.ko 2024-05-16T22:16:28.967 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_length.ko 2024-05-16T22:16:28.967 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_limit.ko 2024-05-16T22:16:28.967 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_mac.ko 2024-05-16T22:16:28.967 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_mark.ko 2024-05-16T22:16:28.967 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_multiport.ko 2024-05-16T22:16:28.967 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_nat.ko 2024-05-16T22:16:28.967 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_nfacct.ko 2024-05-16T22:16:28.967 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_osf.ko 2024-05-16T22:16:28.967 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_owner.ko 2024-05-16T22:16:28.967 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_physdev.ko 2024-05-16T22:16:28.967 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_pkttype.ko 2024-05-16T22:16:28.967 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_policy.ko 2024-05-16T22:16:28.967 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_quota.ko 2024-05-16T22:16:28.967 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_rateest.ko 2024-05-16T22:16:28.967 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_realm.ko 2024-05-16T22:16:28.967 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_recent.ko 2024-05-16T22:16:28.968 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_sctp.ko 2024-05-16T22:16:28.968 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_set.ko 2024-05-16T22:16:28.968 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_socket.ko 2024-05-16T22:16:28.968 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_state.ko 2024-05-16T22:16:28.968 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_statistic.ko 2024-05-16T22:16:28.968 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_string.ko 2024-05-16T22:16:28.968 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_tcpmss.ko 2024-05-16T22:16:28.968 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_time.ko 2024-05-16T22:16:28.968 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_u32.ko 2024-05-16T22:16:28.968 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netlink 2024-05-16T22:16:28.968 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netlink/netlink_diag.ko 2024-05-16T22:16:28.968 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/nsh 2024-05-16T22:16:28.968 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/nsh/nsh.ko 2024-05-16T22:16:28.968 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/openvswitch 2024-05-16T22:16:28.969 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/openvswitch/openvswitch.ko 2024-05-16T22:16:28.969 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/openvswitch/vport-geneve.ko 2024-05-16T22:16:28.969 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/openvswitch/vport-gre.ko 2024-05-16T22:16:28.969 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/openvswitch/vport-vxlan.ko 2024-05-16T22:16:28.969 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/packet 2024-05-16T22:16:28.969 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/packet/af_packet_diag.ko 2024-05-16T22:16:28.969 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/rds 2024-05-16T22:16:28.969 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/rds/rds.ko 2024-05-16T22:16:28.969 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/rds/rds_rdma.ko 2024-05-16T22:16:28.969 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/rds/rds_tcp.ko 2024-05-16T22:16:28.969 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched 2024-05-16T22:16:28.969 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/act_csum.ko 2024-05-16T22:16:28.969 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/act_gact.ko 2024-05-16T22:16:28.970 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/act_mirred.ko 2024-05-16T22:16:28.970 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/act_nat.ko 2024-05-16T22:16:28.970 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/act_pedit.ko 2024-05-16T22:16:28.970 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/act_police.ko 2024-05-16T22:16:28.970 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/act_simple.ko 2024-05-16T22:16:28.970 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/act_skbedit.ko 2024-05-16T22:16:28.970 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/act_vlan.ko 2024-05-16T22:16:28.970 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/cls_basic.ko 2024-05-16T22:16:28.970 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/cls_bpf.ko 2024-05-16T22:16:28.970 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/cls_flow.ko 2024-05-16T22:16:28.970 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/cls_fw.ko 2024-05-16T22:16:28.970 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/cls_route.ko 2024-05-16T22:16:28.970 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/cls_u32.ko 2024-05-16T22:16:28.971 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/em_cmp.ko 2024-05-16T22:16:28.971 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/em_ipset.ko 2024-05-16T22:16:28.971 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/em_meta.ko 2024-05-16T22:16:28.971 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/em_nbyte.ko 2024-05-16T22:16:28.971 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/em_text.ko 2024-05-16T22:16:28.971 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/em_u32.ko 2024-05-16T22:16:28.971 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_choke.ko 2024-05-16T22:16:28.971 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_codel.ko 2024-05-16T22:16:28.971 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_drr.ko 2024-05-16T22:16:28.971 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_fq.ko 2024-05-16T22:16:28.971 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_gred.ko 2024-05-16T22:16:28.971 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_hfsc.ko 2024-05-16T22:16:28.971 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_hhf.ko 2024-05-16T22:16:28.971 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_htb.ko 2024-05-16T22:16:28.972 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_ingress.ko 2024-05-16T22:16:28.972 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_mqprio.ko 2024-05-16T22:16:28.972 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_mqprio_lib.ko 2024-05-16T22:16:28.972 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_multiq.ko 2024-05-16T22:16:28.972 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_netem.ko 2024-05-16T22:16:28.972 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_pie.ko 2024-05-16T22:16:28.972 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_plug.ko 2024-05-16T22:16:28.972 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_prio.ko 2024-05-16T22:16:28.972 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_qfq.ko 2024-05-16T22:16:28.972 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_red.ko 2024-05-16T22:16:28.972 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_sfb.ko 2024-05-16T22:16:28.972 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_sfq.ko 2024-05-16T22:16:28.972 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_tbf.ko 2024-05-16T22:16:28.972 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_teql.ko 2024-05-16T22:16:28.972 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sctp 2024-05-16T22:16:28.973 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sctp/sctp.ko 2024-05-16T22:16:28.973 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sctp/sctp_diag.ko 2024-05-16T22:16:28.973 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sunrpc 2024-05-16T22:16:28.973 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sunrpc/auth_gss 2024-05-16T22:16:28.973 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-16T22:16:28.973 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-16T22:16:28.973 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sunrpc/sunrpc.ko 2024-05-16T22:16:28.973 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sunrpc/xprtrdma 2024-05-16T22:16:28.973 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-16T22:16:28.973 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/tipc 2024-05-16T22:16:28.973 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/tipc/tipc.ko 2024-05-16T22:16:28.973 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/tipc/tipc_diag.ko 2024-05-16T22:16:28.973 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/unix 2024-05-16T22:16:28.973 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/unix/unix_diag.ko 2024-05-16T22:16:28.974 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/vmw_vsock 2024-05-16T22:16:28.974 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-16T22:16:28.974 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-16T22:16:28.974 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/vmw_vsock/vsock.ko 2024-05-16T22:16:28.974 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-16T22:16:28.974 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-16T22:16:28.974 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/xfrm 2024-05-16T22:16:28.974 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-16T22:16:28.974 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/security 2024-05-16T22:16:28.974 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/security/keys 2024-05-16T22:16:28.974 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/security/keys/encrypted-keys 2024-05-16T22:16:28.974 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-05-16T22:16:28.974 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/security/keys/trusted-keys 2024-05-16T22:16:28.974 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/security/keys/trusted-keys/trusted.ko 2024-05-16T22:16:28.975 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/modules.alias 2024-05-16T22:16:28.975 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/modules.alias.bin 2024-05-16T22:16:28.975 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/modules.builtin 2024-05-16T22:16:28.975 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/modules.builtin.alias.bin 2024-05-16T22:16:28.975 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/modules.builtin.bin 2024-05-16T22:16:28.975 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/modules.builtin.modinfo 2024-05-16T22:16:28.975 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/modules.dep 2024-05-16T22:16:28.975 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/modules.dep.bin 2024-05-16T22:16:28.975 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/modules.devname 2024-05-16T22:16:28.975 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/modules.order 2024-05-16T22:16:28.975 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/modules.softdep 2024-05-16T22:16:28.975 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/modules.symbols 2024-05-16T22:16:28.975 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/modules.symbols.bin 2024-05-16T22:16:28.975 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/vmlinuz 2024-05-16T22:16:28.979 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g42e114f04cb0 2024-05-16T22:16:28.980 DEBUG:teuthology.orchestra.run.smithi196:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-05-16T22:16:29.002 INFO:teuthology.orchestra.run.smithi196.stdout:postinstall scriptlet (using /bin/sh): 2024-05-16T22:16:29.002 INFO:teuthology.orchestra.run.smithi196.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-16T22:16:29.002 INFO:teuthology.orchestra.run.smithi196.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g42e114f04cb0 /lib/modules/6.9.0-rc3-g42e114f04cb0/vmlinuz 2024-05-16T22:16:29.002 INFO:teuthology.orchestra.run.smithi196.stdout:fi 2024-05-16T22:16:29.002 INFO:teuthology.orchestra.run.smithi196.stdout:for file in vmlinuz System.map config; do 2024-05-16T22:16:29.002 INFO:teuthology.orchestra.run.smithi196.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g42e114f04cb0/${file}" "/boot/${file}-6.9.0-rc3-g42e114f04cb0"; then 2024-05-16T22:16:29.002 INFO:teuthology.orchestra.run.smithi196.stdout: cp "/lib/modules/6.9.0-rc3-g42e114f04cb0/${file}" "/boot/${file}-6.9.0-rc3-g42e114f04cb0" 2024-05-16T22:16:29.002 INFO:teuthology.orchestra.run.smithi196.stdout: fi 2024-05-16T22:16:29.002 INFO:teuthology.orchestra.run.smithi196.stdout:done 2024-05-16T22:16:29.002 INFO:teuthology.orchestra.run.smithi196.stdout:if [ -d "/lib/modules/6.9.0-rc3-g42e114f04cb0/dtb" ] && \ 2024-05-16T22:16:29.003 INFO:teuthology.orchestra.run.smithi196.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g42e114f04cb0/dtb" "/boot/dtb-6.9.0-rc3-g42e114f04cb0" >/dev/null 2>&1; then 2024-05-16T22:16:29.003 INFO:teuthology.orchestra.run.smithi196.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g42e114f04cb0" 2024-05-16T22:16:29.003 INFO:teuthology.orchestra.run.smithi196.stdout: cp -r "/lib/modules/6.9.0-rc3-g42e114f04cb0/dtb" "/boot/dtb-6.9.0-rc3-g42e114f04cb0" 2024-05-16T22:16:29.003 INFO:teuthology.orchestra.run.smithi196.stdout:fi 2024-05-16T22:16:29.003 INFO:teuthology.orchestra.run.smithi196.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g42e114f04cb0/modules.dep" ]; then 2024-05-16T22:16:29.003 INFO:teuthology.orchestra.run.smithi196.stdout: /usr/sbin/depmod 6.9.0-rc3-g42e114f04cb0 2024-05-16T22:16:29.003 INFO:teuthology.orchestra.run.smithi196.stdout:fi 2024-05-16T22:16:29.003 INFO:teuthology.orchestra.run.smithi196.stdout:preuninstall scriptlet (using /bin/sh): 2024-05-16T22:16:29.003 INFO:teuthology.orchestra.run.smithi196.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-16T22:16:29.003 INFO:teuthology.orchestra.run.smithi196.stdout:kernel-install remove 6.9.0-rc3-g42e114f04cb0 2024-05-16T22:16:29.003 INFO:teuthology.orchestra.run.smithi196.stdout:fi 2024-05-16T22:16:29.004 DEBUG:teuthology.orchestra.run.smithi196:> sudo rpm -qi grub2-tools 2024-05-16T22:16:29.084 INFO:teuthology.orchestra.run.smithi196.stdout:Name : grub2-tools 2024-05-16T22:16:29.084 INFO:teuthology.orchestra.run.smithi196.stdout:Epoch : 1 2024-05-16T22:16:29.084 INFO:teuthology.orchestra.run.smithi196.stdout:Version : 2.06 2024-05-16T22:16:29.084 INFO:teuthology.orchestra.run.smithi196.stdout:Release : 68.el9 2024-05-16T22:16:29.084 INFO:teuthology.orchestra.run.smithi196.stdout:Architecture: x86_64 2024-05-16T22:16:29.084 INFO:teuthology.orchestra.run.smithi196.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-16T22:16:29.084 INFO:teuthology.orchestra.run.smithi196.stdout:Group : Unspecified 2024-05-16T22:16:29.084 INFO:teuthology.orchestra.run.smithi196.stdout:Size : 8264254 2024-05-16T22:16:29.084 INFO:teuthology.orchestra.run.smithi196.stdout:License : GPLv3+ 2024-05-16T22:16:29.084 INFO:teuthology.orchestra.run.smithi196.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-16T22:16:29.085 INFO:teuthology.orchestra.run.smithi196.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-16T22:16:29.085 INFO:teuthology.orchestra.run.smithi196.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-16T22:16:29.085 INFO:teuthology.orchestra.run.smithi196.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-16T22:16:29.085 INFO:teuthology.orchestra.run.smithi196.stdout:Packager : builder@centos.org 2024-05-16T22:16:29.085 INFO:teuthology.orchestra.run.smithi196.stdout:Vendor : CentOS 2024-05-16T22:16:29.085 INFO:teuthology.orchestra.run.smithi196.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-16T22:16:29.085 INFO:teuthology.orchestra.run.smithi196.stdout:Summary : Support tools for GRUB. 2024-05-16T22:16:29.085 INFO:teuthology.orchestra.run.smithi196.stdout:Description : 2024-05-16T22:16:29.085 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:16:29.085 INFO:teuthology.orchestra.run.smithi196.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-16T22:16:29.085 INFO:teuthology.orchestra.run.smithi196.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-16T22:16:29.085 INFO:teuthology.orchestra.run.smithi196.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-16T22:16:29.085 INFO:teuthology.orchestra.run.smithi196.stdout:hardware devices. 2024-05-16T22:16:29.085 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:16:29.085 INFO:teuthology.orchestra.run.smithi196.stdout:This subpackage provides tools for support of all platforms. 2024-05-16T22:16:29.086 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-16T22:16:29.086 INFO:teuthology.task.kernel:Updating grub on smithi196 to boot 6.9.0-rc3-g42e114f04cb0 2024-05-16T22:16:29.086 DEBUG:teuthology.orchestra.run.smithi196:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-16T22:16:29.606 INFO:teuthology.orchestra.run.smithi196.stderr:Generating grub configuration file ... 2024-05-16T22:16:30.999 INFO:teuthology.orchestra.run.smithi196.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-16T22:16:31.030 INFO:teuthology.orchestra.run.smithi196.stderr:done 2024-05-16T22:16:31.032 DEBUG:teuthology.orchestra.run.smithi196:> mktemp 2024-05-16T22:16:31.048 INFO:teuthology.orchestra.run.smithi196.stdout:/tmp/tmp.h9EhC0Aieq 2024-05-16T22:16:31.048 DEBUG:teuthology.orchestra.run.smithi196:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.h9EhC0Aieq 2024-05-16T22:16:31.114 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 0666 /tmp/tmp.h9EhC0Aieq 2024-05-16T22:16:31.250 DEBUG:teuthology.orchestra.remote:smithi196:/tmp/tmp.h9EhC0Aieq is 6KB 2024-05-16T22:16:31.270 DEBUG:teuthology.orchestra.run.smithi196:> rm -fr /tmp/tmp.h9EhC0Aieq 2024-05-16T22:16:31.284 DEBUG:teuthology.orchestra.run.smithi196:> sudo /bin/ls /boot/loader/entries || true 2024-05-16T22:16:31.345 INFO:teuthology.orchestra.run.smithi196.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-16T22:16:31.346 INFO:teuthology.orchestra.run.smithi196.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-16T22:16:31.346 INFO:teuthology.orchestra.run.smithi196.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-16T22:16:31.346 INFO:teuthology.orchestra.run.smithi196.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g42e114f04cb0.conf 2024-05-16T22:16:31.347 DEBUG:teuthology.orchestra.run.smithi196:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g42e114f04cb0 2024-05-16T22:16:31.502 DEBUG:teuthology.orchestra.run.smithi196:> sudo shutdown -r now 2024-05-16T22:17:01.506 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-05-16T22:17:01.506 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-05-16T22:17:01.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-16T22:17:19.906 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-05-16T22:17:28.907 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-05-16T22:17:28.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-16T22:17:31.966 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-05-16T22:17:43.967 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-05-16T22:17:43.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-16T22:18:15.905 DEBUG:teuthology.orchestra.run.smithi196:> true 2024-05-16T22:18:16.510 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-05-16T22:18:16.510 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-rc3-g42e114f04cb0"... 2024-05-16T22:18:16.510 DEBUG:teuthology.orchestra.run.smithi196:> uname -r 2024-05-16T22:18:16.550 INFO:teuthology.orchestra.run.smithi196.stdout:6.9.0-rc3-g42e114f04cb0 2024-05-16T22:18:16.550 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g42e114f04cb0 vs 6.9.0-rc3-g42e114f04cb0 2024-05-16T22:18:16.550 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-16T22:18:16.550 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-16T22:18:17.552 DEBUG:teuthology.parallel:result is None 2024-05-16T22:18:17.552 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-16T22:18:17.559 INFO:teuthology.task.internal:Creating test directory... 2024-05-16T22:18:17.559 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-16T22:18:17.562 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-16T22:18:17.565 DEBUG:teuthology.orchestra.run.smithi196:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-16T22:18:17.609 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-16T22:18:17.615 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-16T22:18:17.624 INFO:teuthology.task.internal:Creating archive directory... 2024-05-16T22:18:17.624 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-16T22:18:17.627 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-16T22:18:17.629 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-16T22:18:17.696 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-16T22:18:17.703 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-16T22:18:17.703 DEBUG:teuthology.orchestra.run.smithi044:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-16T22:18:17.720 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-16T22:18:17.720 DEBUG:teuthology.orchestra.run.smithi070:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-16T22:18:17.736 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-16T22:18:17.737 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-16T22:18:17.763 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-16T22:18:17.779 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-16T22:18:17.795 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-16T22:18:17.807 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-16T22:18:17.829 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-16T22:18:17.829 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-16T22:18:17.935 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-16T22:18:18.008 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-16T22:18:18.012 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-16T22:18:18.019 INFO:teuthology.task.internal:Configuring sudo... 2024-05-16T22:18:18.019 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-16T22:18:18.022 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-16T22:18:18.025 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-16T22:18:18.102 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-16T22:18:18.111 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-16T22:18:18.111 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-16T22:18:18.114 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-16T22:18:18.116 DEBUG:teuthology.orchestra.run.smithi196:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-16T22:18:18.166 DEBUG:teuthology.orchestra.run.smithi044:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-16T22:18:18.216 DEBUG:teuthology.orchestra.run.smithi044:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-16T22:18:18.263 DEBUG:teuthology.orchestra.run.smithi044:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-16T22:18:18.348 DEBUG:teuthology.orchestra.run.smithi044:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-16T22:18:18.391 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-05-16T22:18:18.391 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-16T22:18:18.459 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-16T22:18:18.504 DEBUG:teuthology.orchestra.run.smithi070:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-16T22:18:18.556 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-16T22:18:18.640 DEBUG:teuthology.orchestra.run.smithi070:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-16T22:18:18.681 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-16T22:18:18.682 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-16T22:18:18.747 DEBUG:teuthology.orchestra.run.smithi196:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-16T22:18:18.834 DEBUG:teuthology.orchestra.run.smithi196:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-16T22:18:18.909 DEBUG:teuthology.orchestra.run.smithi196:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-16T22:18:18.985 DEBUG:teuthology.orchestra.run.smithi196:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-16T22:18:19.051 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-16T22:18:19.051 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-16T22:18:19.122 DEBUG:teuthology.orchestra.run.smithi044:> sudo service rsyslog restart 2024-05-16T22:18:19.124 DEBUG:teuthology.orchestra.run.smithi070:> sudo service rsyslog restart 2024-05-16T22:18:19.127 DEBUG:teuthology.orchestra.run.smithi196:> sudo service rsyslog restart 2024-05-16T22:18:19.160 INFO:teuthology.orchestra.run.smithi070.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-16T22:18:19.165 INFO:teuthology.orchestra.run.smithi044.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-16T22:18:19.276 INFO:teuthology.orchestra.run.smithi196.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-16T22:18:19.482 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-16T22:18:19.489 INFO:teuthology.task.internal:Starting timer... 2024-05-16T22:18:19.490 INFO:teuthology.run_tasks:Running task pcp... 2024-05-16T22:18:19.500 INFO:teuthology.run_tasks:Running task selinux... 2024-05-16T22:18:19.507 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-05-16T22:18:19.508 DEBUG:teuthology.orchestra.run.smithi044:> sudo service auditd rotate 2024-05-16T22:18:19.565 INFO:teuthology.orchestra.run.smithi044.stdout:Rotating logs: 2024-05-16T22:18:19.567 DEBUG:teuthology.orchestra.run.smithi070:> sudo service auditd rotate 2024-05-16T22:18:19.642 INFO:teuthology.orchestra.run.smithi070.stdout:Rotating logs: 2024-05-16T22:18:19.645 DEBUG:teuthology.orchestra.run.smithi196:> sudo service auditd rotate 2024-05-16T22:18:19.766 INFO:teuthology.orchestra.run.smithi196.stdout:Rotating logs: 2024-05-16T22:18:19.769 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-16T22:18:19.770 DEBUG:teuthology.orchestra.run.smithi044:> /usr/sbin/getenforce 2024-05-16T22:18:19.803 INFO:teuthology.orchestra.run.smithi044.stdout:Permissive 2024-05-16T22:18:19.804 DEBUG:teuthology.orchestra.run.smithi070:> /usr/sbin/getenforce 2024-05-16T22:18:19.824 INFO:teuthology.orchestra.run.smithi070.stdout:Permissive 2024-05-16T22:18:19.824 DEBUG:teuthology.orchestra.run.smithi196:> /usr/sbin/getenforce 2024-05-16T22:18:19.873 INFO:teuthology.orchestra.run.smithi196.stdout:Permissive 2024-05-16T22:18:19.873 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi044.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi070.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi196.front.sepia.ceph.com': 'permissive'} 2024-05-16T22:18:19.873 DEBUG:teuthology.orchestra.run.smithi044:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-16T22:18:19.900 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-16T22:18:19.901 DEBUG:teuthology.orchestra.run.smithi070:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-16T22:18:19.929 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-16T22:18:19.929 DEBUG:teuthology.orchestra.run.smithi196:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-16T22:18:20.002 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-16T22:18:20.003 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-16T22:18:20.003 DEBUG:teuthology.orchestra.run.smithi044:> sudo /usr/sbin/setenforce permissive 2024-05-16T22:18:20.031 DEBUG:teuthology.orchestra.run.smithi070:> sudo /usr/sbin/setenforce permissive 2024-05-16T22:18:20.058 DEBUG:teuthology.orchestra.run.smithi196:> sudo /usr/sbin/setenforce permissive 2024-05-16T22:18:20.118 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-16T22:18:20.128 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-16T22:18:20.139 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-16T22:18:20.140 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi044.front.sepia.ceph.com,smithi070.front.sepia.ceph.com,smithi196.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-16T22:24:18.484 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi044.front.sepia.ceph.com'), Remote(name='ubuntu@smithi070.front.sepia.ceph.com'), Remote(name='ubuntu@smithi196.front.sepia.ceph.com')] 2024-05-16T22:24:18.485 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-05-16T22:24:18.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-16T22:24:18.563 DEBUG:teuthology.orchestra.run.smithi044:> true 2024-05-16T22:24:18.643 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-05-16T22:24:18.643 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-05-16T22:24:18.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-16T22:24:18.716 DEBUG:teuthology.orchestra.run.smithi070:> true 2024-05-16T22:24:18.793 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-05-16T22:24:18.794 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-05-16T22:24:18.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-16T22:24:18.896 DEBUG:teuthology.orchestra.run.smithi196:> true 2024-05-16T22:24:19.059 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-05-16T22:24:19.060 INFO:teuthology.run_tasks:Running task clock... 2024-05-16T22:24:19.071 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-16T22:24:19.071 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-16T22:24:19.072 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-16T22:24:19.074 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-16T22:24:19.074 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-16T22:24:19.076 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-16T22:24:19.076 DEBUG:teuthology.orchestra.run.smithi196:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-16T22:24:19.104 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-16T22:24:19.105 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-16T22:24:19.118 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-16T22:24:19.120 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-16T22:24:19.141 INFO:teuthology.orchestra.run.smithi070.stderr:sudo: ntpd: command not found 2024-05-16T22:24:19.146 INFO:teuthology.orchestra.run.smithi044.stderr:sudo: ntpd: command not found 2024-05-16T22:24:19.152 INFO:teuthology.orchestra.run.smithi070.stdout:506 Cannot talk to daemon 2024-05-16T22:24:19.158 INFO:teuthology.orchestra.run.smithi044.stdout:506 Cannot talk to daemon 2024-05-16T22:24:19.163 INFO:teuthology.orchestra.run.smithi196.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-16T22:24:19.165 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-16T22:24:19.173 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-16T22:24:19.178 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-16T22:24:19.187 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-16T22:24:19.204 INFO:teuthology.orchestra.run.smithi196.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-16T22:24:19.235 INFO:teuthology.orchestra.run.smithi070.stderr:bash: line 1: ntpq: command not found 2024-05-16T22:24:19.239 INFO:teuthology.orchestra.run.smithi070.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-16T22:24:19.239 INFO:teuthology.orchestra.run.smithi070.stdout:=============================================================================== 2024-05-16T22:24:19.239 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-16T22:24:19.239 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-16T22:24:19.239 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-16T22:24:19.239 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-16T22:24:19.247 INFO:teuthology.orchestra.run.smithi044.stderr:bash: line 1: ntpq: command not found 2024-05-16T22:24:19.251 INFO:teuthology.orchestra.run.smithi044.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-16T22:24:19.251 INFO:teuthology.orchestra.run.smithi044.stdout:=============================================================================== 2024-05-16T22:24:19.251 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-16T22:24:19.251 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-16T22:24:19.251 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-16T22:24:19.251 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-16T22:24:19.274 INFO:teuthology.orchestra.run.smithi196.stderr:sudo: ntpd: command not found 2024-05-16T22:24:19.301 INFO:teuthology.orchestra.run.smithi196.stdout:506 Cannot talk to daemon 2024-05-16T22:24:19.336 INFO:teuthology.orchestra.run.smithi196.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-16T22:24:19.374 INFO:teuthology.orchestra.run.smithi196.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-16T22:24:19.498 INFO:teuthology.orchestra.run.smithi196.stderr:bash: line 1: ntpq: command not found 2024-05-16T22:24:19.506 INFO:teuthology.orchestra.run.smithi196.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-16T22:24:19.507 INFO:teuthology.orchestra.run.smithi196.stdout:=============================================================================== 2024-05-16T22:24:19.507 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-16T22:24:19.507 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-16T22:24:19.507 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-16T22:24:19.507 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-16T22:24:19.508 INFO:teuthology.run_tasks:Running task install... 2024-05-16T22:24:19.516 DEBUG:teuthology.task.install:project ceph 2024-05-16T22:24:19.516 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '43296076bed1da2423ef68e9230eab60284d4c31'}, 'extra_system_packages': {'deb': ['fscrypt'], 'rpm': ['fscrypt']}} 2024-05-16T22:24:19.516 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib', 'fscrypt'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib', 'fscrypt']}, 'flavor': 'default', 'sha1': '43296076bed1da2423ef68e9230eab60284d4c31'} 2024-05-16T22:24:19.516 INFO:teuthology.task.install:Using flavor: default 2024-05-16T22:24:19.521 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-16T22:24:19.521 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-16T22:24:19.522 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib', 'fscrypt'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib', 'fscrypt']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '43296076bed1da2423ef68e9230eab60284d4c31', 'tag': None, 'wait_for_package': False} 2024-05-16T22:24:19.523 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=43296076bed1da2423ef68e9230eab60284d4c31 2024-05-16T22:24:19.524 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib', 'fscrypt'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib', 'fscrypt']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '43296076bed1da2423ef68e9230eab60284d4c31', 'tag': None, 'wait_for_package': False} 2024-05-16T22:24:19.525 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=43296076bed1da2423ef68e9230eab60284d4c31 2024-05-16T22:24:19.526 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib', 'fscrypt'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib', 'fscrypt']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '43296076bed1da2423ef68e9230eab60284d4c31', 'tag': None, 'wait_for_package': False} 2024-05-16T22:24:19.526 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=43296076bed1da2423ef68e9230eab60284d4c31 2024-05-16T22:24:19.683 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240515.023933-debug/43296076bed1da2423ef68e9230eab60284d4c31/centos/9/flavors/default/ 2024-05-16T22:24:19.683 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3709.g43296076 2024-05-16T22:24:19.687 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240515.023933-debug/43296076bed1da2423ef68e9230eab60284d4c31/centos/9/flavors/default/ 2024-05-16T22:24:19.687 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3709.g43296076 2024-05-16T22:24:19.688 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240515.023933-debug/43296076bed1da2423ef68e9230eab60284d4c31/centos/9/flavors/default/ 2024-05-16T22:24:19.688 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3709.g43296076 2024-05-16T22:24:19.798 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240515.023933-debug/43296076bed1da2423ef68e9230eab60284d4c31/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240515.023933-debug/43296076bed1da2423ef68e9230eab60284d4c31/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240515.023933-debug/43296076bed1da2423ef68e9230eab60284d4c31/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-16T22:24:19.798 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-16T22:24:19.798 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-16T22:24:19.824 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, fscrypt, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, fscrypt, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, fscrypt, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, fscrypt on remote rpm x86_64 2024-05-16T22:24:19.824 DEBUG:teuthology.orchestra.run.smithi070:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/43296076bed1da2423ef68e9230eab60284d4c31/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-16T22:24:19.855 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240515.023933-debug/43296076bed1da2423ef68e9230eab60284d4c31/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240515.023933-debug/43296076bed1da2423ef68e9230eab60284d4c31/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240515.023933-debug/43296076bed1da2423ef68e9230eab60284d4c31/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-16T22:24:19.855 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-05-16T22:24:19.855 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-16T22:24:19.861 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240515.023933-debug/43296076bed1da2423ef68e9230eab60284d4c31/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240515.023933-debug/43296076bed1da2423ef68e9230eab60284d4c31/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240515.023933-debug/43296076bed1da2423ef68e9230eab60284d4c31/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-16T22:24:19.861 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-16T22:24:19.862 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-16T22:24:19.885 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, fscrypt, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, fscrypt, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, fscrypt, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, fscrypt, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, fscrypt on remote rpm x86_64 2024-05-16T22:24:19.885 DEBUG:teuthology.orchestra.run.smithi044:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/43296076bed1da2423ef68e9230eab60284d4c31/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-16T22:24:19.889 DEBUG:teuthology.orchestra.run.smithi070:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-16T22:24:19.953 DEBUG:teuthology.orchestra.run.smithi044:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-16T22:24:19.955 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, fscrypt, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, fscrypt, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, fscrypt, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, fscrypt, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, fscrypt, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, fscrypt on remote rpm x86_64 2024-05-16T22:24:19.955 DEBUG:teuthology.orchestra.run.smithi196:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/43296076bed1da2423ef68e9230eab60284d4c31/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-16T22:24:19.962 DEBUG:teuthology.orchestra.run.smithi070:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-16T22:24:20.025 INFO:teuthology.orchestra.run.smithi070.stdout:check_obsoletes = 1 2024-05-16T22:24:20.027 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum clean all 2024-05-16T22:24:20.032 DEBUG:teuthology.orchestra.run.smithi044:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-16T22:24:20.082 DEBUG:teuthology.orchestra.run.smithi196:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-16T22:24:20.097 INFO:teuthology.orchestra.run.smithi044.stdout:check_obsoletes = 1 2024-05-16T22:24:20.099 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum clean all 2024-05-16T22:24:20.194 DEBUG:teuthology.orchestra.run.smithi196:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-16T22:24:20.255 INFO:teuthology.orchestra.run.smithi070.stdout:57 files removed 2024-05-16T22:24:20.273 INFO:teuthology.orchestra.run.smithi196.stdout:check_obsoletes = 1 2024-05-16T22:24:20.277 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum clean all 2024-05-16T22:24:20.282 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt 2024-05-16T22:24:20.341 INFO:teuthology.orchestra.run.smithi044.stdout:57 files removed 2024-05-16T22:24:20.368 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt 2024-05-16T22:24:20.617 INFO:teuthology.orchestra.run.smithi196.stdout:57 files removed 2024-05-16T22:24:20.655 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt 2024-05-16T22:24:21.018 INFO:teuthology.orchestra.run.smithi044.stdout:ceph packages for x86_64 225 kB/s | 84 kB 00:00 2024-05-16T22:24:21.019 INFO:teuthology.orchestra.run.smithi070.stdout:ceph packages for x86_64 175 kB/s | 84 kB 00:00 2024-05-16T22:24:21.385 INFO:teuthology.orchestra.run.smithi044.stdout:ceph noarch packages 36 kB/s | 12 kB 00:00 2024-05-16T22:24:21.436 INFO:teuthology.orchestra.run.smithi070.stdout:ceph noarch packages 31 kB/s | 12 kB 00:00 2024-05-16T22:24:21.813 INFO:teuthology.orchestra.run.smithi196.stdout:ceph packages for x86_64 114 kB/s | 84 kB 00:00 2024-05-16T22:24:21.936 INFO:teuthology.orchestra.run.smithi044.stdout:ceph source packages 3.7 kB/s | 1.9 kB 00:00 2024-05-16T22:24:21.995 INFO:teuthology.orchestra.run.smithi070.stdout:ceph source packages 3.6 kB/s | 1.9 kB 00:00 2024-05-16T22:24:22.510 INFO:teuthology.orchestra.run.smithi196.stdout:ceph noarch packages 20 kB/s | 12 kB 00:00 2024-05-16T22:24:22.562 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.1 MB 00:00 2024-05-16T22:24:23.073 INFO:teuthology.orchestra.run.smithi196.stdout:ceph source packages 4.0 kB/s | 1.9 kB 00:00 2024-05-16T22:24:24.421 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 9 - BaseOS 6.4 MB/s | 8.1 MB 00:01 2024-05-16T22:24:24.477 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - BaseOS 3.2 MB/s | 8.1 MB 00:02 2024-05-16T22:24:24.554 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - AppStream 21 MB/s | 19 MB 00:00 2024-05-16T22:24:26.645 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - AppStream 19 MB/s | 19 MB 00:01 2024-05-16T22:24:28.530 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.2 MB 00:00 2024-05-16T22:24:28.946 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 9 - AppStream 5.8 MB/s | 19 MB 00:03 2024-05-16T22:24:30.031 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - Extras packages 49 kB/s | 16 kB 00:00 2024-05-16T22:24:31.554 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - CRB 5.3 MB/s | 6.2 MB 00:01 2024-05-16T22:24:32.243 INFO:teuthology.orchestra.run.smithi070.stdout:Extra Packages for Enterprise Linux 10 MB/s | 21 MB 00:02 2024-05-16T22:24:33.030 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - Extras packages 61 kB/s | 16 kB 00:00 2024-05-16T22:24:34.339 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 9 - CRB 4.1 MB/s | 6.2 MB 00:01 2024-05-16T22:24:35.059 INFO:teuthology.orchestra.run.smithi044.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-05-16T22:24:36.231 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 16 kB 00:00 2024-05-16T22:24:37.491 INFO:teuthology.orchestra.run.smithi070.stdout:lab-extras 17 kB/s | 1.7 kB 00:00 2024-05-16T22:24:39.783 INFO:teuthology.orchestra.run.smithi070.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-16T22:24:39.784 INFO:teuthology.orchestra.run.smithi070.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-16T22:24:39.794 INFO:teuthology.orchestra.run.smithi070.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-16T22:24:39.795 INFO:teuthology.orchestra.run.smithi070.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-16T22:24:39.796 INFO:teuthology.orchestra.run.smithi070.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-16T22:24:39.797 INFO:teuthology.orchestra.run.smithi070.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-16T22:24:39.798 INFO:teuthology.orchestra.run.smithi070.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-16T22:24:39.801 INFO:teuthology.orchestra.run.smithi070.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-16T22:24:39.801 INFO:teuthology.orchestra.run.smithi070.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-16T22:24:39.863 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-05-16T22:24:39.878 INFO:teuthology.orchestra.run.smithi070.stdout:======================================================================================= 2024-05-16T22:24:39.879 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repository Size 2024-05-16T22:24:39.879 INFO:teuthology.orchestra.run.smithi070.stdout:======================================================================================= 2024-05-16T22:24:39.879 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-05-16T22:24:39.879 INFO:teuthology.orchestra.run.smithi070.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-16T22:24:39.879 INFO:teuthology.orchestra.run.smithi070.stdout: ceph x86_64 2:19.0.0-3709.g43296076.el9 ceph 6.6 k 2024-05-16T22:24:39.879 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-base x86_64 2:19.0.0-3709.g43296076.el9 ceph 5.4 M 2024-05-16T22:24:39.879 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-fuse x86_64 2:19.0.0-3709.g43296076.el9 ceph 863 k 2024-05-16T22:24:39.879 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3709.g43296076.el9 ceph 147 k 2024-05-16T22:24:39.879 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr x86_64 2:19.0.0-3709.g43296076.el9 ceph 1.5 M 2024-05-16T22:24:39.880 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 143 k 2024-05-16T22:24:39.880 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 3.5 M 2024-05-16T22:24:39.880 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 7.4 M 2024-05-16T22:24:39.880 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-rook noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 49 k 2024-05-16T22:24:39.880 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-radosgw x86_64 2:19.0.0-3709.g43296076.el9 ceph 10 M 2024-05-16T22:24:39.880 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-test x86_64 2:19.0.0-3709.g43296076.el9 ceph 43 M 2024-05-16T22:24:39.881 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-volume noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 273 k 2024-05-16T22:24:39.881 INFO:teuthology.orchestra.run.smithi070.stdout: cephadm noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 763 k 2024-05-16T22:24:39.881 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-mirror x86_64 2:19.0.0-3709.g43296076.el9 ceph 224 k 2024-05-16T22:24:39.881 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-shell x86_64 2:19.0.0-3709.g43296076.el9 ceph 27 k 2024-05-16T22:24:39.881 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-top noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 18 k 2024-05-16T22:24:39.881 INFO:teuthology.orchestra.run.smithi070.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-16T22:24:39.881 INFO:teuthology.orchestra.run.smithi070.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-16T22:24:39.881 INFO:teuthology.orchestra.run.smithi070.stdout: fscrypt x86_64 0.3.4-2.el9 epel 2.0 M 2024-05-16T22:24:39.882 INFO:teuthology.orchestra.run.smithi070.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-16T22:24:39.882 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs-devel x86_64 2:19.0.0-3709.g43296076.el9 ceph 32 k 2024-05-16T22:24:39.882 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs2 x86_64 2:19.0.0-3709.g43296076.el9 ceph 756 k 2024-05-16T22:24:39.882 INFO:teuthology.orchestra.run.smithi070.stdout: librados-devel x86_64 2:19.0.0-3709.g43296076.el9 ceph 127 k 2024-05-16T22:24:39.882 INFO:teuthology.orchestra.run.smithi070.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-16T22:24:39.882 INFO:teuthology.orchestra.run.smithi070.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-16T22:24:39.882 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-16T22:24:39.882 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-16T22:24:39.882 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-16T22:24:39.883 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-16T22:24:39.883 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cephfs x86_64 2:19.0.0-3709.g43296076.el9 ceph 162 k 2024-05-16T22:24:39.883 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rados x86_64 2:19.0.0-3709.g43296076.el9 ceph 320 k 2024-05-16T22:24:39.883 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rbd x86_64 2:19.0.0-3709.g43296076.el9 ceph 300 k 2024-05-16T22:24:39.883 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rgw x86_64 2:19.0.0-3709.g43296076.el9 ceph 99 k 2024-05-16T22:24:39.883 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-fuse x86_64 2:19.0.0-3709.g43296076.el9 ceph 86 k 2024-05-16T22:24:39.883 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-mirror x86_64 2:19.0.0-3709.g43296076.el9 ceph 3.0 M 2024-05-16T22:24:39.883 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-nbd x86_64 2:19.0.0-3709.g43296076.el9 ceph 169 k 2024-05-16T22:24:39.883 INFO:teuthology.orchestra.run.smithi070.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-16T22:24:39.883 INFO:teuthology.orchestra.run.smithi070.stdout:Upgrading: 2024-05-16T22:24:39.883 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager x86_64 1:1.47.90-1.el9 baseos 2.3 M 2024-05-16T22:24:39.883 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-libnm x86_64 1:1.47.90-1.el9 baseos 1.8 M 2024-05-16T22:24:39.884 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-team x86_64 1:1.47.90-1.el9 baseos 41 k 2024-05-16T22:24:39.884 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-tui x86_64 1:1.47.90-1.el9 baseos 248 k 2024-05-16T22:24:39.884 INFO:teuthology.orchestra.run.smithi070.stdout: librados2 x86_64 2:19.0.0-3709.g43296076.el9 ceph 3.3 M 2024-05-16T22:24:39.884 INFO:teuthology.orchestra.run.smithi070.stdout: librbd1 x86_64 2:19.0.0-3709.g43296076.el9 ceph 3.1 M 2024-05-16T22:24:39.884 INFO:teuthology.orchestra.run.smithi070.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-16T22:24:39.884 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-16T22:24:39.884 INFO:teuthology.orchestra.run.smithi070.stdout:Installing dependencies: 2024-05-16T22:24:39.884 INFO:teuthology.orchestra.run.smithi070.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-16T22:24:39.884 INFO:teuthology.orchestra.run.smithi070.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-16T22:24:39.884 INFO:teuthology.orchestra.run.smithi070.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-16T22:24:39.885 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-common x86_64 2:19.0.0-3709.g43296076.el9 ceph 20 M 2024-05-16T22:24:39.885 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 34 k 2024-05-16T22:24:39.885 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mds x86_64 2:19.0.0-3709.g43296076.el9 ceph 2.3 M 2024-05-16T22:24:39.885 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 274 k 2024-05-16T22:24:39.885 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mon x86_64 2:19.0.0-3709.g43296076.el9 ceph 4.9 M 2024-05-16T22:24:39.885 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-osd x86_64 2:19.0.0-3709.g43296076.el9 ceph 18 M 2024-05-16T22:24:39.885 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 16 k 2024-05-16T22:24:39.885 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-selinux x86_64 2:19.0.0-3709.g43296076.el9 ceph 25 k 2024-05-16T22:24:39.885 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-16T22:24:39.885 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-16T22:24:39.885 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-16T22:24:39.885 INFO:teuthology.orchestra.run.smithi070.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-16T22:24:39.885 INFO:teuthology.orchestra.run.smithi070.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-16T22:24:39.885 INFO:teuthology.orchestra.run.smithi070.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-16T22:24:39.886 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-16T22:24:39.886 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-16T22:24:39.886 INFO:teuthology.orchestra.run.smithi070.stdout: libcephsqlite x86_64 2:19.0.0-3709.g43296076.el9 ceph 157 k 2024-05-16T22:24:39.886 INFO:teuthology.orchestra.run.smithi070.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-16T22:24:39.886 INFO:teuthology.orchestra.run.smithi070.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-16T22:24:39.886 INFO:teuthology.orchestra.run.smithi070.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-16T22:24:39.886 INFO:teuthology.orchestra.run.smithi070.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-16T22:24:39.886 INFO:teuthology.orchestra.run.smithi070.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-16T22:24:39.886 INFO:teuthology.orchestra.run.smithi070.stdout: libradosstriper1 x86_64 2:19.0.0-3709.g43296076.el9 ceph 497 k 2024-05-16T22:24:39.886 INFO:teuthology.orchestra.run.smithi070.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-16T22:24:39.886 INFO:teuthology.orchestra.run.smithi070.stdout: librgw2 x86_64 2:19.0.0-3709.g43296076.el9 ceph 5.2 M 2024-05-16T22:24:39.886 INFO:teuthology.orchestra.run.smithi070.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-16T22:24:39.886 INFO:teuthology.orchestra.run.smithi070.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-16T22:24:39.887 INFO:teuthology.orchestra.run.smithi070.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-16T22:24:39.887 INFO:teuthology.orchestra.run.smithi070.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-16T22:24:39.887 INFO:teuthology.orchestra.run.smithi070.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-16T22:24:39.887 INFO:teuthology.orchestra.run.smithi070.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-05-16T22:24:39.887 INFO:teuthology.orchestra.run.smithi070.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-16T22:24:39.887 INFO:teuthology.orchestra.run.smithi070.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-16T22:24:39.887 INFO:teuthology.orchestra.run.smithi070.stdout: pam_fscrypt x86_64 0.3.4-2.el9 epel 1.8 M 2024-05-16T22:24:39.887 INFO:teuthology.orchestra.run.smithi070.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-16T22:24:39.887 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-16T22:24:39.887 INFO:teuthology.orchestra.run.smithi070.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-16T22:24:39.887 INFO:teuthology.orchestra.run.smithi070.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-16T22:24:39.887 INFO:teuthology.orchestra.run.smithi070.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-16T22:24:39.887 INFO:teuthology.orchestra.run.smithi070.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-16T22:24:39.887 INFO:teuthology.orchestra.run.smithi070.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-16T22:24:39.887 INFO:teuthology.orchestra.run.smithi070.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-16T22:24:39.888 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-16T22:24:39.888 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-argparse x86_64 2:19.0.0-3709.g43296076.el9 ceph 45 k 2024-05-16T22:24:39.888 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-common x86_64 2:19.0.0-3709.g43296076.el9 ceph 136 k 2024-05-16T22:24:39.888 INFO:teuthology.orchestra.run.smithi070.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-16T22:24:39.888 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-16T22:24:39.888 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-16T22:24:39.888 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-16T22:24:39.888 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-16T22:24:39.888 INFO:teuthology.orchestra.run.smithi070.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-16T22:24:39.888 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-16T22:24:39.888 INFO:teuthology.orchestra.run.smithi070.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-16T22:24:39.888 INFO:teuthology.orchestra.run.smithi070.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-16T22:24:39.888 INFO:teuthology.orchestra.run.smithi070.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-16T22:24:39.888 INFO:teuthology.orchestra.run.smithi070.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-16T22:24:39.889 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-16T22:24:39.889 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-16T22:24:39.889 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-16T22:24:39.889 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-16T22:24:39.889 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-16T22:24:39.889 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-16T22:24:39.889 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-16T22:24:39.889 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-16T22:24:39.889 INFO:teuthology.orchestra.run.smithi070.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-16T22:24:39.889 INFO:teuthology.orchestra.run.smithi070.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-16T22:24:39.889 INFO:teuthology.orchestra.run.smithi070.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-16T22:24:39.889 INFO:teuthology.orchestra.run.smithi070.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-16T22:24:39.889 INFO:teuthology.orchestra.run.smithi070.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-16T22:24:39.890 INFO:teuthology.orchestra.run.smithi070.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-16T22:24:39.890 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-16T22:24:39.890 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-16T22:24:39.890 INFO:teuthology.orchestra.run.smithi070.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-16T22:24:39.890 INFO:teuthology.orchestra.run.smithi070.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-16T22:24:39.890 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-16T22:24:39.890 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-16T22:24:39.890 INFO:teuthology.orchestra.run.smithi070.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-16T22:24:39.890 INFO:teuthology.orchestra.run.smithi070.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-16T22:24:39.890 INFO:teuthology.orchestra.run.smithi070.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-16T22:24:39.890 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-16T22:24:39.890 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-16T22:24:39.890 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-16T22:24:39.891 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-16T22:24:39.891 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-16T22:24:39.891 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-16T22:24:39.891 INFO:teuthology.orchestra.run.smithi070.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-16T22:24:39.891 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-16T22:24:39.891 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-16T22:24:39.891 INFO:teuthology.orchestra.run.smithi070.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-16T22:24:39.891 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-16T22:24:39.891 INFO:teuthology.orchestra.run.smithi070.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-16T22:24:39.891 INFO:teuthology.orchestra.run.smithi070.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-16T22:24:39.891 INFO:teuthology.orchestra.run.smithi070.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-16T22:24:39.891 INFO:teuthology.orchestra.run.smithi070.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-16T22:24:39.891 INFO:teuthology.orchestra.run.smithi070.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-16T22:24:39.891 INFO:teuthology.orchestra.run.smithi070.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-16T22:24:39.892 INFO:teuthology.orchestra.run.smithi070.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-16T22:24:39.892 INFO:teuthology.orchestra.run.smithi070.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-16T22:24:39.892 INFO:teuthology.orchestra.run.smithi070.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-16T22:24:39.892 INFO:teuthology.orchestra.run.smithi070.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-16T22:24:39.892 INFO:teuthology.orchestra.run.smithi070.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-16T22:24:39.892 INFO:teuthology.orchestra.run.smithi070.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-16T22:24:39.892 INFO:teuthology.orchestra.run.smithi070.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-16T22:24:39.892 INFO:teuthology.orchestra.run.smithi070.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-16T22:24:39.892 INFO:teuthology.orchestra.run.smithi070.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-16T22:24:39.892 INFO:teuthology.orchestra.run.smithi070.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-16T22:24:39.892 INFO:teuthology.orchestra.run.smithi070.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-16T22:24:39.892 INFO:teuthology.orchestra.run.smithi070.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-16T22:24:39.892 INFO:teuthology.orchestra.run.smithi070.stdout:Installing weak dependencies: 2024-05-16T22:24:39.892 INFO:teuthology.orchestra.run.smithi070.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-16T22:24:39.893 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-16T22:24:39.893 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-05-16T22:24:39.893 INFO:teuthology.orchestra.run.smithi070.stdout:======================================================================================= 2024-05-16T22:24:39.893 INFO:teuthology.orchestra.run.smithi070.stdout:Install 150 Packages 2024-05-16T22:24:39.893 INFO:teuthology.orchestra.run.smithi070.stdout:Upgrade 8 Packages 2024-05-16T22:24:39.893 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-16T22:24:39.893 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 223 M 2024-05-16T22:24:39.894 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-05-16T22:24:40.432 INFO:teuthology.orchestra.run.smithi044.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-05-16T22:24:41.341 INFO:teuthology.orchestra.run.smithi070.stdout:(1/158): ceph-19.0.0-3709.g43296076.el9.x86_64. 15 kB/s | 6.6 kB 00:00 2024-05-16T22:24:42.758 INFO:teuthology.orchestra.run.smithi070.stdout:(2/158): ceph-base-19.0.0-3709.g43296076.el9.x8 2.9 MB/s | 5.4 MB 00:01 2024-05-16T22:24:42.776 INFO:teuthology.orchestra.run.smithi044.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-16T22:24:42.777 INFO:teuthology.orchestra.run.smithi044.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-16T22:24:42.783 INFO:teuthology.orchestra.run.smithi070.stdout:(3/158): ceph-fuse-19.0.0-3709.g43296076.el9.x8 599 kB/s | 863 kB 00:01 2024-05-16T22:24:42.789 INFO:teuthology.orchestra.run.smithi044.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-16T22:24:42.789 INFO:teuthology.orchestra.run.smithi044.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-16T22:24:42.790 INFO:teuthology.orchestra.run.smithi044.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-16T22:24:42.791 INFO:teuthology.orchestra.run.smithi044.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-16T22:24:42.793 INFO:teuthology.orchestra.run.smithi044.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-16T22:24:42.795 INFO:teuthology.orchestra.run.smithi044.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-16T22:24:42.796 INFO:teuthology.orchestra.run.smithi044.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-16T22:24:42.865 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-05-16T22:24:42.885 INFO:teuthology.orchestra.run.smithi044.stdout:======================================================================================= 2024-05-16T22:24:42.885 INFO:teuthology.orchestra.run.smithi044.stdout: Package Arch Version Repository Size 2024-05-16T22:24:42.885 INFO:teuthology.orchestra.run.smithi044.stdout:======================================================================================= 2024-05-16T22:24:42.885 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2024-05-16T22:24:42.885 INFO:teuthology.orchestra.run.smithi044.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-16T22:24:42.885 INFO:teuthology.orchestra.run.smithi044.stdout: ceph x86_64 2:19.0.0-3709.g43296076.el9 ceph 6.6 k 2024-05-16T22:24:42.885 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-base x86_64 2:19.0.0-3709.g43296076.el9 ceph 5.4 M 2024-05-16T22:24:42.885 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-fuse x86_64 2:19.0.0-3709.g43296076.el9 ceph 863 k 2024-05-16T22:24:42.885 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3709.g43296076.el9 ceph 147 k 2024-05-16T22:24:42.886 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr x86_64 2:19.0.0-3709.g43296076.el9 ceph 1.5 M 2024-05-16T22:24:42.886 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 143 k 2024-05-16T22:24:42.886 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 3.5 M 2024-05-16T22:24:42.886 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 7.4 M 2024-05-16T22:24:42.886 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-rook noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 49 k 2024-05-16T22:24:42.886 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-radosgw x86_64 2:19.0.0-3709.g43296076.el9 ceph 10 M 2024-05-16T22:24:42.886 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-test x86_64 2:19.0.0-3709.g43296076.el9 ceph 43 M 2024-05-16T22:24:42.886 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-volume noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 273 k 2024-05-16T22:24:42.886 INFO:teuthology.orchestra.run.smithi044.stdout: cephadm noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 763 k 2024-05-16T22:24:42.886 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-mirror x86_64 2:19.0.0-3709.g43296076.el9 ceph 224 k 2024-05-16T22:24:42.886 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-shell x86_64 2:19.0.0-3709.g43296076.el9 ceph 27 k 2024-05-16T22:24:42.886 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-top noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 18 k 2024-05-16T22:24:42.887 INFO:teuthology.orchestra.run.smithi044.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-16T22:24:42.887 INFO:teuthology.orchestra.run.smithi044.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-16T22:24:42.887 INFO:teuthology.orchestra.run.smithi044.stdout: fscrypt x86_64 0.3.4-2.el9 epel 2.0 M 2024-05-16T22:24:42.887 INFO:teuthology.orchestra.run.smithi044.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-16T22:24:42.887 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs-devel x86_64 2:19.0.0-3709.g43296076.el9 ceph 32 k 2024-05-16T22:24:42.887 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs2 x86_64 2:19.0.0-3709.g43296076.el9 ceph 756 k 2024-05-16T22:24:42.887 INFO:teuthology.orchestra.run.smithi044.stdout: librados-devel x86_64 2:19.0.0-3709.g43296076.el9 ceph 127 k 2024-05-16T22:24:42.887 INFO:teuthology.orchestra.run.smithi044.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-16T22:24:42.887 INFO:teuthology.orchestra.run.smithi044.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-16T22:24:42.887 INFO:teuthology.orchestra.run.smithi044.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-16T22:24:42.887 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-16T22:24:42.887 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-16T22:24:42.887 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-16T22:24:42.887 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cephfs x86_64 2:19.0.0-3709.g43296076.el9 ceph 162 k 2024-05-16T22:24:42.888 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rados x86_64 2:19.0.0-3709.g43296076.el9 ceph 320 k 2024-05-16T22:24:42.888 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rbd x86_64 2:19.0.0-3709.g43296076.el9 ceph 300 k 2024-05-16T22:24:42.888 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rgw x86_64 2:19.0.0-3709.g43296076.el9 ceph 99 k 2024-05-16T22:24:42.888 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-fuse x86_64 2:19.0.0-3709.g43296076.el9 ceph 86 k 2024-05-16T22:24:42.888 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-mirror x86_64 2:19.0.0-3709.g43296076.el9 ceph 3.0 M 2024-05-16T22:24:42.888 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-nbd x86_64 2:19.0.0-3709.g43296076.el9 ceph 169 k 2024-05-16T22:24:42.888 INFO:teuthology.orchestra.run.smithi044.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-16T22:24:42.888 INFO:teuthology.orchestra.run.smithi044.stdout:Upgrading: 2024-05-16T22:24:42.888 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager x86_64 1:1.47.90-1.el9 baseos 2.3 M 2024-05-16T22:24:42.888 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-libnm x86_64 1:1.47.90-1.el9 baseos 1.8 M 2024-05-16T22:24:42.888 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-team x86_64 1:1.47.90-1.el9 baseos 41 k 2024-05-16T22:24:42.888 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-tui x86_64 1:1.47.90-1.el9 baseos 248 k 2024-05-16T22:24:42.888 INFO:teuthology.orchestra.run.smithi044.stdout: librados2 x86_64 2:19.0.0-3709.g43296076.el9 ceph 3.3 M 2024-05-16T22:24:42.888 INFO:teuthology.orchestra.run.smithi044.stdout: librbd1 x86_64 2:19.0.0-3709.g43296076.el9 ceph 3.1 M 2024-05-16T22:24:42.889 INFO:teuthology.orchestra.run.smithi044.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-16T22:24:42.889 INFO:teuthology.orchestra.run.smithi044.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-16T22:24:42.889 INFO:teuthology.orchestra.run.smithi044.stdout:Installing dependencies: 2024-05-16T22:24:42.889 INFO:teuthology.orchestra.run.smithi044.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-16T22:24:42.889 INFO:teuthology.orchestra.run.smithi044.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-16T22:24:42.889 INFO:teuthology.orchestra.run.smithi044.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-16T22:24:42.889 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-common x86_64 2:19.0.0-3709.g43296076.el9 ceph 20 M 2024-05-16T22:24:42.889 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 34 k 2024-05-16T22:24:42.889 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mds x86_64 2:19.0.0-3709.g43296076.el9 ceph 2.3 M 2024-05-16T22:24:42.889 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 274 k 2024-05-16T22:24:42.889 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mon x86_64 2:19.0.0-3709.g43296076.el9 ceph 4.9 M 2024-05-16T22:24:42.889 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-osd x86_64 2:19.0.0-3709.g43296076.el9 ceph 18 M 2024-05-16T22:24:42.890 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 16 k 2024-05-16T22:24:42.890 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-selinux x86_64 2:19.0.0-3709.g43296076.el9 ceph 25 k 2024-05-16T22:24:42.890 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-16T22:24:42.890 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-16T22:24:42.890 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-16T22:24:42.890 INFO:teuthology.orchestra.run.smithi044.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-16T22:24:42.890 INFO:teuthology.orchestra.run.smithi044.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-16T22:24:42.890 INFO:teuthology.orchestra.run.smithi044.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-16T22:24:42.890 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-16T22:24:42.890 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-16T22:24:42.890 INFO:teuthology.orchestra.run.smithi044.stdout: libcephsqlite x86_64 2:19.0.0-3709.g43296076.el9 ceph 157 k 2024-05-16T22:24:42.890 INFO:teuthology.orchestra.run.smithi044.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-16T22:24:42.890 INFO:teuthology.orchestra.run.smithi044.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-16T22:24:42.891 INFO:teuthology.orchestra.run.smithi044.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-16T22:24:42.891 INFO:teuthology.orchestra.run.smithi044.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-16T22:24:42.891 INFO:teuthology.orchestra.run.smithi044.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-16T22:24:42.891 INFO:teuthology.orchestra.run.smithi044.stdout: libradosstriper1 x86_64 2:19.0.0-3709.g43296076.el9 ceph 497 k 2024-05-16T22:24:42.891 INFO:teuthology.orchestra.run.smithi044.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-16T22:24:42.891 INFO:teuthology.orchestra.run.smithi044.stdout: librgw2 x86_64 2:19.0.0-3709.g43296076.el9 ceph 5.2 M 2024-05-16T22:24:42.891 INFO:teuthology.orchestra.run.smithi044.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-16T22:24:42.891 INFO:teuthology.orchestra.run.smithi044.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-16T22:24:42.891 INFO:teuthology.orchestra.run.smithi044.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-16T22:24:42.891 INFO:teuthology.orchestra.run.smithi044.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-16T22:24:42.891 INFO:teuthology.orchestra.run.smithi044.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-16T22:24:42.891 INFO:teuthology.orchestra.run.smithi044.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-05-16T22:24:42.891 INFO:teuthology.orchestra.run.smithi044.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-16T22:24:42.891 INFO:teuthology.orchestra.run.smithi044.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-16T22:24:42.892 INFO:teuthology.orchestra.run.smithi044.stdout: pam_fscrypt x86_64 0.3.4-2.el9 epel 1.8 M 2024-05-16T22:24:42.892 INFO:teuthology.orchestra.run.smithi044.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-16T22:24:42.892 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-16T22:24:42.892 INFO:teuthology.orchestra.run.smithi044.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-16T22:24:42.892 INFO:teuthology.orchestra.run.smithi044.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-16T22:24:42.892 INFO:teuthology.orchestra.run.smithi044.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-16T22:24:42.892 INFO:teuthology.orchestra.run.smithi044.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-16T22:24:42.892 INFO:teuthology.orchestra.run.smithi044.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-16T22:24:42.892 INFO:teuthology.orchestra.run.smithi044.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-16T22:24:42.892 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-16T22:24:42.892 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-argparse x86_64 2:19.0.0-3709.g43296076.el9 ceph 45 k 2024-05-16T22:24:42.892 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-common x86_64 2:19.0.0-3709.g43296076.el9 ceph 136 k 2024-05-16T22:24:42.893 INFO:teuthology.orchestra.run.smithi044.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-16T22:24:42.893 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-16T22:24:42.893 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-16T22:24:42.893 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-16T22:24:42.893 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-16T22:24:42.893 INFO:teuthology.orchestra.run.smithi044.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-16T22:24:42.893 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-16T22:24:42.893 INFO:teuthology.orchestra.run.smithi044.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-16T22:24:42.893 INFO:teuthology.orchestra.run.smithi044.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-16T22:24:42.893 INFO:teuthology.orchestra.run.smithi044.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-16T22:24:42.893 INFO:teuthology.orchestra.run.smithi044.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-16T22:24:42.893 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-16T22:24:42.893 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-16T22:24:42.893 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-16T22:24:42.893 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-16T22:24:42.894 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-16T22:24:42.894 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-16T22:24:42.894 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-16T22:24:42.894 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-16T22:24:42.894 INFO:teuthology.orchestra.run.smithi044.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-16T22:24:42.894 INFO:teuthology.orchestra.run.smithi044.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-16T22:24:42.894 INFO:teuthology.orchestra.run.smithi044.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-16T22:24:42.894 INFO:teuthology.orchestra.run.smithi044.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-16T22:24:42.894 INFO:teuthology.orchestra.run.smithi044.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-16T22:24:42.894 INFO:teuthology.orchestra.run.smithi044.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-16T22:24:42.894 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-16T22:24:42.894 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-16T22:24:42.895 INFO:teuthology.orchestra.run.smithi044.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-16T22:24:42.895 INFO:teuthology.orchestra.run.smithi044.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-16T22:24:42.895 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-16T22:24:42.895 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-16T22:24:42.895 INFO:teuthology.orchestra.run.smithi044.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-16T22:24:42.895 INFO:teuthology.orchestra.run.smithi044.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-16T22:24:42.895 INFO:teuthology.orchestra.run.smithi044.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-16T22:24:42.895 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-16T22:24:42.895 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-16T22:24:42.895 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-16T22:24:42.895 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-16T22:24:42.895 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-16T22:24:42.895 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-16T22:24:42.895 INFO:teuthology.orchestra.run.smithi044.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-16T22:24:42.895 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-16T22:24:42.896 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-16T22:24:42.896 INFO:teuthology.orchestra.run.smithi044.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-16T22:24:42.896 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-16T22:24:42.896 INFO:teuthology.orchestra.run.smithi044.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-16T22:24:42.896 INFO:teuthology.orchestra.run.smithi044.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-16T22:24:42.896 INFO:teuthology.orchestra.run.smithi044.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-16T22:24:42.896 INFO:teuthology.orchestra.run.smithi044.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-16T22:24:42.896 INFO:teuthology.orchestra.run.smithi044.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-16T22:24:42.896 INFO:teuthology.orchestra.run.smithi044.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-16T22:24:42.896 INFO:teuthology.orchestra.run.smithi044.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-16T22:24:42.896 INFO:teuthology.orchestra.run.smithi044.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-16T22:24:42.896 INFO:teuthology.orchestra.run.smithi044.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-16T22:24:42.896 INFO:teuthology.orchestra.run.smithi044.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-16T22:24:42.896 INFO:teuthology.orchestra.run.smithi044.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-16T22:24:42.897 INFO:teuthology.orchestra.run.smithi044.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-16T22:24:42.897 INFO:teuthology.orchestra.run.smithi044.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-16T22:24:42.897 INFO:teuthology.orchestra.run.smithi044.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-16T22:24:42.897 INFO:teuthology.orchestra.run.smithi044.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-16T22:24:42.897 INFO:teuthology.orchestra.run.smithi044.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-16T22:24:42.897 INFO:teuthology.orchestra.run.smithi044.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-16T22:24:42.897 INFO:teuthology.orchestra.run.smithi044.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-16T22:24:42.897 INFO:teuthology.orchestra.run.smithi044.stdout:Installing weak dependencies: 2024-05-16T22:24:42.897 INFO:teuthology.orchestra.run.smithi044.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-16T22:24:42.897 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:24:42.897 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-05-16T22:24:42.897 INFO:teuthology.orchestra.run.smithi044.stdout:======================================================================================= 2024-05-16T22:24:42.897 INFO:teuthology.orchestra.run.smithi044.stdout:Install 150 Packages 2024-05-16T22:24:42.897 INFO:teuthology.orchestra.run.smithi044.stdout:Upgrade 8 Packages 2024-05-16T22:24:42.897 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:24:42.898 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 223 M 2024-05-16T22:24:42.898 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2024-05-16T22:24:42.950 INFO:teuthology.orchestra.run.smithi070.stdout:(4/158): ceph-immutable-object-cache-19.0.0-370 766 kB/s | 147 kB 00:00 2024-05-16T22:24:43.184 INFO:teuthology.orchestra.run.smithi070.stdout:(5/158): ceph-mgr-19.0.0-3709.g43296076.el9.x86 6.4 MB/s | 1.5 MB 00:00 2024-05-16T22:24:43.667 INFO:teuthology.orchestra.run.smithi070.stdout:(6/158): ceph-common-19.0.0-3709.g43296076.el9. 7.1 MB/s | 20 MB 00:02 2024-05-16T22:24:43.809 INFO:teuthology.orchestra.run.smithi070.stdout:(7/158): ceph-mon-19.0.0-3709.g43296076.el9.x86 7.8 MB/s | 4.9 MB 00:00 2024-05-16T22:24:44.183 INFO:teuthology.orchestra.run.smithi044.stdout:(1/158): ceph-19.0.0-3709.g43296076.el9.x86_64. 20 kB/s | 6.6 kB 00:00 2024-05-16T22:24:44.309 INFO:teuthology.orchestra.run.smithi070.stdout:(8/158): ceph-mds-19.0.0-3709.g43296076.el9.x86 1.5 MB/s | 2.3 MB 00:01 2024-05-16T22:24:44.526 INFO:teuthology.orchestra.run.smithi070.stdout:(9/158): ceph-selinux-19.0.0-3709.g43296076.el9 116 kB/s | 25 kB 00:00 2024-05-16T22:24:44.952 INFO:teuthology.orchestra.run.smithi070.stdout:(10/158): ceph-osd-19.0.0-3709.g43296076.el9.x8 14 MB/s | 18 MB 00:01 2024-05-16T22:24:45.060 INFO:teuthology.orchestra.run.smithi070.stdout:(11/158): ceph-radosgw-19.0.0-3709.g43296076.el 8.1 MB/s | 10 MB 00:01 2024-05-16T22:24:45.085 INFO:teuthology.orchestra.run.smithi070.stdout:(12/158): cephfs-mirror-19.0.0-3709.g43296076.e 1.6 MB/s | 224 kB 00:00 2024-05-16T22:24:45.110 INFO:teuthology.orchestra.run.smithi070.stdout:(13/158): cephfs-shell-19.0.0-3709.g43296076.el 540 kB/s | 27 kB 00:00 2024-05-16T22:24:45.136 INFO:teuthology.orchestra.run.smithi070.stdout:(14/158): libcephfs-devel-19.0.0-3709.g43296076 633 kB/s | 32 kB 00:00 2024-05-16T22:24:45.187 INFO:teuthology.orchestra.run.smithi070.stdout:(15/158): libcephsqlite-19.0.0-3709.g43296076.e 3.1 MB/s | 157 kB 00:00 2024-05-16T22:24:45.220 INFO:teuthology.orchestra.run.smithi070.stdout:(16/158): libcephfs2-19.0.0-3709.g43296076.el9. 6.8 MB/s | 756 kB 00:00 2024-05-16T22:24:45.245 INFO:teuthology.orchestra.run.smithi070.stdout:(17/158): librados-devel-19.0.0-3709.g43296076. 2.1 MB/s | 127 kB 00:00 2024-05-16T22:24:45.320 INFO:teuthology.orchestra.run.smithi070.stdout:(18/158): libradosstriper1-19.0.0-3709.g4329607 4.9 MB/s | 497 kB 00:00 2024-05-16T22:24:45.412 INFO:teuthology.orchestra.run.smithi070.stdout:(19/158): python3-ceph-argparse-19.0.0-3709.g43 492 kB/s | 45 kB 00:00 2024-05-16T22:24:45.431 INFO:teuthology.orchestra.run.smithi196.stdout:Extra Packages for Enterprise Linux 2.3 MB/s | 21 MB 00:08 2024-05-16T22:24:45.512 INFO:teuthology.orchestra.run.smithi070.stdout:(20/158): python3-ceph-common-19.0.0-3709.g4329 1.3 MB/s | 136 kB 00:00 2024-05-16T22:24:45.596 INFO:teuthology.orchestra.run.smithi070.stdout:(21/158): librgw2-19.0.0-3709.g43296076.el9.x86 15 MB/s | 5.2 MB 00:00 2024-05-16T22:24:45.621 INFO:teuthology.orchestra.run.smithi070.stdout:(22/158): python3-cephfs-19.0.0-3709.g43296076. 1.5 MB/s | 162 kB 00:00 2024-05-16T22:24:45.646 INFO:teuthology.orchestra.run.smithi070.stdout:(23/158): python3-rados-19.0.0-3709.g43296076.e 6.2 MB/s | 320 kB 00:00 2024-05-16T22:24:45.680 INFO:teuthology.orchestra.run.smithi070.stdout:(24/158): python3-rbd-19.0.0-3709.g43296076.el9 5.0 MB/s | 300 kB 00:00 2024-05-16T22:24:45.706 INFO:teuthology.orchestra.run.smithi070.stdout:(25/158): python3-rgw-19.0.0-3709.g43296076.el9 1.7 MB/s | 99 kB 00:00 2024-05-16T22:24:45.725 INFO:teuthology.orchestra.run.smithi044.stdout:(2/158): ceph-fuse-19.0.0-3709.g43296076.el9.x8 560 kB/s | 863 kB 00:01 2024-05-16T22:24:45.731 INFO:teuthology.orchestra.run.smithi070.stdout:(26/158): rbd-fuse-19.0.0-3709.g43296076.el9.x8 1.7 MB/s | 86 kB 00:00 2024-05-16T22:24:45.884 INFO:teuthology.orchestra.run.smithi044.stdout:(3/158): ceph-immutable-object-cache-19.0.0-370 928 kB/s | 147 kB 00:00 2024-05-16T22:24:45.990 INFO:teuthology.orchestra.run.smithi070.stdout:(27/158): rbd-mirror-19.0.0-3709.g43296076.el9. 11 MB/s | 3.0 MB 00:00 2024-05-16T22:24:46.015 INFO:teuthology.orchestra.run.smithi070.stdout:(28/158): rbd-nbd-19.0.0-3709.g43296076.el9.x86 597 kB/s | 169 kB 00:00 2024-05-16T22:24:46.040 INFO:teuthology.orchestra.run.smithi070.stdout:(29/158): ceph-grafana-dashboards-19.0.0-3709.g 684 kB/s | 34 kB 00:00 2024-05-16T22:24:46.065 INFO:teuthology.orchestra.run.smithi070.stdout:(30/158): ceph-mgr-cephadm-19.0.0-3709.g4329607 2.8 MB/s | 143 kB 00:00 2024-05-16T22:24:46.324 INFO:teuthology.orchestra.run.smithi070.stdout:(31/158): ceph-mgr-dashboard-19.0.0-3709.g43296 12 MB/s | 3.5 MB 00:00 2024-05-16T22:24:46.416 INFO:teuthology.orchestra.run.smithi070.stdout:(32/158): ceph-mgr-modules-core-19.0.0-3709.g43 2.9 MB/s | 274 kB 00:00 2024-05-16T22:24:46.483 INFO:teuthology.orchestra.run.smithi070.stdout:(33/158): ceph-mgr-rook-19.0.0-3709.g43296076.e 741 kB/s | 49 kB 00:00 2024-05-16T22:24:46.550 INFO:teuthology.orchestra.run.smithi070.stdout:(34/158): ceph-prometheus-alerts-19.0.0-3709.g4 247 kB/s | 16 kB 00:00 2024-05-16T22:24:46.667 INFO:teuthology.orchestra.run.smithi070.stdout:(35/158): ceph-volume-19.0.0-3709.g43296076.el9 2.3 MB/s | 273 kB 00:00 2024-05-16T22:24:46.775 INFO:teuthology.orchestra.run.smithi070.stdout:(36/158): cephadm-19.0.0-3709.g43296076.el9.noa 6.9 MB/s | 763 kB 00:00 2024-05-16T22:24:46.843 INFO:teuthology.orchestra.run.smithi070.stdout:(37/158): cephfs-top-19.0.0-3709.g43296076.el9. 274 kB/s | 18 kB 00:00 2024-05-16T22:24:47.010 INFO:teuthology.orchestra.run.smithi070.stdout:(38/158): ceph-mgr-diskprediction-local-19.0.0- 7.9 MB/s | 7.4 MB 00:00 2024-05-16T22:24:47.035 INFO:teuthology.orchestra.run.smithi070.stdout:(39/158): fuse-2.9.9-15.el9.x86_64.rpm 419 kB/s | 80 kB 00:00 2024-05-16T22:24:47.134 INFO:teuthology.orchestra.run.smithi044.stdout:(4/158): ceph-mds-19.0.0-3709.g43296076.el9.x86 1.8 MB/s | 2.3 MB 00:01 2024-05-16T22:24:47.151 INFO:teuthology.orchestra.run.smithi070.stdout:(40/158): libquadmath-11.4.1-3.el9.x86_64.rpm 1.6 MB/s | 195 kB 00:00 2024-05-16T22:24:47.260 INFO:teuthology.orchestra.run.smithi070.stdout:(41/158): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-05-16T22:24:47.302 INFO:teuthology.orchestra.run.smithi070.stdout:(42/158): libgfortran-11.4.1-3.el9.x86_64.rpm 2.7 MB/s | 803 kB 00:00 2024-05-16T22:24:47.361 INFO:teuthology.orchestra.run.smithi070.stdout:(43/158): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-05-16T22:24:47.400 INFO:teuthology.orchestra.run.smithi044.stdout:(5/158): ceph-common-19.0.0-3709.g43296076.el9. 5.5 MB/s | 20 MB 00:03 2024-05-16T22:24:47.402 INFO:teuthology.orchestra.run.smithi070.stdout:(44/158): python3-cryptography-36.0.1-4.el9.x86 8.6 MB/s | 1.2 MB 00:00 2024-05-16T22:24:47.428 INFO:teuthology.orchestra.run.smithi070.stdout:(45/158): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-05-16T22:24:47.462 INFO:teuthology.orchestra.run.smithi070.stdout:(46/158): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-05-16T22:24:47.487 INFO:teuthology.orchestra.run.smithi070.stdout:(47/158): python3-urllib3-1.26.5-5.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-05-16T22:24:47.509 INFO:teuthology.orchestra.run.smithi044.stdout:(6/158): ceph-base-19.0.0-3709.g43296076.el9.x8 1.5 MB/s | 5.4 MB 00:03 2024-05-16T22:24:47.710 INFO:teuthology.orchestra.run.smithi044.stdout:(7/158): ceph-mon-19.0.0-3709.g43296076.el9.x86 16 MB/s | 4.9 MB 00:00 2024-05-16T22:24:47.743 INFO:teuthology.orchestra.run.smithi044.stdout:(8/158): ceph-mgr-19.0.0-3709.g43296076.el9.x86 2.5 MB/s | 1.5 MB 00:00 2024-05-16T22:24:47.827 INFO:teuthology.orchestra.run.smithi044.stdout:(9/158): ceph-selinux-19.0.0-3709.g43296076.el9 303 kB/s | 25 kB 00:00 2024-05-16T22:24:48.360 INFO:teuthology.orchestra.run.smithi044.stdout:(10/158): ceph-radosgw-19.0.0-3709.g43296076.el 16 MB/s | 10 MB 00:00 2024-05-16T22:24:48.379 INFO:teuthology.orchestra.run.smithi070.stdout:(48/158): automake-1.16.2-8.el9.noarch.rpm 752 kB/s | 689 kB 00:00 2024-05-16T22:24:48.446 INFO:teuthology.orchestra.run.smithi070.stdout:(49/158): bison-3.7.4-5.el9.x86_64.rpm 984 kB/s | 943 kB 00:00 2024-05-16T22:24:48.453 INFO:teuthology.orchestra.run.smithi044.stdout:(11/158): cephfs-mirror-19.0.0-3709.g43296076.e 2.4 MB/s | 224 kB 00:00 2024-05-16T22:24:48.519 INFO:teuthology.orchestra.run.smithi044.stdout:(12/158): cephfs-shell-19.0.0-3709.g43296076.el 407 kB/s | 27 kB 00:00 2024-05-16T22:24:48.578 INFO:teuthology.orchestra.run.smithi044.stdout:(13/158): libcephfs-devel-19.0.0-3709.g43296076 544 kB/s | 32 kB 00:00 2024-05-16T22:24:48.770 INFO:teuthology.orchestra.run.smithi044.stdout:(14/158): libcephfs2-19.0.0-3709.g43296076.el9. 3.9 MB/s | 756 kB 00:00 2024-05-16T22:24:48.837 INFO:teuthology.orchestra.run.smithi044.stdout:(15/158): libcephsqlite-19.0.0-3709.g43296076.e 2.3 MB/s | 157 kB 00:00 2024-05-16T22:24:48.904 INFO:teuthology.orchestra.run.smithi044.stdout:(16/158): librados-devel-19.0.0-3709.g43296076. 1.9 MB/s | 127 kB 00:00 2024-05-16T22:24:49.012 INFO:teuthology.orchestra.run.smithi070.stdout:(50/158): elfutils-libelf-devel-0.190-2.el9.x86 38 kB/s | 21 kB 00:00 2024-05-16T22:24:49.079 INFO:teuthology.orchestra.run.smithi044.stdout:(17/158): libradosstriper1-19.0.0-3709.g4329607 2.8 MB/s | 497 kB 00:00 2024-05-16T22:24:49.088 INFO:teuthology.orchestra.run.smithi070.stdout:(51/158): boost-program-options-1.75.0-8.el9.x8 151 kB/s | 107 kB 00:00 2024-05-16T22:24:49.496 INFO:teuthology.orchestra.run.smithi044.stdout:(18/158): ceph-osd-19.0.0-3709.g43296076.el9.x8 8.9 MB/s | 18 MB 00:01 2024-05-16T22:24:49.621 INFO:teuthology.orchestra.run.smithi044.stdout:(19/158): python3-ceph-argparse-19.0.0-3709.g43 361 kB/s | 45 kB 00:00 2024-05-16T22:24:49.730 INFO:teuthology.orchestra.run.smithi044.stdout:(20/158): python3-ceph-common-19.0.0-3709.g4329 1.2 MB/s | 136 kB 00:00 2024-05-16T22:24:49.730 INFO:teuthology.orchestra.run.smithi070.stdout:(52/158): flexiblas-3.0.4-8.el9.x86_64.rpm 51 kB/s | 33 kB 00:00 2024-05-16T22:24:49.830 INFO:teuthology.orchestra.run.smithi044.stdout:(21/158): python3-cephfs-19.0.0-3709.g43296076. 1.6 MB/s | 162 kB 00:00 2024-05-16T22:24:49.931 INFO:teuthology.orchestra.run.smithi044.stdout:(22/158): librgw2-19.0.0-3709.g43296076.el9.x86 6.1 MB/s | 5.2 MB 00:00 2024-05-16T22:24:49.955 INFO:teuthology.orchestra.run.smithi070.stdout:(53/158): flex-2.6.4-9.el9.x86_64.rpm 333 kB/s | 313 kB 00:00 2024-05-16T22:24:49.956 INFO:teuthology.orchestra.run.smithi044.stdout:(23/158): python3-rados-19.0.0-3709.g43296076.e 2.5 MB/s | 320 kB 00:00 2024-05-16T22:24:49.998 INFO:teuthology.orchestra.run.smithi044.stdout:(24/158): python3-rbd-19.0.0-3709.g43296076.el9 4.4 MB/s | 300 kB 00:00 2024-05-16T22:24:50.065 INFO:teuthology.orchestra.run.smithi044.stdout:(25/158): python3-rgw-19.0.0-3709.g43296076.el9 915 kB/s | 99 kB 00:00 2024-05-16T22:24:50.090 INFO:teuthology.orchestra.run.smithi044.stdout:(26/158): rbd-fuse-19.0.0-3709.g43296076.el9.x8 938 kB/s | 86 kB 00:00 2024-05-16T22:24:50.165 INFO:teuthology.orchestra.run.smithi044.stdout:(27/158): rbd-nbd-19.0.0-3709.g43296076.el9.x86 2.2 MB/s | 169 kB 00:00 2024-05-16T22:24:50.266 INFO:teuthology.orchestra.run.smithi044.stdout:(28/158): ceph-grafana-dashboards-19.0.0-3709.g 342 kB/s | 34 kB 00:00 2024-05-16T22:24:50.332 INFO:teuthology.orchestra.run.smithi044.stdout:(29/158): ceph-mgr-cephadm-19.0.0-3709.g4329607 2.1 MB/s | 143 kB 00:00 2024-05-16T22:24:50.424 INFO:teuthology.orchestra.run.smithi044.stdout:(30/158): rbd-mirror-19.0.0-3709.g43296076.el9. 8.5 MB/s | 3.0 MB 00:00 2024-05-16T22:24:50.655 INFO:teuthology.orchestra.run.smithi070.stdout:(54/158): flexiblas-openblas-openmp-3.0.4-8.el9 26 kB/s | 18 kB 00:00 2024-05-16T22:24:50.733 INFO:teuthology.orchestra.run.smithi044.stdout:(31/158): ceph-mgr-dashboard-19.0.0-3709.g43296 8.8 MB/s | 3.5 MB 00:00 2024-05-16T22:24:50.792 INFO:teuthology.orchestra.run.smithi044.stdout:(32/158): ceph-mgr-modules-core-19.0.0-3709.g43 4.6 MB/s | 274 kB 00:00 2024-05-16T22:24:50.850 INFO:teuthology.orchestra.run.smithi044.stdout:(33/158): ceph-mgr-rook-19.0.0-3709.g43296076.e 845 kB/s | 49 kB 00:00 2024-05-16T22:24:50.917 INFO:teuthology.orchestra.run.smithi044.stdout:(34/158): ceph-prometheus-alerts-19.0.0-3709.g4 247 kB/s | 16 kB 00:00 2024-05-16T22:24:50.993 INFO:teuthology.orchestra.run.smithi044.stdout:(35/158): ceph-volume-19.0.0-3709.g43296076.el9 3.6 MB/s | 273 kB 00:00 2024-05-16T22:24:51.089 INFO:teuthology.orchestra.run.smithi070.stdout:(55/158): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.2 MB/s | 3.0 MB 00:01 2024-05-16T22:24:51.127 INFO:teuthology.orchestra.run.smithi044.stdout:(36/158): cephadm-19.0.0-3709.g43296076.el9.noa 5.6 MB/s | 763 kB 00:00 2024-05-16T22:24:51.206 INFO:teuthology.orchestra.run.smithi070.stdout:(56/158): libaio-devel-0.3.111-13.el9.x86_64.rp 20 kB/s | 11 kB 00:00 2024-05-16T22:24:51.252 INFO:teuthology.orchestra.run.smithi044.stdout:(37/158): cephfs-top-19.0.0-3709.g43296076.el9. 146 kB/s | 18 kB 00:00 2024-05-16T22:24:51.386 INFO:teuthology.orchestra.run.smithi044.stdout:(38/158): ceph-mgr-diskprediction-local-19.0.0- 7.7 MB/s | 7.4 MB 00:00 2024-05-16T22:24:51.436 INFO:teuthology.orchestra.run.smithi044.stdout:(39/158): fuse-2.9.9-15.el9.x86_64.rpm 438 kB/s | 80 kB 00:00 2024-05-16T22:24:51.544 INFO:teuthology.orchestra.run.smithi044.stdout:(40/158): libquadmath-11.4.1-3.el9.x86_64.rpm 1.8 MB/s | 195 kB 00:00 2024-05-16T22:24:51.572 INFO:teuthology.orchestra.run.smithi196.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-05-16T22:24:51.653 INFO:teuthology.orchestra.run.smithi044.stdout:(41/158): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-05-16T22:24:51.848 INFO:teuthology.orchestra.run.smithi070.stdout:(57/158): libpmemobj-1.12.1-1.el9.x86_64.rpm 211 kB/s | 160 kB 00:00 2024-05-16T22:24:51.873 INFO:teuthology.orchestra.run.smithi070.stdout:(58/158): librabbitmq-0.11.0-7.el9.x86_64.rpm 68 kB/s | 45 kB 00:00 2024-05-16T22:24:52.045 INFO:teuthology.orchestra.run.smithi044.stdout:(42/158): ceph-test-19.0.0-3709.g43296076.el9.x 10 MB/s | 43 MB 00:04 2024-05-16T22:24:52.079 INFO:teuthology.orchestra.run.smithi044.stdout:(43/158): libgfortran-11.4.1-3.el9.x86_64.rpm 1.1 MB/s | 803 kB 00:00 2024-05-16T22:24:52.162 INFO:teuthology.orchestra.run.smithi044.stdout:(44/158): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-05-16T22:24:52.187 INFO:teuthology.orchestra.run.smithi044.stdout:(45/158): python3-ply-3.11-14.el9.noarch.rpm 751 kB/s | 106 kB 00:00 2024-05-16T22:24:52.230 INFO:teuthology.orchestra.run.smithi044.stdout:(46/158): python3-cryptography-36.0.1-4.el9.x86 2.1 MB/s | 1.2 MB 00:00 2024-05-16T22:24:52.255 INFO:teuthology.orchestra.run.smithi044.stdout:(47/158): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-05-16T22:24:52.280 INFO:teuthology.orchestra.run.smithi044.stdout:(48/158): python3-urllib3-1.26.5-5.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-05-16T22:24:52.422 INFO:teuthology.orchestra.run.smithi044.stdout:(49/158): boost-program-options-1.75.0-8.el9.x8 755 kB/s | 107 kB 00:00 2024-05-16T22:24:52.455 INFO:teuthology.orchestra.run.smithi044.stdout:(50/158): automake-1.16.2-8.el9.noarch.rpm 3.0 MB/s | 689 kB 00:00 2024-05-16T22:24:52.472 INFO:teuthology.orchestra.run.smithi044.stdout:(51/158): elfutils-libelf-devel-0.190-2.el9.x86 429 kB/s | 21 kB 00:00 2024-05-16T22:24:52.514 INFO:teuthology.orchestra.run.smithi044.stdout:(52/158): bison-3.7.4-5.el9.x86_64.rpm 3.6 MB/s | 943 kB 00:00 2024-05-16T22:24:52.531 INFO:teuthology.orchestra.run.smithi044.stdout:(53/158): flexiblas-3.0.4-8.el9.x86_64.rpm 560 kB/s | 33 kB 00:00 2024-05-16T22:24:52.565 INFO:teuthology.orchestra.run.smithi044.stdout:(54/158): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-05-16T22:24:52.590 INFO:teuthology.orchestra.run.smithi044.stdout:(55/158): flexiblas-openblas-openmp-3.0.4-8.el9 310 kB/s | 18 kB 00:00 2024-05-16T22:24:52.615 INFO:teuthology.orchestra.run.smithi044.stdout:(56/158): libaio-devel-0.3.111-13.el9.x86_64.rp 223 kB/s | 11 kB 00:00 2024-05-16T22:24:52.657 INFO:teuthology.orchestra.run.smithi044.stdout:(57/158): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-05-16T22:24:52.682 INFO:teuthology.orchestra.run.smithi044.stdout:(58/158): librabbitmq-0.11.0-7.el9.x86_64.rpm 676 kB/s | 45 kB 00:00 2024-05-16T22:24:52.741 INFO:teuthology.orchestra.run.smithi044.stdout:(59/158): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2024-05-16T22:24:52.765 INFO:teuthology.orchestra.run.smithi070.stdout:(59/158): librdkafka-1.6.1-102.el9.x86_64.rpm 723 kB/s | 662 kB 00:00 2024-05-16T22:24:52.767 INFO:teuthology.orchestra.run.smithi044.stdout:(60/158): librdkafka-1.6.1-102.el9.x86_64.rpm 6.0 MB/s | 662 kB 00:00 2024-05-16T22:24:52.792 INFO:teuthology.orchestra.run.smithi044.stdout:(61/158): libuuid-devel-2.37.4-18.el9.x86_64.rp 507 kB/s | 25 kB 00:00 2024-05-16T22:24:52.798 INFO:teuthology.orchestra.run.smithi070.stdout:(60/158): libtool-2.4.6-45.el9.x86_64.rpm 629 kB/s | 582 kB 00:00 2024-05-16T22:24:52.817 INFO:teuthology.orchestra.run.smithi044.stdout:(62/158): libzstd-devel-1.5.1-2.el9.x86_64.rpm 942 kB/s | 47 kB 00:00 2024-05-16T22:24:52.843 INFO:teuthology.orchestra.run.smithi044.stdout:(63/158): libtool-2.4.6-45.el9.x86_64.rpm 3.6 MB/s | 582 kB 00:00 2024-05-16T22:24:52.876 INFO:teuthology.orchestra.run.smithi044.stdout:(64/158): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-05-16T22:24:52.901 INFO:teuthology.orchestra.run.smithi044.stdout:(65/158): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-05-16T22:24:52.927 INFO:teuthology.orchestra.run.smithi044.stdout:(66/158): openblas-0.3.21-2.el9.x86_64.rpm 420 kB/s | 35 kB 00:00 2024-05-16T22:24:53.036 INFO:teuthology.orchestra.run.smithi044.stdout:(67/158): openblas-openmp-0.3.21-2.el9.x86_64.r 30 MB/s | 4.7 MB 00:00 2024-05-16T22:24:53.077 INFO:teuthology.orchestra.run.smithi044.stdout:(68/158): postgresql-13.14-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-05-16T22:24:53.119 INFO:teuthology.orchestra.run.smithi044.stdout:(69/158): postgresql-contrib-13.14-1.el9.x86_64 11 MB/s | 911 kB 00:00 2024-05-16T22:24:53.145 INFO:teuthology.orchestra.run.smithi044.stdout:(70/158): postgresql-private-libs-13.14-1.el9.x 1.9 MB/s | 133 kB 00:00 2024-05-16T22:24:53.220 INFO:teuthology.orchestra.run.smithi044.stdout:(71/158): openssl-devel-3.2.1-1.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-05-16T22:24:53.262 INFO:teuthology.orchestra.run.smithi044.stdout:(72/158): protobuf-3.14.0-13.el9.x86_64.rpm 8.7 MB/s | 1.0 MB 00:00 2024-05-16T22:24:53.287 INFO:teuthology.orchestra.run.smithi044.stdout:(73/158): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-05-16T22:24:53.371 INFO:teuthology.orchestra.run.smithi044.stdout:(74/158): postgresql-server-13.14-1.el9.x86_64. 23 MB/s | 5.8 MB 00:00 2024-05-16T22:24:53.396 INFO:teuthology.orchestra.run.smithi044.stdout:(75/158): python3-devel-3.9.18-3.el9.x86_64.rpm 2.2 MB/s | 244 kB 00:00 2024-05-16T22:24:53.415 INFO:teuthology.orchestra.run.smithi070.stdout:(61/158): libuuid-devel-2.37.4-18.el9.x86_64.rp 39 kB/s | 25 kB 00:00 2024-05-16T22:24:53.421 INFO:teuthology.orchestra.run.smithi044.stdout:(76/158): python3-jinja2-2.11.3-5.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-05-16T22:24:53.446 INFO:teuthology.orchestra.run.smithi044.stdout:(77/158): python3-jsonpatch-1.21-16.el9.noarch. 511 kB/s | 26 kB 00:00 2024-05-16T22:24:53.472 INFO:teuthology.orchestra.run.smithi044.stdout:(78/158): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-05-16T22:24:53.474 INFO:teuthology.orchestra.run.smithi070.stdout:(62/158): libzstd-devel-1.5.1-2.el9.x86_64.rpm 70 kB/s | 47 kB 00:00 2024-05-16T22:24:53.497 INFO:teuthology.orchestra.run.smithi044.stdout:(79/158): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-05-16T22:24:53.522 INFO:teuthology.orchestra.run.smithi044.stdout:(80/158): python3-markupsafe-1.1.1-12.el9.x86_6 692 kB/s | 35 kB 00:00 2024-05-16T22:24:53.614 INFO:teuthology.orchestra.run.smithi044.stdout:(81/158): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-05-16T22:24:53.640 INFO:teuthology.orchestra.run.smithi044.stdout:(82/158): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-05-16T22:24:53.673 INFO:teuthology.orchestra.run.smithi044.stdout:(83/158): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-05-16T22:24:53.698 INFO:teuthology.orchestra.run.smithi044.stdout:(84/158): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-05-16T22:24:53.715 INFO:teuthology.orchestra.run.smithi044.stdout:(85/158): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-05-16T22:24:53.749 INFO:teuthology.orchestra.run.smithi044.stdout:(86/158): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-05-16T22:24:53.774 INFO:teuthology.orchestra.run.smithi044.stdout:(87/158): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-05-16T22:24:53.808 INFO:teuthology.orchestra.run.smithi044.stdout:(88/158): python3-pyasn1-modules-0.4.8-6.el9.no 4.6 MB/s | 279 kB 00:00 2024-05-16T22:24:53.825 INFO:teuthology.orchestra.run.smithi044.stdout:(89/158): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-05-16T22:24:53.896 INFO:teuthology.orchestra.run.smithi044.stdout:(90/158): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 5.1 MB 00:00 2024-05-16T22:24:53.926 INFO:teuthology.orchestra.run.smithi044.stdout:(91/158): python3-requests-oauthlib-1.3.0-12.el 456 kB/s | 54 kB 00:00 2024-05-16T22:24:53.951 INFO:teuthology.orchestra.run.smithi044.stdout:(92/158): python3-toml-0.10.2-6.el9.noarch.rpm 760 kB/s | 42 kB 00:00 2024-05-16T22:24:53.968 INFO:teuthology.orchestra.run.smithi044.stdout:(93/158): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 44 kB 00:00 2024-05-16T22:24:54.002 INFO:teuthology.orchestra.run.smithi044.stdout:(94/158): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-05-16T22:24:54.027 INFO:teuthology.orchestra.run.smithi044.stdout:(95/158): qatlib-service-24.02.0-1.el9.x86_64.r 612 kB/s | 36 kB 00:00 2024-05-16T22:24:54.044 INFO:teuthology.orchestra.run.smithi044.stdout:(96/158): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-05-16T22:24:54.089 INFO:teuthology.orchestra.run.smithi196.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-16T22:24:54.091 INFO:teuthology.orchestra.run.smithi196.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-16T22:24:54.102 INFO:teuthology.orchestra.run.smithi044.stdout:(97/158): socat-1.7.4.1-5.el9.x86_64.rpm 4.0 MB/s | 305 kB 00:00 2024-05-16T22:24:54.111 INFO:teuthology.orchestra.run.smithi196.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-16T22:24:54.112 INFO:teuthology.orchestra.run.smithi196.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-16T22:24:54.113 INFO:teuthology.orchestra.run.smithi196.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-16T22:24:54.115 INFO:teuthology.orchestra.run.smithi196.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-16T22:24:54.117 INFO:teuthology.orchestra.run.smithi196.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-16T22:24:54.119 INFO:teuthology.orchestra.run.smithi044.stdout:(98/158): uuid-1.6.2-55.el9.x86_64.rpm 769 kB/s | 58 kB 00:00 2024-05-16T22:24:54.120 INFO:teuthology.orchestra.run.smithi196.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-16T22:24:54.121 INFO:teuthology.orchestra.run.smithi196.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-16T22:24:54.153 INFO:teuthology.orchestra.run.smithi044.stdout:(99/158): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.8 MB/s | 94 kB 00:00 2024-05-16T22:24:54.170 INFO:teuthology.orchestra.run.smithi044.stdout:(100/158): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-05-16T22:24:54.191 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2024-05-16T22:24:54.195 INFO:teuthology.orchestra.run.smithi044.stdout:(101/158): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.0 MB/s | 45 kB 00:00 2024-05-16T22:24:54.226 INFO:teuthology.orchestra.run.smithi196.stdout:======================================================================================= 2024-05-16T22:24:54.226 INFO:teuthology.orchestra.run.smithi196.stdout: Package Arch Version Repository Size 2024-05-16T22:24:54.226 INFO:teuthology.orchestra.run.smithi196.stdout:======================================================================================= 2024-05-16T22:24:54.226 INFO:teuthology.orchestra.run.smithi196.stdout:Installing: 2024-05-16T22:24:54.226 INFO:teuthology.orchestra.run.smithi196.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-16T22:24:54.227 INFO:teuthology.orchestra.run.smithi196.stdout: ceph x86_64 2:19.0.0-3709.g43296076.el9 ceph 6.6 k 2024-05-16T22:24:54.227 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-base x86_64 2:19.0.0-3709.g43296076.el9 ceph 5.4 M 2024-05-16T22:24:54.227 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-fuse x86_64 2:19.0.0-3709.g43296076.el9 ceph 863 k 2024-05-16T22:24:54.227 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3709.g43296076.el9 ceph 147 k 2024-05-16T22:24:54.227 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr x86_64 2:19.0.0-3709.g43296076.el9 ceph 1.5 M 2024-05-16T22:24:54.227 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 143 k 2024-05-16T22:24:54.227 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 3.5 M 2024-05-16T22:24:54.227 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 7.4 M 2024-05-16T22:24:54.227 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-rook noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 49 k 2024-05-16T22:24:54.227 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-radosgw x86_64 2:19.0.0-3709.g43296076.el9 ceph 10 M 2024-05-16T22:24:54.227 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-test x86_64 2:19.0.0-3709.g43296076.el9 ceph 43 M 2024-05-16T22:24:54.227 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-volume noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 273 k 2024-05-16T22:24:54.227 INFO:teuthology.orchestra.run.smithi196.stdout: cephadm noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 763 k 2024-05-16T22:24:54.228 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-mirror x86_64 2:19.0.0-3709.g43296076.el9 ceph 224 k 2024-05-16T22:24:54.228 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-shell x86_64 2:19.0.0-3709.g43296076.el9 ceph 27 k 2024-05-16T22:24:54.228 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-top noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 18 k 2024-05-16T22:24:54.228 INFO:teuthology.orchestra.run.smithi196.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-16T22:24:54.228 INFO:teuthology.orchestra.run.smithi196.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-16T22:24:54.228 INFO:teuthology.orchestra.run.smithi196.stdout: fscrypt x86_64 0.3.4-2.el9 epel 2.0 M 2024-05-16T22:24:54.228 INFO:teuthology.orchestra.run.smithi196.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-16T22:24:54.228 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs-devel x86_64 2:19.0.0-3709.g43296076.el9 ceph 32 k 2024-05-16T22:24:54.228 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs2 x86_64 2:19.0.0-3709.g43296076.el9 ceph 756 k 2024-05-16T22:24:54.228 INFO:teuthology.orchestra.run.smithi196.stdout: librados-devel x86_64 2:19.0.0-3709.g43296076.el9 ceph 127 k 2024-05-16T22:24:54.228 INFO:teuthology.orchestra.run.smithi196.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-16T22:24:54.229 INFO:teuthology.orchestra.run.smithi196.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-16T22:24:54.229 INFO:teuthology.orchestra.run.smithi196.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-16T22:24:54.229 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-16T22:24:54.229 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-16T22:24:54.229 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-16T22:24:54.229 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cephfs x86_64 2:19.0.0-3709.g43296076.el9 ceph 162 k 2024-05-16T22:24:54.229 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rados x86_64 2:19.0.0-3709.g43296076.el9 ceph 320 k 2024-05-16T22:24:54.229 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rbd x86_64 2:19.0.0-3709.g43296076.el9 ceph 300 k 2024-05-16T22:24:54.229 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rgw x86_64 2:19.0.0-3709.g43296076.el9 ceph 99 k 2024-05-16T22:24:54.229 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-fuse x86_64 2:19.0.0-3709.g43296076.el9 ceph 86 k 2024-05-16T22:24:54.230 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-mirror x86_64 2:19.0.0-3709.g43296076.el9 ceph 3.0 M 2024-05-16T22:24:54.230 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-nbd x86_64 2:19.0.0-3709.g43296076.el9 ceph 169 k 2024-05-16T22:24:54.230 INFO:teuthology.orchestra.run.smithi196.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-16T22:24:54.230 INFO:teuthology.orchestra.run.smithi196.stdout:Upgrading: 2024-05-16T22:24:54.230 INFO:teuthology.orchestra.run.smithi196.stdout: NetworkManager x86_64 1:1.47.90-1.el9 baseos 2.3 M 2024-05-16T22:24:54.230 INFO:teuthology.orchestra.run.smithi196.stdout: NetworkManager-libnm x86_64 1:1.47.90-1.el9 baseos 1.8 M 2024-05-16T22:24:54.230 INFO:teuthology.orchestra.run.smithi196.stdout: NetworkManager-team x86_64 1:1.47.90-1.el9 baseos 41 k 2024-05-16T22:24:54.230 INFO:teuthology.orchestra.run.smithi196.stdout: NetworkManager-tui x86_64 1:1.47.90-1.el9 baseos 248 k 2024-05-16T22:24:54.230 INFO:teuthology.orchestra.run.smithi196.stdout: librados2 x86_64 2:19.0.0-3709.g43296076.el9 ceph 3.3 M 2024-05-16T22:24:54.230 INFO:teuthology.orchestra.run.smithi196.stdout: librbd1 x86_64 2:19.0.0-3709.g43296076.el9 ceph 3.1 M 2024-05-16T22:24:54.230 INFO:teuthology.orchestra.run.smithi196.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-16T22:24:54.230 INFO:teuthology.orchestra.run.smithi196.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-16T22:24:54.230 INFO:teuthology.orchestra.run.smithi196.stdout:Installing dependencies: 2024-05-16T22:24:54.231 INFO:teuthology.orchestra.run.smithi196.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-16T22:24:54.231 INFO:teuthology.orchestra.run.smithi196.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-16T22:24:54.231 INFO:teuthology.orchestra.run.smithi196.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-16T22:24:54.231 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-common x86_64 2:19.0.0-3709.g43296076.el9 ceph 20 M 2024-05-16T22:24:54.231 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 34 k 2024-05-16T22:24:54.231 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mds x86_64 2:19.0.0-3709.g43296076.el9 ceph 2.3 M 2024-05-16T22:24:54.231 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 274 k 2024-05-16T22:24:54.231 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mon x86_64 2:19.0.0-3709.g43296076.el9 ceph 4.9 M 2024-05-16T22:24:54.231 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-osd x86_64 2:19.0.0-3709.g43296076.el9 ceph 18 M 2024-05-16T22:24:54.231 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 16 k 2024-05-16T22:24:54.231 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-selinux x86_64 2:19.0.0-3709.g43296076.el9 ceph 25 k 2024-05-16T22:24:54.231 INFO:teuthology.orchestra.run.smithi196.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-16T22:24:54.232 INFO:teuthology.orchestra.run.smithi196.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-16T22:24:54.232 INFO:teuthology.orchestra.run.smithi196.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-16T22:24:54.232 INFO:teuthology.orchestra.run.smithi196.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-16T22:24:54.232 INFO:teuthology.orchestra.run.smithi196.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-16T22:24:54.232 INFO:teuthology.orchestra.run.smithi196.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-16T22:24:54.232 INFO:teuthology.orchestra.run.smithi196.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-16T22:24:54.232 INFO:teuthology.orchestra.run.smithi196.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-16T22:24:54.232 INFO:teuthology.orchestra.run.smithi196.stdout: libcephsqlite x86_64 2:19.0.0-3709.g43296076.el9 ceph 157 k 2024-05-16T22:24:54.232 INFO:teuthology.orchestra.run.smithi196.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-16T22:24:54.232 INFO:teuthology.orchestra.run.smithi196.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-16T22:24:54.232 INFO:teuthology.orchestra.run.smithi196.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-16T22:24:54.232 INFO:teuthology.orchestra.run.smithi196.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-16T22:24:54.232 INFO:teuthology.orchestra.run.smithi196.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-16T22:24:54.233 INFO:teuthology.orchestra.run.smithi196.stdout: libradosstriper1 x86_64 2:19.0.0-3709.g43296076.el9 ceph 497 k 2024-05-16T22:24:54.233 INFO:teuthology.orchestra.run.smithi196.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-16T22:24:54.233 INFO:teuthology.orchestra.run.smithi196.stdout: librgw2 x86_64 2:19.0.0-3709.g43296076.el9 ceph 5.2 M 2024-05-16T22:24:54.233 INFO:teuthology.orchestra.run.smithi196.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-16T22:24:54.233 INFO:teuthology.orchestra.run.smithi196.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-16T22:24:54.233 INFO:teuthology.orchestra.run.smithi196.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-16T22:24:54.233 INFO:teuthology.orchestra.run.smithi196.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-16T22:24:54.233 INFO:teuthology.orchestra.run.smithi196.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-16T22:24:54.233 INFO:teuthology.orchestra.run.smithi196.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-05-16T22:24:54.234 INFO:teuthology.orchestra.run.smithi196.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-16T22:24:54.234 INFO:teuthology.orchestra.run.smithi196.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-16T22:24:54.234 INFO:teuthology.orchestra.run.smithi196.stdout: pam_fscrypt x86_64 0.3.4-2.el9 epel 1.8 M 2024-05-16T22:24:54.234 INFO:teuthology.orchestra.run.smithi196.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-16T22:24:54.234 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-16T22:24:54.234 INFO:teuthology.orchestra.run.smithi196.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-16T22:24:54.234 INFO:teuthology.orchestra.run.smithi196.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-16T22:24:54.234 INFO:teuthology.orchestra.run.smithi196.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-16T22:24:54.234 INFO:teuthology.orchestra.run.smithi196.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-16T22:24:54.234 INFO:teuthology.orchestra.run.smithi196.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-16T22:24:54.234 INFO:teuthology.orchestra.run.smithi196.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-16T22:24:54.234 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-16T22:24:54.235 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-argparse x86_64 2:19.0.0-3709.g43296076.el9 ceph 45 k 2024-05-16T22:24:54.235 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-common x86_64 2:19.0.0-3709.g43296076.el9 ceph 136 k 2024-05-16T22:24:54.235 INFO:teuthology.orchestra.run.smithi196.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-16T22:24:54.235 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-16T22:24:54.235 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-16T22:24:54.235 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-16T22:24:54.235 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-16T22:24:54.235 INFO:teuthology.orchestra.run.smithi196.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-16T22:24:54.235 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-16T22:24:54.235 INFO:teuthology.orchestra.run.smithi196.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-16T22:24:54.235 INFO:teuthology.orchestra.run.smithi196.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-16T22:24:54.235 INFO:teuthology.orchestra.run.smithi196.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-16T22:24:54.235 INFO:teuthology.orchestra.run.smithi196.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-16T22:24:54.236 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-16T22:24:54.236 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-16T22:24:54.236 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-16T22:24:54.236 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-16T22:24:54.236 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-16T22:24:54.236 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-16T22:24:54.236 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-16T22:24:54.236 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-16T22:24:54.236 INFO:teuthology.orchestra.run.smithi196.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-16T22:24:54.236 INFO:teuthology.orchestra.run.smithi196.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-16T22:24:54.236 INFO:teuthology.orchestra.run.smithi196.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-16T22:24:54.236 INFO:teuthology.orchestra.run.smithi196.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-16T22:24:54.236 INFO:teuthology.orchestra.run.smithi196.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-16T22:24:54.237 INFO:teuthology.orchestra.run.smithi196.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-16T22:24:54.237 INFO:teuthology.orchestra.run.smithi196.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-16T22:24:54.237 INFO:teuthology.orchestra.run.smithi196.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-16T22:24:54.237 INFO:teuthology.orchestra.run.smithi196.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-16T22:24:54.237 INFO:teuthology.orchestra.run.smithi196.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-16T22:24:54.237 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-16T22:24:54.237 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-16T22:24:54.237 INFO:teuthology.orchestra.run.smithi196.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-16T22:24:54.237 INFO:teuthology.orchestra.run.smithi196.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-16T22:24:54.237 INFO:teuthology.orchestra.run.smithi196.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-16T22:24:54.237 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-16T22:24:54.237 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-16T22:24:54.237 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-16T22:24:54.237 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-16T22:24:54.238 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-16T22:24:54.238 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-16T22:24:54.238 INFO:teuthology.orchestra.run.smithi196.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-16T22:24:54.238 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-16T22:24:54.238 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-16T22:24:54.238 INFO:teuthology.orchestra.run.smithi196.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-16T22:24:54.238 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-16T22:24:54.238 INFO:teuthology.orchestra.run.smithi196.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-16T22:24:54.238 INFO:teuthology.orchestra.run.smithi196.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-16T22:24:54.238 INFO:teuthology.orchestra.run.smithi196.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-16T22:24:54.238 INFO:teuthology.orchestra.run.smithi196.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-16T22:24:54.238 INFO:teuthology.orchestra.run.smithi196.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-16T22:24:54.239 INFO:teuthology.orchestra.run.smithi196.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-16T22:24:54.239 INFO:teuthology.orchestra.run.smithi196.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-16T22:24:54.239 INFO:teuthology.orchestra.run.smithi196.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-16T22:24:54.239 INFO:teuthology.orchestra.run.smithi196.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-16T22:24:54.239 INFO:teuthology.orchestra.run.smithi196.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-16T22:24:54.239 INFO:teuthology.orchestra.run.smithi196.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-16T22:24:54.239 INFO:teuthology.orchestra.run.smithi196.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-16T22:24:54.239 INFO:teuthology.orchestra.run.smithi196.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-16T22:24:54.239 INFO:teuthology.orchestra.run.smithi196.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-16T22:24:54.239 INFO:teuthology.orchestra.run.smithi196.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-16T22:24:54.239 INFO:teuthology.orchestra.run.smithi196.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-16T22:24:54.239 INFO:teuthology.orchestra.run.smithi196.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-16T22:24:54.240 INFO:teuthology.orchestra.run.smithi196.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-16T22:24:54.240 INFO:teuthology.orchestra.run.smithi196.stdout:Installing weak dependencies: 2024-05-16T22:24:54.240 INFO:teuthology.orchestra.run.smithi196.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-16T22:24:54.240 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:24:54.240 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2024-05-16T22:24:54.240 INFO:teuthology.orchestra.run.smithi196.stdout:======================================================================================= 2024-05-16T22:24:54.240 INFO:teuthology.orchestra.run.smithi196.stdout:Install 150 Packages 2024-05-16T22:24:54.240 INFO:teuthology.orchestra.run.smithi196.stdout:Upgrade 8 Packages 2024-05-16T22:24:54.240 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:24:54.240 INFO:teuthology.orchestra.run.smithi196.stdout:Total download size: 223 M 2024-05-16T22:24:54.241 INFO:teuthology.orchestra.run.smithi196.stdout:Downloading Packages: 2024-05-16T22:24:54.265 INFO:teuthology.orchestra.run.smithi070.stdout:(63/158): lua-5.4.4-4.el9.x86_64.rpm 238 kB/s | 188 kB 00:00 2024-05-16T22:24:54.291 INFO:teuthology.orchestra.run.smithi070.stdout:(64/158): lttng-ust-2.12.0-6.el9.x86_64.rpm 334 kB/s | 292 kB 00:00 2024-05-16T22:24:54.421 INFO:teuthology.orchestra.run.smithi044.stdout:(102/158): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-05-16T22:24:54.438 INFO:teuthology.orchestra.run.smithi044.stdout:(103/158): lua-devel-5.4.4-4.el9.x86_64.rpm 83 kB/s | 22 kB 00:00 2024-05-16T22:24:54.883 INFO:teuthology.orchestra.run.smithi070.stdout:(65/158): openblas-0.3.21-2.el9.x86_64.rpm 57 kB/s | 35 kB 00:00 2024-05-16T22:24:54.888 INFO:teuthology.orchestra.run.smithi044.stdout:(104/158): abseil-cpp-20211102.0-3.el9.x86_64.r 1.1 MB/s | 548 kB 00:00 2024-05-16T22:24:54.980 INFO:teuthology.orchestra.run.smithi044.stdout:(105/158): gperftools-libs-2.9.1-2.el9.x86_64.r 3.3 MB/s | 309 kB 00:00 2024-05-16T22:24:55.047 INFO:teuthology.orchestra.run.smithi044.stdout:(106/158): fscrypt-0.3.4-2.el9.x86_64.rpm 3.4 MB/s | 2.0 MB 00:00 2024-05-16T22:24:55.072 INFO:teuthology.orchestra.run.smithi044.stdout:(107/158): grpc-data-1.46.7-10.el9.noarch.rpm 212 kB/s | 19 kB 00:00 2024-05-16T22:24:55.106 INFO:teuthology.orchestra.run.smithi044.stdout:(108/158): protobuf-compiler-3.14.0-13.el9.x86_ 949 kB/s | 863 kB 00:00 2024-05-16T22:24:55.132 INFO:teuthology.orchestra.run.smithi196.stdout:(1/158): ceph-19.0.0-3709.g43296076.el9.x86_64. 24 kB/s | 6.6 kB 00:00 2024-05-16T22:24:55.156 INFO:teuthology.orchestra.run.smithi044.stdout:(109/158): libarrow-doc-9.0.0-11.el9.noarch.rpm 311 kB/s | 26 kB 00:00 2024-05-16T22:24:55.264 INFO:teuthology.orchestra.run.smithi044.stdout:(110/158): libarrow-9.0.0-11.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2024-05-16T22:24:55.290 INFO:teuthology.orchestra.run.smithi044.stdout:(111/158): libunwind-1.6.2-1.el9.x86_64.rpm 639 kB/s | 67 kB 00:00 2024-05-16T22:24:55.365 INFO:teuthology.orchestra.run.smithi044.stdout:(112/158): luarocks-3.9.2-5.el9.noarch.rpm 1.5 MB/s | 151 kB 00:00 2024-05-16T22:24:55.432 INFO:teuthology.orchestra.run.smithi044.stdout:(113/158): liboath-2.6.7-2.el9.x86_64.rpm 149 kB/s | 49 kB 00:00 2024-05-16T22:24:55.500 INFO:teuthology.orchestra.run.smithi070.stdout:(66/158): openblas-openmp-0.3.21-2.el9.x86_64.r 3.9 MB/s | 4.7 MB 00:01 2024-05-16T22:24:55.507 INFO:teuthology.orchestra.run.smithi044.stdout:(114/158): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.8 MB/s | 839 kB 00:00 2024-05-16T22:24:55.549 INFO:teuthology.orchestra.run.smithi044.stdout:(115/158): pam_fscrypt-0.3.4-2.el9.x86_64.rpm 7.1 MB/s | 1.8 MB 00:00 2024-05-16T22:24:55.591 INFO:teuthology.orchestra.run.smithi044.stdout:(116/158): python3-bcrypt-3.2.2-1.el9.x86_64.rp 520 kB/s | 43 kB 00:00 2024-05-16T22:24:55.625 INFO:teuthology.orchestra.run.smithi044.stdout:(117/158): python3-cachetools-4.2.4-1.el9.noarc 429 kB/s | 32 kB 00:00 2024-05-16T22:24:55.667 INFO:teuthology.orchestra.run.smithi044.stdout:(118/158): python3-certifi-2021.10.8-2.el9.noar 199 kB/s | 15 kB 00:00 2024-05-16T22:24:55.700 INFO:teuthology.orchestra.run.smithi044.stdout:(119/158): python3-asyncssh-2.13.2-5.el9.noarch 2.0 MB/s | 548 kB 00:00 2024-05-16T22:24:55.734 INFO:teuthology.orchestra.run.smithi044.stdout:(120/158): python3-cheroot-8.6.0-4.el9.noarch.r 1.5 MB/s | 172 kB 00:00 2024-05-16T22:24:55.760 INFO:teuthology.orchestra.run.smithi044.stdout:(121/158): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-05-16T22:24:55.810 INFO:teuthology.orchestra.run.smithi044.stdout:(122/158): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.7 MB/s | 303 kB 00:00 2024-05-16T22:24:55.835 INFO:teuthology.orchestra.run.smithi044.stdout:(123/158): python3-colorama-0.4.4-12.el9.noarch 351 kB/s | 35 kB 00:00 2024-05-16T22:24:55.860 INFO:teuthology.orchestra.run.smithi044.stdout:(124/158): python3-google-auth-2.29.0-1.el9.noa 2.0 MB/s | 206 kB 00:00 2024-05-16T22:24:55.965 INFO:teuthology.orchestra.run.smithi196.stdout:(2/158): ceph-fuse-19.0.0-3709.g43296076.el9.x8 1.0 MB/s | 863 kB 00:00 2024-05-16T22:24:55.994 INFO:teuthology.orchestra.run.smithi044.stdout:(125/158): python3-grpcio-tools-1.46.7-10.el9.x 911 kB/s | 144 kB 00:00 2024-05-16T22:24:56.019 INFO:teuthology.orchestra.run.smithi044.stdout:(126/158): python3-jaraco-8.2.1-3.el9.noarch.rp 67 kB/s | 11 kB 00:00 2024-05-16T22:24:56.078 INFO:teuthology.orchestra.run.smithi044.stdout:(127/158): python3-grpcio-1.46.7-10.el9.x86_64. 7.6 MB/s | 2.0 MB 00:00 2024-05-16T22:24:56.095 INFO:teuthology.orchestra.run.smithi044.stdout:(128/158): python3-jaraco-classes-3.2.1-5.el9.n 176 kB/s | 18 kB 00:00 2024-05-16T22:24:56.112 INFO:teuthology.orchestra.run.smithi044.stdout:(129/158): python3-jaraco-collections-3.0.0-8.e 251 kB/s | 23 kB 00:00 2024-05-16T22:24:56.125 INFO:teuthology.orchestra.run.smithi070.stdout:(67/158): openssl-devel-3.2.1-1.el9.x86_64.rpm 3.6 MB/s | 4.4 MB 00:01 2024-05-16T22:24:56.146 INFO:teuthology.orchestra.run.smithi044.stdout:(130/158): python3-jaraco-functools-3.5.0-2.el9 289 kB/s | 19 kB 00:00 2024-05-16T22:24:56.162 INFO:teuthology.orchestra.run.smithi044.stdout:(131/158): python3-jaraco-text-3.2.0-6.el9.noar 293 kB/s | 20 kB 00:00 2024-05-16T22:24:56.174 INFO:teuthology.orchestra.run.smithi196.stdout:(3/158): ceph-immutable-object-cache-19.0.0-370 707 kB/s | 147 kB 00:00 2024-05-16T22:24:56.213 INFO:teuthology.orchestra.run.smithi044.stdout:(132/158): python3-kubernetes-26.1.0-2.el9.noar 10 MB/s | 1.0 MB 00:00 2024-05-16T22:24:56.230 INFO:teuthology.orchestra.run.smithi044.stdout:(133/158): python3-logutils-0.3.5-21.el9.noarch 552 kB/s | 46 kB 00:00 2024-05-16T22:24:56.255 INFO:teuthology.orchestra.run.smithi044.stdout:(134/158): python3-more-itertools-8.12.0-2.el9. 854 kB/s | 79 kB 00:00 2024-05-16T22:24:56.330 INFO:teuthology.orchestra.run.smithi044.stdout:(135/158): python3-natsort-7.1.1-5.el9.noarch.r 493 kB/s | 58 kB 00:00 2024-05-16T22:24:56.347 INFO:teuthology.orchestra.run.smithi044.stdout:(136/158): python3-portend-3.1.0-2.el9.noarch.r 179 kB/s | 16 kB 00:00 2024-05-16T22:24:56.372 INFO:teuthology.orchestra.run.smithi044.stdout:(137/158): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2024-05-16T22:24:56.414 INFO:teuthology.orchestra.run.smithi044.stdout:(138/158): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-05-16T22:24:56.431 INFO:teuthology.orchestra.run.smithi044.stdout:(139/158): python3-pyperclip-1.8.2-2.el9.noarch 337 kB/s | 28 kB 00:00 2024-05-16T22:24:56.457 INFO:teuthology.orchestra.run.smithi044.stdout:(140/158): python3-repoze-lru-0.7-16.el9.noarch 367 kB/s | 31 kB 00:00 2024-05-16T22:24:56.515 INFO:teuthology.orchestra.run.smithi044.stdout:(141/158): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-05-16T22:24:56.540 INFO:teuthology.orchestra.run.smithi044.stdout:(142/158): python3-rsa-4.9-2.el9.noarch.rpm 543 kB/s | 59 kB 00:00 2024-05-16T22:24:56.566 INFO:teuthology.orchestra.run.smithi044.stdout:(143/158): python3-tempora-5.0.0-2.el9.noarch.r 328 kB/s | 36 kB 00:00 2024-05-16T22:24:56.566 INFO:teuthology.orchestra.run.smithi070.stdout:(68/158): postgresql-13.14-1.el9.x86_64.rpm 1.5 MB/s | 1.6 MB 00:01 2024-05-16T22:24:56.633 INFO:teuthology.orchestra.run.smithi044.stdout:(144/158): python3-typing-extensions-4.4.0-2.el 434 kB/s | 51 kB 00:00 2024-05-16T22:24:56.658 INFO:teuthology.orchestra.run.smithi044.stdout:(145/158): python3-websocket-client-1.2.3-2.el9 976 kB/s | 90 kB 00:00 2024-05-16T22:24:56.683 INFO:teuthology.orchestra.run.smithi044.stdout:(146/158): python3-webob-1.8.7-6.el9.noarch.rpm 1.6 MB/s | 230 kB 00:00 2024-05-16T22:24:56.767 INFO:teuthology.orchestra.run.smithi044.stdout:(147/158): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-05-16T22:24:56.792 INFO:teuthology.orchestra.run.smithi044.stdout:(148/158): python3-zc-lockfile-2.0-10.el9.noarc 149 kB/s | 20 kB 00:00 2024-05-16T22:24:56.859 INFO:teuthology.orchestra.run.smithi044.stdout:(149/158): re2-20211101-3.el9.x86_64.rpm 1.1 MB/s | 192 kB 00:00 2024-05-16T22:24:56.916 INFO:teuthology.orchestra.run.smithi196.stdout:(4/158): ceph-common-19.0.0-3709.g43296076.el9. 9.5 MB/s | 20 MB 00:02 2024-05-16T22:24:56.918 INFO:teuthology.orchestra.run.smithi044.stdout:(150/158): thrift-0.15.0-2.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-05-16T22:24:57.017 INFO:teuthology.orchestra.run.smithi196.stdout:(5/158): ceph-mds-19.0.0-3709.g43296076.el9.x86 2.7 MB/s | 2.3 MB 00:00 2024-05-16T22:24:57.083 INFO:teuthology.orchestra.run.smithi196.stdout:(6/158): ceph-mgr-19.0.0-3709.g43296076.el9.x86 9.1 MB/s | 1.5 MB 00:00 2024-05-16T22:24:57.150 INFO:teuthology.orchestra.run.smithi070.stdout:(69/158): postgresql-contrib-13.14-1.el9.x86_64 889 kB/s | 911 kB 00:01 2024-05-16T22:24:57.308 INFO:teuthology.orchestra.run.smithi070.stdout:(70/158): postgresql-private-libs-13.14-1.el9.x 180 kB/s | 133 kB 00:00 2024-05-16T22:24:57.393 INFO:teuthology.orchestra.run.smithi044.stdout:(151/158): NetworkManager-1.47.90-1.el9.x86_64. 5.2 MB/s | 2.3 MB 00:00 2024-05-16T22:24:57.469 INFO:teuthology.orchestra.run.smithi044.stdout:(152/158): librados2-19.0.0-3709.g43296076.el9. 4.9 MB/s | 3.3 MB 00:00 2024-05-16T22:24:57.519 INFO:teuthology.orchestra.run.smithi044.stdout:(153/158): NetworkManager-team-1.47.90-1.el9.x8 832 kB/s | 41 kB 00:00 2024-05-16T22:24:57.600 INFO:teuthology.orchestra.run.smithi196.stdout:(7/158): ceph-base-19.0.0-3709.g43296076.el9.x8 2.0 MB/s | 5.4 MB 00:02 2024-05-16T22:24:57.635 INFO:teuthology.orchestra.run.smithi044.stdout:(154/158): NetworkManager-tui-1.47.90-1.el9.x86 2.1 MB/s | 248 kB 00:00 2024-05-16T22:24:57.702 INFO:teuthology.orchestra.run.smithi044.stdout:(155/158): NetworkManager-libnm-1.47.90-1.el9.x 5.8 MB/s | 1.8 MB 00:00 2024-05-16T22:24:57.961 INFO:teuthology.orchestra.run.smithi044.stdout:(156/158): openssl-3.2.1-1.el9.x86_64.rpm 4.2 MB/s | 1.3 MB 00:00 2024-05-16T22:24:58.111 INFO:teuthology.orchestra.run.smithi044.stdout:(157/158): openssl-libs-3.2.1-1.el9.x86_64.rpm 5.9 MB/s | 2.4 MB 00:00 2024-05-16T22:24:58.125 INFO:teuthology.orchestra.run.smithi196.stdout:(8/158): ceph-mon-19.0.0-3709.g43296076.el9.x86 4.4 MB/s | 4.9 MB 00:01 2024-05-16T22:24:58.201 INFO:teuthology.orchestra.run.smithi196.stdout:(9/158): ceph-selinux-19.0.0-3709.g43296076.el9 340 kB/s | 25 kB 00:00 2024-05-16T22:24:58.461 INFO:teuthology.orchestra.run.smithi070.stdout:(71/158): ceph-test-19.0.0-3709.g43296076.el9.x 3.1 MB/s | 43 MB 00:13 2024-05-16T22:24:58.543 INFO:teuthology.orchestra.run.smithi196.stdout:(10/158): ceph-osd-19.0.0-3709.g43296076.el9.x8 12 MB/s | 18 MB 00:01 2024-05-16T22:24:58.609 INFO:teuthology.orchestra.run.smithi196.stdout:(11/158): cephfs-mirror-19.0.0-3709.g43296076.e 3.4 MB/s | 224 kB 00:00 2024-05-16T22:24:58.668 INFO:teuthology.orchestra.run.smithi196.stdout:(12/158): cephfs-shell-19.0.0-3709.g43296076.el 471 kB/s | 27 kB 00:00 2024-05-16T22:24:58.727 INFO:teuthology.orchestra.run.smithi196.stdout:(13/158): libcephfs-devel-19.0.0-3709.g43296076 553 kB/s | 32 kB 00:00 2024-05-16T22:24:58.877 INFO:teuthology.orchestra.run.smithi196.stdout:(14/158): libcephfs2-19.0.0-3709.g43296076.el9. 5.0 MB/s | 756 kB 00:00 2024-05-16T22:24:58.995 INFO:teuthology.orchestra.run.smithi044.stdout:(158/158): librbd1-19.0.0-3709.g43296076.el9.x8 1.4 MB/s | 3.1 MB 00:02 2024-05-16T22:24:59.001 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-05-16T22:24:59.001 INFO:teuthology.orchestra.run.smithi044.stdout:Total 14 MB/s | 223 MB 00:16 2024-05-16T22:24:59.036 INFO:teuthology.orchestra.run.smithi196.stdout:(15/158): ceph-radosgw-19.0.0-3709.g43296076.el 7.1 MB/s | 10 MB 00:01 2024-05-16T22:24:59.061 INFO:teuthology.orchestra.run.smithi196.stdout:(16/158): libcephsqlite-19.0.0-3709.g43296076.e 860 kB/s | 157 kB 00:00 2024-05-16T22:24:59.119 INFO:teuthology.orchestra.run.smithi196.stdout:(17/158): librados-devel-19.0.0-3709.g43296076. 1.5 MB/s | 127 kB 00:00 2024-05-16T22:24:59.159 INFO:teuthology.orchestra.run.smithi070.stdout:(72/158): python3-attrs-20.3.0-7.el9.noarch.rpm 125 kB/s | 87 kB 00:00 2024-05-16T22:24:59.161 INFO:teuthology.orchestra.run.smithi196.stdout:(18/158): libradosstriper1-19.0.0-3709.g4329607 4.9 MB/s | 497 kB 00:00 2024-05-16T22:24:59.228 INFO:teuthology.orchestra.run.smithi196.stdout:(19/158): python3-ceph-argparse-19.0.0-3709.g43 686 kB/s | 45 kB 00:00 2024-05-16T22:24:59.312 INFO:teuthology.orchestra.run.smithi196.stdout:(20/158): python3-ceph-common-19.0.0-3709.g4329 1.6 MB/s | 136 kB 00:00 2024-05-16T22:24:59.412 INFO:teuthology.orchestra.run.smithi196.stdout:(21/158): python3-cephfs-19.0.0-3709.g43296076. 1.6 MB/s | 162 kB 00:00 2024-05-16T22:24:59.521 INFO:teuthology.orchestra.run.smithi196.stdout:(22/158): python3-rados-19.0.0-3709.g43296076.e 2.9 MB/s | 320 kB 00:00 2024-05-16T22:24:59.663 INFO:teuthology.orchestra.run.smithi196.stdout:(23/158): librgw2-19.0.0-3709.g43296076.el9.x86 9.5 MB/s | 5.2 MB 00:00 2024-05-16T22:24:59.697 INFO:teuthology.orchestra.run.smithi196.stdout:(24/158): python3-rbd-19.0.0-3709.g43296076.el9 1.7 MB/s | 300 kB 00:00 2024-05-16T22:24:59.746 INFO:teuthology.orchestra.run.smithi196.stdout:(25/158): python3-rgw-19.0.0-3709.g43296076.el9 1.2 MB/s | 99 kB 00:00 2024-05-16T22:24:59.772 INFO:teuthology.orchestra.run.smithi196.stdout:(26/158): rbd-fuse-19.0.0-3709.g43296076.el9.x8 1.1 MB/s | 86 kB 00:00 2024-05-16T22:24:59.855 INFO:teuthology.orchestra.run.smithi196.stdout:(27/158): rbd-nbd-19.0.0-3709.g43296076.el9.x86 2.0 MB/s | 169 kB 00:00 2024-05-16T22:24:59.884 INFO:teuthology.orchestra.run.smithi070.stdout:(73/158): postgresql-server-13.14-1.el9.x86_64. 2.1 MB/s | 5.8 MB 00:02 2024-05-16T22:24:59.918 INFO:teuthology.orchestra.run.smithi070.stdout:(74/158): protobuf-3.14.0-13.el9.x86_64.rpm 396 kB/s | 1.0 MB 00:02 2024-05-16T22:24:59.964 INFO:teuthology.orchestra.run.smithi196.stdout:(28/158): ceph-grafana-dashboards-19.0.0-3709.g 318 kB/s | 34 kB 00:00 2024-05-16T22:25:00.073 INFO:teuthology.orchestra.run.smithi196.stdout:(29/158): ceph-mgr-cephadm-19.0.0-3709.g4329607 1.3 MB/s | 143 kB 00:00 2024-05-16T22:25:00.198 INFO:teuthology.orchestra.run.smithi196.stdout:(30/158): rbd-mirror-19.0.0-3709.g43296076.el9. 7.2 MB/s | 3.0 MB 00:00 2024-05-16T22:25:00.200 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2024-05-16T22:25:00.368 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2024-05-16T22:25:00.368 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2024-05-16T22:25:00.515 INFO:teuthology.orchestra.run.smithi196.stdout:(31/158): ceph-mgr-dashboard-19.0.0-3709.g43296 8.0 MB/s | 3.5 MB 00:00 2024-05-16T22:25:00.576 INFO:teuthology.orchestra.run.smithi070.stdout:(75/158): python3-babel-2.9.1-2.el9.noarch.rpm 4.2 MB/s | 6.0 MB 00:01 2024-05-16T22:25:00.648 INFO:teuthology.orchestra.run.smithi196.stdout:(32/158): ceph-mgr-modules-core-19.0.0-3709.g43 2.0 MB/s | 274 kB 00:00 2024-05-16T22:25:00.716 INFO:teuthology.orchestra.run.smithi196.stdout:(33/158): ceph-mgr-rook-19.0.0-3709.g43296076.e 749 kB/s | 49 kB 00:00 2024-05-16T22:25:00.782 INFO:teuthology.orchestra.run.smithi196.stdout:(34/158): ceph-prometheus-alerts-19.0.0-3709.g4 250 kB/s | 16 kB 00:00 2024-05-16T22:25:00.843 INFO:teuthology.orchestra.run.smithi070.stdout:(76/158): python3-devel-3.9.18-3.el9.x86_64.rpm 255 kB/s | 244 kB 00:00 2024-05-16T22:25:00.893 INFO:teuthology.orchestra.run.smithi070.stdout:(77/158): python3-jinja2-2.11.3-5.el9.noarch.rp 254 kB/s | 248 kB 00:00 2024-05-16T22:25:00.908 INFO:teuthology.orchestra.run.smithi196.stdout:(35/158): ceph-volume-19.0.0-3709.g43296076.el9 2.1 MB/s | 273 kB 00:00 2024-05-16T22:25:01.217 INFO:teuthology.orchestra.run.smithi196.stdout:(36/158): ceph-mgr-diskprediction-local-19.0.0- 7.3 MB/s | 7.4 MB 00:01 2024-05-16T22:25:01.259 INFO:teuthology.orchestra.run.smithi196.stdout:(37/158): cephadm-19.0.0-3709.g43296076.el9.noa 2.1 MB/s | 763 kB 00:00 2024-05-16T22:25:01.269 INFO:teuthology.orchestra.run.smithi070.stdout:(78/158): python3-jsonpatch-1.21-16.el9.noarch. 37 kB/s | 26 kB 00:00 2024-05-16T22:25:01.284 INFO:teuthology.orchestra.run.smithi196.stdout:(38/158): cephfs-top-19.0.0-3709.g43296076.el9. 277 kB/s | 18 kB 00:00 2024-05-16T22:25:01.477 INFO:teuthology.orchestra.run.smithi070.stdout:(79/158): python3-jsonpointer-2.0-4.el9.noarch. 32 kB/s | 19 kB 00:00 2024-05-16T22:25:01.743 INFO:teuthology.orchestra.run.smithi196.stdout:(39/158): ceph-test-19.0.0-3709.g43296076.el9.x 12 MB/s | 43 MB 00:03 2024-05-16T22:25:01.767 INFO:teuthology.orchestra.run.smithi196.stdout:(40/158): fuse-2.9.9-15.el9.x86_64.rpm 158 kB/s | 80 kB 00:00 2024-05-16T22:25:01.777 INFO:teuthology.orchestra.run.smithi070.stdout:(80/158): python3-mako-1.1.4-6.el9.noarch.rpm 195 kB/s | 172 kB 00:00 2024-05-16T22:25:01.920 INFO:teuthology.orchestra.run.smithi070.stdout:(81/158): python3-markupsafe-1.1.1-12.el9.x86_6 54 kB/s | 35 kB 00:00 2024-05-16T22:25:01.985 INFO:teuthology.orchestra.run.smithi196.stdout:(41/158): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.1 MB/s | 253 kB 00:00 2024-05-16T22:25:02.010 INFO:teuthology.orchestra.run.smithi196.stdout:(42/158): libquadmath-11.4.1-3.el9.x86_64.rpm 735 kB/s | 195 kB 00:00 2024-05-16T22:25:02.135 INFO:teuthology.orchestra.run.smithi196.stdout:(43/158): python3-ply-3.11-14.el9.noarch.rpm 857 kB/s | 106 kB 00:00 2024-05-16T22:25:02.235 INFO:teuthology.orchestra.run.smithi196.stdout:(44/158): libgfortran-11.4.1-3.el9.x86_64.rpm 845 kB/s | 803 kB 00:00 2024-05-16T22:25:02.267 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2024-05-16T22:25:02.267 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2024-05-16T22:25:02.327 INFO:teuthology.orchestra.run.smithi196.stdout:(45/158): python3-pycparser-2.20-6.el9.noarch.r 707 kB/s | 135 kB 00:00 2024-05-16T22:25:02.411 INFO:teuthology.orchestra.run.smithi196.stdout:(46/158): python3-requests-2.25.1-8.el9.noarch. 717 kB/s | 125 kB 00:00 2024-05-16T22:25:02.511 INFO:teuthology.orchestra.run.smithi196.stdout:(47/158): python3-urllib3-1.26.5-5.el9.noarch.r 1.1 MB/s | 215 kB 00:00 2024-05-16T22:25:02.820 INFO:teuthology.orchestra.run.smithi196.stdout:(48/158): python3-cryptography-36.0.1-4.el9.x86 1.5 MB/s | 1.2 MB 00:00 2024-05-16T22:25:02.886 INFO:teuthology.orchestra.run.smithi070.stdout:(82/158): python3-numpy-f2py-1.20.1-5.el9.x86_6 226 kB/s | 250 kB 00:01 2024-05-16T22:25:03.011 INFO:teuthology.orchestra.run.smithi070.stdout:(83/158): python3-oauthlib-3.1.1-5.el9.noarch.r 203 kB/s | 222 kB 00:01 2024-05-16T22:25:03.012 INFO:teuthology.orchestra.run.smithi196.stdout:(49/158): automake-1.16.2-8.el9.noarch.rpm 1.1 MB/s | 689 kB 00:00 2024-05-16T22:25:03.095 INFO:teuthology.orchestra.run.smithi196.stdout:(50/158): elfutils-libelf-devel-0.190-2.el9.x86 260 kB/s | 21 kB 00:00 2024-05-16T22:25:03.112 INFO:teuthology.orchestra.run.smithi070.stdout:(84/158): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.1 MB/s | 5.1 MB 00:01 2024-05-16T22:25:03.163 INFO:teuthology.orchestra.run.smithi196.stdout:(51/158): bison-3.7.4-5.el9.x86_64.rpm 1.4 MB/s | 943 kB 00:00 2024-05-16T22:25:03.187 INFO:teuthology.orchestra.run.smithi196.stdout:(52/158): boost-program-options-1.75.0-8.el9.x8 291 kB/s | 107 kB 00:00 2024-05-16T22:25:03.246 INFO:teuthology.orchestra.run.smithi196.stdout:(53/158): flexiblas-3.0.4-8.el9.x86_64.rpm 396 kB/s | 33 kB 00:00 2024-05-16T22:25:03.304 INFO:teuthology.orchestra.run.smithi196.stdout:(54/158): flex-2.6.4-9.el9.x86_64.rpm 1.5 MB/s | 313 kB 00:00 2024-05-16T22:25:03.322 INFO:teuthology.orchestra.run.smithi196.stdout:(55/158): flexiblas-openblas-openmp-3.0.4-8.el9 244 kB/s | 18 kB 00:00 2024-05-16T22:25:03.380 INFO:teuthology.orchestra.run.smithi196.stdout:(56/158): libaio-devel-0.3.111-13.el9.x86_64.rp 150 kB/s | 11 kB 00:00 2024-05-16T22:25:03.480 INFO:teuthology.orchestra.run.smithi196.stdout:(57/158): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.0 MB/s | 160 kB 00:00 2024-05-16T22:25:03.506 INFO:teuthology.orchestra.run.smithi196.stdout:(58/158): librabbitmq-0.11.0-7.el9.x86_64.rpm 362 kB/s | 45 kB 00:00 2024-05-16T22:25:03.898 INFO:teuthology.orchestra.run.smithi196.stdout:(59/158): librdkafka-1.6.1-102.el9.x86_64.rpm 1.6 MB/s | 662 kB 00:00 2024-05-16T22:25:03.920 INFO:teuthology.orchestra.run.smithi070.stdout:(85/158): python3-packaging-20.9-5.el9.noarch.r 75 kB/s | 77 kB 00:01 2024-05-16T22:25:03.931 INFO:teuthology.orchestra.run.smithi196.stdout:(60/158): libtool-2.4.6-45.el9.x86_64.rpm 1.3 MB/s | 582 kB 00:00 2024-05-16T22:25:03.945 INFO:teuthology.orchestra.run.smithi070.stdout:(86/158): python3-prettytable-0.7.2-27.el9.noar 45 kB/s | 42 kB 00:00 2024-05-16T22:25:03.982 INFO:teuthology.orchestra.run.smithi196.stdout:(61/158): libuuid-devel-2.37.4-18.el9.x86_64.rp 306 kB/s | 25 kB 00:00 2024-05-16T22:25:04.182 INFO:teuthology.orchestra.run.smithi196.stdout:(62/158): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.4 MB/s | 292 kB 00:00 2024-05-16T22:25:04.207 INFO:teuthology.orchestra.run.smithi196.stdout:(63/158): libzstd-devel-1.5.1-2.el9.x86_64.rpm 172 kB/s | 47 kB 00:00 2024-05-16T22:25:04.299 INFO:teuthology.orchestra.run.smithi196.stdout:(64/158): openblas-0.3.21-2.el9.x86_64.rpm 387 kB/s | 35 kB 00:00 2024-05-16T22:25:04.313 INFO:teuthology.orchestra.run.smithi070.stdout:(87/158): python3-protobuf-3.14.0-13.el9.noarch 224 kB/s | 269 kB 00:01 2024-05-16T22:25:04.449 INFO:teuthology.orchestra.run.smithi196.stdout:(65/158): lua-5.4.4-4.el9.x86_64.rpm 707 kB/s | 188 kB 00:00 2024-05-16T22:25:04.683 INFO:teuthology.orchestra.run.smithi196.stdout:(66/158): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.0 MB/s | 3.0 MB 00:01 2024-05-16T22:25:04.963 INFO:teuthology.orchestra.run.smithi070.stdout:(88/158): python3-pyasn1-0.4.8-6.el9.noarch.rpm 152 kB/s | 159 kB 00:01 2024-05-16T22:25:05.046 INFO:teuthology.orchestra.run.smithi070.stdout:(89/158): python3-pyasn1-modules-0.4.8-6.el9.no 253 kB/s | 279 kB 00:01 2024-05-16T22:25:05.180 INFO:teuthology.orchestra.run.smithi070.stdout:(90/158): python3-pytz-2021.1-5.el9.noarch.rpm 59 kB/s | 51 kB 00:00 2024-05-16T22:25:05.383 INFO:teuthology.orchestra.run.smithi196.stdout:(67/158): postgresql-13.14-1.el9.x86_64.rpm 2.3 MB/s | 1.6 MB 00:00 2024-05-16T22:25:05.767 INFO:teuthology.orchestra.run.smithi196.stdout:(68/158): postgresql-contrib-13.14-1.el9.x86_64 2.3 MB/s | 911 kB 00:00 2024-05-16T22:25:05.813 INFO:teuthology.orchestra.run.smithi070.stdout:(91/158): python3-requests-oauthlib-1.3.0-12.el 63 kB/s | 54 kB 00:00 2024-05-16T22:25:05.826 INFO:teuthology.orchestra.run.smithi196.stdout:(69/158): postgresql-private-libs-13.14-1.el9.x 2.3 MB/s | 133 kB 00:00 2024-05-16T22:25:05.963 INFO:teuthology.orchestra.run.smithi070.stdout:(92/158): python3-toml-0.10.2-6.el9.noarch.rpm 53 kB/s | 42 kB 00:00 2024-05-16T22:25:06.209 INFO:teuthology.orchestra.run.smithi196.stdout:(70/158): openblas-openmp-0.3.21-2.el9.x86_64.r 2.5 MB/s | 4.7 MB 00:01 2024-05-16T22:25:06.468 INFO:teuthology.orchestra.run.smithi196.stdout:(71/158): openssl-devel-3.2.1-1.el9.x86_64.rpm 2.2 MB/s | 4.4 MB 00:02 2024-05-16T22:25:06.580 INFO:teuthology.orchestra.run.smithi070.stdout:(93/158): python3-wcwidth-0.2.5-8.el9.noarch.rp 58 kB/s | 44 kB 00:00 2024-05-16T22:25:06.609 INFO:teuthology.orchestra.run.smithi196.stdout:(72/158): python3-attrs-20.3.0-7.el9.noarch.rpm 620 kB/s | 87 kB 00:00 2024-05-16T22:25:06.710 INFO:teuthology.orchestra.run.smithi196.stdout:(73/158): protobuf-3.14.0-13.el9.x86_64.rpm 2.0 MB/s | 1.0 MB 00:00 2024-05-16T22:25:06.837 INFO:teuthology.orchestra.run.smithi196.stdout:(74/158): python3-devel-3.9.18-3.el9.x86_64.rpm 1.9 MB/s | 244 kB 00:00 2024-05-16T22:25:06.935 INFO:teuthology.orchestra.run.smithi196.stdout:(75/158): python3-jinja2-2.11.3-5.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-05-16T22:25:06.994 INFO:teuthology.orchestra.run.smithi196.stdout:(76/158): python3-jsonpatch-1.21-16.el9.noarch. 442 kB/s | 26 kB 00:00 2024-05-16T22:25:07.005 INFO:teuthology.orchestra.run.smithi070.stdout:(94/158): python3-scipy-1.6.2-8.el9.x86_64.rpm 8.3 MB/s | 16 MB 00:01 2024-05-16T22:25:07.053 INFO:teuthology.orchestra.run.smithi196.stdout:(77/158): python3-jsonpointer-2.0-4.el9.noarch. 333 kB/s | 19 kB 00:00 2024-05-16T22:25:07.056 INFO:teuthology.orchestra.run.smithi070.stdout:(95/158): qatlib-24.02.0-1.el9.x86_64.rpm 202 kB/s | 221 kB 00:01 2024-05-16T22:25:07.120 INFO:teuthology.orchestra.run.smithi196.stdout:(78/158): python3-mako-1.1.4-6.el9.noarch.rpm 2.6 MB/s | 172 kB 00:00 2024-05-16T22:25:07.178 INFO:teuthology.orchestra.run.smithi196.stdout:(79/158): python3-markupsafe-1.1.1-12.el9.x86_6 604 kB/s | 35 kB 00:00 2024-05-16T22:25:07.431 INFO:teuthology.orchestra.run.smithi070.stdout:(96/158): qatlib-service-24.02.0-1.el9.x86_64.r 42 kB/s | 36 kB 00:00 2024-05-16T22:25:07.454 INFO:teuthology.orchestra.run.smithi196.stdout:(80/158): postgresql-server-13.14-1.el9.x86_64. 3.6 MB/s | 5.8 MB 00:01 2024-05-16T22:25:07.570 INFO:teuthology.orchestra.run.smithi196.stdout:(81/158): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-05-16T22:25:07.673 INFO:teuthology.orchestra.run.smithi070.stdout:(97/158): qatzip-libs-1.2.0-1.el9.x86_64.rpm 74 kB/s | 47 kB 00:00 2024-05-16T22:25:07.746 INFO:teuthology.orchestra.run.smithi196.stdout:(82/158): python3-babel-2.9.1-2.el9.noarch.rpm 5.3 MB/s | 6.0 MB 00:01 2024-05-16T22:25:07.771 INFO:teuthology.orchestra.run.smithi196.stdout:(83/158): python3-oauthlib-3.1.1-5.el9.noarch.r 1.1 MB/s | 222 kB 00:00 2024-05-16T22:25:07.796 INFO:teuthology.orchestra.run.smithi196.stdout:(84/158): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-05-16T22:25:07.830 INFO:teuthology.orchestra.run.smithi196.stdout:(85/158): python3-prettytable-0.7.2-27.el9.noar 731 kB/s | 42 kB 00:00 2024-05-16T22:25:07.864 INFO:teuthology.orchestra.run.smithi196.stdout:(86/158): python3-protobuf-3.14.0-13.el9.noarch 4.0 MB/s | 269 kB 00:00 2024-05-16T22:25:07.897 INFO:teuthology.orchestra.run.smithi196.stdout:(87/158): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-05-16T22:25:07.906 INFO:teuthology.orchestra.run.smithi070.stdout:(98/158): socat-1.7.4.1-5.el9.x86_64.rpm 358 kB/s | 305 kB 00:00 2024-05-16T22:25:07.931 INFO:teuthology.orchestra.run.smithi196.stdout:(88/158): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-05-16T22:25:07.956 INFO:teuthology.orchestra.run.smithi196.stdout:(89/158): python3-pytz-2021.1-5.el9.noarch.rpm 878 kB/s | 51 kB 00:00 2024-05-16T22:25:07.990 INFO:teuthology.orchestra.run.smithi196.stdout:(90/158): python3-requests-oauthlib-1.3.0-12.el 925 kB/s | 54 kB 00:00 2024-05-16T22:25:08.057 INFO:teuthology.orchestra.run.smithi196.stdout:(91/158): python3-toml-0.10.2-6.el9.noarch.rpm 631 kB/s | 42 kB 00:00 2024-05-16T22:25:08.140 INFO:teuthology.orchestra.run.smithi070.stdout:(99/158): uuid-1.6.2-55.el9.x86_64.rpm 82 kB/s | 58 kB 00:00 2024-05-16T22:25:08.182 INFO:teuthology.orchestra.run.smithi196.stdout:(92/158): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.1 MB/s | 5.1 MB 00:01 2024-05-16T22:25:08.207 INFO:teuthology.orchestra.run.smithi196.stdout:(93/158): python3-wcwidth-0.2.5-8.el9.noarch.rp 295 kB/s | 44 kB 00:00 2024-05-16T22:25:08.241 INFO:teuthology.orchestra.run.smithi196.stdout:(94/158): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-05-16T22:25:08.266 INFO:teuthology.orchestra.run.smithi196.stdout:(95/158): qatlib-service-24.02.0-1.el9.x86_64.r 620 kB/s | 36 kB 00:00 2024-05-16T22:25:08.300 INFO:teuthology.orchestra.run.smithi196.stdout:(96/158): qatzip-libs-1.2.0-1.el9.x86_64.rpm 822 kB/s | 47 kB 00:00 2024-05-16T22:25:08.334 INFO:teuthology.orchestra.run.smithi196.stdout:(97/158): socat-1.7.4.1-5.el9.x86_64.rpm 4.5 MB/s | 305 kB 00:00 2024-05-16T22:25:08.359 INFO:teuthology.orchestra.run.smithi196.stdout:(98/158): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 58 kB 00:00 2024-05-16T22:25:08.392 INFO:teuthology.orchestra.run.smithi196.stdout:(99/158): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.6 MB/s | 94 kB 00:00 2024-05-16T22:25:08.409 INFO:teuthology.orchestra.run.smithi196.stdout:(100/158): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2024-05-16T22:25:08.443 INFO:teuthology.orchestra.run.smithi196.stdout:(101/158): zlib-devel-1.2.11-41.el9.x86_64.rpm 906 kB/s | 45 kB 00:00 2024-05-16T22:25:08.448 INFO:teuthology.orchestra.run.smithi070.stdout:(100/158): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 125 kB/s | 94 kB 00:00 2024-05-16T22:25:08.510 INFO:teuthology.orchestra.run.smithi196.stdout:(102/158): lua-devel-5.4.4-4.el9.x86_64.rpm 224 kB/s | 22 kB 00:00 2024-05-16T22:25:08.540 INFO:teuthology.orchestra.run.smithi070.stdout:(101/158): lua-devel-5.4.4-4.el9.x86_64.rpm 244 kB/s | 22 kB 00:00 2024-05-16T22:25:08.628 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2024-05-16T22:25:08.632 INFO:teuthology.orchestra.run.smithi070.stdout:(102/158): xmlstarlet-1.6.1-20.el9.x86_64.rpm 88 kB/s | 64 kB 00:00 2024-05-16T22:25:08.716 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/166 2024-05-16T22:25:08.755 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/166 2024-05-16T22:25:08.799 INFO:teuthology.orchestra.run.smithi070.stdout:(103/158): zlib-devel-1.2.11-41.el9.x86_64.rpm 68 kB/s | 45 kB 00:00 2024-05-16T22:25:08.802 INFO:teuthology.orchestra.run.smithi196.stdout:(103/158): protobuf-compiler-3.14.0-13.el9.x86_ 2.4 MB/s | 863 kB 00:00 2024-05-16T22:25:08.809 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/166 2024-05-16T22:25:08.833 INFO:teuthology.orchestra.run.smithi070.stdout:(104/158): protobuf-compiler-3.14.0-13.el9.x86_ 2.9 MB/s | 863 kB 00:00 2024-05-16T22:25:08.859 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/166 2024-05-16T22:25:08.884 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/166 2024-05-16T22:25:08.891 INFO:teuthology.orchestra.run.smithi070.stdout:(105/158): abseil-cpp-20211102.0-3.el9.x86_64.r 2.1 MB/s | 548 kB 00:00 2024-05-16T22:25:08.928 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/166 2024-05-16T22:25:09.150 INFO:teuthology.orchestra.run.smithi070.stdout:(106/158): grpc-data-1.46.7-10.el9.noarch.rpm 75 kB/s | 19 kB 00:00 2024-05-16T22:25:09.200 INFO:teuthology.orchestra.run.smithi070.stdout:(107/158): gperftools-libs-2.9.1-2.el9.x86_64.r 841 kB/s | 309 kB 00:00 2024-05-16T22:25:09.251 INFO:teuthology.orchestra.run.smithi070.stdout:(108/158): libarrow-doc-9.0.0-11.el9.noarch.rpm 519 kB/s | 26 kB 00:00 2024-05-16T22:25:09.280 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/166 2024-05-16T22:25:09.301 INFO:teuthology.orchestra.run.smithi070.stdout:(109/158): liboath-2.6.7-2.el9.x86_64.rpm 971 kB/s | 49 kB 00:00 2024-05-16T22:25:09.352 INFO:teuthology.orchestra.run.smithi070.stdout:(110/158): fscrypt-0.3.4-2.el9.x86_64.rpm 3.7 MB/s | 2.0 MB 00:00 2024-05-16T22:25:09.377 INFO:teuthology.orchestra.run.smithi070.stdout:(111/158): libunwind-1.6.2-1.el9.x86_64.rpm 895 kB/s | 67 kB 00:00 2024-05-16T22:25:09.393 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : librados2-2:19.0.0-3709.g43296076.el9.x86_64 8/166 2024-05-16T22:25:09.410 INFO:teuthology.orchestra.run.smithi070.stdout:(112/158): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-05-16T22:25:09.511 INFO:teuthology.orchestra.run.smithi070.stdout:(113/158): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 839 kB 00:00 2024-05-16T22:25:09.530 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librados2-2:19.0.0-3709.g43296076.el9.x86_64 8/166 2024-05-16T22:25:09.544 INFO:teuthology.orchestra.run.smithi196.stdout:(104/158): fscrypt-0.3.4-2.el9.x86_64.rpm 2.8 MB/s | 2.0 MB 00:00 2024-05-16T22:25:09.553 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcephfs2-2:19.0.0-3709.g43296076.el9.x86_64 9/166 2024-05-16T22:25:09.561 INFO:teuthology.orchestra.run.smithi070.stdout:(114/158): pam_fscrypt-0.3.4-2.el9.x86_64.rpm 10 MB/s | 1.8 MB 00:00 2024-05-16T22:25:09.577 INFO:teuthology.orchestra.run.smithi196.stdout:(105/158): abseil-cpp-20211102.0-3.el9.x86_64.r 514 kB/s | 548 kB 00:01 2024-05-16T22:25:09.620 INFO:teuthology.orchestra.run.smithi070.stdout:(115/158): python3-asyncssh-2.13.2-5.el9.noarch 4.9 MB/s | 548 kB 00:00 2024-05-16T22:25:09.628 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libcephfs2-2:19.0.0-3709.g43296076.el9.x86_64 9/166 2024-05-16T22:25:09.645 INFO:teuthology.orchestra.run.smithi070.stdout:(116/158): python3-bcrypt-3.2.2-1.el9.x86_64.rp 520 kB/s | 43 kB 00:00 2024-05-16T22:25:09.657 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rados-2:19.0.0-3709.g43296076.el9.x86_64 10/166 2024-05-16T22:25:09.661 INFO:teuthology.orchestra.run.smithi196.stdout:(106/158): gperftools-libs-2.9.1-2.el9.x86_64.r 2.6 MB/s | 309 kB 00:00 2024-05-16T22:25:09.670 INFO:teuthology.orchestra.run.smithi070.stdout:(117/158): python3-cachetools-4.2.4-1.el9.noarc 641 kB/s | 32 kB 00:00 2024-05-16T22:25:09.686 INFO:teuthology.orchestra.run.smithi196.stdout:(107/158): grpc-data-1.46.7-10.el9.noarch.rpm 180 kB/s | 19 kB 00:00 2024-05-16T22:25:09.696 INFO:teuthology.orchestra.run.smithi070.stdout:(118/158): python3-certifi-2021.10.8-2.el9.noar 298 kB/s | 15 kB 00:00 2024-05-16T22:25:09.721 INFO:teuthology.orchestra.run.smithi070.stdout:(119/158): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-05-16T22:25:09.746 INFO:teuthology.orchestra.run.smithi070.stdout:(120/158): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-05-16T22:25:09.771 INFO:teuthology.orchestra.run.smithi070.stdout:(121/158): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-05-16T22:25:09.805 INFO:teuthology.orchestra.run.smithi070.stdout:(122/158): python3-colorama-0.4.4-12.el9.noarch 603 kB/s | 35 kB 00:00 2024-05-16T22:25:09.805 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/166 2024-05-16T22:25:09.830 INFO:teuthology.orchestra.run.smithi070.stdout:(123/158): python3-google-auth-2.29.0-1.el9.noa 3.4 MB/s | 206 kB 00:00 2024-05-16T22:25:09.845 INFO:teuthology.orchestra.run.smithi196.stdout:(108/158): libarrow-doc-9.0.0-11.el9.noarch.rpm 165 kB/s | 26 kB 00:00 2024-05-16T22:25:09.872 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/166 2024-05-16T22:25:09.880 INFO:teuthology.orchestra.run.smithi070.stdout:(124/158): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-05-16T22:25:09.891 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcephsqlite-2:19.0.0-3709.g43296076.el9.x86_64 13/166 2024-05-16T22:25:09.939 INFO:teuthology.orchestra.run.smithi070.stdout:(125/158): python3-jaraco-8.2.1-3.el9.noarch.rp 184 kB/s | 11 kB 00:00 2024-05-16T22:25:09.970 INFO:teuthology.orchestra.run.smithi196.stdout:(109/158): libarrow-9.0.0-11.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-05-16T22:25:09.987 INFO:teuthology.orchestra.run.smithi196.stdout:(110/158): liboath-2.6.7-2.el9.x86_64.rpm 379 kB/s | 49 kB 00:00 2024-05-16T22:25:09.997 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3709.g43296076.el9.x86_64 13/166 2024-05-16T22:25:10.006 INFO:teuthology.orchestra.run.smithi070.stdout:(126/158): libarrow-9.0.0-11.el9.x86_64.rpm 5.2 MB/s | 4.4 MB 00:00 2024-05-16T22:25:10.017 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libradosstriper1-2:19.0.0-3709.g43296076.el9.x86 14/166 2024-05-16T22:25:10.031 INFO:teuthology.orchestra.run.smithi070.stdout:(127/158): python3-jaraco-classes-3.2.1-5.el9.n 192 kB/s | 18 kB 00:00 2024-05-16T22:25:10.080 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3709.g43296076.el9.x86 14/166 2024-05-16T22:25:10.082 INFO:teuthology.orchestra.run.smithi070.stdout:(128/158): python3-grpcio-1.46.7-10.el9.x86_64. 7.4 MB/s | 2.0 MB 00:00 2024-05-16T22:25:10.093 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/166 2024-05-16T22:25:10.107 INFO:teuthology.orchestra.run.smithi070.stdout:(129/158): python3-jaraco-collections-3.0.0-8.e 230 kB/s | 23 kB 00:00 2024-05-16T22:25:10.119 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/166 2024-05-16T22:25:10.132 INFO:teuthology.orchestra.run.smithi070.stdout:(130/158): python3-jaraco-functools-3.5.0-2.el9 194 kB/s | 19 kB 00:00 2024-05-16T22:25:10.157 INFO:teuthology.orchestra.run.smithi070.stdout:(131/158): python3-jaraco-text-3.2.0-6.el9.noar 261 kB/s | 20 kB 00:00 2024-05-16T22:25:10.191 INFO:teuthology.orchestra.run.smithi070.stdout:(132/158): python3-logutils-0.3.5-21.el9.noarch 794 kB/s | 46 kB 00:00 2024-05-16T22:25:10.216 INFO:teuthology.orchestra.run.smithi070.stdout:(133/158): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-05-16T22:25:10.250 INFO:teuthology.orchestra.run.smithi070.stdout:(134/158): python3-natsort-7.1.1-5.el9.noarch.r 988 kB/s | 58 kB 00:00 2024-05-16T22:25:10.262 INFO:teuthology.orchestra.run.smithi196.stdout:(111/158): python3-scipy-1.6.2-8.el9.x86_64.rpm 7.1 MB/s | 16 MB 00:02 2024-05-16T22:25:10.275 INFO:teuthology.orchestra.run.smithi070.stdout:(135/158): python3-pecan-1.4.2-3.el9.noarch.rpm 4.5 MB/s | 272 kB 00:00 2024-05-16T22:25:10.287 INFO:teuthology.orchestra.run.smithi196.stdout:(112/158): libunwind-1.6.2-1.el9.x86_64.rpm 213 kB/s | 67 kB 00:00 2024-05-16T22:25:10.300 INFO:teuthology.orchestra.run.smithi070.stdout:(136/158): python3-portend-3.1.0-2.el9.noarch.r 327 kB/s | 16 kB 00:00 2024-05-16T22:25:10.310 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/166 2024-05-16T22:25:10.312 INFO:teuthology.orchestra.run.smithi196.stdout:(113/158): luarocks-3.9.2-5.el9.noarch.rpm 466 kB/s | 151 kB 00:00 2024-05-16T22:25:10.326 INFO:teuthology.orchestra.run.smithi070.stdout:(137/158): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-05-16T22:25:10.351 INFO:teuthology.orchestra.run.smithi070.stdout:(138/158): python3-pyperclip-1.8.2-2.el9.noarch 558 kB/s | 28 kB 00:00 2024-05-16T22:25:10.376 INFO:teuthology.orchestra.run.smithi070.stdout:(139/158): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-05-16T22:25:10.410 INFO:teuthology.orchestra.run.smithi070.stdout:(140/158): python3-kubernetes-26.1.0-2.el9.noar 3.7 MB/s | 1.0 MB 00:00 2024-05-16T22:25:10.432 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/166 2024-05-16T22:25:10.435 INFO:teuthology.orchestra.run.smithi070.stdout:(141/158): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-05-16T22:25:10.461 INFO:teuthology.orchestra.run.smithi070.stdout:(142/158): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2024-05-16T22:25:10.486 INFO:teuthology.orchestra.run.smithi070.stdout:(143/158): python3-tempora-5.0.0-2.el9.noarch.r 473 kB/s | 36 kB 00:00 2024-05-16T22:25:10.496 INFO:teuthology.orchestra.run.smithi196.stdout:(114/158): pam_fscrypt-0.3.4-2.el9.x86_64.rpm 8.0 MB/s | 1.8 MB 00:00 2024-05-16T22:25:10.511 INFO:teuthology.orchestra.run.smithi070.stdout:(144/158): python3-typing-extensions-4.4.0-2.el 674 kB/s | 51 kB 00:00 2024-05-16T22:25:10.536 INFO:teuthology.orchestra.run.smithi070.stdout:(145/158): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-05-16T22:25:10.546 INFO:teuthology.orchestra.run.smithi196.stdout:(115/158): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.5 MB/s | 839 kB 00:00 2024-05-16T22:25:10.570 INFO:teuthology.orchestra.run.smithi070.stdout:(146/158): python3-websocket-client-1.2.3-2.el9 1.0 MB/s | 90 kB 00:00 2024-05-16T22:25:10.587 INFO:teuthology.orchestra.run.smithi070.stdout:(147/158): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-05-16T22:25:10.588 INFO:teuthology.orchestra.run.smithi196.stdout:(116/158): python3-asyncssh-2.13.2-5.el9.noarch 2.0 MB/s | 548 kB 00:00 2024-05-16T22:25:10.599 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/166 2024-05-16T22:25:10.612 INFO:teuthology.orchestra.run.smithi070.stdout:(148/158): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-05-16T22:25:10.638 INFO:teuthology.orchestra.run.smithi070.stdout:(149/158): re2-20211101-3.el9.x86_64.rpm 2.8 MB/s | 192 kB 00:00 2024-05-16T22:25:10.641 INFO:teuthology.orchestra.run.smithi196.stdout:(117/158): python3-bcrypt-3.2.2-1.el9.x86_64.rp 330 kB/s | 43 kB 00:00 2024-05-16T22:25:10.668 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/166 2024-05-16T22:25:10.697 INFO:teuthology.orchestra.run.smithi196.stdout:(118/158): python3-cachetools-4.2.4-1.el9.noarc 298 kB/s | 32 kB 00:00 2024-05-16T22:25:10.723 INFO:teuthology.orchestra.run.smithi196.stdout:(119/158): python3-certifi-2021.10.8-2.el9.noar 113 kB/s | 15 kB 00:00 2024-05-16T22:25:10.729 INFO:teuthology.orchestra.run.smithi070.stdout:(150/158): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-05-16T22:25:10.756 INFO:teuthology.orchestra.run.smithi196.stdout:(120/158): python3-cheroot-8.6.0-4.el9.noarch.r 1.5 MB/s | 172 kB 00:00 2024-05-16T22:25:10.765 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/166 2024-05-16T22:25:10.815 INFO:teuthology.orchestra.run.smithi196.stdout:(121/158): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2024-05-16T22:25:10.836 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : NetworkManager-1:1.47.90-1.el9.x86_64 18/166 2024-05-16T22:25:10.848 INFO:teuthology.orchestra.run.smithi196.stdout:(122/158): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.4 MB/s | 303 kB 00:00 2024-05-16T22:25:10.874 INFO:teuthology.orchestra.run.smithi196.stdout:(123/158): python3-colorama-0.4.4-12.el9.noarch 303 kB/s | 35 kB 00:00 2024-05-16T22:25:10.932 INFO:teuthology.orchestra.run.smithi196.stdout:(124/158): python3-google-auth-2.29.0-1.el9.noa 1.8 MB/s | 206 kB 00:00 2024-05-16T22:25:10.946 INFO:teuthology.orchestra.run.smithi070.stdout:(151/158): librbd1-19.0.0-3709.g43296076.el9.x8 10 MB/s | 3.1 MB 00:00 2024-05-16T22:25:11.043 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/166 2024-05-16T22:25:11.049 INFO:teuthology.orchestra.run.smithi196.stdout:(125/158): python3-grpcio-1.46.7-10.el9.x86_64. 10 MB/s | 2.0 MB 00:00 2024-05-16T22:25:11.075 INFO:teuthology.orchestra.run.smithi196.stdout:(126/158): python3-grpcio-tools-1.46.7-10.el9.x 722 kB/s | 144 kB 00:00 2024-05-16T22:25:11.091 INFO:teuthology.orchestra.run.smithi196.stdout:(127/158): python3-jaraco-8.2.1-3.el9.noarch.rp 68 kB/s | 11 kB 00:00 2024-05-16T22:25:11.113 INFO:teuthology.orchestra.run.smithi070.stdout:(152/158): NetworkManager-1.47.90-1.el9.x86_64. 6.0 MB/s | 2.3 MB 00:00 2024-05-16T22:25:11.150 INFO:teuthology.orchestra.run.smithi196.stdout:(128/158): python3-jaraco-classes-3.2.1-5.el9.n 180 kB/s | 18 kB 00:00 2024-05-16T22:25:11.154 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/166 2024-05-16T22:25:11.189 INFO:teuthology.orchestra.run.smithi070.stdout:(153/158): NetworkManager-team-1.47.90-1.el9.x8 555 kB/s | 41 kB 00:00 2024-05-16T22:25:11.190 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/166 2024-05-16T22:25:11.192 INFO:teuthology.orchestra.run.smithi196.stdout:(129/158): python3-jaraco-collections-3.0.0-8.e 233 kB/s | 23 kB 00:00 2024-05-16T22:25:11.209 INFO:teuthology.orchestra.run.smithi196.stdout:(130/158): python3-jaraco-functools-3.5.0-2.el9 168 kB/s | 19 kB 00:00 2024-05-16T22:25:11.225 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/166 2024-05-16T22:25:11.259 INFO:teuthology.orchestra.run.smithi196.stdout:(131/158): python3-jaraco-text-3.2.0-6.el9.noar 182 kB/s | 20 kB 00:00 2024-05-16T22:25:11.264 INFO:teuthology.orchestra.run.smithi070.stdout:(154/158): NetworkManager-tui-1.47.90-1.el9.x86 3.2 MB/s | 248 kB 00:00 2024-05-16T22:25:11.300 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/166 2024-05-16T22:25:11.314 INFO:teuthology.orchestra.run.smithi070.stdout:(155/158): NetworkManager-libnm-1.47.90-1.el9.x 4.9 MB/s | 1.8 MB 00:00 2024-05-16T22:25:11.343 INFO:teuthology.orchestra.run.smithi196.stdout:(132/158): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-05-16T22:25:11.349 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/166 2024-05-16T22:25:11.359 INFO:teuthology.orchestra.run.smithi196.stdout:(133/158): python3-logutils-0.3.5-21.el9.noarch 309 kB/s | 46 kB 00:00 2024-05-16T22:25:11.373 INFO:teuthology.orchestra.run.smithi070.stdout:(156/158): librados2-19.0.0-3709.g43296076.el9. 4.4 MB/s | 3.3 MB 00:00 2024-05-16T22:25:11.385 INFO:teuthology.orchestra.run.smithi196.stdout:(134/158): python3-more-itertools-8.12.0-2.el9. 631 kB/s | 79 kB 00:00 2024-05-16T22:25:11.393 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/166 2024-05-16T22:25:11.425 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/166 2024-05-16T22:25:11.440 INFO:teuthology.orchestra.run.smithi070.stdout:(157/158): openssl-3.2.1-1.el9.x86_64.rpm 7.7 MB/s | 1.3 MB 00:00 2024-05-16T22:25:11.455 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/166 2024-05-16T22:25:11.460 INFO:teuthology.orchestra.run.smithi196.stdout:(135/158): python3-natsort-7.1.1-5.el9.noarch.r 586 kB/s | 58 kB 00:00 2024-05-16T22:25:11.494 INFO:teuthology.orchestra.run.smithi196.stdout:(136/158): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-05-16T22:25:11.510 INFO:teuthology.orchestra.run.smithi196.stdout:(137/158): python3-portend-3.1.0-2.el9.noarch.r 131 kB/s | 16 kB 00:00 2024-05-16T22:25:11.526 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/166 2024-05-16T22:25:11.565 INFO:teuthology.orchestra.run.smithi070.stdout:(158/158): openssl-libs-3.2.1-1.el9.x86_64.rpm 9.6 MB/s | 2.4 MB 00:00 2024-05-16T22:25:11.568 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-05-16T22:25:11.569 INFO:teuthology.orchestra.run.smithi070.stdout:Total 7.0 MB/s | 223 MB 00:31 2024-05-16T22:25:11.569 INFO:teuthology.orchestra.run.smithi196.stdout:(138/158): python3-pyOpenSSL-21.0.0-1.el9.noarc 851 kB/s | 90 kB 00:00 2024-05-16T22:25:11.587 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/166 2024-05-16T22:25:11.594 INFO:teuthology.orchestra.run.smithi196.stdout:(139/158): python3-pyperclip-1.8.2-2.el9.noarch 283 kB/s | 28 kB 00:00 2024-05-16T22:25:11.611 INFO:teuthology.orchestra.run.smithi196.stdout:(140/158): python3-repoze-lru-0.7-16.el9.noarch 308 kB/s | 31 kB 00:00 2024-05-16T22:25:11.617 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/166 2024-05-16T22:25:11.661 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/166 2024-05-16T22:25:11.687 INFO:teuthology.orchestra.run.smithi196.stdout:(141/158): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-05-16T22:25:11.712 INFO:teuthology.orchestra.run.smithi196.stdout:(142/158): python3-rsa-4.9-2.el9.noarch.rpm 509 kB/s | 59 kB 00:00 2024-05-16T22:25:11.729 INFO:teuthology.orchestra.run.smithi196.stdout:(143/158): python3-tempora-5.0.0-2.el9.noarch.r 307 kB/s | 36 kB 00:00 2024-05-16T22:25:11.739 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/166 2024-05-16T22:25:11.771 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-ceph-common-2:19.0.0-3709.g43296076.el9. 32/166 2024-05-16T22:25:11.779 INFO:teuthology.orchestra.run.smithi196.stdout:(144/158): python3-typing-extensions-4.4.0-2.el 561 kB/s | 51 kB 00:00 2024-05-16T22:25:11.815 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-ceph-argparse-2:19.0.0-3709.g43296076.el 33/166 2024-05-16T22:25:11.821 INFO:teuthology.orchestra.run.smithi196.stdout:(145/158): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-05-16T22:25:11.846 INFO:teuthology.orchestra.run.smithi196.stdout:(146/158): python3-websocket-client-1.2.3-2.el9 769 kB/s | 90 kB 00:00 2024-05-16T22:25:11.852 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cephfs-2:19.0.0-3709.g43296076.el9.x86_6 34/166 2024-05-16T22:25:11.896 INFO:teuthology.orchestra.run.smithi196.stdout:(147/158): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2024-05-16T22:25:11.913 INFO:teuthology.orchestra.run.smithi196.stdout:(148/158): python3-zc-lockfile-2.0-10.el9.noarc 220 kB/s | 20 kB 00:00 2024-05-16T22:25:11.926 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/166 2024-05-16T22:25:11.956 INFO:teuthology.orchestra.run.smithi196.stdout:(149/158): re2-20211101-3.el9.x86_64.rpm 1.7 MB/s | 192 kB 00:00 2024-05-16T22:25:11.984 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : luarocks-3.9.2-5.el9.noarch 36/166 2024-05-16T22:25:12.061 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/166 2024-05-16T22:25:12.072 INFO:teuthology.orchestra.run.smithi196.stdout:(150/158): thrift-0.15.0-2.el9.x86_64.rpm 9.0 MB/s | 1.6 MB 00:00 2024-05-16T22:25:12.206 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/166 2024-05-16T22:25:12.270 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/166 2024-05-16T22:25:12.398 INFO:teuthology.orchestra.run.smithi196.stdout:(151/158): librados2-19.0.0-3709.g43296076.el9. 6.9 MB/s | 3.3 MB 00:00 2024-05-16T22:25:12.473 INFO:teuthology.orchestra.run.smithi196.stdout:(152/158): NetworkManager-1.47.90-1.el9.x86_64. 5.8 MB/s | 2.3 MB 00:00 2024-05-16T22:25:12.557 INFO:teuthology.orchestra.run.smithi196.stdout:(153/158): librbd1-19.0.0-3709.g43296076.el9.x8 5.2 MB/s | 3.1 MB 00:00 2024-05-16T22:25:12.574 INFO:teuthology.orchestra.run.smithi196.stdout:(154/158): NetworkManager-team-1.47.90-1.el9.x8 418 kB/s | 41 kB 00:00 2024-05-16T22:25:12.696 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-05-16T22:25:12.724 INFO:teuthology.orchestra.run.smithi196.stdout:(155/158): openssl-3.2.1-1.el9.x86_64.rpm 9.0 MB/s | 1.3 MB 00:00 2024-05-16T22:25:12.774 INFO:teuthology.orchestra.run.smithi196.stdout:(156/158): NetworkManager-tui-1.47.90-1.el9.x86 1.1 MB/s | 248 kB 00:00 2024-05-16T22:25:12.839 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/166 2024-05-16T22:25:12.845 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-05-16T22:25:12.845 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-05-16T22:25:12.849 INFO:teuthology.orchestra.run.smithi196.stdout:(157/158): NetworkManager-libnm-1.47.90-1.el9.x 4.0 MB/s | 1.8 MB 00:00 2024-05-16T22:25:12.926 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/166 2024-05-16T22:25:12.961 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/166 2024-05-16T22:25:12.974 INFO:teuthology.orchestra.run.smithi196.stdout:(158/158): openssl-libs-3.2.1-1.el9.x86_64.rpm 9.6 MB/s | 2.4 MB 00:00 2024-05-16T22:25:12.983 INFO:teuthology.orchestra.run.smithi196.stdout:-------------------------------------------------------------------------------- 2024-05-16T22:25:12.984 INFO:teuthology.orchestra.run.smithi196.stdout:Total 12 MB/s | 223 MB 00:18 2024-05-16T22:25:13.004 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/166 2024-05-16T22:25:13.042 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librados-devel-2:19.0.0-3709.g43296076.el9.x86_6 44/166 2024-05-16T22:25:13.084 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/166 2024-05-16T22:25:13.240 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/166 2024-05-16T22:25:13.353 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/166 2024-05-16T22:25:13.405 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : pam_fscrypt-0.3.4-2.el9.x86_64 48/166 2024-05-16T22:25:13.438 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : fscrypt-0.3.4-2.el9.x86_64 49/166 2024-05-16T22:25:13.534 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/166 2024-05-16T22:25:13.595 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/166 2024-05-16T22:25:13.669 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/166 2024-05-16T22:25:13.706 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/166 2024-05-16T22:25:13.743 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/166 2024-05-16T22:25:13.790 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/166 2024-05-16T22:25:13.833 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/166 2024-05-16T22:25:13.964 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/166 2024-05-16T22:25:14.129 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/166 2024-05-16T22:25:14.275 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/166 2024-05-16T22:25:14.317 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/166 2024-05-16T22:25:14.347 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 61/166 2024-05-16T22:25:14.397 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 62/166 2024-05-16T22:25:14.495 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 63/166 2024-05-16T22:25:14.521 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 64/166 2024-05-16T22:25:14.562 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 65/166 2024-05-16T22:25:14.595 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 66/166 2024-05-16T22:25:14.620 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 67/166 2024-05-16T22:25:14.699 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 68/166 2024-05-16T22:25:14.710 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-05-16T22:25:14.710 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-05-16T22:25:14.827 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 69/166 2024-05-16T22:25:14.878 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 70/166 2024-05-16T22:25:14.906 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 71/166 2024-05-16T22:25:14.940 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 72/166 2024-05-16T22:25:14.979 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : uuid-1.6.2-55.el9.x86_64 73/166 2024-05-16T22:25:15.021 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 74/166 2024-05-16T22:25:15.049 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 75/166 2024-05-16T22:25:15.084 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 76/166 2024-05-16T22:25:15.117 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 77/166 2024-05-16T22:25:15.159 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 78/166 2024-05-16T22:25:15.193 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 79/166 2024-05-16T22:25:15.284 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 80/166 2024-05-16T22:25:15.341 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 81/166 2024-05-16T22:25:15.371 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 82/166 2024-05-16T22:25:15.428 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 83/166 2024-05-16T22:25:15.541 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-packaging-20.9-5.el9.noarch 84/166 2024-05-16T22:25:15.591 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 85/166 2024-05-16T22:25:16.042 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction check 2024-05-16T22:25:16.285 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction check succeeded. 2024-05-16T22:25:16.285 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction test 2024-05-16T22:25:16.362 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/166 2024-05-16T22:25:16.412 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 87/166 2024-05-16T22:25:16.446 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 88/166 2024-05-16T22:25:16.550 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 89/166 2024-05-16T22:25:16.605 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 90/166 2024-05-16T22:25:16.695 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/166 2024-05-16T22:25:16.739 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/166 2024-05-16T22:25:16.917 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/166 2024-05-16T22:25:16.945 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/166 2024-05-16T22:25:17.026 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/166 2024-05-16T22:25:17.715 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/166 2024-05-16T22:25:17.832 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/166 2024-05-16T22:25:18.792 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction test succeeded. 2024-05-16T22:25:18.795 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction 2024-05-16T22:25:19.138 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/166 2024-05-16T22:25:19.209 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/166 2024-05-16T22:25:19.237 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/166 2024-05-16T22:25:19.270 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/166 2024-05-16T22:25:19.600 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/166 2024-05-16T22:25:19.649 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : librbd1-2:19.0.0-3709.g43296076.el9.x86_64 103/166 2024-05-16T22:25:19.725 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librbd1-2:19.0.0-3709.g43296076.el9.x86_64 103/166 2024-05-16T22:25:19.754 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rbd-2:19.0.0-3709.g43296076.el9.x86_64 104/166 2024-05-16T22:25:19.791 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/166 2024-05-16T22:25:20.307 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/166 2024-05-16T22:25:20.336 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librgw2-2:19.0.0-3709.g43296076.el9.x86_64 107/166 2024-05-16T22:25:20.407 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librgw2-2:19.0.0-3709.g43296076.el9.x86_64 107/166 2024-05-16T22:25:20.438 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rgw-2:19.0.0-3709.g43296076.el9.x86_64 108/166 2024-05-16T22:25:20.887 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-05-16T22:25:20.955 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/166 2024-05-16T22:25:20.993 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/166 2024-05-16T22:25:21.054 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/166 2024-05-16T22:25:21.089 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/166 2024-05-16T22:25:21.114 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/166 2024-05-16T22:25:21.157 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/166 2024-05-16T22:25:21.500 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/166 2024-05-16T22:25:21.615 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : librados2-2:19.0.0-3709.g43296076.el9.x86_64 8/166 2024-05-16T22:25:21.739 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librados2-2:19.0.0-3709.g43296076.el9.x86_64 8/166 2024-05-16T22:25:21.800 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcephfs2-2:19.0.0-3709.g43296076.el9.x86_64 9/166 2024-05-16T22:25:21.873 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libcephfs2-2:19.0.0-3709.g43296076.el9.x86_64 9/166 2024-05-16T22:25:21.904 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rados-2:19.0.0-3709.g43296076.el9.x86_64 10/166 2024-05-16T22:25:22.052 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/166 2024-05-16T22:25:22.109 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/166 2024-05-16T22:25:22.138 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcephsqlite-2:19.0.0-3709.g43296076.el9.x86_64 13/166 2024-05-16T22:25:22.241 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3709.g43296076.el9.x86_64 13/166 2024-05-16T22:25:22.263 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libradosstriper1-2:19.0.0-3709.g43296076.el9.x86 14/166 2024-05-16T22:25:22.326 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3709.g43296076.el9.x86 14/166 2024-05-16T22:25:22.348 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/166 2024-05-16T22:25:22.368 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/166 2024-05-16T22:25:22.556 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/166 2024-05-16T22:25:22.689 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/166 2024-05-16T22:25:22.788 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 109/166 2024-05-16T22:25:22.826 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 109/166 2024-05-16T22:25:22.837 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/166 2024-05-16T22:25:22.897 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/166 2024-05-16T22:25:22.989 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/166 2024-05-16T22:25:23.082 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : NetworkManager-1:1.47.90-1.el9.x86_64 18/166 2024-05-16T22:25:23.281 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/166 2024-05-16T22:25:23.386 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/166 2024-05-16T22:25:23.413 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 109/166 2024-05-16T22:25:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/166 2024-05-16T22:25:23.454 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/166 2024-05-16T22:25:23.454 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-base-2:19.0.0-3709.g43296076.el9.x86_64 110/166 2024-05-16T22:25:23.526 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/166 2024-05-16T22:25:23.547 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-base-2:19.0.0-3709.g43296076.el9.x86_64 110/166 2024-05-16T22:25:23.547 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-16T22:25:23.547 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-16T22:25:23.547 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:25:23.562 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/166 2024-05-16T22:25:23.589 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-selinux-2:19.0.0-3709.g43296076.el9.x86_64 111/166 2024-05-16T22:25:23.605 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/166 2024-05-16T22:25:23.638 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/166 2024-05-16T22:25:23.666 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/166 2024-05-16T22:25:23.733 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/166 2024-05-16T22:25:23.796 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/166 2024-05-16T22:25:23.827 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/166 2024-05-16T22:25:23.863 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/166 2024-05-16T22:25:23.937 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/166 2024-05-16T22:25:23.973 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-ceph-common-2:19.0.0-3709.g43296076.el9. 32/166 2024-05-16T22:25:24.017 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-ceph-argparse-2:19.0.0-3709.g43296076.el 33/166 2024-05-16T22:25:24.046 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cephfs-2:19.0.0-3709.g43296076.el9.x86_6 34/166 2024-05-16T22:25:24.114 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/166 2024-05-16T22:25:24.161 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : luarocks-3.9.2-5.el9.noarch 36/166 2024-05-16T22:25:24.233 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/166 2024-05-16T22:25:24.373 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/166 2024-05-16T22:25:24.429 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/166 2024-05-16T22:25:24.954 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/166 2024-05-16T22:25:25.040 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/166 2024-05-16T22:25:25.079 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/166 2024-05-16T22:25:25.122 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/166 2024-05-16T22:25:25.159 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librados-devel-2:19.0.0-3709.g43296076.el9.x86_6 44/166 2024-05-16T22:25:25.201 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/166 2024-05-16T22:25:25.346 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/166 2024-05-16T22:25:25.433 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/166 2024-05-16T22:25:25.433 INFO:teuthology.orchestra.run.smithi196.stdout: Preparing : 1/1 2024-05-16T22:25:25.488 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : pam_fscrypt-0.3.4-2.el9.x86_64 48/166 2024-05-16T22:25:25.521 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : fscrypt-0.3.4-2.el9.x86_64 49/166 2024-05-16T22:25:25.540 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/166 2024-05-16T22:25:25.611 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/166 2024-05-16T22:25:25.615 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/166 2024-05-16T22:25:25.686 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/166 2024-05-16T22:25:25.730 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/166 2024-05-16T22:25:25.758 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/166 2024-05-16T22:25:25.785 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/166 2024-05-16T22:25:25.790 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/166 2024-05-16T22:25:25.824 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/166 2024-05-16T22:25:25.842 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/166 2024-05-16T22:25:25.889 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/166 2024-05-16T22:25:25.926 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/166 2024-05-16T22:25:25.928 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/166 2024-05-16T22:25:25.968 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/166 2024-05-16T22:25:26.010 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/166 2024-05-16T22:25:26.147 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/166 2024-05-16T22:25:26.191 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/166 2024-05-16T22:25:26.222 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 61/166 2024-05-16T22:25:26.263 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 62/166 2024-05-16T22:25:26.357 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 63/166 2024-05-16T22:25:26.390 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 64/166 2024-05-16T22:25:26.408 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/166 2024-05-16T22:25:26.430 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 65/166 2024-05-16T22:25:26.456 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 66/166 2024-05-16T22:25:26.481 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 67/166 2024-05-16T22:25:26.514 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : librados2-2:19.0.0-3709.g43296076.el9.x86_64 8/166 2024-05-16T22:25:26.555 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 68/166 2024-05-16T22:25:26.680 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 69/166 2024-05-16T22:25:26.694 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librados2-2:19.0.0-3709.g43296076.el9.x86_64 8/166 2024-05-16T22:25:26.721 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 70/166 2024-05-16T22:25:26.731 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libcephfs2-2:19.0.0-3709.g43296076.el9.x86_64 9/166 2024-05-16T22:25:26.748 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 71/166 2024-05-16T22:25:26.783 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 72/166 2024-05-16T22:25:26.822 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : uuid-1.6.2-55.el9.x86_64 73/166 2024-05-16T22:25:26.854 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 74/166 2024-05-16T22:25:26.856 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libcephfs2-2:19.0.0-3709.g43296076.el9.x86_64 9/166 2024-05-16T22:25:26.884 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 75/166 2024-05-16T22:25:26.888 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-rados-2:19.0.0-3709.g43296076.el9.x86_64 10/166 2024-05-16T22:25:26.910 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 76/166 2024-05-16T22:25:26.943 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 77/166 2024-05-16T22:25:26.984 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 78/166 2024-05-16T22:25:27.019 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 79/166 2024-05-16T22:25:27.105 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 80/166 2024-05-16T22:25:27.149 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 81/166 2024-05-16T22:25:27.173 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/166 2024-05-16T22:25:27.181 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 82/166 2024-05-16T22:25:27.227 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 83/166 2024-05-16T22:25:27.241 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/166 2024-05-16T22:25:27.268 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libcephsqlite-2:19.0.0-3709.g43296076.el9.x86_64 13/166 2024-05-16T22:25:27.325 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-packaging-20.9-5.el9.noarch 84/166 2024-05-16T22:25:27.381 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 85/166 2024-05-16T22:25:27.435 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3709.g43296076.el9.x86_64 13/166 2024-05-16T22:25:27.469 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libradosstriper1-2:19.0.0-3709.g43296076.el9.x86 14/166 2024-05-16T22:25:27.556 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3709.g43296076.el9.x86 14/166 2024-05-16T22:25:27.587 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/166 2024-05-16T22:25:27.654 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/166 2024-05-16T22:25:27.939 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/166 2024-05-16T22:25:28.090 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/166 2024-05-16T22:25:28.128 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 87/166 2024-05-16T22:25:28.162 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 88/166 2024-05-16T22:25:28.259 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 89/166 2024-05-16T22:25:28.261 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/166 2024-05-16T22:25:28.311 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 90/166 2024-05-16T22:25:28.390 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/166 2024-05-16T22:25:28.431 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/166 2024-05-16T22:25:28.485 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/166 2024-05-16T22:25:28.590 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/166 2024-05-16T22:25:28.607 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/166 2024-05-16T22:25:28.637 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/166 2024-05-16T22:25:28.714 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/166 2024-05-16T22:25:28.778 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/166 2024-05-16T22:25:28.888 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : NetworkManager-1:1.47.90-1.el9.x86_64 18/166 2024-05-16T22:25:29.230 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/166 2024-05-16T22:25:29.343 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/166 2024-05-16T22:25:29.433 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/166 2024-05-16T22:25:29.459 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/166 2024-05-16T22:25:29.469 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/166 2024-05-16T22:25:29.523 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/166 2024-05-16T22:25:29.639 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/166 2024-05-16T22:25:29.689 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/166 2024-05-16T22:25:29.753 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/166 2024-05-16T22:25:29.802 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/166 2024-05-16T22:25:29.842 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/166 2024-05-16T22:25:29.957 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/166 2024-05-16T22:25:30.023 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/166 2024-05-16T22:25:30.062 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/166 2024-05-16T22:25:30.141 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/166 2024-05-16T22:25:30.254 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/166 2024-05-16T22:25:30.288 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-ceph-common-2:19.0.0-3709.g43296076.el9. 32/166 2024-05-16T22:25:30.338 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-ceph-argparse-2:19.0.0-3709.g43296076.el 33/166 2024-05-16T22:25:30.370 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cephfs-2:19.0.0-3709.g43296076.el9.x86_6 34/166 2024-05-16T22:25:30.474 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/166 2024-05-16T22:25:30.540 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : luarocks-3.9.2-5.el9.noarch 36/166 2024-05-16T22:25:30.636 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/166 2024-05-16T22:25:30.676 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/166 2024-05-16T22:25:30.748 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/166 2024-05-16T22:25:30.776 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/166 2024-05-16T22:25:30.805 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/166 2024-05-16T22:25:30.809 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/166 2024-05-16T22:25:30.880 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/166 2024-05-16T22:25:31.128 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/166 2024-05-16T22:25:31.180 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : librbd1-2:19.0.0-3709.g43296076.el9.x86_64 103/166 2024-05-16T22:25:31.253 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librbd1-2:19.0.0-3709.g43296076.el9.x86_64 103/166 2024-05-16T22:25:31.277 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rbd-2:19.0.0-3709.g43296076.el9.x86_64 104/166 2024-05-16T22:25:31.313 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/166 2024-05-16T22:25:31.564 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/166 2024-05-16T22:25:31.665 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/166 2024-05-16T22:25:31.703 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/166 2024-05-16T22:25:31.748 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/166 2024-05-16T22:25:31.789 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : librados-devel-2:19.0.0-3709.g43296076.el9.x86_6 44/166 2024-05-16T22:25:31.800 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/166 2024-05-16T22:25:31.850 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librgw2-2:19.0.0-3709.g43296076.el9.x86_64 107/166 2024-05-16T22:25:31.862 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/166 2024-05-16T22:25:31.920 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librgw2-2:19.0.0-3709.g43296076.el9.x86_64 107/166 2024-05-16T22:25:31.943 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rgw-2:19.0.0-3709.g43296076.el9.x86_64 108/166 2024-05-16T22:25:32.058 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/166 2024-05-16T22:25:32.187 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/166 2024-05-16T22:25:32.263 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : pam_fscrypt-0.3.4-2.el9.x86_64 48/166 2024-05-16T22:25:32.298 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : fscrypt-0.3.4-2.el9.x86_64 49/166 2024-05-16T22:25:32.419 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/166 2024-05-16T22:25:32.483 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/166 2024-05-16T22:25:32.566 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/166 2024-05-16T22:25:32.607 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/166 2024-05-16T22:25:32.645 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/166 2024-05-16T22:25:32.708 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/166 2024-05-16T22:25:32.751 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/166 2024-05-16T22:25:32.805 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/166 2024-05-16T22:25:32.864 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/166 2024-05-16T22:25:33.071 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/166 2024-05-16T22:25:33.119 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/166 2024-05-16T22:25:33.186 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 61/166 2024-05-16T22:25:33.246 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 62/166 2024-05-16T22:25:33.377 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 63/166 2024-05-16T22:25:33.423 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 64/166 2024-05-16T22:25:33.513 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 65/166 2024-05-16T22:25:33.556 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 66/166 2024-05-16T22:25:33.588 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 67/166 2024-05-16T22:25:33.790 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 68/166 2024-05-16T22:25:33.973 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 69/166 2024-05-16T22:25:34.010 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 70/166 2024-05-16T22:25:34.051 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 71/166 2024-05-16T22:25:34.095 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 72/166 2024-05-16T22:25:34.151 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : uuid-1.6.2-55.el9.x86_64 73/166 2024-05-16T22:25:34.176 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 109/166 2024-05-16T22:25:34.206 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 109/166 2024-05-16T22:25:34.221 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 74/166 2024-05-16T22:25:34.263 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 75/166 2024-05-16T22:25:34.310 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 76/166 2024-05-16T22:25:34.359 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 77/166 2024-05-16T22:25:34.425 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 78/166 2024-05-16T22:25:34.465 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 79/166 2024-05-16T22:25:34.604 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 80/166 2024-05-16T22:25:34.668 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 81/166 2024-05-16T22:25:34.706 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 82/166 2024-05-16T22:25:34.756 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 109/166 2024-05-16T22:25:34.775 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 83/166 2024-05-16T22:25:34.784 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-base-2:19.0.0-3709.g43296076.el9.x86_64 110/166 2024-05-16T22:25:34.875 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-base-2:19.0.0-3709.g43296076.el9.x86_64 110/166 2024-05-16T22:25:34.875 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-16T22:25:34.875 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-16T22:25:34.875 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-16T22:25:34.902 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-selinux-2:19.0.0-3709.g43296076.el9.x86_64 111/166 2024-05-16T22:25:34.933 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-packaging-20.9-5.el9.noarch 84/166 2024-05-16T22:25:35.002 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 85/166 2024-05-16T22:25:35.537 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3709.g43296076.el9.x86_64 111/166 2024-05-16T22:25:35.538 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /sys 2024-05-16T22:25:35.538 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /proc 2024-05-16T22:25:35.538 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /mnt 2024-05-16T22:25:35.538 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /var/tmp 2024-05-16T22:25:35.538 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /home 2024-05-16T22:25:35.538 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /root 2024-05-16T22:25:35.538 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /tmp 2024-05-16T22:25:35.538 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:25:35.738 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-volume-2:19.0.0-3709.g43296076.el9.noarch 112/166 2024-05-16T22:25:35.755 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-volume-2:19.0.0-3709.g43296076.el9.noarch 112/166 2024-05-16T22:25:35.755 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T22:25:35.755 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-16T22:25:35.756 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:25:35.966 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/166 2024-05-16T22:25:36.018 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 87/166 2024-05-16T22:25:36.052 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 88/166 2024-05-16T22:25:36.173 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 89/166 2024-05-16T22:25:36.258 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 90/166 2024-05-16T22:25:36.364 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/166 2024-05-16T22:25:36.412 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/166 2024-05-16T22:25:36.647 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/166 2024-05-16T22:25:36.675 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/166 2024-05-16T22:25:36.771 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/166 2024-05-16T22:25:37.382 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-osd-2:19.0.0-3709.g43296076.el9.x86_64 113/166 2024-05-16T22:25:37.410 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-osd-2:19.0.0-3709.g43296076.el9.x86_64 113/166 2024-05-16T22:25:37.410 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T22:25:37.410 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-16T22:25:37.410 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-16T22:25:37.410 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-16T22:25:37.410 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:25:37.573 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/166 2024-05-16T22:25:37.641 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mds-2:19.0.0-3709.g43296076.el9.x86_64 114/166 2024-05-16T22:25:37.665 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mds-2:19.0.0-3709.g43296076.el9.x86_64 114/166 2024-05-16T22:25:37.665 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T22:25:37.665 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-16T22:25:37.666 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-16T22:25:37.666 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-16T22:25:37.666 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:25:37.720 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/166 2024-05-16T22:25:38.150 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mon-2:19.0.0-3709.g43296076.el9.x86_64 115/166 2024-05-16T22:25:38.174 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mon-2:19.0.0-3709.g43296076.el9.x86_64 115/166 2024-05-16T22:25:38.174 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T22:25:38.174 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-16T22:25:38.175 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-16T22:25:38.175 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-16T22:25:38.175 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:25:38.282 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : automake-1.16.2-8.el9.noarch 116/166 2024-05-16T22:25:38.339 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/166 2024-05-16T22:25:38.394 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/166 2024-05-16T22:25:38.592 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/166 2024-05-16T22:25:38.644 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/166 2024-05-16T22:25:38.725 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/166 2024-05-16T22:25:38.821 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/166 2024-05-16T22:25:38.964 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/166 2024-05-16T22:25:39.002 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/166 2024-05-16T22:25:39.034 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/166 2024-05-16T22:25:39.061 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/166 2024-05-16T22:25:39.313 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/166 2024-05-16T22:25:39.414 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/166 2024-05-16T22:25:39.450 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/166 2024-05-16T22:25:39.486 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/166 2024-05-16T22:25:39.488 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: cephadm-2:19.0.0-3709.g43296076.el9.noarch 127/166 2024-05-16T22:25:39.518 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : cephadm-2:19.0.0-3709.g43296076.el9.noarch 127/166 2024-05-16T22:25:39.551 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3709.g43296076.e 128/166 2024-05-16T22:25:39.614 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3709.g43296076. 129/166 2024-05-16T22:25:39.641 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3709.g43296076.el9.noa 130/166 2024-05-16T22:25:39.873 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/166 2024-05-16T22:25:39.918 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : librbd1-2:19.0.0-3709.g43296076.el9.x86_64 103/166 2024-05-16T22:25:40.038 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librbd1-2:19.0.0-3709.g43296076.el9.x86_64 103/166 2024-05-16T22:25:40.066 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-rbd-2:19.0.0-3709.g43296076.el9.x86_64 104/166 2024-05-16T22:25:40.120 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/166 2024-05-16T22:25:40.670 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/166 2024-05-16T22:25:40.713 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : librgw2-2:19.0.0-3709.g43296076.el9.x86_64 107/166 2024-05-16T22:25:40.737 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3709.g43296076.el9.noa 130/166 2024-05-16T22:25:40.768 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3709.g43296076.el9.n 131/166 2024-05-16T22:25:40.804 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librgw2-2:19.0.0-3709.g43296076.el9.x86_64 107/166 2024-05-16T22:25:40.831 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-rgw-2:19.0.0-3709.g43296076.el9.x86_64 108/166 2024-05-16T22:25:41.784 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3709.g43296076.el9.n 131/166 2024-05-16T22:25:41.810 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3709.g432 132/166 2024-05-16T22:25:41.928 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3709.g432 132/166 2024-05-16T22:25:42.109 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3709.g43296076.el 133/166 2024-05-16T22:25:42.146 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-2:19.0.0-3709.g43296076.el9.x86_64 134/166 2024-05-16T22:25:42.170 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3709.g43296076.el9.x86_64 134/166 2024-05-16T22:25:42.170 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T22:25:42.170 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-16T22:25:42.171 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-16T22:25:42.171 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-16T22:25:42.171 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:25:42.221 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-rook-2:19.0.0-3709.g43296076.el9.noarch 135/166 2024-05-16T22:25:42.233 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3709.g43296076.el9.noarch 135/166 2024-05-16T22:25:42.335 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-2:19.0.0-3709.g43296076.el9.x86_64 136/166 2024-05-16T22:25:42.388 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-fuse-2:19.0.0-3709.g43296076.el9.x86_64 137/166 2024-05-16T22:25:43.378 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/166 2024-05-16T22:25:43.407 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-radosgw-2:19.0.0-3709.g43296076.el9.x86_64 139/166 2024-05-16T22:25:43.432 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3709.g43296076.el9.x86_64 139/166 2024-05-16T22:25:43.432 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T22:25:43.432 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-16T22:25:43.432 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-16T22:25:43.432 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-16T22:25:43.432 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:25:43.464 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 109/166 2024-05-16T22:25:43.475 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3709.g43296 140/166 2024-05-16T22:25:43.498 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3709.g43296 140/166 2024-05-16T22:25:43.498 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T22:25:43.498 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-16T22:25:43.498 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:25:43.502 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 109/166 2024-05-16T22:25:43.550 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : cephfs-mirror-2:19.0.0-3709.g43296076.el9.x86_64 141/166 2024-05-16T22:25:43.574 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3709.g43296076.el9.x86_64 141/166 2024-05-16T22:25:43.574 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T22:25:43.574 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-16T22:25:43.574 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-16T22:25:43.574 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-16T22:25:43.574 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:25:43.901 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : rbd-mirror-2:19.0.0-3709.g43296076.el9.x86_64 142/166 2024-05-16T22:25:43.925 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3709.g43296076.el9.x86_64 142/166 2024-05-16T22:25:43.925 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T22:25:43.925 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-16T22:25:43.925 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-16T22:25:43.925 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-16T22:25:43.925 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:25:44.181 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 109/166 2024-05-16T22:25:44.222 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-base-2:19.0.0-3709.g43296076.el9.x86_64 110/166 2024-05-16T22:25:44.386 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-base-2:19.0.0-3709.g43296076.el9.x86_64 110/166 2024-05-16T22:25:44.386 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-16T22:25:44.386 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-16T22:25:44.386 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:25:44.440 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-selinux-2:19.0.0-3709.g43296076.el9.x86_64 111/166 2024-05-16T22:25:46.495 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3709.g43296076.el9.x86_64 111/166 2024-05-16T22:25:46.495 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /sys 2024-05-16T22:25:46.496 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /proc 2024-05-16T22:25:46.496 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /mnt 2024-05-16T22:25:46.496 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /var/tmp 2024-05-16T22:25:46.496 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /home 2024-05-16T22:25:46.496 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /root 2024-05-16T22:25:46.496 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /tmp 2024-05-16T22:25:46.496 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-16T22:25:46.655 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-volume-2:19.0.0-3709.g43296076.el9.noarch 112/166 2024-05-16T22:25:46.669 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-volume-2:19.0.0-3709.g43296076.el9.noarch 112/166 2024-05-16T22:25:46.669 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T22:25:46.670 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-16T22:25:46.670 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-16T22:25:48.240 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-osd-2:19.0.0-3709.g43296076.el9.x86_64 113/166 2024-05-16T22:25:48.266 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-osd-2:19.0.0-3709.g43296076.el9.x86_64 113/166 2024-05-16T22:25:48.266 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T22:25:48.266 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-16T22:25:48.266 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-16T22:25:48.266 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-16T22:25:48.266 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-16T22:25:48.431 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-test-2:19.0.0-3709.g43296076.el9.x86_64 143/166 2024-05-16T22:25:48.481 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : rbd-fuse-2:19.0.0-3709.g43296076.el9.x86_64 144/166 2024-05-16T22:25:48.489 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mds-2:19.0.0-3709.g43296076.el9.x86_64 114/166 2024-05-16T22:25:48.511 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mds-2:19.0.0-3709.g43296076.el9.x86_64 114/166 2024-05-16T22:25:48.511 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T22:25:48.511 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-16T22:25:48.511 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-16T22:25:48.511 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-16T22:25:48.511 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-16T22:25:48.521 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : rbd-nbd-2:19.0.0-3709.g43296076.el9.x86_64 145/166 2024-05-16T22:25:48.561 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/166 2024-05-16T22:25:48.588 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 147/166 2024-05-16T22:25:48.782 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : cephfs-shell-2:19.0.0-3709.g43296076.el9.x86_64 148/166 2024-05-16T22:25:48.826 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/166 2024-05-16T22:25:48.856 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcephfs-devel-2:19.0.0-3709.g43296076.el9.x86_ 150/166 2024-05-16T22:25:48.895 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : NetworkManager-team-1:1.47.90-1.el9.x86_64 151/166 2024-05-16T22:25:48.940 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : NetworkManager-tui-1:1.47.90-1.el9.x86_64 152/166 2024-05-16T22:25:48.989 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mon-2:19.0.0-3709.g43296076.el9.x86_64 115/166 2024-05-16T22:25:49.011 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mon-2:19.0.0-3709.g43296076.el9.x86_64 115/166 2024-05-16T22:25:49.011 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T22:25:49.011 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-16T22:25:49.011 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-16T22:25:49.011 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-16T22:25:49.011 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-16T22:25:49.119 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : automake-1.16.2-8.el9.noarch 116/166 2024-05-16T22:25:49.176 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/166 2024-05-16T22:25:49.231 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/166 2024-05-16T22:25:49.416 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/166 2024-05-16T22:25:49.473 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/166 2024-05-16T22:25:49.550 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/166 2024-05-16T22:25:49.569 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 153/166 2024-05-16T22:25:49.613 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 153/166 2024-05-16T22:25:49.634 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 153/166 2024-05-16T22:25:49.638 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/166 2024-05-16T22:25:49.778 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/166 2024-05-16T22:25:49.823 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/166 2024-05-16T22:25:49.855 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/166 2024-05-16T22:25:49.883 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/166 2024-05-16T22:25:50.340 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: cephadm-2:19.0.0-3709.g43296076.el9.noarch 127/166 2024-05-16T22:25:50.365 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : cephadm-2:19.0.0-3709.g43296076.el9.noarch 127/166 2024-05-16T22:25:50.397 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3709.g43296076.e 128/166 2024-05-16T22:25:50.459 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3709.g43296076. 129/166 2024-05-16T22:25:50.488 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3709.g43296076.el9.noa 130/166 2024-05-16T22:25:50.544 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : cephfs-top-2:19.0.0-3709.g43296076.el9.noarch 154/166 2024-05-16T22:25:50.635 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 155/166 2024-05-16T22:25:50.677 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 156/166 2024-05-16T22:25:50.760 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flex-2.6.4-9.el9.x86_64 157/166 2024-05-16T22:25:50.787 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : bison-3.7.4-5.el9.x86_64 158/166 2024-05-16T22:25:50.822 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 159/166 2024-05-16T22:25:50.822 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/166 2024-05-16T22:25:50.906 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/166 2024-05-16T22:25:50.939 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 161/166 2024-05-16T22:25:50.939 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 162/166 2024-05-16T22:25:51.015 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 162/166 2024-05-16T22:25:51.040 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 163/166 2024-05-16T22:25:51.046 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 164/166 2024-05-16T22:25:51.046 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 164/166 2024-05-16T22:25:51.243 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 164/166 2024-05-16T22:25:51.243 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 165/166 2024-05-16T22:25:51.319 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 165/166 2024-05-16T22:25:51.393 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 166/166 2024-05-16T22:25:51.521 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3709.g43296076.el9.noa 130/166 2024-05-16T22:25:51.565 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3709.g43296076.el9.n 131/166 2024-05-16T22:25:52.525 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3709.g43296076.el9.n 131/166 2024-05-16T22:25:52.556 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3709.g432 132/166 2024-05-16T22:25:52.667 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3709.g432 132/166 2024-05-16T22:25:52.839 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3709.g43296076.el 133/166 2024-05-16T22:25:52.867 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-2:19.0.0-3709.g43296076.el9.x86_64 134/166 2024-05-16T22:25:52.890 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3709.g43296076.el9.x86_64 134/166 2024-05-16T22:25:52.890 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T22:25:52.890 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-16T22:25:52.890 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-16T22:25:52.890 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-16T22:25:52.891 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-16T22:25:52.934 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-rook-2:19.0.0-3709.g43296076.el9.noarch 135/166 2024-05-16T22:25:52.945 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3709.g43296076.el9.noarch 135/166 2024-05-16T22:25:53.044 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-2:19.0.0-3709.g43296076.el9.x86_64 136/166 2024-05-16T22:25:53.091 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-fuse-2:19.0.0-3709.g43296076.el9.x86_64 137/166 2024-05-16T22:25:54.027 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/166 2024-05-16T22:25:54.054 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-radosgw-2:19.0.0-3709.g43296076.el9.x86_64 139/166 2024-05-16T22:25:54.076 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3709.g43296076.el9.x86_64 139/166 2024-05-16T22:25:54.076 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T22:25:54.076 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-16T22:25:54.076 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-16T22:25:54.076 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-16T22:25:54.076 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-16T22:25:54.121 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3709.g43296 140/166 2024-05-16T22:25:54.142 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3709.g43296 140/166 2024-05-16T22:25:54.143 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T22:25:54.143 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-16T22:25:54.143 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-16T22:25:54.188 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : cephfs-mirror-2:19.0.0-3709.g43296076.el9.x86_64 141/166 2024-05-16T22:25:54.210 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3709.g43296076.el9.x86_64 141/166 2024-05-16T22:25:54.210 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T22:25:54.211 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-16T22:25:54.211 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-16T22:25:54.211 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-16T22:25:54.211 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-16T22:25:54.522 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : rbd-mirror-2:19.0.0-3709.g43296076.el9.x86_64 142/166 2024-05-16T22:25:54.544 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3709.g43296076.el9.x86_64 142/166 2024-05-16T22:25:54.545 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T22:25:54.545 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-16T22:25:54.545 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-16T22:25:54.545 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-16T22:25:54.545 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-16T22:25:57.074 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3709.g43296076.el9.x86_64 111/166 2024-05-16T22:25:57.074 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /sys 2024-05-16T22:25:57.074 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /proc 2024-05-16T22:25:57.074 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /mnt 2024-05-16T22:25:57.074 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /var/tmp 2024-05-16T22:25:57.074 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /home 2024-05-16T22:25:57.074 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /root 2024-05-16T22:25:57.074 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /tmp 2024-05-16T22:25:57.074 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:25:57.088 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 166/166 2024-05-16T22:25:57.088 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-2:19.0.0-3709.g43296076.el9.x86_64 1/166 2024-05-16T22:25:57.088 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-base-2:19.0.0-3709.g43296076.el9.x86_64 2/166 2024-05-16T22:25:57.088 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 3/166 2024-05-16T22:25:57.089 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-fuse-2:19.0.0-3709.g43296076.el9.x86_64 4/166 2024-05-16T22:25:57.089 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3709.g43296 5/166 2024-05-16T22:25:57.089 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mds-2:19.0.0-3709.g43296076.el9.x86_64 6/166 2024-05-16T22:25:57.089 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-2:19.0.0-3709.g43296076.el9.x86_64 7/166 2024-05-16T22:25:57.089 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mon-2:19.0.0-3709.g43296076.el9.x86_64 8/166 2024-05-16T22:25:57.089 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-osd-2:19.0.0-3709.g43296076.el9.x86_64 9/166 2024-05-16T22:25:57.089 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-radosgw-2:19.0.0-3709.g43296076.el9.x86_64 10/166 2024-05-16T22:25:57.089 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-selinux-2:19.0.0-3709.g43296076.el9.x86_64 11/166 2024-05-16T22:25:57.089 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-test-2:19.0.0-3709.g43296076.el9.x86_64 12/166 2024-05-16T22:25:57.089 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : cephfs-mirror-2:19.0.0-3709.g43296076.el9.x86_64 13/166 2024-05-16T22:25:57.089 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : cephfs-shell-2:19.0.0-3709.g43296076.el9.x86_64 14/166 2024-05-16T22:25:57.089 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcephfs-devel-2:19.0.0-3709.g43296076.el9.x86_ 15/166 2024-05-16T22:25:57.089 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcephfs2-2:19.0.0-3709.g43296076.el9.x86_64 16/166 2024-05-16T22:25:57.090 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcephsqlite-2:19.0.0-3709.g43296076.el9.x86_64 17/166 2024-05-16T22:25:57.090 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librados-devel-2:19.0.0-3709.g43296076.el9.x86_6 18/166 2024-05-16T22:25:57.090 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libradosstriper1-2:19.0.0-3709.g43296076.el9.x86 19/166 2024-05-16T22:25:57.090 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librgw2-2:19.0.0-3709.g43296076.el9.x86_64 20/166 2024-05-16T22:25:57.090 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3709.g43296076.el 21/166 2024-05-16T22:25:57.090 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-ceph-common-2:19.0.0-3709.g43296076.el9. 22/166 2024-05-16T22:25:57.090 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cephfs-2:19.0.0-3709.g43296076.el9.x86_6 23/166 2024-05-16T22:25:57.090 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rados-2:19.0.0-3709.g43296076.el9.x86_64 24/166 2024-05-16T22:25:57.090 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rbd-2:19.0.0-3709.g43296076.el9.x86_64 25/166 2024-05-16T22:25:57.090 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rgw-2:19.0.0-3709.g43296076.el9.x86_64 26/166 2024-05-16T22:25:57.090 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : rbd-fuse-2:19.0.0-3709.g43296076.el9.x86_64 27/166 2024-05-16T22:25:57.103 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : rbd-mirror-2:19.0.0-3709.g43296076.el9.x86_64 28/166 2024-05-16T22:25:57.103 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : rbd-nbd-2:19.0.0-3709.g43296076.el9.x86_64 29/166 2024-05-16T22:25:57.103 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3709.g43296076. 30/166 2024-05-16T22:25:57.103 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3709.g43296076.el9.noa 31/166 2024-05-16T22:25:57.103 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3709.g43296076.el9.n 32/166 2024-05-16T22:25:57.103 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3709.g432 33/166 2024-05-16T22:25:57.103 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3709.g43296076.el 34/166 2024-05-16T22:25:57.103 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3709.g43296076.el9.noarch 35/166 2024-05-16T22:25:57.103 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3709.g43296076.e 36/166 2024-05-16T22:25:57.103 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-volume-2:19.0.0-3709.g43296076.el9.noarch 37/166 2024-05-16T22:25:57.104 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : cephadm-2:19.0.0-3709.g43296076.el9.noarch 38/166 2024-05-16T22:25:57.104 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : cephfs-top-2:19.0.0-3709.g43296076.el9.noarch 39/166 2024-05-16T22:25:57.104 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/166 2024-05-16T22:25:57.104 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/166 2024-05-16T22:25:57.104 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/166 2024-05-16T22:25:57.104 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/166 2024-05-16T22:25:57.104 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/166 2024-05-16T22:25:57.104 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/166 2024-05-16T22:25:57.104 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/166 2024-05-16T22:25:57.104 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/166 2024-05-16T22:25:57.104 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/166 2024-05-16T22:25:57.104 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/166 2024-05-16T22:25:57.104 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/166 2024-05-16T22:25:57.105 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/166 2024-05-16T22:25:57.105 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/166 2024-05-16T22:25:57.105 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/166 2024-05-16T22:25:57.105 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/166 2024-05-16T22:25:57.105 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/166 2024-05-16T22:25:57.105 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/166 2024-05-16T22:25:57.105 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/166 2024-05-16T22:25:57.105 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/166 2024-05-16T22:25:57.105 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/166 2024-05-16T22:25:57.105 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/166 2024-05-16T22:25:57.105 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/166 2024-05-16T22:25:57.105 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/166 2024-05-16T22:25:57.105 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/166 2024-05-16T22:25:57.105 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/166 2024-05-16T22:25:57.106 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/166 2024-05-16T22:25:57.106 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/166 2024-05-16T22:25:57.106 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/166 2024-05-16T22:25:57.106 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/166 2024-05-16T22:25:57.106 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/166 2024-05-16T22:25:57.106 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/166 2024-05-16T22:25:57.106 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/166 2024-05-16T22:25:57.106 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/166 2024-05-16T22:25:57.106 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/166 2024-05-16T22:25:57.106 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/166 2024-05-16T22:25:57.106 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/166 2024-05-16T22:25:57.107 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/166 2024-05-16T22:25:57.107 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/166 2024-05-16T22:25:57.107 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/166 2024-05-16T22:25:57.107 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/166 2024-05-16T22:25:57.107 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/166 2024-05-16T22:25:57.107 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/166 2024-05-16T22:25:57.107 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/166 2024-05-16T22:25:57.107 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/166 2024-05-16T22:25:57.107 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/166 2024-05-16T22:25:57.107 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/166 2024-05-16T22:25:57.107 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/166 2024-05-16T22:25:57.107 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/166 2024-05-16T22:25:57.107 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/166 2024-05-16T22:25:57.108 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/166 2024-05-16T22:25:57.108 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/166 2024-05-16T22:25:57.108 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/166 2024-05-16T22:25:57.108 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/166 2024-05-16T22:25:57.108 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/166 2024-05-16T22:25:57.108 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/166 2024-05-16T22:25:57.108 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/166 2024-05-16T22:25:57.108 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/166 2024-05-16T22:25:57.108 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/166 2024-05-16T22:25:57.108 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/166 2024-05-16T22:25:57.108 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/166 2024-05-16T22:25:57.108 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/166 2024-05-16T22:25:57.108 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/166 2024-05-16T22:25:57.109 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/166 2024-05-16T22:25:57.109 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/166 2024-05-16T22:25:57.109 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/166 2024-05-16T22:25:57.109 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/166 2024-05-16T22:25:57.109 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : fscrypt-0.3.4-2.el9.x86_64 106/166 2024-05-16T22:25:57.109 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/166 2024-05-16T22:25:57.109 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/166 2024-05-16T22:25:57.109 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/166 2024-05-16T22:25:57.109 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/166 2024-05-16T22:25:57.109 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/166 2024-05-16T22:25:57.109 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/166 2024-05-16T22:25:57.109 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/166 2024-05-16T22:25:57.109 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : pam_fscrypt-0.3.4-2.el9.x86_64 114/166 2024-05-16T22:25:57.109 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/166 2024-05-16T22:25:57.109 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/166 2024-05-16T22:25:57.110 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/166 2024-05-16T22:25:57.110 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/166 2024-05-16T22:25:57.110 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/166 2024-05-16T22:25:57.110 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/166 2024-05-16T22:25:57.110 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/166 2024-05-16T22:25:57.110 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/166 2024-05-16T22:25:57.110 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/166 2024-05-16T22:25:57.110 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 124/166 2024-05-16T22:25:57.110 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/166 2024-05-16T22:25:57.110 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/166 2024-05-16T22:25:57.111 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/166 2024-05-16T22:25:57.111 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/166 2024-05-16T22:25:57.111 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/166 2024-05-16T22:25:57.111 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/166 2024-05-16T22:25:57.111 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/166 2024-05-16T22:25:57.111 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/166 2024-05-16T22:25:57.111 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/166 2024-05-16T22:25:57.111 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/166 2024-05-16T22:25:57.111 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/166 2024-05-16T22:25:57.111 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/166 2024-05-16T22:25:57.111 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/166 2024-05-16T22:25:57.111 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/166 2024-05-16T22:25:57.111 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/166 2024-05-16T22:25:57.112 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/166 2024-05-16T22:25:57.112 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/166 2024-05-16T22:25:57.112 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/166 2024-05-16T22:25:57.112 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/166 2024-05-16T22:25:57.112 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/166 2024-05-16T22:25:57.112 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/166 2024-05-16T22:25:57.112 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/166 2024-05-16T22:25:57.112 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/166 2024-05-16T22:25:57.112 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/166 2024-05-16T22:25:57.112 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/166 2024-05-16T22:25:57.112 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/166 2024-05-16T22:25:57.112 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librados2-2:19.0.0-3709.g43296076.el9.x86_64 151/166 2024-05-16T22:25:57.112 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/166 2024-05-16T22:25:57.112 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librbd1-2:19.0.0-3709.g43296076.el9.x86_64 153/166 2024-05-16T22:25:57.113 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/166 2024-05-16T22:25:57.113 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-1:1.47.90-1.el9.x86_64 155/166 2024-05-16T22:25:57.113 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 156/166 2024-05-16T22:25:57.113 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 157/166 2024-05-16T22:25:57.113 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 158/166 2024-05-16T22:25:57.113 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-team-1:1.47.90-1.el9.x86_64 159/166 2024-05-16T22:25:57.113 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 160/166 2024-05-16T22:25:57.113 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-tui-1:1.47.90-1.el9.x86_64 161/166 2024-05-16T22:25:57.113 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 162/166 2024-05-16T22:25:57.113 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 163/166 2024-05-16T22:25:57.113 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 164/166 2024-05-16T22:25:57.113 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 165/166 2024-05-16T22:25:57.289 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-volume-2:19.0.0-3709.g43296076.el9.noarch 112/166 2024-05-16T22:25:57.331 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-volume-2:19.0.0-3709.g43296076.el9.noarch 112/166 2024-05-16T22:25:57.331 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T22:25:57.331 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-16T22:25:57.331 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:25:58.793 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-test-2:19.0.0-3709.g43296076.el9.x86_64 143/166 2024-05-16T22:25:58.834 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : rbd-fuse-2:19.0.0-3709.g43296076.el9.x86_64 144/166 2024-05-16T22:25:58.875 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : rbd-nbd-2:19.0.0-3709.g43296076.el9.x86_64 145/166 2024-05-16T22:25:58.907 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/166 2024-05-16T22:25:58.934 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 147/166 2024-05-16T22:25:59.015 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-osd-2:19.0.0-3709.g43296076.el9.x86_64 113/166 2024-05-16T22:25:59.116 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : cephfs-shell-2:19.0.0-3709.g43296076.el9.x86_64 148/166 2024-05-16T22:25:59.117 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-osd-2:19.0.0-3709.g43296076.el9.x86_64 113/166 2024-05-16T22:25:59.117 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T22:25:59.117 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-16T22:25:59.117 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-16T22:25:59.117 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-16T22:25:59.117 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:25:59.164 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/166 2024-05-16T22:25:59.186 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcephfs-devel-2:19.0.0-3709.g43296076.el9.x86_ 150/166 2024-05-16T22:25:59.215 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : NetworkManager-team-1:1.47.90-1.el9.x86_64 151/166 2024-05-16T22:25:59.262 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : NetworkManager-tui-1:1.47.90-1.el9.x86_64 152/166 2024-05-16T22:25:59.365 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mds-2:19.0.0-3709.g43296076.el9.x86_64 114/166 2024-05-16T22:25:59.450 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mds-2:19.0.0-3709.g43296076.el9.x86_64 114/166 2024-05-16T22:25:59.450 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T22:25:59.450 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-16T22:25:59.450 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-16T22:25:59.450 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-16T22:25:59.450 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:25:59.849 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 153/166 2024-05-16T22:25:59.893 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 153/166 2024-05-16T22:25:59.912 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 153/166 2024-05-16T22:25:59.958 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mon-2:19.0.0-3709.g43296076.el9.x86_64 115/166 2024-05-16T22:25:59.962 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 166/166 2024-05-16T22:25:59.963 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:25:59.963 INFO:teuthology.orchestra.run.smithi044.stdout:Upgraded: 2024-05-16T22:25:59.963 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-1:1.47.90-1.el9.x86_64 2024-05-16T22:25:59.963 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 2024-05-16T22:25:59.963 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-team-1:1.47.90-1.el9.x86_64 2024-05-16T22:25:59.963 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-tui-1:1.47.90-1.el9.x86_64 2024-05-16T22:25:59.963 INFO:teuthology.orchestra.run.smithi044.stdout: librados2-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:25:59.963 INFO:teuthology.orchestra.run.smithi044.stdout: librbd1-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:25:59.963 INFO:teuthology.orchestra.run.smithi044.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-16T22:25:59.963 INFO:teuthology.orchestra.run.smithi044.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-16T22:25:59.963 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2024-05-16T22:25:59.964 INFO:teuthology.orchestra.run.smithi044.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-16T22:25:59.964 INFO:teuthology.orchestra.run.smithi044.stdout: automake-1.16.2-8.el9.noarch 2024-05-16T22:25:59.964 INFO:teuthology.orchestra.run.smithi044.stdout: bison-3.7.4-5.el9.x86_64 2024-05-16T22:25:59.964 INFO:teuthology.orchestra.run.smithi044.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-16T22:25:59.964 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:25:59.964 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-base-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:25:59.964 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:25:59.964 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-fuse-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:25:59.964 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-grafana-dashboards-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T22:25:59.964 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-immutable-object-cache-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:25:59.964 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mds-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:25:59.964 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:25:59.964 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-cephadm-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T22:25:59.965 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-dashboard-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T22:25:59.965 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T22:25:59.965 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-modules-core-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T22:25:59.965 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-rook-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T22:25:59.965 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mon-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:25:59.965 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-osd-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:25:59.965 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-prometheus-alerts-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T22:25:59.965 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-radosgw-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:25:59.965 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-selinux-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:25:59.965 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-test-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:25:59.966 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-volume-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T22:25:59.966 INFO:teuthology.orchestra.run.smithi044.stdout: cephadm-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T22:25:59.966 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-mirror-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:25:59.966 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-shell-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:25:59.966 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-top-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T22:25:59.966 INFO:teuthology.orchestra.run.smithi044.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-16T22:25:59.966 INFO:teuthology.orchestra.run.smithi044.stdout: flex-2.6.4-9.el9.x86_64 2024-05-16T22:25:59.966 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-16T22:25:59.966 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-16T22:25:59.966 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-16T22:25:59.966 INFO:teuthology.orchestra.run.smithi044.stdout: fscrypt-0.3.4-2.el9.x86_64 2024-05-16T22:25:59.967 INFO:teuthology.orchestra.run.smithi044.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-16T22:25:59.967 INFO:teuthology.orchestra.run.smithi044.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-16T22:25:59.967 INFO:teuthology.orchestra.run.smithi044.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-16T22:25:59.967 INFO:teuthology.orchestra.run.smithi044.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-16T22:25:59.967 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-16T22:25:59.967 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-16T22:25:59.967 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs-devel-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:25:59.967 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs2-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:25:59.967 INFO:teuthology.orchestra.run.smithi044.stdout: libcephsqlite-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:25:59.967 INFO:teuthology.orchestra.run.smithi044.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-16T22:25:59.967 INFO:teuthology.orchestra.run.smithi044.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-16T22:25:59.967 INFO:teuthology.orchestra.run.smithi044.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-16T22:25:59.967 INFO:teuthology.orchestra.run.smithi044.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-16T22:25:59.967 INFO:teuthology.orchestra.run.smithi044.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-16T22:25:59.968 INFO:teuthology.orchestra.run.smithi044.stdout: librados-devel-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:25:59.968 INFO:teuthology.orchestra.run.smithi044.stdout: libradosstriper1-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:25:59.968 INFO:teuthology.orchestra.run.smithi044.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-16T22:25:59.968 INFO:teuthology.orchestra.run.smithi044.stdout: librgw2-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:25:59.968 INFO:teuthology.orchestra.run.smithi044.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-16T22:25:59.968 INFO:teuthology.orchestra.run.smithi044.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-16T22:25:59.968 INFO:teuthology.orchestra.run.smithi044.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-16T22:25:59.968 INFO:teuthology.orchestra.run.smithi044.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-16T22:25:59.968 INFO:teuthology.orchestra.run.smithi044.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-16T22:25:59.968 INFO:teuthology.orchestra.run.smithi044.stdout: lua-5.4.4-4.el9.x86_64 2024-05-16T22:25:59.968 INFO:teuthology.orchestra.run.smithi044.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-16T22:25:59.968 INFO:teuthology.orchestra.run.smithi044.stdout: luarocks-3.9.2-5.el9.noarch 2024-05-16T22:25:59.968 INFO:teuthology.orchestra.run.smithi044.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-16T22:25:59.968 INFO:teuthology.orchestra.run.smithi044.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-16T22:25:59.968 INFO:teuthology.orchestra.run.smithi044.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-16T22:25:59.969 INFO:teuthology.orchestra.run.smithi044.stdout: pam_fscrypt-0.3.4-2.el9.x86_64 2024-05-16T22:25:59.969 INFO:teuthology.orchestra.run.smithi044.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-16T22:25:59.969 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-13.14-1.el9.x86_64 2024-05-16T22:25:59.969 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-16T22:25:59.969 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-16T22:25:59.969 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-16T22:25:59.969 INFO:teuthology.orchestra.run.smithi044.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-16T22:25:59.969 INFO:teuthology.orchestra.run.smithi044.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-16T22:25:59.969 INFO:teuthology.orchestra.run.smithi044.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-16T22:25:59.969 INFO:teuthology.orchestra.run.smithi044.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-16T22:25:59.969 INFO:teuthology.orchestra.run.smithi044.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-16T22:25:59.969 INFO:teuthology.orchestra.run.smithi044.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-16T22:25:59.969 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-16T22:25:59.969 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-argparse-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:25:59.969 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:25:59.970 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cephfs-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:25:59.970 INFO:teuthology.orchestra.run.smithi044.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-16T22:25:59.970 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-16T22:25:59.970 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-16T22:25:59.970 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-16T22:25:59.970 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-16T22:25:59.970 INFO:teuthology.orchestra.run.smithi044.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-16T22:25:59.970 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-16T22:25:59.970 INFO:teuthology.orchestra.run.smithi044.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-16T22:25:59.970 INFO:teuthology.orchestra.run.smithi044.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-16T22:25:59.970 INFO:teuthology.orchestra.run.smithi044.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-16T22:25:59.970 INFO:teuthology.orchestra.run.smithi044.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-16T22:25:59.970 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-16T22:25:59.970 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-16T22:25:59.971 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-16T22:25:59.971 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-16T22:25:59.971 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-16T22:25:59.971 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-16T22:25:59.971 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-16T22:25:59.971 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-16T22:25:59.971 INFO:teuthology.orchestra.run.smithi044.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-16T22:25:59.971 INFO:teuthology.orchestra.run.smithi044.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-16T22:25:59.971 INFO:teuthology.orchestra.run.smithi044.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-16T22:25:59.971 INFO:teuthology.orchestra.run.smithi044.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-16T22:25:59.971 INFO:teuthology.orchestra.run.smithi044.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-16T22:25:59.971 INFO:teuthology.orchestra.run.smithi044.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-16T22:25:59.971 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-16T22:25:59.971 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-16T22:25:59.972 INFO:teuthology.orchestra.run.smithi044.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-16T22:25:59.972 INFO:teuthology.orchestra.run.smithi044.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-16T22:25:59.972 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-16T22:25:59.972 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ply-3.11-14.el9.noarch 2024-05-16T22:25:59.972 INFO:teuthology.orchestra.run.smithi044.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-16T22:25:59.972 INFO:teuthology.orchestra.run.smithi044.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-16T22:25:59.972 INFO:teuthology.orchestra.run.smithi044.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-16T22:25:59.972 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-16T22:25:59.972 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-16T22:25:59.972 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-16T22:25:59.972 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-16T22:25:59.972 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-16T22:25:59.972 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-16T22:25:59.972 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rados-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:25:59.972 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rbd-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:25:59.973 INFO:teuthology.orchestra.run.smithi044.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-16T22:25:59.973 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-16T22:25:59.973 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-16T22:25:59.973 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rgw-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:25:59.973 INFO:teuthology.orchestra.run.smithi044.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-16T22:25:59.973 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-16T22:25:59.973 INFO:teuthology.orchestra.run.smithi044.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-16T22:25:59.973 INFO:teuthology.orchestra.run.smithi044.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-16T22:25:59.973 INFO:teuthology.orchestra.run.smithi044.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-16T22:25:59.973 INFO:teuthology.orchestra.run.smithi044.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-16T22:25:59.973 INFO:teuthology.orchestra.run.smithi044.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-16T22:25:59.973 INFO:teuthology.orchestra.run.smithi044.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-16T22:25:59.973 INFO:teuthology.orchestra.run.smithi044.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-16T22:25:59.973 INFO:teuthology.orchestra.run.smithi044.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-16T22:25:59.973 INFO:teuthology.orchestra.run.smithi044.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-16T22:25:59.974 INFO:teuthology.orchestra.run.smithi044.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-16T22:25:59.974 INFO:teuthology.orchestra.run.smithi044.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-16T22:25:59.974 INFO:teuthology.orchestra.run.smithi044.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-16T22:25:59.974 INFO:teuthology.orchestra.run.smithi044.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-16T22:25:59.974 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-fuse-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:25:59.974 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-mirror-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:25:59.974 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-nbd-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:25:59.974 INFO:teuthology.orchestra.run.smithi044.stdout: re2-1:20211101-3.el9.x86_64 2024-05-16T22:25:59.974 INFO:teuthology.orchestra.run.smithi044.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-16T22:25:59.974 INFO:teuthology.orchestra.run.smithi044.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-16T22:25:59.974 INFO:teuthology.orchestra.run.smithi044.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-16T22:25:59.974 INFO:teuthology.orchestra.run.smithi044.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-16T22:25:59.974 INFO:teuthology.orchestra.run.smithi044.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-16T22:25:59.975 INFO:teuthology.orchestra.run.smithi044.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-16T22:25:59.975 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:25:59.975 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-05-16T22:26:00.048 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mon-2:19.0.0-3709.g43296076.el9.x86_64 115/166 2024-05-16T22:26:00.048 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T22:26:00.048 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-16T22:26:00.048 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-16T22:26:00.048 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-16T22:26:00.048 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:26:00.183 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : automake-1.16.2-8.el9.noarch 116/166 2024-05-16T22:26:00.245 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/166 2024-05-16T22:26:00.320 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/166 2024-05-16T22:26:00.519 DEBUG:teuthology.parallel:result is None 2024-05-16T22:26:00.552 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/166 2024-05-16T22:26:00.612 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/166 2024-05-16T22:26:00.704 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/166 2024-05-16T22:26:00.740 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : cephfs-top-2:19.0.0-3709.g43296076.el9.noarch 154/166 2024-05-16T22:26:00.813 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/166 2024-05-16T22:26:00.841 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 155/166 2024-05-16T22:26:00.872 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 156/166 2024-05-16T22:26:00.953 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flex-2.6.4-9.el9.x86_64 157/166 2024-05-16T22:26:00.972 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/166 2024-05-16T22:26:00.985 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : bison-3.7.4-5.el9.x86_64 158/166 2024-05-16T22:26:01.011 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 159/166 2024-05-16T22:26:01.011 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/166 2024-05-16T22:26:01.019 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/166 2024-05-16T22:26:01.078 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/166 2024-05-16T22:26:01.078 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/166 2024-05-16T22:26:01.110 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/166 2024-05-16T22:26:01.120 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 161/166 2024-05-16T22:26:01.120 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 162/166 2024-05-16T22:26:01.204 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 162/166 2024-05-16T22:26:01.229 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 163/166 2024-05-16T22:26:01.234 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 164/166 2024-05-16T22:26:01.234 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 164/166 2024-05-16T22:26:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 164/166 2024-05-16T22:26:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 165/166 2024-05-16T22:26:01.515 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 165/166 2024-05-16T22:26:01.578 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 166/166 2024-05-16T22:26:01.709 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: cephadm-2:19.0.0-3709.g43296076.el9.noarch 127/166 2024-05-16T22:26:01.755 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : cephadm-2:19.0.0-3709.g43296076.el9.noarch 127/166 2024-05-16T22:26:01.809 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3709.g43296076.e 128/166 2024-05-16T22:26:01.918 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3709.g43296076. 129/166 2024-05-16T22:26:01.948 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3709.g43296076.el9.noa 130/166 2024-05-16T22:26:03.234 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3709.g43296076.el9.noa 130/166 2024-05-16T22:26:03.275 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3709.g43296076.el9.n 131/166 2024-05-16T22:26:04.373 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3709.g43296076.el9.n 131/166 2024-05-16T22:26:04.401 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3709.g432 132/166 2024-05-16T22:26:04.558 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3709.g432 132/166 2024-05-16T22:26:04.737 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3709.g43296076.el 133/166 2024-05-16T22:26:04.794 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-2:19.0.0-3709.g43296076.el9.x86_64 134/166 2024-05-16T22:26:04.864 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3709.g43296076.el9.x86_64 134/166 2024-05-16T22:26:04.864 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T22:26:04.864 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-16T22:26:04.864 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-16T22:26:04.864 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-16T22:26:04.865 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:26:04.920 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-rook-2:19.0.0-3709.g43296076.el9.noarch 135/166 2024-05-16T22:26:04.957 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3709.g43296076.el9.noarch 135/166 2024-05-16T22:26:05.077 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-2:19.0.0-3709.g43296076.el9.x86_64 136/166 2024-05-16T22:26:05.139 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-fuse-2:19.0.0-3709.g43296076.el9.x86_64 137/166 2024-05-16T22:26:06.173 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/166 2024-05-16T22:26:06.205 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-radosgw-2:19.0.0-3709.g43296076.el9.x86_64 139/166 2024-05-16T22:26:06.281 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3709.g43296076.el9.x86_64 139/166 2024-05-16T22:26:06.281 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T22:26:06.281 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-16T22:26:06.281 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-16T22:26:06.281 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-16T22:26:06.281 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:26:06.332 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3709.g43296 140/166 2024-05-16T22:26:06.429 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3709.g43296 140/166 2024-05-16T22:26:06.429 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T22:26:06.429 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-16T22:26:06.429 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:26:06.508 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : cephfs-mirror-2:19.0.0-3709.g43296076.el9.x86_64 141/166 2024-05-16T22:26:06.601 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3709.g43296076.el9.x86_64 141/166 2024-05-16T22:26:06.601 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T22:26:06.601 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-16T22:26:06.601 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-16T22:26:06.601 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-16T22:26:06.601 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:26:06.984 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : rbd-mirror-2:19.0.0-3709.g43296076.el9.x86_64 142/166 2024-05-16T22:26:07.082 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3709.g43296076.el9.x86_64 142/166 2024-05-16T22:26:07.082 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-16T22:26:07.082 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-16T22:26:07.082 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-16T22:26:07.082 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-16T22:26:07.082 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:26:07.404 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 166/166 2024-05-16T22:26:07.404 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-2:19.0.0-3709.g43296076.el9.x86_64 1/166 2024-05-16T22:26:07.404 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-base-2:19.0.0-3709.g43296076.el9.x86_64 2/166 2024-05-16T22:26:07.405 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 3/166 2024-05-16T22:26:07.405 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-fuse-2:19.0.0-3709.g43296076.el9.x86_64 4/166 2024-05-16T22:26:07.405 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3709.g43296 5/166 2024-05-16T22:26:07.405 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mds-2:19.0.0-3709.g43296076.el9.x86_64 6/166 2024-05-16T22:26:07.405 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-2:19.0.0-3709.g43296076.el9.x86_64 7/166 2024-05-16T22:26:07.405 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mon-2:19.0.0-3709.g43296076.el9.x86_64 8/166 2024-05-16T22:26:07.405 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-osd-2:19.0.0-3709.g43296076.el9.x86_64 9/166 2024-05-16T22:26:07.405 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-radosgw-2:19.0.0-3709.g43296076.el9.x86_64 10/166 2024-05-16T22:26:07.405 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-selinux-2:19.0.0-3709.g43296076.el9.x86_64 11/166 2024-05-16T22:26:07.405 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-test-2:19.0.0-3709.g43296076.el9.x86_64 12/166 2024-05-16T22:26:07.405 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : cephfs-mirror-2:19.0.0-3709.g43296076.el9.x86_64 13/166 2024-05-16T22:26:07.405 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : cephfs-shell-2:19.0.0-3709.g43296076.el9.x86_64 14/166 2024-05-16T22:26:07.406 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcephfs-devel-2:19.0.0-3709.g43296076.el9.x86_ 15/166 2024-05-16T22:26:07.406 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcephfs2-2:19.0.0-3709.g43296076.el9.x86_64 16/166 2024-05-16T22:26:07.406 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcephsqlite-2:19.0.0-3709.g43296076.el9.x86_64 17/166 2024-05-16T22:26:07.406 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librados-devel-2:19.0.0-3709.g43296076.el9.x86_6 18/166 2024-05-16T22:26:07.406 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libradosstriper1-2:19.0.0-3709.g43296076.el9.x86 19/166 2024-05-16T22:26:07.406 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librgw2-2:19.0.0-3709.g43296076.el9.x86_64 20/166 2024-05-16T22:26:07.406 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3709.g43296076.el 21/166 2024-05-16T22:26:07.406 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-ceph-common-2:19.0.0-3709.g43296076.el9. 22/166 2024-05-16T22:26:07.406 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cephfs-2:19.0.0-3709.g43296076.el9.x86_6 23/166 2024-05-16T22:26:07.406 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rados-2:19.0.0-3709.g43296076.el9.x86_64 24/166 2024-05-16T22:26:07.406 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rbd-2:19.0.0-3709.g43296076.el9.x86_64 25/166 2024-05-16T22:26:07.406 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rgw-2:19.0.0-3709.g43296076.el9.x86_64 26/166 2024-05-16T22:26:07.406 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : rbd-fuse-2:19.0.0-3709.g43296076.el9.x86_64 27/166 2024-05-16T22:26:07.419 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : rbd-mirror-2:19.0.0-3709.g43296076.el9.x86_64 28/166 2024-05-16T22:26:07.419 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : rbd-nbd-2:19.0.0-3709.g43296076.el9.x86_64 29/166 2024-05-16T22:26:07.419 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3709.g43296076. 30/166 2024-05-16T22:26:07.419 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3709.g43296076.el9.noa 31/166 2024-05-16T22:26:07.419 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3709.g43296076.el9.n 32/166 2024-05-16T22:26:07.419 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3709.g432 33/166 2024-05-16T22:26:07.419 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3709.g43296076.el 34/166 2024-05-16T22:26:07.419 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3709.g43296076.el9.noarch 35/166 2024-05-16T22:26:07.419 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3709.g43296076.e 36/166 2024-05-16T22:26:07.420 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-volume-2:19.0.0-3709.g43296076.el9.noarch 37/166 2024-05-16T22:26:07.420 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : cephadm-2:19.0.0-3709.g43296076.el9.noarch 38/166 2024-05-16T22:26:07.420 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : cephfs-top-2:19.0.0-3709.g43296076.el9.noarch 39/166 2024-05-16T22:26:07.420 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/166 2024-05-16T22:26:07.420 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/166 2024-05-16T22:26:07.420 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/166 2024-05-16T22:26:07.420 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/166 2024-05-16T22:26:07.420 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/166 2024-05-16T22:26:07.420 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/166 2024-05-16T22:26:07.420 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/166 2024-05-16T22:26:07.420 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/166 2024-05-16T22:26:07.420 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/166 2024-05-16T22:26:07.420 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/166 2024-05-16T22:26:07.421 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/166 2024-05-16T22:26:07.421 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/166 2024-05-16T22:26:07.421 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/166 2024-05-16T22:26:07.421 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/166 2024-05-16T22:26:07.421 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/166 2024-05-16T22:26:07.421 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/166 2024-05-16T22:26:07.421 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/166 2024-05-16T22:26:07.421 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/166 2024-05-16T22:26:07.421 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/166 2024-05-16T22:26:07.421 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/166 2024-05-16T22:26:07.421 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/166 2024-05-16T22:26:07.421 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/166 2024-05-16T22:26:07.421 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/166 2024-05-16T22:26:07.421 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/166 2024-05-16T22:26:07.422 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/166 2024-05-16T22:26:07.422 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/166 2024-05-16T22:26:07.422 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/166 2024-05-16T22:26:07.422 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/166 2024-05-16T22:26:07.422 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/166 2024-05-16T22:26:07.422 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/166 2024-05-16T22:26:07.422 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/166 2024-05-16T22:26:07.422 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/166 2024-05-16T22:26:07.422 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/166 2024-05-16T22:26:07.422 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/166 2024-05-16T22:26:07.422 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/166 2024-05-16T22:26:07.422 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/166 2024-05-16T22:26:07.423 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/166 2024-05-16T22:26:07.423 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/166 2024-05-16T22:26:07.423 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/166 2024-05-16T22:26:07.423 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/166 2024-05-16T22:26:07.423 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/166 2024-05-16T22:26:07.423 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/166 2024-05-16T22:26:07.423 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/166 2024-05-16T22:26:07.423 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/166 2024-05-16T22:26:07.423 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/166 2024-05-16T22:26:07.423 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/166 2024-05-16T22:26:07.423 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/166 2024-05-16T22:26:07.423 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/166 2024-05-16T22:26:07.423 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/166 2024-05-16T22:26:07.423 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/166 2024-05-16T22:26:07.424 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/166 2024-05-16T22:26:07.424 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/166 2024-05-16T22:26:07.424 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/166 2024-05-16T22:26:07.424 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/166 2024-05-16T22:26:07.424 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/166 2024-05-16T22:26:07.424 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/166 2024-05-16T22:26:07.424 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/166 2024-05-16T22:26:07.424 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/166 2024-05-16T22:26:07.424 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/166 2024-05-16T22:26:07.424 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/166 2024-05-16T22:26:07.424 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/166 2024-05-16T22:26:07.424 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/166 2024-05-16T22:26:07.424 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/166 2024-05-16T22:26:07.424 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/166 2024-05-16T22:26:07.425 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/166 2024-05-16T22:26:07.425 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/166 2024-05-16T22:26:07.425 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : fscrypt-0.3.4-2.el9.x86_64 106/166 2024-05-16T22:26:07.425 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/166 2024-05-16T22:26:07.425 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/166 2024-05-16T22:26:07.425 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/166 2024-05-16T22:26:07.425 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/166 2024-05-16T22:26:07.425 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/166 2024-05-16T22:26:07.425 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/166 2024-05-16T22:26:07.425 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/166 2024-05-16T22:26:07.425 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : pam_fscrypt-0.3.4-2.el9.x86_64 114/166 2024-05-16T22:26:07.425 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/166 2024-05-16T22:26:07.425 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/166 2024-05-16T22:26:07.425 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/166 2024-05-16T22:26:07.425 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/166 2024-05-16T22:26:07.425 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/166 2024-05-16T22:26:07.426 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/166 2024-05-16T22:26:07.426 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/166 2024-05-16T22:26:07.426 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/166 2024-05-16T22:26:07.426 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/166 2024-05-16T22:26:07.426 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 124/166 2024-05-16T22:26:07.426 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/166 2024-05-16T22:26:07.426 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/166 2024-05-16T22:26:07.426 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/166 2024-05-16T22:26:07.426 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/166 2024-05-16T22:26:07.426 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/166 2024-05-16T22:26:07.426 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/166 2024-05-16T22:26:07.426 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/166 2024-05-16T22:26:07.426 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/166 2024-05-16T22:26:07.427 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/166 2024-05-16T22:26:07.427 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/166 2024-05-16T22:26:07.427 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/166 2024-05-16T22:26:07.427 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/166 2024-05-16T22:26:07.427 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/166 2024-05-16T22:26:07.427 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/166 2024-05-16T22:26:07.427 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/166 2024-05-16T22:26:07.427 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/166 2024-05-16T22:26:07.427 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/166 2024-05-16T22:26:07.427 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/166 2024-05-16T22:26:07.427 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/166 2024-05-16T22:26:07.427 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/166 2024-05-16T22:26:07.427 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/166 2024-05-16T22:26:07.428 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/166 2024-05-16T22:26:07.428 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/166 2024-05-16T22:26:07.428 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/166 2024-05-16T22:26:07.428 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/166 2024-05-16T22:26:07.428 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/166 2024-05-16T22:26:07.428 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librados2-2:19.0.0-3709.g43296076.el9.x86_64 151/166 2024-05-16T22:26:07.428 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/166 2024-05-16T22:26:07.428 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librbd1-2:19.0.0-3709.g43296076.el9.x86_64 153/166 2024-05-16T22:26:07.428 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/166 2024-05-16T22:26:07.428 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-1:1.47.90-1.el9.x86_64 155/166 2024-05-16T22:26:07.428 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 156/166 2024-05-16T22:26:07.428 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 157/166 2024-05-16T22:26:07.428 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 158/166 2024-05-16T22:26:07.429 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-team-1:1.47.90-1.el9.x86_64 159/166 2024-05-16T22:26:07.429 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 160/166 2024-05-16T22:26:07.429 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-tui-1:1.47.90-1.el9.x86_64 161/166 2024-05-16T22:26:07.429 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 162/166 2024-05-16T22:26:07.429 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 163/166 2024-05-16T22:26:07.429 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 164/166 2024-05-16T22:26:07.429 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 165/166 2024-05-16T22:26:09.754 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 166/166 2024-05-16T22:26:09.754 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-16T22:26:09.754 INFO:teuthology.orchestra.run.smithi070.stdout:Upgraded: 2024-05-16T22:26:09.754 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-1:1.47.90-1.el9.x86_64 2024-05-16T22:26:09.754 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 2024-05-16T22:26:09.754 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-team-1:1.47.90-1.el9.x86_64 2024-05-16T22:26:09.754 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-tui-1:1.47.90-1.el9.x86_64 2024-05-16T22:26:09.754 INFO:teuthology.orchestra.run.smithi070.stdout: librados2-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:09.754 INFO:teuthology.orchestra.run.smithi070.stdout: librbd1-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:09.755 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-16T22:26:09.755 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-16T22:26:09.755 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-05-16T22:26:09.755 INFO:teuthology.orchestra.run.smithi070.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-16T22:26:09.755 INFO:teuthology.orchestra.run.smithi070.stdout: automake-1.16.2-8.el9.noarch 2024-05-16T22:26:09.755 INFO:teuthology.orchestra.run.smithi070.stdout: bison-3.7.4-5.el9.x86_64 2024-05-16T22:26:09.755 INFO:teuthology.orchestra.run.smithi070.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-16T22:26:09.755 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:09.755 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-base-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:09.755 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:09.755 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-fuse-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:09.755 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-grafana-dashboards-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T22:26:09.755 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-immutable-object-cache-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:09.755 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mds-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:09.756 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:09.756 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-cephadm-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T22:26:09.756 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-dashboard-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T22:26:09.756 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T22:26:09.756 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-modules-core-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T22:26:09.756 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-rook-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T22:26:09.756 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mon-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:09.756 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-osd-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:09.756 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-prometheus-alerts-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T22:26:09.756 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-radosgw-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:09.756 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-selinux-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:09.756 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-test-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:09.756 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-volume-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T22:26:09.757 INFO:teuthology.orchestra.run.smithi070.stdout: cephadm-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T22:26:09.757 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-mirror-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:09.757 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-shell-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:09.757 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-top-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T22:26:09.757 INFO:teuthology.orchestra.run.smithi070.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-16T22:26:09.757 INFO:teuthology.orchestra.run.smithi070.stdout: flex-2.6.4-9.el9.x86_64 2024-05-16T22:26:09.757 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-16T22:26:09.757 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-16T22:26:09.757 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-16T22:26:09.757 INFO:teuthology.orchestra.run.smithi070.stdout: fscrypt-0.3.4-2.el9.x86_64 2024-05-16T22:26:09.757 INFO:teuthology.orchestra.run.smithi070.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-16T22:26:09.757 INFO:teuthology.orchestra.run.smithi070.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-16T22:26:09.757 INFO:teuthology.orchestra.run.smithi070.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-16T22:26:09.757 INFO:teuthology.orchestra.run.smithi070.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-16T22:26:09.758 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-16T22:26:09.758 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-16T22:26:09.758 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs-devel-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:09.758 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs2-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:09.758 INFO:teuthology.orchestra.run.smithi070.stdout: libcephsqlite-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:09.758 INFO:teuthology.orchestra.run.smithi070.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-16T22:26:09.758 INFO:teuthology.orchestra.run.smithi070.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-16T22:26:09.758 INFO:teuthology.orchestra.run.smithi070.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-16T22:26:09.758 INFO:teuthology.orchestra.run.smithi070.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-16T22:26:09.758 INFO:teuthology.orchestra.run.smithi070.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-16T22:26:09.758 INFO:teuthology.orchestra.run.smithi070.stdout: librados-devel-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:09.758 INFO:teuthology.orchestra.run.smithi070.stdout: libradosstriper1-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:09.759 INFO:teuthology.orchestra.run.smithi070.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-16T22:26:09.759 INFO:teuthology.orchestra.run.smithi070.stdout: librgw2-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:09.759 INFO:teuthology.orchestra.run.smithi070.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-16T22:26:09.759 INFO:teuthology.orchestra.run.smithi070.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-16T22:26:09.759 INFO:teuthology.orchestra.run.smithi070.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-16T22:26:09.759 INFO:teuthology.orchestra.run.smithi070.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-16T22:26:09.759 INFO:teuthology.orchestra.run.smithi070.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-16T22:26:09.759 INFO:teuthology.orchestra.run.smithi070.stdout: lua-5.4.4-4.el9.x86_64 2024-05-16T22:26:09.759 INFO:teuthology.orchestra.run.smithi070.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-16T22:26:09.759 INFO:teuthology.orchestra.run.smithi070.stdout: luarocks-3.9.2-5.el9.noarch 2024-05-16T22:26:09.759 INFO:teuthology.orchestra.run.smithi070.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-16T22:26:09.759 INFO:teuthology.orchestra.run.smithi070.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-16T22:26:09.759 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-16T22:26:09.760 INFO:teuthology.orchestra.run.smithi070.stdout: pam_fscrypt-0.3.4-2.el9.x86_64 2024-05-16T22:26:09.760 INFO:teuthology.orchestra.run.smithi070.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-16T22:26:09.760 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-13.14-1.el9.x86_64 2024-05-16T22:26:09.760 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-16T22:26:09.760 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-16T22:26:09.760 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-16T22:26:09.760 INFO:teuthology.orchestra.run.smithi070.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-16T22:26:09.760 INFO:teuthology.orchestra.run.smithi070.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-16T22:26:09.760 INFO:teuthology.orchestra.run.smithi070.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-16T22:26:09.760 INFO:teuthology.orchestra.run.smithi070.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-16T22:26:09.760 INFO:teuthology.orchestra.run.smithi070.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-16T22:26:09.760 INFO:teuthology.orchestra.run.smithi070.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-16T22:26:09.760 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-16T22:26:09.760 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-argparse-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:09.760 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:09.761 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cephfs-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:09.761 INFO:teuthology.orchestra.run.smithi070.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-16T22:26:09.761 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-16T22:26:09.761 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-16T22:26:09.761 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-16T22:26:09.761 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-16T22:26:09.761 INFO:teuthology.orchestra.run.smithi070.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-16T22:26:09.761 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-16T22:26:09.761 INFO:teuthology.orchestra.run.smithi070.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-16T22:26:09.761 INFO:teuthology.orchestra.run.smithi070.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-16T22:26:09.761 INFO:teuthology.orchestra.run.smithi070.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-16T22:26:09.761 INFO:teuthology.orchestra.run.smithi070.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-16T22:26:09.761 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-16T22:26:09.761 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-16T22:26:09.762 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-16T22:26:09.762 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-16T22:26:09.762 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-16T22:26:09.762 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-16T22:26:09.762 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-16T22:26:09.762 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-16T22:26:09.762 INFO:teuthology.orchestra.run.smithi070.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-16T22:26:09.762 INFO:teuthology.orchestra.run.smithi070.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-16T22:26:09.762 INFO:teuthology.orchestra.run.smithi070.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-16T22:26:09.762 INFO:teuthology.orchestra.run.smithi070.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-16T22:26:09.762 INFO:teuthology.orchestra.run.smithi070.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-16T22:26:09.762 INFO:teuthology.orchestra.run.smithi070.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-16T22:26:09.762 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-16T22:26:09.763 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-16T22:26:09.763 INFO:teuthology.orchestra.run.smithi070.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-16T22:26:09.763 INFO:teuthology.orchestra.run.smithi070.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-16T22:26:09.763 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-16T22:26:09.763 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ply-3.11-14.el9.noarch 2024-05-16T22:26:09.763 INFO:teuthology.orchestra.run.smithi070.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-16T22:26:09.763 INFO:teuthology.orchestra.run.smithi070.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-16T22:26:09.763 INFO:teuthology.orchestra.run.smithi070.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-16T22:26:09.763 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-16T22:26:09.763 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-16T22:26:09.763 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-16T22:26:09.763 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-16T22:26:09.763 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-16T22:26:09.763 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-16T22:26:09.764 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rados-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:09.764 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rbd-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:09.764 INFO:teuthology.orchestra.run.smithi070.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-16T22:26:09.764 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-16T22:26:09.764 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-16T22:26:09.764 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rgw-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:09.764 INFO:teuthology.orchestra.run.smithi070.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-16T22:26:09.764 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-16T22:26:09.764 INFO:teuthology.orchestra.run.smithi070.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-16T22:26:09.764 INFO:teuthology.orchestra.run.smithi070.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-16T22:26:09.764 INFO:teuthology.orchestra.run.smithi070.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-16T22:26:09.764 INFO:teuthology.orchestra.run.smithi070.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-16T22:26:09.764 INFO:teuthology.orchestra.run.smithi070.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-16T22:26:09.764 INFO:teuthology.orchestra.run.smithi070.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-16T22:26:09.765 INFO:teuthology.orchestra.run.smithi070.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-16T22:26:09.765 INFO:teuthology.orchestra.run.smithi070.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-16T22:26:09.765 INFO:teuthology.orchestra.run.smithi070.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-16T22:26:09.765 INFO:teuthology.orchestra.run.smithi070.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-16T22:26:09.765 INFO:teuthology.orchestra.run.smithi070.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-16T22:26:09.765 INFO:teuthology.orchestra.run.smithi070.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-16T22:26:09.765 INFO:teuthology.orchestra.run.smithi070.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-16T22:26:09.765 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-fuse-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:09.765 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-mirror-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:09.765 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-nbd-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:09.765 INFO:teuthology.orchestra.run.smithi070.stdout: re2-1:20211101-3.el9.x86_64 2024-05-16T22:26:09.765 INFO:teuthology.orchestra.run.smithi070.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-16T22:26:09.765 INFO:teuthology.orchestra.run.smithi070.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-16T22:26:09.765 INFO:teuthology.orchestra.run.smithi070.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-16T22:26:09.766 INFO:teuthology.orchestra.run.smithi070.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-16T22:26:09.766 INFO:teuthology.orchestra.run.smithi070.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-16T22:26:09.766 INFO:teuthology.orchestra.run.smithi070.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-16T22:26:09.766 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-16T22:26:09.766 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-05-16T22:26:10.148 DEBUG:teuthology.parallel:result is None 2024-05-16T22:26:11.748 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-test-2:19.0.0-3709.g43296076.el9.x86_64 143/166 2024-05-16T22:26:11.801 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : rbd-fuse-2:19.0.0-3709.g43296076.el9.x86_64 144/166 2024-05-16T22:26:11.855 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : rbd-nbd-2:19.0.0-3709.g43296076.el9.x86_64 145/166 2024-05-16T22:26:11.888 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/166 2024-05-16T22:26:11.951 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 147/166 2024-05-16T22:26:12.251 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : cephfs-shell-2:19.0.0-3709.g43296076.el9.x86_64 148/166 2024-05-16T22:26:12.319 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/166 2024-05-16T22:26:12.349 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libcephfs-devel-2:19.0.0-3709.g43296076.el9.x86_ 150/166 2024-05-16T22:26:12.396 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : NetworkManager-team-1:1.47.90-1.el9.x86_64 151/166 2024-05-16T22:26:12.442 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : NetworkManager-tui-1:1.47.90-1.el9.x86_64 152/166 2024-05-16T22:26:13.389 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 153/166 2024-05-16T22:26:13.439 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 153/166 2024-05-16T22:26:13.502 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 153/166 2024-05-16T22:26:14.866 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : cephfs-top-2:19.0.0-3709.g43296076.el9.noarch 154/166 2024-05-16T22:26:14.978 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 155/166 2024-05-16T22:26:15.077 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 156/166 2024-05-16T22:26:15.229 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : flex-2.6.4-9.el9.x86_64 157/166 2024-05-16T22:26:15.263 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : bison-3.7.4-5.el9.x86_64 158/166 2024-05-16T22:26:15.301 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 159/166 2024-05-16T22:26:15.301 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/166 2024-05-16T22:26:15.428 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/166 2024-05-16T22:26:15.476 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 161/166 2024-05-16T22:26:15.477 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 162/166 2024-05-16T22:26:15.621 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 162/166 2024-05-16T22:26:15.660 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 163/166 2024-05-16T22:26:15.692 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 164/166 2024-05-16T22:26:15.692 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 164/166 2024-05-16T22:26:16.015 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 164/166 2024-05-16T22:26:16.016 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 165/166 2024-05-16T22:26:16.159 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 165/166 2024-05-16T22:26:16.291 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 166/166 2024-05-16T22:26:16.521 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 166/166 2024-05-16T22:26:16.521 INFO:teuthology.orchestra.run.smithi196.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-05-16T22:26:16.521 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:26:22.384 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-2:19.0.0-3709.g43296076.el9.x86_64 1/166 2024-05-16T22:26:22.384 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-base-2:19.0.0-3709.g43296076.el9.x86_64 2/166 2024-05-16T22:26:22.384 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 3/166 2024-05-16T22:26:22.384 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-fuse-2:19.0.0-3709.g43296076.el9.x86_64 4/166 2024-05-16T22:26:22.384 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3709.g43296 5/166 2024-05-16T22:26:22.384 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mds-2:19.0.0-3709.g43296076.el9.x86_64 6/166 2024-05-16T22:26:22.384 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-2:19.0.0-3709.g43296076.el9.x86_64 7/166 2024-05-16T22:26:22.384 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mon-2:19.0.0-3709.g43296076.el9.x86_64 8/166 2024-05-16T22:26:22.385 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-osd-2:19.0.0-3709.g43296076.el9.x86_64 9/166 2024-05-16T22:26:22.385 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-radosgw-2:19.0.0-3709.g43296076.el9.x86_64 10/166 2024-05-16T22:26:22.385 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-selinux-2:19.0.0-3709.g43296076.el9.x86_64 11/166 2024-05-16T22:26:22.385 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-test-2:19.0.0-3709.g43296076.el9.x86_64 12/166 2024-05-16T22:26:22.385 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : cephfs-mirror-2:19.0.0-3709.g43296076.el9.x86_64 13/166 2024-05-16T22:26:22.385 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : cephfs-shell-2:19.0.0-3709.g43296076.el9.x86_64 14/166 2024-05-16T22:26:22.385 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libcephfs-devel-2:19.0.0-3709.g43296076.el9.x86_ 15/166 2024-05-16T22:26:22.385 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libcephfs2-2:19.0.0-3709.g43296076.el9.x86_64 16/166 2024-05-16T22:26:22.385 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libcephsqlite-2:19.0.0-3709.g43296076.el9.x86_64 17/166 2024-05-16T22:26:22.385 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librados-devel-2:19.0.0-3709.g43296076.el9.x86_6 18/166 2024-05-16T22:26:22.385 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libradosstriper1-2:19.0.0-3709.g43296076.el9.x86 19/166 2024-05-16T22:26:22.385 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librgw2-2:19.0.0-3709.g43296076.el9.x86_64 20/166 2024-05-16T22:26:22.385 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3709.g43296076.el 21/166 2024-05-16T22:26:22.385 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-ceph-common-2:19.0.0-3709.g43296076.el9. 22/166 2024-05-16T22:26:22.386 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cephfs-2:19.0.0-3709.g43296076.el9.x86_6 23/166 2024-05-16T22:26:22.386 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-rados-2:19.0.0-3709.g43296076.el9.x86_64 24/166 2024-05-16T22:26:22.386 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-rbd-2:19.0.0-3709.g43296076.el9.x86_64 25/166 2024-05-16T22:26:22.386 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-rgw-2:19.0.0-3709.g43296076.el9.x86_64 26/166 2024-05-16T22:26:22.386 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : rbd-fuse-2:19.0.0-3709.g43296076.el9.x86_64 27/166 2024-05-16T22:26:22.386 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : rbd-mirror-2:19.0.0-3709.g43296076.el9.x86_64 28/166 2024-05-16T22:26:22.386 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : rbd-nbd-2:19.0.0-3709.g43296076.el9.x86_64 29/166 2024-05-16T22:26:22.386 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3709.g43296076. 30/166 2024-05-16T22:26:22.386 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3709.g43296076.el9.noa 31/166 2024-05-16T22:26:22.386 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3709.g43296076.el9.n 32/166 2024-05-16T22:26:22.386 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3709.g432 33/166 2024-05-16T22:26:22.386 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3709.g43296076.el 34/166 2024-05-16T22:26:22.386 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3709.g43296076.el9.noarch 35/166 2024-05-16T22:26:22.387 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3709.g43296076.e 36/166 2024-05-16T22:26:22.387 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-volume-2:19.0.0-3709.g43296076.el9.noarch 37/166 2024-05-16T22:26:22.387 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : cephadm-2:19.0.0-3709.g43296076.el9.noarch 38/166 2024-05-16T22:26:22.387 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : cephfs-top-2:19.0.0-3709.g43296076.el9.noarch 39/166 2024-05-16T22:26:22.387 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/166 2024-05-16T22:26:22.387 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/166 2024-05-16T22:26:22.387 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/166 2024-05-16T22:26:22.387 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/166 2024-05-16T22:26:22.387 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/166 2024-05-16T22:26:22.387 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/166 2024-05-16T22:26:22.387 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/166 2024-05-16T22:26:22.387 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/166 2024-05-16T22:26:22.387 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/166 2024-05-16T22:26:22.387 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/166 2024-05-16T22:26:22.388 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/166 2024-05-16T22:26:22.388 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/166 2024-05-16T22:26:22.388 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/166 2024-05-16T22:26:22.388 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/166 2024-05-16T22:26:22.388 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/166 2024-05-16T22:26:22.388 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/166 2024-05-16T22:26:22.388 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/166 2024-05-16T22:26:22.388 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/166 2024-05-16T22:26:22.388 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/166 2024-05-16T22:26:22.388 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/166 2024-05-16T22:26:22.388 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/166 2024-05-16T22:26:22.388 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/166 2024-05-16T22:26:22.388 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/166 2024-05-16T22:26:22.388 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/166 2024-05-16T22:26:22.388 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/166 2024-05-16T22:26:22.389 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/166 2024-05-16T22:26:22.389 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/166 2024-05-16T22:26:22.389 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/166 2024-05-16T22:26:22.389 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/166 2024-05-16T22:26:22.389 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/166 2024-05-16T22:26:22.389 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/166 2024-05-16T22:26:22.389 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/166 2024-05-16T22:26:22.389 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/166 2024-05-16T22:26:22.389 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/166 2024-05-16T22:26:22.389 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/166 2024-05-16T22:26:22.389 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/166 2024-05-16T22:26:22.389 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/166 2024-05-16T22:26:22.389 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/166 2024-05-16T22:26:22.390 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/166 2024-05-16T22:26:22.390 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/166 2024-05-16T22:26:22.390 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/166 2024-05-16T22:26:22.390 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/166 2024-05-16T22:26:22.390 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/166 2024-05-16T22:26:22.390 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/166 2024-05-16T22:26:22.390 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/166 2024-05-16T22:26:22.390 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/166 2024-05-16T22:26:22.390 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/166 2024-05-16T22:26:22.390 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/166 2024-05-16T22:26:22.390 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/166 2024-05-16T22:26:22.390 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/166 2024-05-16T22:26:22.390 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/166 2024-05-16T22:26:22.391 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/166 2024-05-16T22:26:22.391 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/166 2024-05-16T22:26:22.391 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/166 2024-05-16T22:26:22.391 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/166 2024-05-16T22:26:22.391 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/166 2024-05-16T22:26:22.391 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/166 2024-05-16T22:26:22.391 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/166 2024-05-16T22:26:22.391 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/166 2024-05-16T22:26:22.391 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/166 2024-05-16T22:26:22.391 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/166 2024-05-16T22:26:22.391 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/166 2024-05-16T22:26:22.391 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/166 2024-05-16T22:26:22.391 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/166 2024-05-16T22:26:22.391 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/166 2024-05-16T22:26:22.392 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/166 2024-05-16T22:26:22.392 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : fscrypt-0.3.4-2.el9.x86_64 106/166 2024-05-16T22:26:22.392 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/166 2024-05-16T22:26:22.392 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/166 2024-05-16T22:26:22.392 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/166 2024-05-16T22:26:22.392 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/166 2024-05-16T22:26:22.392 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/166 2024-05-16T22:26:22.392 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/166 2024-05-16T22:26:22.392 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/166 2024-05-16T22:26:22.392 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : pam_fscrypt-0.3.4-2.el9.x86_64 114/166 2024-05-16T22:26:22.392 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/166 2024-05-16T22:26:22.392 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/166 2024-05-16T22:26:22.392 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/166 2024-05-16T22:26:22.392 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/166 2024-05-16T22:26:22.393 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/166 2024-05-16T22:26:22.393 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/166 2024-05-16T22:26:22.393 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/166 2024-05-16T22:26:22.393 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/166 2024-05-16T22:26:22.393 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/166 2024-05-16T22:26:22.393 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 124/166 2024-05-16T22:26:22.393 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/166 2024-05-16T22:26:22.393 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/166 2024-05-16T22:26:22.393 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/166 2024-05-16T22:26:22.393 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/166 2024-05-16T22:26:22.393 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/166 2024-05-16T22:26:22.393 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/166 2024-05-16T22:26:22.393 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/166 2024-05-16T22:26:22.394 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/166 2024-05-16T22:26:22.394 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/166 2024-05-16T22:26:22.394 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/166 2024-05-16T22:26:22.394 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/166 2024-05-16T22:26:22.394 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/166 2024-05-16T22:26:22.394 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/166 2024-05-16T22:26:22.394 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/166 2024-05-16T22:26:22.394 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/166 2024-05-16T22:26:22.394 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/166 2024-05-16T22:26:22.394 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/166 2024-05-16T22:26:22.394 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/166 2024-05-16T22:26:22.394 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/166 2024-05-16T22:26:22.395 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/166 2024-05-16T22:26:22.395 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/166 2024-05-16T22:26:22.395 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/166 2024-05-16T22:26:22.395 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/166 2024-05-16T22:26:22.395 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/166 2024-05-16T22:26:22.395 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/166 2024-05-16T22:26:22.395 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/166 2024-05-16T22:26:22.395 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librados2-2:19.0.0-3709.g43296076.el9.x86_64 151/166 2024-05-16T22:26:22.395 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/166 2024-05-16T22:26:22.395 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librbd1-2:19.0.0-3709.g43296076.el9.x86_64 153/166 2024-05-16T22:26:22.395 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/166 2024-05-16T22:26:22.395 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : NetworkManager-1:1.47.90-1.el9.x86_64 155/166 2024-05-16T22:26:22.395 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 156/166 2024-05-16T22:26:22.395 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 157/166 2024-05-16T22:26:22.395 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 158/166 2024-05-16T22:26:22.396 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : NetworkManager-team-1:1.47.90-1.el9.x86_64 159/166 2024-05-16T22:26:22.396 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 160/166 2024-05-16T22:26:22.396 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : NetworkManager-tui-1:1.47.90-1.el9.x86_64 161/166 2024-05-16T22:26:22.396 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 162/166 2024-05-16T22:26:22.396 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 163/166 2024-05-16T22:26:22.396 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 164/166 2024-05-16T22:26:22.396 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 165/166 2024-05-16T22:26:24.567 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 166/166 2024-05-16T22:26:24.568 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:26:24.568 INFO:teuthology.orchestra.run.smithi196.stdout:Upgraded: 2024-05-16T22:26:24.568 INFO:teuthology.orchestra.run.smithi196.stdout: NetworkManager-1:1.47.90-1.el9.x86_64 2024-05-16T22:26:24.568 INFO:teuthology.orchestra.run.smithi196.stdout: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 2024-05-16T22:26:24.568 INFO:teuthology.orchestra.run.smithi196.stdout: NetworkManager-team-1:1.47.90-1.el9.x86_64 2024-05-16T22:26:24.568 INFO:teuthology.orchestra.run.smithi196.stdout: NetworkManager-tui-1:1.47.90-1.el9.x86_64 2024-05-16T22:26:24.568 INFO:teuthology.orchestra.run.smithi196.stdout: librados2-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:24.568 INFO:teuthology.orchestra.run.smithi196.stdout: librbd1-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:24.568 INFO:teuthology.orchestra.run.smithi196.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-16T22:26:24.568 INFO:teuthology.orchestra.run.smithi196.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-16T22:26:24.568 INFO:teuthology.orchestra.run.smithi196.stdout:Installed: 2024-05-16T22:26:24.569 INFO:teuthology.orchestra.run.smithi196.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-16T22:26:24.569 INFO:teuthology.orchestra.run.smithi196.stdout: automake-1.16.2-8.el9.noarch 2024-05-16T22:26:24.569 INFO:teuthology.orchestra.run.smithi196.stdout: bison-3.7.4-5.el9.x86_64 2024-05-16T22:26:24.569 INFO:teuthology.orchestra.run.smithi196.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-16T22:26:24.569 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:24.569 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-base-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:24.569 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:24.569 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-fuse-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:24.569 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-grafana-dashboards-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T22:26:24.569 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-immutable-object-cache-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:24.569 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mds-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:24.569 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:24.569 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-cephadm-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T22:26:24.569 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-dashboard-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T22:26:24.570 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T22:26:24.570 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-modules-core-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T22:26:24.570 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-rook-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T22:26:24.570 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mon-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:24.570 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-osd-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:24.570 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-prometheus-alerts-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T22:26:24.570 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-radosgw-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:24.570 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-selinux-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:24.570 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-test-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:24.570 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-volume-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T22:26:24.570 INFO:teuthology.orchestra.run.smithi196.stdout: cephadm-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T22:26:24.570 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-mirror-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:24.570 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-shell-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:24.571 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-top-2:19.0.0-3709.g43296076.el9.noarch 2024-05-16T22:26:24.571 INFO:teuthology.orchestra.run.smithi196.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-16T22:26:24.571 INFO:teuthology.orchestra.run.smithi196.stdout: flex-2.6.4-9.el9.x86_64 2024-05-16T22:26:24.571 INFO:teuthology.orchestra.run.smithi196.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-16T22:26:24.571 INFO:teuthology.orchestra.run.smithi196.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-16T22:26:24.571 INFO:teuthology.orchestra.run.smithi196.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-16T22:26:24.571 INFO:teuthology.orchestra.run.smithi196.stdout: fscrypt-0.3.4-2.el9.x86_64 2024-05-16T22:26:24.571 INFO:teuthology.orchestra.run.smithi196.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-16T22:26:24.571 INFO:teuthology.orchestra.run.smithi196.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-16T22:26:24.571 INFO:teuthology.orchestra.run.smithi196.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-16T22:26:24.571 INFO:teuthology.orchestra.run.smithi196.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-16T22:26:24.571 INFO:teuthology.orchestra.run.smithi196.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-16T22:26:24.571 INFO:teuthology.orchestra.run.smithi196.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-16T22:26:24.571 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs-devel-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:24.572 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs2-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:24.572 INFO:teuthology.orchestra.run.smithi196.stdout: libcephsqlite-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:24.572 INFO:teuthology.orchestra.run.smithi196.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-16T22:26:24.572 INFO:teuthology.orchestra.run.smithi196.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-16T22:26:24.572 INFO:teuthology.orchestra.run.smithi196.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-16T22:26:24.572 INFO:teuthology.orchestra.run.smithi196.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-16T22:26:24.572 INFO:teuthology.orchestra.run.smithi196.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-16T22:26:24.572 INFO:teuthology.orchestra.run.smithi196.stdout: librados-devel-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:24.572 INFO:teuthology.orchestra.run.smithi196.stdout: libradosstriper1-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:24.572 INFO:teuthology.orchestra.run.smithi196.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-16T22:26:24.572 INFO:teuthology.orchestra.run.smithi196.stdout: librgw2-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:24.572 INFO:teuthology.orchestra.run.smithi196.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-16T22:26:24.572 INFO:teuthology.orchestra.run.smithi196.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-16T22:26:24.573 INFO:teuthology.orchestra.run.smithi196.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-16T22:26:24.573 INFO:teuthology.orchestra.run.smithi196.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-16T22:26:24.573 INFO:teuthology.orchestra.run.smithi196.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-16T22:26:24.573 INFO:teuthology.orchestra.run.smithi196.stdout: lua-5.4.4-4.el9.x86_64 2024-05-16T22:26:24.573 INFO:teuthology.orchestra.run.smithi196.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-16T22:26:24.573 INFO:teuthology.orchestra.run.smithi196.stdout: luarocks-3.9.2-5.el9.noarch 2024-05-16T22:26:24.573 INFO:teuthology.orchestra.run.smithi196.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-16T22:26:24.573 INFO:teuthology.orchestra.run.smithi196.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-16T22:26:24.573 INFO:teuthology.orchestra.run.smithi196.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-16T22:26:24.573 INFO:teuthology.orchestra.run.smithi196.stdout: pam_fscrypt-0.3.4-2.el9.x86_64 2024-05-16T22:26:24.573 INFO:teuthology.orchestra.run.smithi196.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-16T22:26:24.573 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-13.14-1.el9.x86_64 2024-05-16T22:26:24.573 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-16T22:26:24.574 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-16T22:26:24.574 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-16T22:26:24.574 INFO:teuthology.orchestra.run.smithi196.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-16T22:26:24.574 INFO:teuthology.orchestra.run.smithi196.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-16T22:26:24.574 INFO:teuthology.orchestra.run.smithi196.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-16T22:26:24.574 INFO:teuthology.orchestra.run.smithi196.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-16T22:26:24.574 INFO:teuthology.orchestra.run.smithi196.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-16T22:26:24.574 INFO:teuthology.orchestra.run.smithi196.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-16T22:26:24.574 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-16T22:26:24.574 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-argparse-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:24.574 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:24.574 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cephfs-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:24.574 INFO:teuthology.orchestra.run.smithi196.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-16T22:26:24.575 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-16T22:26:24.575 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-16T22:26:24.575 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-16T22:26:24.575 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-16T22:26:24.575 INFO:teuthology.orchestra.run.smithi196.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-16T22:26:24.575 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-16T22:26:24.575 INFO:teuthology.orchestra.run.smithi196.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-16T22:26:24.575 INFO:teuthology.orchestra.run.smithi196.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-16T22:26:24.575 INFO:teuthology.orchestra.run.smithi196.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-16T22:26:24.575 INFO:teuthology.orchestra.run.smithi196.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-16T22:26:24.575 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-16T22:26:24.575 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-16T22:26:24.575 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-16T22:26:24.575 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-16T22:26:24.576 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-16T22:26:24.576 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-16T22:26:24.576 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-16T22:26:24.576 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-16T22:26:24.576 INFO:teuthology.orchestra.run.smithi196.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-16T22:26:24.576 INFO:teuthology.orchestra.run.smithi196.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-16T22:26:24.576 INFO:teuthology.orchestra.run.smithi196.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-16T22:26:24.576 INFO:teuthology.orchestra.run.smithi196.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-16T22:26:24.576 INFO:teuthology.orchestra.run.smithi196.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-16T22:26:24.576 INFO:teuthology.orchestra.run.smithi196.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-16T22:26:24.576 INFO:teuthology.orchestra.run.smithi196.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-16T22:26:24.576 INFO:teuthology.orchestra.run.smithi196.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-16T22:26:24.576 INFO:teuthology.orchestra.run.smithi196.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-16T22:26:24.577 INFO:teuthology.orchestra.run.smithi196.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-16T22:26:24.577 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-16T22:26:24.577 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ply-3.11-14.el9.noarch 2024-05-16T22:26:24.577 INFO:teuthology.orchestra.run.smithi196.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-16T22:26:24.577 INFO:teuthology.orchestra.run.smithi196.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-16T22:26:24.577 INFO:teuthology.orchestra.run.smithi196.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-16T22:26:24.577 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-16T22:26:24.577 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-16T22:26:24.577 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-16T22:26:24.577 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-16T22:26:24.577 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-16T22:26:24.577 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-16T22:26:24.577 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rados-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:24.578 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rbd-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:24.578 INFO:teuthology.orchestra.run.smithi196.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-16T22:26:24.578 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-16T22:26:24.578 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-16T22:26:24.578 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rgw-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:24.578 INFO:teuthology.orchestra.run.smithi196.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-16T22:26:24.578 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-16T22:26:24.578 INFO:teuthology.orchestra.run.smithi196.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-16T22:26:24.578 INFO:teuthology.orchestra.run.smithi196.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-16T22:26:24.578 INFO:teuthology.orchestra.run.smithi196.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-16T22:26:24.578 INFO:teuthology.orchestra.run.smithi196.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-16T22:26:24.579 INFO:teuthology.orchestra.run.smithi196.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-16T22:26:24.579 INFO:teuthology.orchestra.run.smithi196.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-16T22:26:24.579 INFO:teuthology.orchestra.run.smithi196.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-16T22:26:24.579 INFO:teuthology.orchestra.run.smithi196.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-16T22:26:24.579 INFO:teuthology.orchestra.run.smithi196.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-16T22:26:24.579 INFO:teuthology.orchestra.run.smithi196.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-16T22:26:24.579 INFO:teuthology.orchestra.run.smithi196.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-16T22:26:24.579 INFO:teuthology.orchestra.run.smithi196.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-16T22:26:24.579 INFO:teuthology.orchestra.run.smithi196.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-16T22:26:24.579 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-fuse-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:24.579 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-mirror-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:24.579 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-nbd-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-16T22:26:24.579 INFO:teuthology.orchestra.run.smithi196.stdout: re2-1:20211101-3.el9.x86_64 2024-05-16T22:26:24.580 INFO:teuthology.orchestra.run.smithi196.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-16T22:26:24.580 INFO:teuthology.orchestra.run.smithi196.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-16T22:26:24.580 INFO:teuthology.orchestra.run.smithi196.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-16T22:26:24.580 INFO:teuthology.orchestra.run.smithi196.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-16T22:26:24.580 INFO:teuthology.orchestra.run.smithi196.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-16T22:26:24.580 INFO:teuthology.orchestra.run.smithi196.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-16T22:26:24.580 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:26:24.580 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2024-05-16T22:26:25.286 DEBUG:teuthology.parallel:result is None 2024-05-16T22:26:25.286 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=43296076bed1da2423ef68e9230eab60284d4c31 2024-05-16T22:26:25.437 DEBUG:teuthology.orchestra.run.smithi044:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-16T22:26:25.464 INFO:teuthology.orchestra.run.smithi044.stdout:19.0.0-3709.g43296076.el9 2024-05-16T22:26:25.465 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3709.g43296076.el9 2024-05-16T22:26:25.465 INFO:teuthology.task.install:The correct ceph version 19.0.0-3709.g43296076 is installed. 2024-05-16T22:26:25.467 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=43296076bed1da2423ef68e9230eab60284d4c31 2024-05-16T22:26:25.759 DEBUG:teuthology.orchestra.run.smithi070:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-16T22:26:25.784 INFO:teuthology.orchestra.run.smithi070.stdout:19.0.0-3709.g43296076.el9 2024-05-16T22:26:25.784 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3709.g43296076.el9 2024-05-16T22:26:25.784 INFO:teuthology.task.install:The correct ceph version 19.0.0-3709.g43296076 is installed. 2024-05-16T22:26:25.786 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=43296076bed1da2423ef68e9230eab60284d4c31 2024-05-16T22:26:25.922 DEBUG:teuthology.orchestra.run.smithi196:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-16T22:26:25.972 INFO:teuthology.orchestra.run.smithi196.stdout:19.0.0-3709.g43296076.el9 2024-05-16T22:26:25.972 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3709.g43296076.el9 2024-05-16T22:26:25.972 INFO:teuthology.task.install:The correct ceph version 19.0.0-3709.g43296076 is installed. 2024-05-16T22:26:25.973 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-16T22:26:25.973 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-05-16T22:26:25.974 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-16T22:26:26.006 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-16T22:26:26.006 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-16T22:26:26.037 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-16T22:26:26.037 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-16T22:26:26.102 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-16T22:26:26.102 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-05-16T22:26:26.102 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/daemon-helper 2024-05-16T22:26:26.131 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-16T22:26:26.199 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-16T22:26:26.199 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/daemon-helper 2024-05-16T22:26:26.227 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-16T22:26:26.295 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-16T22:26:26.295 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/daemon-helper 2024-05-16T22:26:26.362 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-16T22:26:26.470 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-16T22:26:26.470 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-05-16T22:26:26.470 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-16T22:26:26.495 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-16T22:26:26.559 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-16T22:26:26.559 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-16T22:26:26.583 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-16T22:26:26.646 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-16T22:26:26.646 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-16T22:26:26.712 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-16T22:26:26.820 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-16T22:26:26.820 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-05-16T22:26:26.821 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/stdin-killer 2024-05-16T22:26:26.846 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-16T22:26:26.909 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-16T22:26:26.909 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/stdin-killer 2024-05-16T22:26:26.934 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-16T22:26:26.997 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-16T22:26:26.997 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/stdin-killer 2024-05-16T22:26:27.057 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-16T22:26:27.165 INFO:teuthology.run_tasks:Running task ceph... 2024-05-16T22:26:27.238 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-16T22:26:27.238 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 777 /var/log/ceph 2024-05-16T22:26:27.240 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 777 /var/log/ceph 2024-05-16T22:26:27.242 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 777 /var/log/ceph 2024-05-16T22:26:27.313 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-16T22:26:27.313 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-16T22:26:27.315 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-16T22:26:27.317 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-16T22:26:27.382 INFO:tasks.ceph:Creating extra log directories... 2024-05-16T22:26:27.383 DEBUG:teuthology.orchestra.run.smithi044:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-16T22:26:27.385 DEBUG:teuthology.orchestra.run.smithi070:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-16T22:26:27.387 DEBUG:teuthology.orchestra.run.smithi196:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-16T22:26:27.457 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-16T22:26:27.457 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-16T22:26:27.457 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-16T22:26:27.457 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-05-16T22:26:27.457 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-16T22:26:27.473 DEBUG:teuthology.orchestra.run.smithi044:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-16T22:26:27.581 DEBUG:teuthology.orchestra.run.smithi044:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-16T22:26:27.605 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-16T22:26:27.605 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-16T22:26:27.620 DEBUG:teuthology.orchestra.run.smithi070:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-16T22:26:27.744 DEBUG:teuthology.orchestra.run.smithi070:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-16T22:26:27.767 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-16T22:26:27.767 DEBUG:teuthology.orchestra.run.smithi196:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-16T22:26:27.812 DEBUG:teuthology.orchestra.run.smithi196:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-16T22:26:27.989 DEBUG:teuthology.orchestra.run.smithi196:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-16T22:26:28.063 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-16T22:26:28.063 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-16T22:26:28.063 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-05-16_22:05:38-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7709888', 'branch': 'wip-pdonnell-testing-20240515.023933-debug', 'description': 'fs:fscrypt/{begin/{0-install 1-ceph 2-logrotate 3-modules} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down osd pg-warn pg_health} tasks/{0-client 1-tests/fscrypt-common}}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7709888', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'pdonnell-2024-05-16_22:05:38-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240515.023933-debug'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '43296076bed1da2423ef68e9230eab60284d4c31'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '43296076bed1da2423ef68e9230eab60284d4c31'}, 'extra_system_packages': {'deb': ['fscrypt'], 'rpm': ['fscrypt']}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'i64602', 'sha1': '4d9eb97fa160d2c19d1436d63c7ffea8b5461de0'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 65, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0']], 'seed': 4756, 'sha1': '43296076bed1da2423ef68e9230eab60284d4c31', 'sleep_before_teardown': 0, 'suite': 'fs:fscrypt', 'suite_branch': 'i64602', 'suite_path': '/home/teuthworker/src/github.com_batrick_ceph_4d9eb97fa160d2c19d1436d63c7ffea8b5461de0/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/batrick/ceph.git', 'suite_sha1': '4d9eb97fa160d2c19d1436d63c7ffea8b5461de0', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi044.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAt5rcUO4Y7SferHnsS0xP4UK1u8AcDvnsU3NbSFYtsAlZnr3NsT5mWskvl8O+kjXaJQNqYGpgdM5kfJK3hO6WQ=', 'smithi070.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDIXx6UZPtPph7S+DeRygWR+koZsxIHdJq7YABiIz+4yDx3pjYMMeRPWCVJVaU0fBVs04k4oN9uXnKFJCrJU0pY=', 'smithi196.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCc/414NTDfFM39WmJCX7+FMCG01VdK0WrgTsS7qdBV17NP6D6e5c3R2XPeHh/CUFQOdO5usm+glmupjtMzVU1g='}, 'task': None, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib', 'fscrypt'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib', 'fscrypt']}, 'flavor': 'default', 'sha1': '43296076bed1da2423ef68e9230eab60284d4c31'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '43296076bed1da2423ef68e9230eab60284d4c31', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'full_sequential_finally': [{'sleep': {'duration': 3600}}]}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_fscrypt']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end', 'if not is_kupstream() then reject() end']}, 'teuthology_branch': 'install-override-extra_system_packages', 'teuthology_sha1': '08ca1187b5d019c0ae6c90488c6c9faaace42185', 'timestamp': '2024-05-16_22:05:38', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-16T22:26:28.064 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-16T22:26:28.066 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-16T22:26:28.068 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-16T22:26:28.117 DEBUG:teuthology.orchestra.run.smithi044:> sudo install -d -m0777 -- /var/run/ceph 2024-05-16T22:26:28.122 DEBUG:teuthology.orchestra.run.smithi070:> sudo install -d -m0777 -- /var/run/ceph 2024-05-16T22:26:28.124 DEBUG:teuthology.orchestra.run.smithi196:> sudo install -d -m0777 -- /var/run/ceph 2024-05-16T22:26:28.197 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-05-16T22:26:28.197 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/scratch_devs of=/dev/stdout 2024-05-16T22:26:28.213 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-16T22:26:28.213 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_1 2024-05-16T22:26:28.268 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-16T22:26:28.268 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-16T22:26:28.268 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 663 Links: 1 2024-05-16T22:26:28.268 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-16T22:26:28.268 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2024-05-16T22:26:28.269 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-05-16 22:25:51.742760422 +0000 2024-05-16T22:26:28.269 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-05-16 22:22:42.466283950 +0000 2024-05-16T22:26:28.269 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-05-16 22:22:42.466283950 +0000 2024-05-16T22:26:28.269 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-05-16 22:22:42.466283950 +0000 2024-05-16T22:26:28.269 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-16T22:26:28.331 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-05-16T22:26:28.331 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-05-16T22:26:28.331 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000356319 s, 1.4 MB/s 2024-05-16T22:26:28.333 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-16T22:26:28.390 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_2 2024-05-16T22:26:28.445 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-16T22:26:28.445 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-16T22:26:28.445 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-05-16T22:26:28.446 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-16T22:26:28.446 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2024-05-16T22:26:28.446 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-05-16 22:25:51.742760422 +0000 2024-05-16T22:26:28.446 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-05-16 22:22:42.816278386 +0000 2024-05-16T22:26:28.446 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-05-16 22:22:42.816278386 +0000 2024-05-16T22:26:28.446 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-05-16 22:22:42.816278386 +0000 2024-05-16T22:26:28.446 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-16T22:26:28.509 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-05-16T22:26:28.509 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-05-16T22:26:28.509 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000184695 s, 2.8 MB/s 2024-05-16T22:26:28.510 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-16T22:26:28.567 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_3 2024-05-16T22:26:28.622 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-16T22:26:28.622 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-16T22:26:28.622 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-05-16T22:26:28.623 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-16T22:26:28.623 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2024-05-16T22:26:28.623 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-05-16 22:25:51.742760422 +0000 2024-05-16T22:26:28.623 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-05-16 22:22:43.156272980 +0000 2024-05-16T22:26:28.623 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-05-16 22:22:43.156272980 +0000 2024-05-16T22:26:28.623 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-05-16 22:22:43.156272980 +0000 2024-05-16T22:26:28.623 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-16T22:26:28.686 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-05-16T22:26:28.686 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-05-16T22:26:28.686 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000199632 s, 2.6 MB/s 2024-05-16T22:26:28.687 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-16T22:26:28.743 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_4 2024-05-16T22:26:28.798 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-16T22:26:28.798 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-16T22:26:28.798 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-05-16T22:26:28.798 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-16T22:26:28.798 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2024-05-16T22:26:28.798 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-05-16 22:25:51.743760406 +0000 2024-05-16T22:26:28.798 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-05-16 22:22:43.495267591 +0000 2024-05-16T22:26:28.798 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-05-16 22:22:43.495267591 +0000 2024-05-16T22:26:28.798 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-05-16 22:22:43.495267591 +0000 2024-05-16T22:26:28.799 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-16T22:26:28.860 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-05-16T22:26:28.860 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-05-16T22:26:28.860 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000191462 s, 2.7 MB/s 2024-05-16T22:26:28.862 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-16T22:26:28.918 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-16T22:26:28.918 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-16T22:26:28.918 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/scratch_devs of=/dev/stdout 2024-05-16T22:26:28.936 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-16T22:26:28.936 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_1 2024-05-16T22:26:28.993 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-16T22:26:28.993 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-16T22:26:28.993 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-05-16T22:26:28.994 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-16T22:26:28.994 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-05-16T22:26:28.994 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-05-16 22:26:01.905205044 +0000 2024-05-16T22:26:28.994 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-05-16 22:22:14.798575462 +0000 2024-05-16T22:26:28.994 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-05-16 22:22:14.798575462 +0000 2024-05-16T22:26:28.994 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-05-16 22:22:14.798575462 +0000 2024-05-16T22:26:28.994 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-16T22:26:29.058 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-05-16T22:26:29.058 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-05-16T22:26:29.058 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000120918 s, 4.2 MB/s 2024-05-16T22:26:29.059 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-16T22:26:29.117 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_2 2024-05-16T22:26:29.173 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-16T22:26:29.173 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-16T22:26:29.173 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-05-16T22:26:29.173 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-16T22:26:29.173 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-05-16T22:26:29.173 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-05-16 22:26:01.906205013 +0000 2024-05-16T22:26:29.173 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-05-16 22:22:15.292559957 +0000 2024-05-16T22:26:29.174 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-05-16 22:22:15.292559957 +0000 2024-05-16T22:26:29.174 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-05-16 22:22:15.292559957 +0000 2024-05-16T22:26:29.174 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-16T22:26:29.237 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-05-16T22:26:29.237 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-05-16T22:26:29.237 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000108401 s, 4.7 MB/s 2024-05-16T22:26:29.238 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-16T22:26:29.295 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_3 2024-05-16T22:26:29.350 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-16T22:26:29.351 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-16T22:26:29.351 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-05-16T22:26:29.351 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-16T22:26:29.351 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-05-16T22:26:29.351 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-05-16 22:26:01.906205013 +0000 2024-05-16T22:26:29.351 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-05-16 22:22:15.619549695 +0000 2024-05-16T22:26:29.351 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-05-16 22:22:15.619549695 +0000 2024-05-16T22:26:29.351 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-05-16 22:22:15.619549695 +0000 2024-05-16T22:26:29.351 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-16T22:26:29.414 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-05-16T22:26:29.414 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-05-16T22:26:29.414 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 8.7063e-05 s, 5.9 MB/s 2024-05-16T22:26:29.415 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-16T22:26:29.471 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_4 2024-05-16T22:26:29.526 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-16T22:26:29.526 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-16T22:26:29.526 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-05-16T22:26:29.526 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-16T22:26:29.526 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-05-16T22:26:29.526 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-05-16 22:26:01.907204982 +0000 2024-05-16T22:26:29.526 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-05-16 22:22:15.934539808 +0000 2024-05-16T22:26:29.526 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-05-16 22:22:15.934539808 +0000 2024-05-16T22:26:29.527 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-05-16 22:22:15.934539808 +0000 2024-05-16T22:26:29.527 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-16T22:26:29.588 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-05-16T22:26:29.588 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-05-16T22:26:29.588 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 8.2096e-05 s, 6.2 MB/s 2024-05-16T22:26:29.589 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-16T22:26:29.644 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-16T22:26:29.644 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi044.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi070.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-16T22:26:29.644 INFO:tasks.ceph:Generating config... 2024-05-16T22:26:29.645 INFO:tasks.ceph:[client] client mount timeout = 600 2024-05-16T22:26:29.645 INFO:tasks.ceph:[client] debug client = 20 2024-05-16T22:26:29.645 INFO:tasks.ceph:[client] debug ms = 1 2024-05-16T22:26:29.645 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-05-16T22:26:29.645 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-05-16T22:26:29.646 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2024-05-16T22:26:29.646 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-05-16T22:26:29.646 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-16T22:26:29.646 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-05-16T22:26:29.646 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-16T22:26:29.646 INFO:tasks.ceph:[mds] mds debug frag = True 2024-05-16T22:26:29.646 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-05-16T22:26:29.646 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-05-16T22:26:29.646 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-05-16T22:26:29.646 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-05-16T22:26:29.646 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-05-16T22:26:29.646 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-05-16T22:26:29.646 INFO:tasks.ceph:[mgr] debug client = 20 2024-05-16T22:26:29.646 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-16T22:26:29.647 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-16T22:26:29.647 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-16T22:26:29.647 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-16T22:26:29.647 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-16T22:26:29.647 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-05-16T22:26:29.647 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-05-16T22:26:29.647 INFO:tasks.ceph:[osd] bdev async discard = True 2024-05-16T22:26:29.647 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-05-16T22:26:29.647 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-05-16T22:26:29.647 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-16T22:26:29.647 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-16T22:26:29.647 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-05-16T22:26:29.647 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-05-16T22:26:29.647 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-16T22:26:29.647 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-16T22:26:29.647 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-05-16T22:26:29.648 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-16T22:26:29.648 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-16T22:26:29.648 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-16T22:26:29.648 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-16T22:26:29.648 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-16T22:26:29.648 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-05-16T22:26:29.648 INFO:tasks.ceph:Setting up mon.a... 2024-05-16T22:26:29.648 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-16T22:26:29.709 INFO:teuthology.orchestra.run.smithi044.stdout:creating /etc/ceph/ceph.keyring 2024-05-16T22:26:29.712 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-16T22:26:29.766 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-16T22:26:29.790 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.44'), ('mon.b', '172.21.15.70'), ('mon.c', '[v2:172.21.15.70:3301,v1:172.21.15.70:6790]')] 2024-05-16T22:26:29.791 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.44,172.21.15.70,[v2:172.21.15.70:3301,v1:172.21.15.70:6790]', 'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-05-16T22:26:29.792 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-05-16T22:26:29.792 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-16T22:26:29.846 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.44 --add b 172.21.15.70 --addv c '[v2:172.21.15.70:3301,v1:172.21.15.70:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-16T22:26:29.943 INFO:teuthology.orchestra.run.smithi044.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-16T22:26:29.943 INFO:teuthology.orchestra.run.smithi044.stdout:monmaptool: generated fsid 572ab7cc-b103-4548-ae8f-c6614d57f0c8 2024-05-16T22:26:29.943 INFO:teuthology.orchestra.run.smithi044.stdout:setting min_mon_release = quincy 2024-05-16T22:26:29.944 INFO:teuthology.orchestra.run.smithi044.stdout:epoch 0 2024-05-16T22:26:29.944 INFO:teuthology.orchestra.run.smithi044.stdout:fsid 572ab7cc-b103-4548-ae8f-c6614d57f0c8 2024-05-16T22:26:29.944 INFO:teuthology.orchestra.run.smithi044.stdout:last_changed 2024-05-16T22:26:29.945267+0000 2024-05-16T22:26:29.944 INFO:teuthology.orchestra.run.smithi044.stdout:created 2024-05-16T22:26:29.945267+0000 2024-05-16T22:26:29.944 INFO:teuthology.orchestra.run.smithi044.stdout:min_mon_release 17 (quincy) 2024-05-16T22:26:29.944 INFO:teuthology.orchestra.run.smithi044.stdout:election_strategy: 1 2024-05-16T22:26:29.944 INFO:teuthology.orchestra.run.smithi044.stdout:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-05-16T22:26:29.944 INFO:teuthology.orchestra.run.smithi044.stdout:1: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.b 2024-05-16T22:26:29.944 INFO:teuthology.orchestra.run.smithi044.stdout:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-05-16T22:26:29.944 INFO:teuthology.orchestra.run.smithi044.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-16T22:26:29.946 DEBUG:teuthology.orchestra.run.smithi044:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-16T22:26:29.960 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 572ab7cc-b103-4548-ae8f-c6614d57f0c8... 2024-05-16T22:26:29.961 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-16T22:26:30.003 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-16T22:26:30.006 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-16T22:26:30.043 INFO:teuthology.orchestra.run.smithi044.stdout:[global] 2024-05-16T22:26:30.043 INFO:teuthology.orchestra.run.smithi044.stdout: chdir = "" 2024-05-16T22:26:30.043 INFO:teuthology.orchestra.run.smithi044.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-16T22:26:30.043 INFO:teuthology.orchestra.run.smithi044.stdout: auth supported = cephx 2024-05-16T22:26:30.043 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:26:30.043 INFO:teuthology.orchestra.run.smithi044.stdout: filestore xattr use omap = true 2024-05-16T22:26:30.043 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:26:30.043 INFO:teuthology.orchestra.run.smithi044.stdout: mon clock drift allowed = 1.000 2024-05-16T22:26:30.043 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:26:30.043 INFO:teuthology.orchestra.run.smithi044.stdout: osd crush chooseleaf type = 0 2024-05-16T22:26:30.043 INFO:teuthology.orchestra.run.smithi044.stdout: auth debug = true 2024-05-16T22:26:30.043 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:26:30.044 INFO:teuthology.orchestra.run.smithi044.stdout: ms die on old message = true 2024-05-16T22:26:30.044 INFO:teuthology.orchestra.run.smithi044.stdout: ms die on bug = true 2024-05-16T22:26:30.044 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:26:30.044 INFO:teuthology.orchestra.run.smithi044.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-16T22:26:30.044 INFO:teuthology.orchestra.run.smithi044.stdout: mon pg warn max object skew = 0 2024-05-16T22:26:30.044 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:26:30.044 INFO:teuthology.orchestra.run.smithi044.stdout: # disable pg_autoscaler by default for new pools 2024-05-16T22:26:30.044 INFO:teuthology.orchestra.run.smithi044.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-16T22:26:30.044 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:26:30.044 INFO:teuthology.orchestra.run.smithi044.stdout: osd pool default size = 2 2024-05-16T22:26:30.044 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:26:30.044 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd allow primary affinity = true 2024-05-16T22:26:30.044 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd allow pg remap = true 2024-05-16T22:26:30.045 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on legacy crush tunables = false 2024-05-16T22:26:30.045 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on crush straw calc version zero = false 2024-05-16T22:26:30.045 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on no sortbitwise = false 2024-05-16T22:26:30.045 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on osd down out interval zero = false 2024-05-16T22:26:30.045 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on too few osds = false 2024-05-16T22:26:30.045 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-16T22:26:30.045 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-16T22:26:30.045 INFO:teuthology.orchestra.run.smithi044.stdout: mon_allow_pool_size_one = true 2024-05-16T22:26:30.045 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:26:30.045 INFO:teuthology.orchestra.run.smithi044.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-16T22:26:30.045 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:26:30.045 INFO:teuthology.orchestra.run.smithi044.stdout: osd default data pool replay window = 5 2024-05-16T22:26:30.045 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:26:30.045 INFO:teuthology.orchestra.run.smithi044.stdout: mon allow pool delete = true 2024-05-16T22:26:30.045 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:26:30.046 INFO:teuthology.orchestra.run.smithi044.stdout: mon cluster log file level = debug 2024-05-16T22:26:30.046 INFO:teuthology.orchestra.run.smithi044.stdout: debug asserts on shutdown = true 2024-05-16T22:26:30.046 INFO:teuthology.orchestra.run.smithi044.stdout: mon health detail to clog = false 2024-05-16T22:26:30.046 INFO:teuthology.orchestra.run.smithi044.stdout: mon host = "172.21.15.44,172.21.15.70,[v2:172.21.15.70:3301,v1:172.21.15.70:6790]" 2024-05-16T22:26:30.046 INFO:teuthology.orchestra.run.smithi044.stdout: mon pg warn min per osd = 0 2024-05-16T22:26:30.046 INFO:teuthology.orchestra.run.smithi044.stdout: ms die on skipped message = False 2024-05-16T22:26:30.046 INFO:teuthology.orchestra.run.smithi044.stdout: fsid = 572ab7cc-b103-4548-ae8f-c6614d57f0c8 2024-05-16T22:26:30.046 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:26:30.046 INFO:teuthology.orchestra.run.smithi044.stdout:[osd] 2024-05-16T22:26:30.046 INFO:teuthology.orchestra.run.smithi044.stdout: osd journal size = 100 2024-05-16T22:26:30.046 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:26:30.046 INFO:teuthology.orchestra.run.smithi044.stdout: osd scrub load threshold = 5.0 2024-05-16T22:26:30.046 INFO:teuthology.orchestra.run.smithi044.stdout: osd scrub max interval = 600 2024-05-16T22:26:30.047 INFO:teuthology.orchestra.run.smithi044.stdout: osd mclock profile = high_recovery_ops 2024-05-16T22:26:30.047 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:26:30.047 INFO:teuthology.orchestra.run.smithi044.stdout: osd recover clone overlap = true 2024-05-16T22:26:30.047 INFO:teuthology.orchestra.run.smithi044.stdout: osd recovery max chunk = 1048576 2024-05-16T22:26:30.047 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:26:30.047 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug shutdown = true 2024-05-16T22:26:30.047 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug op order = true 2024-05-16T22:26:30.047 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug verify stray on activate = true 2024-05-16T22:26:30.047 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug trim objects = true 2024-05-16T22:26:30.047 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:26:30.047 INFO:teuthology.orchestra.run.smithi044.stdout: osd open classes on start = true 2024-05-16T22:26:30.047 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug pg log writeout = true 2024-05-16T22:26:30.047 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:26:30.048 INFO:teuthology.orchestra.run.smithi044.stdout: osd deep scrub update digest min age = 30 2024-05-16T22:26:30.048 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:26:30.048 INFO:teuthology.orchestra.run.smithi044.stdout: osd map max advance = 10 2024-05-16T22:26:30.048 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:26:30.048 INFO:teuthology.orchestra.run.smithi044.stdout: journal zero on create = true 2024-05-16T22:26:30.048 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:26:30.048 INFO:teuthology.orchestra.run.smithi044.stdout: filestore ondisk finisher threads = 3 2024-05-16T22:26:30.048 INFO:teuthology.orchestra.run.smithi044.stdout: filestore apply finisher threads = 3 2024-05-16T22:26:30.048 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:26:30.048 INFO:teuthology.orchestra.run.smithi044.stdout: bdev debug aio = true 2024-05-16T22:26:30.048 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug misdirected ops = true 2024-05-16T22:26:30.048 INFO:teuthology.orchestra.run.smithi044.stdout: bdev async discard = True 2024-05-16T22:26:30.048 INFO:teuthology.orchestra.run.smithi044.stdout: bdev enable discard = True 2024-05-16T22:26:30.048 INFO:teuthology.orchestra.run.smithi044.stdout: bluestore allocator = bitmap 2024-05-16T22:26:30.048 INFO:teuthology.orchestra.run.smithi044.stdout: bluestore block size = 96636764160 2024-05-16T22:26:30.048 INFO:teuthology.orchestra.run.smithi044.stdout: bluestore fsck on mount = True 2024-05-16T22:26:30.049 INFO:teuthology.orchestra.run.smithi044.stdout: debug bluefs = 1/20 2024-05-16T22:26:30.049 INFO:teuthology.orchestra.run.smithi044.stdout: debug bluestore = 20 2024-05-16T22:26:30.049 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2024-05-16T22:26:30.049 INFO:teuthology.orchestra.run.smithi044.stdout: debug osd = 20 2024-05-16T22:26:30.049 INFO:teuthology.orchestra.run.smithi044.stdout: debug rocksdb = 4/10 2024-05-16T22:26:30.049 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd backfillfull_ratio = 0.85 2024-05-16T22:26:30.049 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd full ratio = 0.9 2024-05-16T22:26:30.049 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd nearfull ratio = 0.8 2024-05-16T22:26:30.049 INFO:teuthology.orchestra.run.smithi044.stdout: osd failsafe full ratio = 0.95 2024-05-16T22:26:30.049 INFO:teuthology.orchestra.run.smithi044.stdout: osd objectstore = bluestore 2024-05-16T22:26:30.049 INFO:teuthology.orchestra.run.smithi044.stdout: osd op complaint time = 180 2024-05-16T22:26:30.049 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:26:30.049 INFO:teuthology.orchestra.run.smithi044.stdout:[mgr] 2024-05-16T22:26:30.049 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2024-05-16T22:26:30.049 INFO:teuthology.orchestra.run.smithi044.stdout: debug mgr = 20 2024-05-16T22:26:30.050 INFO:teuthology.orchestra.run.smithi044.stdout: debug mon = 20 2024-05-16T22:26:30.050 INFO:teuthology.orchestra.run.smithi044.stdout: debug auth = 20 2024-05-16T22:26:30.050 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min pgs per osd = 4 2024-05-16T22:26:30.050 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min bytes per osd = 10 2024-05-16T22:26:30.050 INFO:teuthology.orchestra.run.smithi044.stdout: mgr/telemetry/nag = false 2024-05-16T22:26:30.050 INFO:teuthology.orchestra.run.smithi044.stdout: debug client = 20 2024-05-16T22:26:30.050 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:26:30.050 INFO:teuthology.orchestra.run.smithi044.stdout:[mon] 2024-05-16T22:26:30.050 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2024-05-16T22:26:30.050 INFO:teuthology.orchestra.run.smithi044.stdout: debug mon = 20 2024-05-16T22:26:30.050 INFO:teuthology.orchestra.run.smithi044.stdout: debug paxos = 20 2024-05-16T22:26:30.050 INFO:teuthology.orchestra.run.smithi044.stdout: debug auth = 20 2024-05-16T22:26:30.050 INFO:teuthology.orchestra.run.smithi044.stdout: mon data avail warn = 5 2024-05-16T22:26:30.050 INFO:teuthology.orchestra.run.smithi044.stdout: mon mgr mkfs grace = 240 2024-05-16T22:26:30.050 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min pgs per osd = 4 2024-05-16T22:26:30.051 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd reporter subtree level = osd 2024-05-16T22:26:30.051 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd prime pg temp = true 2024-05-16T22:26:30.051 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min bytes per osd = 10 2024-05-16T22:26:30.051 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:26:30.051 INFO:teuthology.orchestra.run.smithi044.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-16T22:26:30.051 INFO:teuthology.orchestra.run.smithi044.stdout: auth mon ticket ttl = 660 # 11m 2024-05-16T22:26:30.051 INFO:teuthology.orchestra.run.smithi044.stdout: auth service ticket ttl = 240 # 4m 2024-05-16T22:26:30.051 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:26:30.051 INFO:teuthology.orchestra.run.smithi044.stdout: # don't complain about insecure global_id in the test suite 2024-05-16T22:26:30.051 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-16T22:26:30.051 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-16T22:26:30.051 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:26:30.051 INFO:teuthology.orchestra.run.smithi044.stdout: # 1m isn't quite enough 2024-05-16T22:26:30.051 INFO:teuthology.orchestra.run.smithi044.stdout: mon_down_mkfs_grace = 2m 2024-05-16T22:26:30.052 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:26:30.052 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_filestore_osds = false 2024-05-16T22:26:30.052 INFO:teuthology.orchestra.run.smithi044.stdout: mon down mkfs grace = 300 2024-05-16T22:26:30.052 INFO:teuthology.orchestra.run.smithi044.stdout: mon op complaint time = 120 2024-05-16T22:26:30.052 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:26:30.052 INFO:teuthology.orchestra.run.smithi044.stdout:[client] 2024-05-16T22:26:30.052 INFO:teuthology.orchestra.run.smithi044.stdout: rgw cache enabled = true 2024-05-16T22:26:30.052 INFO:teuthology.orchestra.run.smithi044.stdout: rgw enable ops log = true 2024-05-16T22:26:30.052 INFO:teuthology.orchestra.run.smithi044.stdout: rgw enable usage log = true 2024-05-16T22:26:30.052 INFO:teuthology.orchestra.run.smithi044.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-16T22:26:30.052 INFO:teuthology.orchestra.run.smithi044.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-16T22:26:30.052 INFO:teuthology.orchestra.run.smithi044.stdout: client mount timeout = 600 2024-05-16T22:26:30.052 INFO:teuthology.orchestra.run.smithi044.stdout: debug client = 20 2024-05-16T22:26:30.053 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2024-05-16T22:26:30.053 INFO:teuthology.orchestra.run.smithi044.stdout: rados mon op timeout = 900 2024-05-16T22:26:30.053 INFO:teuthology.orchestra.run.smithi044.stdout: rados osd op timeout = 900 2024-05-16T22:26:30.053 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.a] 2024-05-16T22:26:30.053 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.b] 2024-05-16T22:26:30.053 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.c] 2024-05-16T22:26:30.053 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.a] 2024-05-16T22:26:30.053 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.c] 2024-05-16T22:26:30.053 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.b] 2024-05-16T22:26:30.053 INFO:teuthology.orchestra.run.smithi044.stdout:[mds] 2024-05-16T22:26:30.053 INFO:teuthology.orchestra.run.smithi044.stdout: debug mds = 20 2024-05-16T22:26:30.053 INFO:teuthology.orchestra.run.smithi044.stdout: debug mds balancer = 20 2024-05-16T22:26:30.053 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2024-05-16T22:26:30.054 INFO:teuthology.orchestra.run.smithi044.stdout: mds debug frag = True 2024-05-16T22:26:30.054 INFO:teuthology.orchestra.run.smithi044.stdout: mds debug scatterstat = True 2024-05-16T22:26:30.054 INFO:teuthology.orchestra.run.smithi044.stdout: mds op complaint time = 180 2024-05-16T22:26:30.054 INFO:teuthology.orchestra.run.smithi044.stdout: mds verify scatter = True 2024-05-16T22:26:30.054 INFO:teuthology.orchestra.run.smithi044.stdout: osd op complaint time = 180 2024-05-16T22:26:30.054 INFO:teuthology.orchestra.run.smithi044.stdout: rados mon op timeout = 900 2024-05-16T22:26:30.054 INFO:teuthology.orchestra.run.smithi044.stdout: rados osd op timeout = 900 2024-05-16T22:26:30.055 INFO:teuthology.orchestra.run.smithi070.stdout:[global] 2024-05-16T22:26:30.055 INFO:teuthology.orchestra.run.smithi070.stdout: chdir = "" 2024-05-16T22:26:30.056 INFO:teuthology.orchestra.run.smithi070.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-16T22:26:30.056 INFO:teuthology.orchestra.run.smithi070.stdout: auth supported = cephx 2024-05-16T22:26:30.056 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-16T22:26:30.056 INFO:teuthology.orchestra.run.smithi070.stdout: filestore xattr use omap = true 2024-05-16T22:26:30.056 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-16T22:26:30.056 INFO:teuthology.orchestra.run.smithi070.stdout: mon clock drift allowed = 1.000 2024-05-16T22:26:30.056 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-16T22:26:30.056 INFO:teuthology.orchestra.run.smithi070.stdout: osd crush chooseleaf type = 0 2024-05-16T22:26:30.056 INFO:teuthology.orchestra.run.smithi070.stdout: auth debug = true 2024-05-16T22:26:30.056 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-16T22:26:30.056 INFO:teuthology.orchestra.run.smithi070.stdout: ms die on old message = true 2024-05-16T22:26:30.056 INFO:teuthology.orchestra.run.smithi070.stdout: ms die on bug = true 2024-05-16T22:26:30.056 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-16T22:26:30.057 INFO:teuthology.orchestra.run.smithi070.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-16T22:26:30.057 INFO:teuthology.orchestra.run.smithi070.stdout: mon pg warn max object skew = 0 2024-05-16T22:26:30.057 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-16T22:26:30.057 INFO:teuthology.orchestra.run.smithi070.stdout: # disable pg_autoscaler by default for new pools 2024-05-16T22:26:30.057 INFO:teuthology.orchestra.run.smithi070.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-16T22:26:30.057 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-16T22:26:30.057 INFO:teuthology.orchestra.run.smithi070.stdout: osd pool default size = 2 2024-05-16T22:26:30.057 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-16T22:26:30.057 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd allow primary affinity = true 2024-05-16T22:26:30.057 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd allow pg remap = true 2024-05-16T22:26:30.057 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on legacy crush tunables = false 2024-05-16T22:26:30.057 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on crush straw calc version zero = false 2024-05-16T22:26:30.057 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on no sortbitwise = false 2024-05-16T22:26:30.058 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on osd down out interval zero = false 2024-05-16T22:26:30.058 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on too few osds = false 2024-05-16T22:26:30.058 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-16T22:26:30.058 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-16T22:26:30.058 INFO:teuthology.orchestra.run.smithi070.stdout: mon_allow_pool_size_one = true 2024-05-16T22:26:30.058 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-16T22:26:30.058 INFO:teuthology.orchestra.run.smithi070.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-16T22:26:30.058 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-16T22:26:30.058 INFO:teuthology.orchestra.run.smithi070.stdout: osd default data pool replay window = 5 2024-05-16T22:26:30.058 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-16T22:26:30.058 INFO:teuthology.orchestra.run.smithi070.stdout: mon allow pool delete = true 2024-05-16T22:26:30.058 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-16T22:26:30.058 INFO:teuthology.orchestra.run.smithi070.stdout: mon cluster log file level = debug 2024-05-16T22:26:30.059 INFO:teuthology.orchestra.run.smithi070.stdout: debug asserts on shutdown = true 2024-05-16T22:26:30.059 INFO:teuthology.orchestra.run.smithi070.stdout: mon health detail to clog = false 2024-05-16T22:26:30.059 INFO:teuthology.orchestra.run.smithi070.stdout: mon host = "172.21.15.44,172.21.15.70,[v2:172.21.15.70:3301,v1:172.21.15.70:6790]" 2024-05-16T22:26:30.059 INFO:teuthology.orchestra.run.smithi070.stdout: mon pg warn min per osd = 0 2024-05-16T22:26:30.059 INFO:teuthology.orchestra.run.smithi070.stdout: ms die on skipped message = False 2024-05-16T22:26:30.059 INFO:teuthology.orchestra.run.smithi070.stdout: fsid = 572ab7cc-b103-4548-ae8f-c6614d57f0c8 2024-05-16T22:26:30.059 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-16T22:26:30.059 INFO:teuthology.orchestra.run.smithi070.stdout:[osd] 2024-05-16T22:26:30.059 INFO:teuthology.orchestra.run.smithi070.stdout: osd journal size = 100 2024-05-16T22:26:30.059 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-16T22:26:30.059 INFO:teuthology.orchestra.run.smithi070.stdout: osd scrub load threshold = 5.0 2024-05-16T22:26:30.059 INFO:teuthology.orchestra.run.smithi070.stdout: osd scrub max interval = 600 2024-05-16T22:26:30.059 INFO:teuthology.orchestra.run.smithi070.stdout: osd mclock profile = high_recovery_ops 2024-05-16T22:26:30.059 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-16T22:26:30.059 INFO:teuthology.orchestra.run.smithi070.stdout: osd recover clone overlap = true 2024-05-16T22:26:30.060 INFO:teuthology.orchestra.run.smithi070.stdout: osd recovery max chunk = 1048576 2024-05-16T22:26:30.060 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-16T22:26:30.060 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug shutdown = true 2024-05-16T22:26:30.060 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug op order = true 2024-05-16T22:26:30.060 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug verify stray on activate = true 2024-05-16T22:26:30.060 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug trim objects = true 2024-05-16T22:26:30.060 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-16T22:26:30.060 INFO:teuthology.orchestra.run.smithi070.stdout: osd open classes on start = true 2024-05-16T22:26:30.060 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug pg log writeout = true 2024-05-16T22:26:30.060 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-16T22:26:30.060 INFO:teuthology.orchestra.run.smithi070.stdout: osd deep scrub update digest min age = 30 2024-05-16T22:26:30.060 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-16T22:26:30.060 INFO:teuthology.orchestra.run.smithi070.stdout: osd map max advance = 10 2024-05-16T22:26:30.060 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-16T22:26:30.060 INFO:teuthology.orchestra.run.smithi070.stdout: journal zero on create = true 2024-05-16T22:26:30.061 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-16T22:26:30.061 INFO:teuthology.orchestra.run.smithi070.stdout: filestore ondisk finisher threads = 3 2024-05-16T22:26:30.061 INFO:teuthology.orchestra.run.smithi070.stdout: filestore apply finisher threads = 3 2024-05-16T22:26:30.061 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-16T22:26:30.061 INFO:teuthology.orchestra.run.smithi070.stdout: bdev debug aio = true 2024-05-16T22:26:30.061 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug misdirected ops = true 2024-05-16T22:26:30.061 INFO:teuthology.orchestra.run.smithi070.stdout: bdev async discard = True 2024-05-16T22:26:30.061 INFO:teuthology.orchestra.run.smithi070.stdout: bdev enable discard = True 2024-05-16T22:26:30.061 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore allocator = bitmap 2024-05-16T22:26:30.061 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore block size = 96636764160 2024-05-16T22:26:30.061 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore fsck on mount = True 2024-05-16T22:26:30.061 INFO:teuthology.orchestra.run.smithi070.stdout: debug bluefs = 1/20 2024-05-16T22:26:30.061 INFO:teuthology.orchestra.run.smithi070.stdout: debug bluestore = 20 2024-05-16T22:26:30.061 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-05-16T22:26:30.061 INFO:teuthology.orchestra.run.smithi070.stdout: debug osd = 20 2024-05-16T22:26:30.061 INFO:teuthology.orchestra.run.smithi070.stdout: debug rocksdb = 4/10 2024-05-16T22:26:30.062 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd backfillfull_ratio = 0.85 2024-05-16T22:26:30.062 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd full ratio = 0.9 2024-05-16T22:26:30.062 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd nearfull ratio = 0.8 2024-05-16T22:26:30.062 INFO:teuthology.orchestra.run.smithi070.stdout: osd failsafe full ratio = 0.95 2024-05-16T22:26:30.062 INFO:teuthology.orchestra.run.smithi070.stdout: osd objectstore = bluestore 2024-05-16T22:26:30.062 INFO:teuthology.orchestra.run.smithi070.stdout: osd op complaint time = 180 2024-05-16T22:26:30.062 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-16T22:26:30.062 INFO:teuthology.orchestra.run.smithi070.stdout:[mgr] 2024-05-16T22:26:30.062 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-05-16T22:26:30.062 INFO:teuthology.orchestra.run.smithi070.stdout: debug mgr = 20 2024-05-16T22:26:30.062 INFO:teuthology.orchestra.run.smithi070.stdout: debug mon = 20 2024-05-16T22:26:30.062 INFO:teuthology.orchestra.run.smithi070.stdout: debug auth = 20 2024-05-16T22:26:30.062 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min pgs per osd = 4 2024-05-16T22:26:30.062 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min bytes per osd = 10 2024-05-16T22:26:30.063 INFO:teuthology.orchestra.run.smithi070.stdout: mgr/telemetry/nag = false 2024-05-16T22:26:30.063 INFO:teuthology.orchestra.run.smithi070.stdout: debug client = 20 2024-05-16T22:26:30.063 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-16T22:26:30.063 INFO:teuthology.orchestra.run.smithi070.stdout:[mon] 2024-05-16T22:26:30.063 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-05-16T22:26:30.063 INFO:teuthology.orchestra.run.smithi070.stdout: debug mon = 20 2024-05-16T22:26:30.063 INFO:teuthology.orchestra.run.smithi070.stdout: debug paxos = 20 2024-05-16T22:26:30.063 INFO:teuthology.orchestra.run.smithi070.stdout: debug auth = 20 2024-05-16T22:26:30.063 INFO:teuthology.orchestra.run.smithi070.stdout: mon data avail warn = 5 2024-05-16T22:26:30.063 INFO:teuthology.orchestra.run.smithi070.stdout: mon mgr mkfs grace = 240 2024-05-16T22:26:30.063 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min pgs per osd = 4 2024-05-16T22:26:30.063 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd reporter subtree level = osd 2024-05-16T22:26:30.063 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd prime pg temp = true 2024-05-16T22:26:30.063 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min bytes per osd = 10 2024-05-16T22:26:30.063 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-16T22:26:30.064 INFO:teuthology.orchestra.run.smithi070.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-16T22:26:30.064 INFO:teuthology.orchestra.run.smithi070.stdout: auth mon ticket ttl = 660 # 11m 2024-05-16T22:26:30.064 INFO:teuthology.orchestra.run.smithi070.stdout: auth service ticket ttl = 240 # 4m 2024-05-16T22:26:30.064 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-16T22:26:30.064 INFO:teuthology.orchestra.run.smithi070.stdout: # don't complain about insecure global_id in the test suite 2024-05-16T22:26:30.064 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-16T22:26:30.064 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-16T22:26:30.064 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-16T22:26:30.064 INFO:teuthology.orchestra.run.smithi070.stdout: # 1m isn't quite enough 2024-05-16T22:26:30.064 INFO:teuthology.orchestra.run.smithi070.stdout: mon_down_mkfs_grace = 2m 2024-05-16T22:26:30.064 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-16T22:26:30.064 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_filestore_osds = false 2024-05-16T22:26:30.064 INFO:teuthology.orchestra.run.smithi070.stdout: mon down mkfs grace = 300 2024-05-16T22:26:30.064 INFO:teuthology.orchestra.run.smithi070.stdout: mon op complaint time = 120 2024-05-16T22:26:30.064 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-16T22:26:30.065 INFO:teuthology.orchestra.run.smithi070.stdout:[client] 2024-05-16T22:26:30.065 INFO:teuthology.orchestra.run.smithi070.stdout: rgw cache enabled = true 2024-05-16T22:26:30.065 INFO:teuthology.orchestra.run.smithi070.stdout: rgw enable ops log = true 2024-05-16T22:26:30.065 INFO:teuthology.orchestra.run.smithi070.stdout: rgw enable usage log = true 2024-05-16T22:26:30.065 INFO:teuthology.orchestra.run.smithi070.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-16T22:26:30.065 INFO:teuthology.orchestra.run.smithi070.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-16T22:26:30.065 INFO:teuthology.orchestra.run.smithi070.stdout: client mount timeout = 600 2024-05-16T22:26:30.065 INFO:teuthology.orchestra.run.smithi070.stdout: debug client = 20 2024-05-16T22:26:30.065 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-05-16T22:26:30.065 INFO:teuthology.orchestra.run.smithi070.stdout: rados mon op timeout = 900 2024-05-16T22:26:30.065 INFO:teuthology.orchestra.run.smithi070.stdout: rados osd op timeout = 900 2024-05-16T22:26:30.065 INFO:teuthology.orchestra.run.smithi070.stdout:[mon.a] 2024-05-16T22:26:30.065 INFO:teuthology.orchestra.run.smithi070.stdout:[mon.b] 2024-05-16T22:26:30.065 INFO:teuthology.orchestra.run.smithi070.stdout:[mon.c] 2024-05-16T22:26:30.065 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.a] 2024-05-16T22:26:30.065 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.c] 2024-05-16T22:26:30.066 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.b] 2024-05-16T22:26:30.066 INFO:teuthology.orchestra.run.smithi070.stdout:[mds] 2024-05-16T22:26:30.066 INFO:teuthology.orchestra.run.smithi070.stdout: debug mds = 20 2024-05-16T22:26:30.066 INFO:teuthology.orchestra.run.smithi070.stdout: debug mds balancer = 20 2024-05-16T22:26:30.066 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-05-16T22:26:30.066 INFO:teuthology.orchestra.run.smithi070.stdout: mds debug frag = True 2024-05-16T22:26:30.066 INFO:teuthology.orchestra.run.smithi070.stdout: mds debug scatterstat = True 2024-05-16T22:26:30.066 INFO:teuthology.orchestra.run.smithi070.stdout: mds op complaint time = 180 2024-05-16T22:26:30.066 INFO:teuthology.orchestra.run.smithi070.stdout: mds verify scatter = True 2024-05-16T22:26:30.066 INFO:teuthology.orchestra.run.smithi070.stdout: osd op complaint time = 180 2024-05-16T22:26:30.066 INFO:teuthology.orchestra.run.smithi070.stdout: rados mon op timeout = 900 2024-05-16T22:26:30.066 INFO:teuthology.orchestra.run.smithi070.stdout: rados osd op timeout = 900 2024-05-16T22:26:30.154 INFO:teuthology.orchestra.run.smithi196.stdout:[global] 2024-05-16T22:26:30.154 INFO:teuthology.orchestra.run.smithi196.stdout: chdir = "" 2024-05-16T22:26:30.154 INFO:teuthology.orchestra.run.smithi196.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-16T22:26:30.154 INFO:teuthology.orchestra.run.smithi196.stdout: auth supported = cephx 2024-05-16T22:26:30.154 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:26:30.154 INFO:teuthology.orchestra.run.smithi196.stdout: filestore xattr use omap = true 2024-05-16T22:26:30.154 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:26:30.154 INFO:teuthology.orchestra.run.smithi196.stdout: mon clock drift allowed = 1.000 2024-05-16T22:26:30.154 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:26:30.155 INFO:teuthology.orchestra.run.smithi196.stdout: osd crush chooseleaf type = 0 2024-05-16T22:26:30.155 INFO:teuthology.orchestra.run.smithi196.stdout: auth debug = true 2024-05-16T22:26:30.155 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:26:30.155 INFO:teuthology.orchestra.run.smithi196.stdout: ms die on old message = true 2024-05-16T22:26:30.155 INFO:teuthology.orchestra.run.smithi196.stdout: ms die on bug = true 2024-05-16T22:26:30.155 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:26:30.155 INFO:teuthology.orchestra.run.smithi196.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-16T22:26:30.155 INFO:teuthology.orchestra.run.smithi196.stdout: mon pg warn max object skew = 0 2024-05-16T22:26:30.155 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:26:30.155 INFO:teuthology.orchestra.run.smithi196.stdout: # disable pg_autoscaler by default for new pools 2024-05-16T22:26:30.155 INFO:teuthology.orchestra.run.smithi196.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-16T22:26:30.155 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:26:30.155 INFO:teuthology.orchestra.run.smithi196.stdout: osd pool default size = 2 2024-05-16T22:26:30.156 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:26:30.156 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd allow primary affinity = true 2024-05-16T22:26:30.156 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd allow pg remap = true 2024-05-16T22:26:30.156 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on legacy crush tunables = false 2024-05-16T22:26:30.156 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on crush straw calc version zero = false 2024-05-16T22:26:30.156 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on no sortbitwise = false 2024-05-16T22:26:30.156 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on osd down out interval zero = false 2024-05-16T22:26:30.156 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on too few osds = false 2024-05-16T22:26:30.156 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-16T22:26:30.156 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-16T22:26:30.156 INFO:teuthology.orchestra.run.smithi196.stdout: mon_allow_pool_size_one = true 2024-05-16T22:26:30.156 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:26:30.156 INFO:teuthology.orchestra.run.smithi196.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-16T22:26:30.157 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:26:30.157 INFO:teuthology.orchestra.run.smithi196.stdout: osd default data pool replay window = 5 2024-05-16T22:26:30.157 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:26:30.157 INFO:teuthology.orchestra.run.smithi196.stdout: mon allow pool delete = true 2024-05-16T22:26:30.157 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:26:30.157 INFO:teuthology.orchestra.run.smithi196.stdout: mon cluster log file level = debug 2024-05-16T22:26:30.157 INFO:teuthology.orchestra.run.smithi196.stdout: debug asserts on shutdown = true 2024-05-16T22:26:30.157 INFO:teuthology.orchestra.run.smithi196.stdout: mon health detail to clog = false 2024-05-16T22:26:30.157 INFO:teuthology.orchestra.run.smithi196.stdout: mon host = "172.21.15.44,172.21.15.70,[v2:172.21.15.70:3301,v1:172.21.15.70:6790]" 2024-05-16T22:26:30.157 INFO:teuthology.orchestra.run.smithi196.stdout: mon pg warn min per osd = 0 2024-05-16T22:26:30.157 INFO:teuthology.orchestra.run.smithi196.stdout: ms die on skipped message = False 2024-05-16T22:26:30.157 INFO:teuthology.orchestra.run.smithi196.stdout: fsid = 572ab7cc-b103-4548-ae8f-c6614d57f0c8 2024-05-16T22:26:30.157 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:26:30.157 INFO:teuthology.orchestra.run.smithi196.stdout:[osd] 2024-05-16T22:26:30.157 INFO:teuthology.orchestra.run.smithi196.stdout: osd journal size = 100 2024-05-16T22:26:30.158 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:26:30.158 INFO:teuthology.orchestra.run.smithi196.stdout: osd scrub load threshold = 5.0 2024-05-16T22:26:30.158 INFO:teuthology.orchestra.run.smithi196.stdout: osd scrub max interval = 600 2024-05-16T22:26:30.158 INFO:teuthology.orchestra.run.smithi196.stdout: osd mclock profile = high_recovery_ops 2024-05-16T22:26:30.158 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:26:30.158 INFO:teuthology.orchestra.run.smithi196.stdout: osd recover clone overlap = true 2024-05-16T22:26:30.158 INFO:teuthology.orchestra.run.smithi196.stdout: osd recovery max chunk = 1048576 2024-05-16T22:26:30.158 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:26:30.158 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug shutdown = true 2024-05-16T22:26:30.158 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug op order = true 2024-05-16T22:26:30.158 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug verify stray on activate = true 2024-05-16T22:26:30.158 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug trim objects = true 2024-05-16T22:26:30.158 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:26:30.158 INFO:teuthology.orchestra.run.smithi196.stdout: osd open classes on start = true 2024-05-16T22:26:30.158 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug pg log writeout = true 2024-05-16T22:26:30.159 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:26:30.159 INFO:teuthology.orchestra.run.smithi196.stdout: osd deep scrub update digest min age = 30 2024-05-16T22:26:30.159 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:26:30.159 INFO:teuthology.orchestra.run.smithi196.stdout: osd map max advance = 10 2024-05-16T22:26:30.159 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:26:30.159 INFO:teuthology.orchestra.run.smithi196.stdout: journal zero on create = true 2024-05-16T22:26:30.159 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:26:30.159 INFO:teuthology.orchestra.run.smithi196.stdout: filestore ondisk finisher threads = 3 2024-05-16T22:26:30.159 INFO:teuthology.orchestra.run.smithi196.stdout: filestore apply finisher threads = 3 2024-05-16T22:26:30.159 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:26:30.159 INFO:teuthology.orchestra.run.smithi196.stdout: bdev debug aio = true 2024-05-16T22:26:30.159 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug misdirected ops = true 2024-05-16T22:26:30.159 INFO:teuthology.orchestra.run.smithi196.stdout: bdev async discard = True 2024-05-16T22:26:30.159 INFO:teuthology.orchestra.run.smithi196.stdout: bdev enable discard = True 2024-05-16T22:26:30.160 INFO:teuthology.orchestra.run.smithi196.stdout: bluestore allocator = bitmap 2024-05-16T22:26:30.160 INFO:teuthology.orchestra.run.smithi196.stdout: bluestore block size = 96636764160 2024-05-16T22:26:30.160 INFO:teuthology.orchestra.run.smithi196.stdout: bluestore fsck on mount = True 2024-05-16T22:26:30.160 INFO:teuthology.orchestra.run.smithi196.stdout: debug bluefs = 1/20 2024-05-16T22:26:30.160 INFO:teuthology.orchestra.run.smithi196.stdout: debug bluestore = 20 2024-05-16T22:26:30.160 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2024-05-16T22:26:30.160 INFO:teuthology.orchestra.run.smithi196.stdout: debug osd = 20 2024-05-16T22:26:30.160 INFO:teuthology.orchestra.run.smithi196.stdout: debug rocksdb = 4/10 2024-05-16T22:26:30.160 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd backfillfull_ratio = 0.85 2024-05-16T22:26:30.160 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd full ratio = 0.9 2024-05-16T22:26:30.160 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd nearfull ratio = 0.8 2024-05-16T22:26:30.160 INFO:teuthology.orchestra.run.smithi196.stdout: osd failsafe full ratio = 0.95 2024-05-16T22:26:30.160 INFO:teuthology.orchestra.run.smithi196.stdout: osd objectstore = bluestore 2024-05-16T22:26:30.160 INFO:teuthology.orchestra.run.smithi196.stdout: osd op complaint time = 180 2024-05-16T22:26:30.160 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:26:30.161 INFO:teuthology.orchestra.run.smithi196.stdout:[mgr] 2024-05-16T22:26:30.161 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2024-05-16T22:26:30.161 INFO:teuthology.orchestra.run.smithi196.stdout: debug mgr = 20 2024-05-16T22:26:30.161 INFO:teuthology.orchestra.run.smithi196.stdout: debug mon = 20 2024-05-16T22:26:30.161 INFO:teuthology.orchestra.run.smithi196.stdout: debug auth = 20 2024-05-16T22:26:30.161 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min pgs per osd = 4 2024-05-16T22:26:30.161 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min bytes per osd = 10 2024-05-16T22:26:30.161 INFO:teuthology.orchestra.run.smithi196.stdout: mgr/telemetry/nag = false 2024-05-16T22:26:30.161 INFO:teuthology.orchestra.run.smithi196.stdout: debug client = 20 2024-05-16T22:26:30.161 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:26:30.161 INFO:teuthology.orchestra.run.smithi196.stdout:[mon] 2024-05-16T22:26:30.161 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2024-05-16T22:26:30.161 INFO:teuthology.orchestra.run.smithi196.stdout: debug mon = 20 2024-05-16T22:26:30.161 INFO:teuthology.orchestra.run.smithi196.stdout: debug paxos = 20 2024-05-16T22:26:30.161 INFO:teuthology.orchestra.run.smithi196.stdout: debug auth = 20 2024-05-16T22:26:30.162 INFO:teuthology.orchestra.run.smithi196.stdout: mon data avail warn = 5 2024-05-16T22:26:30.162 INFO:teuthology.orchestra.run.smithi196.stdout: mon mgr mkfs grace = 240 2024-05-16T22:26:30.162 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min pgs per osd = 4 2024-05-16T22:26:30.162 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd reporter subtree level = osd 2024-05-16T22:26:30.162 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd prime pg temp = true 2024-05-16T22:26:30.162 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min bytes per osd = 10 2024-05-16T22:26:30.162 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:26:30.162 INFO:teuthology.orchestra.run.smithi196.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-16T22:26:30.162 INFO:teuthology.orchestra.run.smithi196.stdout: auth mon ticket ttl = 660 # 11m 2024-05-16T22:26:30.162 INFO:teuthology.orchestra.run.smithi196.stdout: auth service ticket ttl = 240 # 4m 2024-05-16T22:26:30.162 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:26:30.162 INFO:teuthology.orchestra.run.smithi196.stdout: # don't complain about insecure global_id in the test suite 2024-05-16T22:26:30.162 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-16T22:26:30.162 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-16T22:26:30.162 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:26:30.163 INFO:teuthology.orchestra.run.smithi196.stdout: # 1m isn't quite enough 2024-05-16T22:26:30.163 INFO:teuthology.orchestra.run.smithi196.stdout: mon_down_mkfs_grace = 2m 2024-05-16T22:26:30.163 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:26:30.163 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_filestore_osds = false 2024-05-16T22:26:30.163 INFO:teuthology.orchestra.run.smithi196.stdout: mon down mkfs grace = 300 2024-05-16T22:26:30.163 INFO:teuthology.orchestra.run.smithi196.stdout: mon op complaint time = 120 2024-05-16T22:26:30.163 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:26:30.163 INFO:teuthology.orchestra.run.smithi196.stdout:[client] 2024-05-16T22:26:30.163 INFO:teuthology.orchestra.run.smithi196.stdout: rgw cache enabled = true 2024-05-16T22:26:30.163 INFO:teuthology.orchestra.run.smithi196.stdout: rgw enable ops log = true 2024-05-16T22:26:30.163 INFO:teuthology.orchestra.run.smithi196.stdout: rgw enable usage log = true 2024-05-16T22:26:30.163 INFO:teuthology.orchestra.run.smithi196.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-16T22:26:30.163 INFO:teuthology.orchestra.run.smithi196.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-16T22:26:30.163 INFO:teuthology.orchestra.run.smithi196.stdout: client mount timeout = 600 2024-05-16T22:26:30.164 INFO:teuthology.orchestra.run.smithi196.stdout: debug client = 20 2024-05-16T22:26:30.164 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2024-05-16T22:26:30.164 INFO:teuthology.orchestra.run.smithi196.stdout: rados mon op timeout = 900 2024-05-16T22:26:30.164 INFO:teuthology.orchestra.run.smithi196.stdout: rados osd op timeout = 900 2024-05-16T22:26:30.164 INFO:teuthology.orchestra.run.smithi196.stdout:[mon.a] 2024-05-16T22:26:30.164 INFO:teuthology.orchestra.run.smithi196.stdout:[mon.b] 2024-05-16T22:26:30.164 INFO:teuthology.orchestra.run.smithi196.stdout:[mon.c] 2024-05-16T22:26:30.164 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.a] 2024-05-16T22:26:30.164 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.c] 2024-05-16T22:26:30.164 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.b] 2024-05-16T22:26:30.164 INFO:teuthology.orchestra.run.smithi196.stdout:[mds] 2024-05-16T22:26:30.164 INFO:teuthology.orchestra.run.smithi196.stdout: debug mds = 20 2024-05-16T22:26:30.164 INFO:teuthology.orchestra.run.smithi196.stdout: debug mds balancer = 20 2024-05-16T22:26:30.164 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2024-05-16T22:26:30.165 INFO:teuthology.orchestra.run.smithi196.stdout: mds debug frag = True 2024-05-16T22:26:30.165 INFO:teuthology.orchestra.run.smithi196.stdout: mds debug scatterstat = True 2024-05-16T22:26:30.165 INFO:teuthology.orchestra.run.smithi196.stdout: mds op complaint time = 180 2024-05-16T22:26:30.165 INFO:teuthology.orchestra.run.smithi196.stdout: mds verify scatter = True 2024-05-16T22:26:30.165 INFO:teuthology.orchestra.run.smithi196.stdout: osd op complaint time = 180 2024-05-16T22:26:30.165 INFO:teuthology.orchestra.run.smithi196.stdout: rados mon op timeout = 900 2024-05-16T22:26:30.165 INFO:teuthology.orchestra.run.smithi196.stdout: rados osd op timeout = 900 2024-05-16T22:26:30.187 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-16T22:26:30.187 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-16T22:26:30.251 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-16T22:26:30.251 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-05-16T22:26:30.251 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-16T22:26:30.266 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-05-16T22:26:30.266 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-16T22:26:30.321 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi044.front.sepia.ceph.com 2024-05-16T22:26:30.321 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-05-16T22:26:30.321 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-16T22:26:30.321 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-16T22:26:30.394 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-05-16T22:26:30.394 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-16T22:26:30.450 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi070.front.sepia.ceph.com 2024-05-16T22:26:30.450 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-16T22:26:30.450 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-16T22:26:30.451 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-16T22:26:30.485 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-16T22:26:30.485 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-16T22:26:30.540 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi196.front.sepia.ceph.com 2024-05-16T22:26:30.540 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-16T22:26:30.540 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-16T22:26:30.540 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-16T22:26:30.663 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-16T22:26:30.663 DEBUG:teuthology.orchestra.run.smithi196:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-16T22:26:30.761 INFO:tasks.ceph:Setting up mon nodes... 2024-05-16T22:26:30.762 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-16T22:26:30.762 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-16T22:26:30.823 INFO:teuthology.orchestra.run.smithi044.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-16T22:26:30.826 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-16T22:26:30.892 INFO:teuthology.orchestra.run.smithi070.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-16T22:26:30.895 INFO:tasks.ceph:Setting up mds nodes... 2024-05-16T22:26:30.895 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-16T22:26:30.955 INFO:teuthology.orchestra.run.smithi044.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-16T22:26:30.958 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-16T22:26:30.982 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-05-16T22:26:31.082 INFO:teuthology.orchestra.run.smithi044.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-05-16T22:26:31.085 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-05-16T22:26:31.109 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-16T22:26:31.168 INFO:teuthology.orchestra.run.smithi070.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-16T22:26:31.171 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-16T22:26:31.194 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-16T22:26:31.194 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-16T22:26:31.408 INFO:teuthology.orchestra.run.smithi196.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-16T22:26:31.455 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-16T22:26:31.455 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi044.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi070.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-16T22:26:31.455 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-16T22:26:31.479 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-16T22:26:31.479 INFO:tasks.ceph:role: osd.0 2024-05-16T22:26:31.479 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi044.front.sepia.ceph.com 2024-05-16T22:26:31.480 DEBUG:teuthology.orchestra.run.smithi044:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-16T22:26:31.551 INFO:teuthology.orchestra.run.smithi044.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-16T22:26:31.552 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-16T22:26:31.552 INFO:teuthology.orchestra.run.smithi044.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-16T22:26:31.552 INFO:teuthology.orchestra.run.smithi044.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-16T22:26:31.552 INFO:teuthology.orchestra.run.smithi044.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-16T22:26:31.552 INFO:teuthology.orchestra.run.smithi044.stdout: = sunit=0 swidth=0 blks 2024-05-16T22:26:31.552 INFO:teuthology.orchestra.run.smithi044.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-16T22:26:31.552 INFO:teuthology.orchestra.run.smithi044.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-16T22:26:31.552 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-16T22:26:31.552 INFO:teuthology.orchestra.run.smithi044.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-16T22:26:32.043 INFO:teuthology.orchestra.run.smithi044.stdout:Discarding blocks...Done. 2024-05-16T22:26:32.045 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi044.front.sepia.ceph.com -o noatime 2024-05-16T22:26:32.045 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-16T22:26:32.156 DEBUG:teuthology.orchestra.run.smithi044:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-16T22:26:32.188 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-16T22:26:32.252 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-16T22:26:32.253 INFO:tasks.ceph:role: osd.1 2024-05-16T22:26:32.253 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi044.front.sepia.ceph.com 2024-05-16T22:26:32.253 DEBUG:teuthology.orchestra.run.smithi044:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-16T22:26:32.325 INFO:teuthology.orchestra.run.smithi044.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-16T22:26:32.325 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-16T22:26:32.325 INFO:teuthology.orchestra.run.smithi044.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-16T22:26:32.325 INFO:teuthology.orchestra.run.smithi044.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-16T22:26:32.325 INFO:teuthology.orchestra.run.smithi044.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-16T22:26:32.325 INFO:teuthology.orchestra.run.smithi044.stdout: = sunit=0 swidth=0 blks 2024-05-16T22:26:32.325 INFO:teuthology.orchestra.run.smithi044.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-16T22:26:32.325 INFO:teuthology.orchestra.run.smithi044.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-16T22:26:32.325 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-16T22:26:32.325 INFO:teuthology.orchestra.run.smithi044.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-16T22:26:32.796 INFO:teuthology.orchestra.run.smithi044.stdout:Discarding blocks...Done. 2024-05-16T22:26:32.798 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi044.front.sepia.ceph.com -o noatime 2024-05-16T22:26:32.799 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-16T22:26:32.884 DEBUG:teuthology.orchestra.run.smithi044:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-16T22:26:32.914 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-16T22:26:32.980 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-16T22:26:32.980 INFO:tasks.ceph:role: osd.2 2024-05-16T22:26:32.980 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi044.front.sepia.ceph.com 2024-05-16T22:26:32.980 DEBUG:teuthology.orchestra.run.smithi044:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-16T22:26:33.052 INFO:teuthology.orchestra.run.smithi044.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-16T22:26:33.052 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-16T22:26:33.053 INFO:teuthology.orchestra.run.smithi044.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-16T22:26:33.053 INFO:teuthology.orchestra.run.smithi044.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-16T22:26:33.053 INFO:teuthology.orchestra.run.smithi044.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-16T22:26:33.053 INFO:teuthology.orchestra.run.smithi044.stdout: = sunit=0 swidth=0 blks 2024-05-16T22:26:33.053 INFO:teuthology.orchestra.run.smithi044.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-16T22:26:33.053 INFO:teuthology.orchestra.run.smithi044.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-16T22:26:33.053 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-16T22:26:33.053 INFO:teuthology.orchestra.run.smithi044.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-16T22:26:33.539 INFO:teuthology.orchestra.run.smithi044.stdout:Discarding blocks...Done. 2024-05-16T22:26:33.542 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi044.front.sepia.ceph.com -o noatime 2024-05-16T22:26:33.542 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-16T22:26:33.688 DEBUG:teuthology.orchestra.run.smithi044:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-16T22:26:33.722 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-16T22:26:33.789 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-16T22:26:33.789 INFO:tasks.ceph:role: osd.3 2024-05-16T22:26:33.790 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi044.front.sepia.ceph.com 2024-05-16T22:26:33.790 DEBUG:teuthology.orchestra.run.smithi044:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-16T22:26:33.864 INFO:teuthology.orchestra.run.smithi044.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-16T22:26:33.864 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-16T22:26:33.864 INFO:teuthology.orchestra.run.smithi044.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-16T22:26:33.864 INFO:teuthology.orchestra.run.smithi044.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-16T22:26:33.864 INFO:teuthology.orchestra.run.smithi044.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-16T22:26:33.864 INFO:teuthology.orchestra.run.smithi044.stdout: = sunit=0 swidth=0 blks 2024-05-16T22:26:33.865 INFO:teuthology.orchestra.run.smithi044.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-16T22:26:33.865 INFO:teuthology.orchestra.run.smithi044.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-16T22:26:33.865 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-16T22:26:33.865 INFO:teuthology.orchestra.run.smithi044.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-16T22:26:34.349 INFO:teuthology.orchestra.run.smithi044.stdout:Discarding blocks...Done. 2024-05-16T22:26:34.351 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi044.front.sepia.ceph.com -o noatime 2024-05-16T22:26:34.352 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-16T22:26:34.482 DEBUG:teuthology.orchestra.run.smithi044:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-16T22:26:34.517 DEBUG:teuthology.orchestra.run.smithi044:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-16T22:26:34.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:26:34.625+0000 7ff3c4a1c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-16T22:26:34.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:26:34.625+0000 7ff3c4a1c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-16T22:26:34.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:26:34.625+0000 7ff3c4a1c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-16T22:26:34.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:26:34.625+0000 7ff3c4a1c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-16T22:26:34.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:26:34.625+0000 7ff3c4a1c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-16T22:26:34.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:26:34.626+0000 7ff3c4a1c640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-16T22:26:37.496 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-16T22:26:37.522 DEBUG:teuthology.orchestra.run.smithi044:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-16T22:26:37.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:26:37.621+0000 7ff22e463640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-16T22:26:37.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:26:37.621+0000 7ff22e463640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-16T22:26:37.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:26:37.621+0000 7ff22e463640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-16T22:26:37.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:26:37.621+0000 7ff22e463640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-16T22:26:37.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:26:37.621+0000 7ff22e463640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-16T22:26:37.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:26:37.622+0000 7ff22e463640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-16T22:26:40.470 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-16T22:26:40.502 DEBUG:teuthology.orchestra.run.smithi044:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-16T22:26:40.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:26:40.604+0000 7f2908a1a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-16T22:26:40.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:26:40.605+0000 7f2908a1a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-16T22:26:40.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:26:40.605+0000 7f2908a1a640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-16T22:26:40.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:26:40.605+0000 7f2908a1a640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-16T22:26:40.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:26:40.605+0000 7f2908a1a640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-16T22:26:40.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:26:40.605+0000 7f2908a1a640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-16T22:26:43.470 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-16T22:26:43.499 DEBUG:teuthology.orchestra.run.smithi044:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-16T22:26:43.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:26:43.603+0000 7f907122c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-16T22:26:43.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:26:43.603+0000 7f907122c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-16T22:26:43.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:26:43.603+0000 7f907122c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-16T22:26:43.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:26:43.603+0000 7f907122c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-16T22:26:43.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:26:43.603+0000 7f907122c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-16T22:26:43.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:26:43.604+0000 7f907122c640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-16T22:26:46.448 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-16T22:26:46.477 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-16T22:26:46.505 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-16T22:26:46.505 INFO:tasks.ceph:role: osd.4 2024-05-16T22:26:46.505 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi070.front.sepia.ceph.com 2024-05-16T22:26:46.505 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-16T22:26:46.572 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-16T22:26:46.572 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-16T22:26:46.572 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-16T22:26:46.572 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-16T22:26:46.573 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-16T22:26:46.573 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2024-05-16T22:26:46.573 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-16T22:26:46.573 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-16T22:26:46.573 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-16T22:26:46.573 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-16T22:26:46.605 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2024-05-16T22:26:46.607 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2024-05-16T22:26:46.608 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-16T22:26:46.677 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-16T22:26:46.745 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-16T22:26:46.810 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-16T22:26:46.810 INFO:tasks.ceph:role: osd.5 2024-05-16T22:26:46.810 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi070.front.sepia.ceph.com 2024-05-16T22:26:46.810 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-16T22:26:46.873 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-16T22:26:46.873 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-16T22:26:46.873 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-16T22:26:46.873 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-16T22:26:46.873 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-16T22:26:46.873 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2024-05-16T22:26:46.873 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-16T22:26:46.874 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-16T22:26:46.874 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-16T22:26:46.874 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-16T22:26:46.905 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2024-05-16T22:26:46.907 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2024-05-16T22:26:46.907 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-16T22:26:46.974 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-16T22:26:47.044 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-16T22:26:47.107 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-16T22:26:47.107 INFO:tasks.ceph:role: osd.6 2024-05-16T22:26:47.107 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi070.front.sepia.ceph.com 2024-05-16T22:26:47.108 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-16T22:26:47.172 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-16T22:26:47.172 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-16T22:26:47.172 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-16T22:26:47.172 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-16T22:26:47.172 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-16T22:26:47.172 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2024-05-16T22:26:47.172 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-16T22:26:47.172 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-16T22:26:47.172 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-16T22:26:47.172 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-16T22:26:47.204 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2024-05-16T22:26:47.207 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2024-05-16T22:26:47.207 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-16T22:26:47.274 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-16T22:26:47.340 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-16T22:26:47.404 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-16T22:26:47.404 INFO:tasks.ceph:role: osd.7 2024-05-16T22:26:47.404 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi070.front.sepia.ceph.com 2024-05-16T22:26:47.404 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-16T22:26:47.467 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-16T22:26:47.467 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-16T22:26:47.467 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-16T22:26:47.467 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-16T22:26:47.467 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-16T22:26:47.467 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2024-05-16T22:26:47.467 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-16T22:26:47.467 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-16T22:26:47.468 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-16T22:26:47.468 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-16T22:26:47.499 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2024-05-16T22:26:47.501 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2024-05-16T22:26:47.501 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-16T22:26:47.573 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-16T22:26:47.640 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-16T22:26:47.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:26:47.740+0000 7f61c3116640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-16T22:26:47.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:26:47.741+0000 7f61c3116640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-16T22:26:47.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:26:47.741+0000 7f61c3116640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-16T22:26:47.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:26:47.741+0000 7f61c3116640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-16T22:26:47.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:26:47.741+0000 7f61c3116640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-16T22:26:47.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:26:47.741+0000 7f61c3116640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-16T22:26:50.582 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-16T22:26:50.610 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-16T22:26:50.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:26:50.713+0000 7fabec40c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-16T22:26:50.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:26:50.714+0000 7fabec40c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-16T22:26:50.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:26:50.714+0000 7fabec40c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-16T22:26:50.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:26:50.714+0000 7fabec40c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-16T22:26:50.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:26:50.714+0000 7fabec40c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-16T22:26:50.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:26:50.714+0000 7fabec40c640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-16T22:26:53.558 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-16T22:26:53.586 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-16T22:26:53.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:26:53.685+0000 7f2196123640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-16T22:26:53.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:26:53.685+0000 7f2196123640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-16T22:26:53.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:26:53.685+0000 7f2196123640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-16T22:26:53.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:26:53.685+0000 7f2196123640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-16T22:26:53.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:26:53.685+0000 7f2196123640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-16T22:26:53.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:26:53.686+0000 7f2196123640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-16T22:26:56.530 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-16T22:26:56.557 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-16T22:26:56.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:26:56.658+0000 7f5692418640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-16T22:26:56.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:26:56.659+0000 7f5692418640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-16T22:26:56.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:26:56.659+0000 7f5692418640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-16T22:26:56.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:26:56.659+0000 7f5692418640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-16T22:26:56.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:26:56.659+0000 7f5692418640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-16T22:26:56.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:26:56.659+0000 7f5692418640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-16T22:26:58.065 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:26:58.067 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:26:58.070 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:26:59.512 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-16T22:26:59.538 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-16T22:26:59.538 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-05-16T22:26:59.538 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-16T22:26:59.569 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-05-16T22:26:59.569 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-16T22:26:59.638 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-05-16T22:26:59.639 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-05-16T22:26:59.708 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-05-16T22:26:59.708 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-16T22:26:59.777 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-05-16T22:26:59.777 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-16T22:26:59.847 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-05-16T22:26:59.847 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-16T22:26:59.916 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-05-16T22:26:59.916 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-16T22:26:59.985 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-16T22:26:59.985 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-16T22:27:00.013 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-16T22:27:00.013 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-16T22:27:00.079 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-16T22:27:00.079 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-16T22:27:00.144 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-16T22:27:00.144 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-16T22:27:00.209 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-16T22:27:00.209 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-16T22:27:00.273 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-16T22:27:00.273 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-16T22:27:00.337 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-16T22:27:00.337 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-16T22:27:00.394 INFO:tasks.ceph:Adding keys to all mons... 2024-05-16T22:27:00.394 DEBUG:teuthology.orchestra.run.smithi044:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-16T22:27:00.397 DEBUG:teuthology.orchestra.run.smithi070:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-16T22:27:00.419 INFO:teuthology.orchestra.run.smithi070.stdout:[mgr.y] 2024-05-16T22:27:00.419 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQAWiEZmUj4wMRAAsBAzNHvbKW0neWbAITTL1A== 2024-05-16T22:27:00.419 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.a] 2024-05-16T22:27:00.419 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQAWiEZmxekLORAA65NIhbDezFAP1GVT9W/2RA== 2024-05-16T22:27:00.419 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.c] 2024-05-16T22:27:00.419 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQAXiEZmtUcJBRAASN/71ONwgQ6oUKwSgrptjw== 2024-05-16T22:27:00.420 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.0] 2024-05-16T22:27:00.420 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQAaiEZm+8xUJRAA9xLLdiQFRJCz2p87HaNmyA== 2024-05-16T22:27:00.420 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.1] 2024-05-16T22:27:00.420 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQAdiEZmmMAaJRAArJoDZU7bZnxdQigZzd0YVg== 2024-05-16T22:27:00.420 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.2] 2024-05-16T22:27:00.420 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQAgiEZmPjYbJBAAHAcCdSqGENz8izm4WRgL+A== 2024-05-16T22:27:00.420 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.3] 2024-05-16T22:27:00.420 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQAjiEZmEtkSJBAAyLOddh7tm2/aH5Kg1vEAyg== 2024-05-16T22:27:00.420 INFO:teuthology.orchestra.run.smithi070.stdout:[mgr.x] 2024-05-16T22:27:00.420 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQAWiEZm7uNONRAAmiKGMr87L5iAlRVZjapvxQ== 2024-05-16T22:27:00.420 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.b] 2024-05-16T22:27:00.420 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQAXiEZmurcoChAAJiwILq5JEI80q8OpClacbw== 2024-05-16T22:27:00.420 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.4] 2024-05-16T22:27:00.420 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQAniEZm1f01LBAAl7Okxq8NCE6pNDSpffrHNQ== 2024-05-16T22:27:00.420 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.5] 2024-05-16T22:27:00.421 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQAqiEZmL9yZKhAAHdy+cA/TusLioV8AuJLMzg== 2024-05-16T22:27:00.421 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.6] 2024-05-16T22:27:00.421 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQAtiEZm+r/pKBAA1P18UVMTaPbPfz0x+n+rcA== 2024-05-16T22:27:00.421 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.7] 2024-05-16T22:27:00.421 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQAwiEZm9IVUJxAAXMx+HxIIDuBtRZ8pRXMdEQ== 2024-05-16T22:27:00.421 INFO:teuthology.orchestra.run.smithi070.stdout:[client.0] 2024-05-16T22:27:00.421 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQAXiEZms3dqGBAAS4ISUkubc7YrigOk4RRlXA== 2024-05-16T22:27:00.422 INFO:teuthology.orchestra.run.smithi044.stdout:[mgr.y] 2024-05-16T22:27:00.422 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQAWiEZmUj4wMRAAsBAzNHvbKW0neWbAITTL1A== 2024-05-16T22:27:00.422 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.a] 2024-05-16T22:27:00.422 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQAWiEZmxekLORAA65NIhbDezFAP1GVT9W/2RA== 2024-05-16T22:27:00.422 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.c] 2024-05-16T22:27:00.422 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQAXiEZmtUcJBRAASN/71ONwgQ6oUKwSgrptjw== 2024-05-16T22:27:00.422 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.0] 2024-05-16T22:27:00.422 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQAaiEZm+8xUJRAA9xLLdiQFRJCz2p87HaNmyA== 2024-05-16T22:27:00.423 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.1] 2024-05-16T22:27:00.423 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQAdiEZmmMAaJRAArJoDZU7bZnxdQigZzd0YVg== 2024-05-16T22:27:00.423 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.2] 2024-05-16T22:27:00.423 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQAgiEZmPjYbJBAAHAcCdSqGENz8izm4WRgL+A== 2024-05-16T22:27:00.423 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.3] 2024-05-16T22:27:00.423 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQAjiEZmEtkSJBAAyLOddh7tm2/aH5Kg1vEAyg== 2024-05-16T22:27:00.423 INFO:teuthology.orchestra.run.smithi044.stdout:[mgr.x] 2024-05-16T22:27:00.423 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQAWiEZm7uNONRAAmiKGMr87L5iAlRVZjapvxQ== 2024-05-16T22:27:00.423 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.b] 2024-05-16T22:27:00.423 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQAXiEZmurcoChAAJiwILq5JEI80q8OpClacbw== 2024-05-16T22:27:00.423 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.4] 2024-05-16T22:27:00.423 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQAniEZm1f01LBAAl7Okxq8NCE6pNDSpffrHNQ== 2024-05-16T22:27:00.423 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.5] 2024-05-16T22:27:00.423 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQAqiEZmL9yZKhAAHdy+cA/TusLioV8AuJLMzg== 2024-05-16T22:27:00.424 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.6] 2024-05-16T22:27:00.424 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQAtiEZm+r/pKBAA1P18UVMTaPbPfz0x+n+rcA== 2024-05-16T22:27:00.424 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.7] 2024-05-16T22:27:00.424 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQAwiEZm9IVUJxAAXMx+HxIIDuBtRZ8pRXMdEQ== 2024-05-16T22:27:00.424 INFO:teuthology.orchestra.run.smithi044.stdout:[client.0] 2024-05-16T22:27:00.424 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQAXiEZms3dqGBAAS4ISUkubc7YrigOk4RRlXA== 2024-05-16T22:27:00.425 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-16T22:27:00.468 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-16T22:27:00.536 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-16T22:27:00.538 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-16T22:27:00.602 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-16T22:27:00.605 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-16T22:27:00.667 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-16T22:27:00.670 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-16T22:27:00.729 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-16T22:27:00.732 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-16T22:27:00.791 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-16T22:27:00.793 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-16T22:27:00.852 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-16T22:27:00.854 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-16T22:27:00.913 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-16T22:27:00.916 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-16T22:27:00.975 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-16T22:27:00.977 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-16T22:27:01.038 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-16T22:27:01.040 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-16T22:27:01.099 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-16T22:27:01.101 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-16T22:27:01.160 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-16T22:27:01.163 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-16T22:27:01.222 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-16T22:27:01.224 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-16T22:27:01.284 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-16T22:27:01.287 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-16T22:27:01.349 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-16T22:27:01.349 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-16T22:27:01.373 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-16T22:27:01.482 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-16T22:27:01.507 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-16T22:27:01.531 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-16T22:27:01.635 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-16T22:27:01.658 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-16T22:27:01.721 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-16T22:27:01.823 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-16T22:27:01.846 DEBUG:teuthology.orchestra.run.smithi044:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-16T22:27:01.848 DEBUG:teuthology.orchestra.run.smithi070:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-16T22:27:01.900 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-16T22:27:01.900 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-16T22:27:01.900 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-16T22:27:01.904 INFO:tasks.ceph.mon.a:Started 2024-05-16T22:27:01.904 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-16T22:27:01.905 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-16T22:27:01.942 INFO:tasks.ceph.mon.b:Started 2024-05-16T22:27:01.942 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-16T22:27:01.942 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-16T22:27:01.944 INFO:tasks.ceph.mon.c:Started 2024-05-16T22:27:01.944 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-16T22:27:01.944 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-16T22:27:01.944 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-16T22:27:01.947 INFO:tasks.ceph.mgr.y:Started 2024-05-16T22:27:01.947 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-16T22:27:01.947 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-16T22:27:01.949 INFO:tasks.ceph.mgr.x:Started 2024-05-16T22:27:01.950 INFO:tasks.ceph:Setting crush tunables to default 2024-05-16T22:27:01.951 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph osd crush tunables default 2024-05-16T22:27:02.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.068+0000 7f5289227640 1 Processor -- start 2024-05-16T22:27:02.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.068+0000 7f5289227640 1 -- start start 2024-05-16T22:27:02.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.069+0000 7f5289227640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f52840a9060 0x7f5284148910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:02.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.069+0000 7f5289227640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52840b8a30 con 0x7f52840ba0f0 2024-05-16T22:27:02.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.069+0000 7f5289227640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52840b8d10 con 0x7f528414ed70 2024-05-16T22:27:02.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.069+0000 7f5289227640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f52840b8ff0 con 0x7f52840a9060 2024-05-16T22:27:02.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.070+0000 7f5282d9d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f52840a9060 0x7f5284148910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:02.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.070+0000 7f528259c640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f52840ba0f0 0x7f528414e660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:32900/0 (socket says 172.21.15.44:32900) 2024-05-16T22:27:02.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.070+0000 7f528259c640 1 -- 172.21.15.44:0/3073792492 learned_addr learned my addr 172.21.15.44:0/3073792492 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:27:02.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.070+0000 7f5282d9d640 1 -- 172.21.15.44:0/3073792492 >> v2:172.21.15.44:3300/0 conn(0x7f52840a9060 msgr2=0x7f5284148910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-16T22:27:02.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.070+0000 7f5282d9d640 1 -- 172.21.15.44:0/3073792492 >> v2:172.21.15.44:3300/0 conn(0x7f52840a9060 msgr2=0x7f5284148910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-16T22:27:02.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.070+0000 7f5282d9d640 1 --2- 172.21.15.44:0/3073792492 >> v2:172.21.15.44:3300/0 conn(0x7f52840a9060 0x7f5284148910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-16T22:27:02.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.070+0000 7f5282d9d640 1 --2- 172.21.15.44:0/3073792492 >> v2:172.21.15.44:3300/0 conn(0x7f52840a9060 0x7f5284148910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-16T22:27:02.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.227+0000 7f5281d9b640 1 -- 172.21.15.44:0/3073792492 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3699073330 0 0) 0x7f52840b8d10 con 0x7f528414ed70 2024-05-16T22:27:02.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.227+0000 7f5281d9b640 1 -- 172.21.15.44:0/3073792492 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5270003520 con 0x7f528414ed70 2024-05-16T22:27:02.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.227+0000 7f5281d9b640 1 -- 172.21.15.44:0/3073792492 <== mon.1 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 314457379 0 0) 0x7f5270003520 con 0x7f528414ed70 2024-05-16T22:27:02.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.227+0000 7f5281d9b640 1 -- 172.21.15.44:0/3073792492 >> v2:172.21.15.44:3300/0 conn(0x7f52840a9060 msgr2=0x7f5284148910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-16T22:27:02.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.227+0000 7f5281d9b640 1 --2- 172.21.15.44:0/3073792492 >> v2:172.21.15.44:3300/0 conn(0x7f52840a9060 0x7f5284148910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:02.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.227+0000 7f5281d9b640 1 -- 172.21.15.44:0/3073792492 >> v1:172.21.15.44:6789/0 conn(0x7f52840ba0f0 legacy=0x7f528414e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:02.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.227+0000 7f5281d9b640 1 -- 172.21.15.44:0/3073792492 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52840b92d0 con 0x7f528414ed70 2024-05-16T22:27:02.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.227+0000 7f5281d9b640 1 -- 172.21.15.44:0/3073792492 <== mon.1 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 568431863 0 0) 0x7f527c001a70 con 0x7f528414ed70 2024-05-16T22:27:02.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.227+0000 7f5281d9b640 1 -- 172.21.15.44:0/3073792492 >> v1:172.21.15.70:6789/0 conn(0x7f528414ed70 legacy=0x7f5284158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:02.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.227+0000 7f5281d9b640 1 --2- 172.21.15.44:0/3073792492 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5270003a50 0x7f5270003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:02.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.227+0000 7f5281d9b640 1 --2- 172.21.15.44:0/3073792492 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5270004800 0x7f5270004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:02.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.227+0000 7f5281d9b640 1 --2- 172.21.15.44:0/3073792492 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5270005350 0x7f527000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:02.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.227+0000 7f5281d9b640 1 -- 172.21.15.44:0/3073792492 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f52840b8ff0 con 0x7f5270004800 2024-05-16T22:27:02.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.227+0000 7f5281d9b640 1 -- 172.21.15.44:0/3073792492 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f527000c1b0 con 0x7f5270003a50 2024-05-16T22:27:02.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.227+0000 7f5281d9b640 1 -- 172.21.15.44:0/3073792492 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f527000c3b0 con 0x7f5270005350 2024-05-16T22:27:02.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.228+0000 7f528259c640 1 --2- 172.21.15.44:0/3073792492 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5270004800 0x7f5270004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:02.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.228+0000 7f5282d9d640 1 --2- 172.21.15.44:0/3073792492 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5270003a50 0x7f5270003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:02.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.228+0000 7f528359e640 1 --2- 172.21.15.44:0/3073792492 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5270005350 0x7f527000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:02.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.228+0000 7f5282d9d640 1 -- 172.21.15.44:0/3073792492 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5270005350 msgr2=0x7f527000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:02.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.228+0000 7f5282d9d640 1 --2- 172.21.15.44:0/3073792492 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5270005350 0x7f527000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:02.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.228+0000 7f5282d9d640 1 -- 172.21.15.44:0/3073792492 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5270004800 msgr2=0x7f5270004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:02.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.228+0000 7f5282d9d640 1 --2- 172.21.15.44:0/3073792492 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5270004800 0x7f5270004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:02.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.228+0000 7f5282d9d640 1 -- 172.21.15.44:0/3073792492 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5270003520 con 0x7f5270003a50 2024-05-16T22:27:02.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.228+0000 7f528359e640 1 -- 172.21.15.44:0/3073792492 reap_dead start 2024-05-16T22:27:02.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.229+0000 7f5282d9d640 1 --2- 172.21.15.44:0/3073792492 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5270003a50 0x7f5270003e80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f526c00b9e0 tx=0x7f5270005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc696356644ec8f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:02.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.229+0000 7f5281d9b640 1 -- 172.21.15.44:0/3073792492 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526c030070 con 0x7f5270003a50 2024-05-16T22:27:02.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.229+0000 7f5281d9b640 1 -- 172.21.15.44:0/3073792492 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f526c02ada0 con 0x7f5270003a50 2024-05-16T22:27:02.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.229+0000 7f5281d9b640 1 -- 172.21.15.44:0/3073792492 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526c00b5e0 con 0x7f5270003a50 2024-05-16T22:27:02.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.230+0000 7f5289227640 1 -- 172.21.15.44:0/3073792492 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5270003a50 msgr2=0x7f5270003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:02.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.230+0000 7f5289227640 1 --2- 172.21.15.44:0/3073792492 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5270003a50 0x7f5270003e80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f526c00b9e0 tx=0x7f5270005830 comp rx=0 tx=0).stop 2024-05-16T22:27:02.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.230+0000 7f5289227640 1 -- 172.21.15.44:0/3073792492 shutdown_connections 2024-05-16T22:27:02.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.230+0000 7f5289227640 1 --2- 172.21.15.44:0/3073792492 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5270003a50 0x7f5270003e80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:02.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.230+0000 7f5289227640 1 -- 172.21.15.44:0/3073792492 >> 172.21.15.44:0/3073792492 conn(0x7f52840c07c0 msgr2=0x7f52840c0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:02.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.230+0000 7f5289227640 1 -- 172.21.15.44:0/3073792492 shutdown_connections 2024-05-16T22:27:02.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.230+0000 7f5289227640 1 -- 172.21.15.44:0/3073792492 wait complete. 2024-05-16T22:27:02.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.232+0000 7f5289227640 1 Processor -- start 2024-05-16T22:27:02.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.232+0000 7f5289227640 1 -- start start 2024-05-16T22:27:02.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.233+0000 7f5289227640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5270003a50 0x7f5284151e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:02.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.233+0000 7f5289227640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f528414fa00 0x7f5284146de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:02.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.233+0000 7f5289227640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5284142ee0 0x7f52841432f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:02.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.233+0000 7f5289227640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f528408dbb0 con 0x7f528414fa00 2024-05-16T22:27:02.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.233+0000 7f5289227640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f528408da30 con 0x7f5284142ee0 2024-05-16T22:27:02.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.233+0000 7f5289227640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f52840ba500 con 0x7f5270003a50 2024-05-16T22:27:02.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.233+0000 7f5282d9d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5270003a50 0x7f5284151e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:02.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.234+0000 7f5282d9d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5270003a50 0x7f5284151e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.44:58468/0 (socket says 172.21.15.44:58468) 2024-05-16T22:27:02.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.234+0000 7f528259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f528414fa00 0x7f5284146de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:02.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.234+0000 7f5282d9d640 1 -- 172.21.15.44:0/4223403584 learned_addr learned my addr 172.21.15.44:0/4223403584 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:02.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.234+0000 7f528359e640 1 --2- 172.21.15.44:0/4223403584 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5284142ee0 0x7f52841432f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:02.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.234+0000 7f528259c640 1 -- 172.21.15.44:0/4223403584 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5270003a50 msgr2=0x7f5284151e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:02.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.234+0000 7f528259c640 1 --2- 172.21.15.44:0/4223403584 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5270003a50 0x7f5284151e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:02.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.234+0000 7f528259c640 1 -- 172.21.15.44:0/4223403584 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5284142ee0 msgr2=0x7f52841432f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:02.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.234+0000 7f528259c640 1 --2- 172.21.15.44:0/4223403584 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5284142ee0 0x7f52841432f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:02.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.234+0000 7f528259c640 1 -- 172.21.15.44:0/4223403584 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5284147320 con 0x7f528414fa00 2024-05-16T22:27:02.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.234+0000 7f5282d9d640 1 --2- 172.21.15.44:0/4223403584 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5270003a50 0x7f5284151e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:27:02.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.234+0000 7f528259c640 1 --2- 172.21.15.44:0/4223403584 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f528414fa00 0x7f5284146de0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5274007fd0 tx=0x7f5274001b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:02.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.235+0000 7f527b7fe640 1 -- 172.21.15.44:0/4223403584 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5274007740 con 0x7f528414fa00 2024-05-16T22:27:02.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.235+0000 7f527b7fe640 1 -- 172.21.15.44:0/4223403584 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5274018070 con 0x7f528414fa00 2024-05-16T22:27:02.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.235+0000 7f5289227640 1 -- 172.21.15.44:0/4223403584 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5284147530 con 0x7f528414fa00 2024-05-16T22:27:02.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.235+0000 7f5289227640 1 -- 172.21.15.44:0/4223403584 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5284152700 con 0x7f528414fa00 2024-05-16T22:27:02.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.235+0000 7f527b7fe640 1 -- 172.21.15.44:0/4223403584 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f527400f9f0 con 0x7f528414fa00 2024-05-16T22:27:02.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.236+0000 7f5289227640 1 -- 172.21.15.44:0/4223403584 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5268005290 con 0x7f528414fa00 2024-05-16T22:27:02.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.236+0000 7f527b7fe640 1 -- 172.21.15.44:0/4223403584 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f527400fb90 con 0x7f528414fa00 2024-05-16T22:27:02.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.236+0000 7f527b7fe640 1 -- 172.21.15.44:0/4223403584 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5274027430 con 0x7f528414fa00 2024-05-16T22:27:02.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.238+0000 7f527b7fe640 1 -- 172.21.15.44:0/4223403584 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f527401d460 con 0x7f528414fa00 2024-05-16T22:27:02.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.305+0000 7f5289227640 1 -- 172.21.15.44:0/4223403584 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f5268005850 con 0x7f528414fa00 2024-05-16T22:27:02.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.307+0000 7f527b7fe640 1 -- 172.21.15.44:0/4223403584 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f527401d640 con 0x7f528414fa00 2024-05-16T22:27:02.306 INFO:teuthology.orchestra.run.smithi044.stderr:adjusted tunables profile to default 2024-05-16T22:27:02.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.308+0000 7f5289227640 1 -- 172.21.15.44:0/4223403584 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f528414fa00 msgr2=0x7f5284146de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:02.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.308+0000 7f5289227640 1 --2- 172.21.15.44:0/4223403584 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f528414fa00 0x7f5284146de0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5274007fd0 tx=0x7f5274001b20 comp rx=0 tx=0).stop 2024-05-16T22:27:02.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.308+0000 7f5289227640 1 -- 172.21.15.44:0/4223403584 shutdown_connections 2024-05-16T22:27:02.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.308+0000 7f5289227640 1 --2- 172.21.15.44:0/4223403584 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5284142ee0 0x7f52841432f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:02.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.308+0000 7f5289227640 1 --2- 172.21.15.44:0/4223403584 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f528414fa00 0x7f5284146de0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:02.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.308+0000 7f5289227640 1 --2- 172.21.15.44:0/4223403584 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5270003a50 0x7f5284151e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:02.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.308+0000 7f5289227640 1 -- 172.21.15.44:0/4223403584 >> 172.21.15.44:0/4223403584 conn(0x7f52840c07c0 msgr2=0x7f528414e580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:02.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.308+0000 7f5289227640 1 -- 172.21.15.44:0/4223403584 shutdown_connections 2024-05-16T22:27:02.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:02.308+0000 7f5289227640 1 -- 172.21.15.44:0/4223403584 wait complete. 2024-05-16T22:27:02.318 INFO:tasks.ceph:check_enable_crimson: False 2024-05-16T22:27:02.319 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-16T22:27:02.319 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-05-16T22:27:02.319 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-16T22:27:02.339 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-16T22:27:02.339+0000 7fba1451c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-16T22:27:02.342 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-05-16T22:27:02.343+0000 7f5ed2b17040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-16T22:27:02.343 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-05-16T22:27:02.343 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-16T22:27:02.407 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-05-16T22:27:02.407 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-16T22:27:02.472 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-05-16T22:27:02.472 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-16T22:27:02.488 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-16T22:27:02.489+0000 7fba1451c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-16T22:27:02.501 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-05-16T22:27:02.502+0000 7f5ed2b17040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-16T22:27:02.525 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-16T22:27:02.525 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-16T22:27:02.542 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-16T22:27:02.543+0000 7fba1451c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-16T22:27:02.549 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-16T22:27:02.549 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-16T22:27:02.558 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-05-16T22:27:02.559+0000 7f5ed2b17040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-16T22:27:02.612 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-16T22:27:02.612 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-16T22:27:02.679 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-16T22:27:02.679 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-16T22:27:02.742 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd new a7003e89-c706-4562-9f25-670bb35ae108 0 2024-05-16T22:27:02.799 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-16T22:27:02.800+0000 7fba1451c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-16T22:27:02.816 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-05-16T22:27:02.817+0000 7f5ed2b17040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-16T22:27:02.847 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-16T22:27:02.848+0000 7fba1451c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-16T22:27:02.865 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-05-16T22:27:02.865+0000 7f5ed2b17040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-16T22:27:02.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.890+0000 7f4c37947640 1 Processor -- start 2024-05-16T22:27:02.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.891+0000 7f4c37947640 1 -- start start 2024-05-16T22:27:02.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.892+0000 7f4c37947640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4c300bf3b0 0x7f4c3006f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:02.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.892+0000 7f4c37947640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4c301539a0 0x7f4c30155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:02.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.892+0000 7f4c37947640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c300bf7c0 con 0x7f4c300bb3f0 2024-05-16T22:27:02.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.892+0000 7f4c37947640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f4c300bbf10 con 0x7f4c301539a0 2024-05-16T22:27:02.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.892+0000 7f4c37947640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f4c301457d0 con 0x7f4c300bf3b0 2024-05-16T22:27:02.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.892+0000 7f4c356e3640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4c300bf3b0 0x7f4c3006f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:02.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.892+0000 7f4c356e3640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4c300bf3b0 0x7f4c3006f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.70:54886/0 (socket says 172.21.15.70:54886) 2024-05-16T22:27:02.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.892+0000 7f4c34ee2640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f4c300bb3f0 0x7f4c300bb800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:46310/0 (socket says 172.21.15.70:46310) 2024-05-16T22:27:02.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.892+0000 7f4c356e3640 1 -- 172.21.15.70:0/4242994880 learned_addr learned my addr 172.21.15.70:0/4242994880 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-16T22:27:02.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.892+0000 7f4c35ee4640 1 --2- 172.21.15.70:0/4242994880 >> v2:172.21.15.44:3300/0 conn(0x7f4c301539a0 0x7f4c30155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:02.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.892+0000 7f4c27fff640 1 -- 172.21.15.70:0/4242994880 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2211608990 0 0) 0x7f4c300bf7c0 con 0x7f4c300bb3f0 2024-05-16T22:27:02.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.892+0000 7f4c27fff640 1 -- 172.21.15.70:0/4242994880 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c1c003520 con 0x7f4c300bb3f0 2024-05-16T22:27:02.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.892+0000 7f4c356e3640 1 -- 172.21.15.70:0/4242994880 >> v2:172.21.15.44:3300/0 conn(0x7f4c301539a0 msgr2=0x7f4c30155dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:02.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.892+0000 7f4c356e3640 1 --2- 172.21.15.70:0/4242994880 >> v2:172.21.15.44:3300/0 conn(0x7f4c301539a0 0x7f4c30155dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:02.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.892+0000 7f4c356e3640 1 -- 172.21.15.70:0/4242994880 >> v1:172.21.15.70:6789/0 conn(0x7f4c300bb3f0 legacy=0x7f4c300bb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:02.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.892+0000 7f4c356e3640 1 -- 172.21.15.70:0/4242994880 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c3014b380 con 0x7f4c300bf3b0 2024-05-16T22:27:02.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.893+0000 7f4c356e3640 1 --2- 172.21.15.70:0/4242994880 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4c300bf3b0 0x7f4c3006f960 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4c20009870 tx=0x7f4c2002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc58be8f5b2e58f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:02.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.893+0000 7f4c27fff640 1 -- 172.21.15.70:0/4242994880 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c20037070 con 0x7f4c300bf3b0 2024-05-16T22:27:02.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.893+0000 7f4c27fff640 1 -- 172.21.15.70:0/4242994880 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c20032440 con 0x7f4c300bf3b0 2024-05-16T22:27:02.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.893+0000 7f4c27fff640 1 -- 172.21.15.70:0/4242994880 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c20032810 con 0x7f4c300bf3b0 2024-05-16T22:27:02.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.894+0000 7f4c37947640 1 -- 172.21.15.70:0/4242994880 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4c300bf3b0 msgr2=0x7f4c3006f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:02.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.894+0000 7f4c37947640 1 --2- 172.21.15.70:0/4242994880 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4c300bf3b0 0x7f4c3006f960 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4c20009870 tx=0x7f4c2002a1c0 comp rx=0 tx=0).stop 2024-05-16T22:27:02.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.894+0000 7f4c37947640 1 -- 172.21.15.70:0/4242994880 shutdown_connections 2024-05-16T22:27:02.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.894+0000 7f4c37947640 1 --2- 172.21.15.70:0/4242994880 >> v2:172.21.15.44:3300/0 conn(0x7f4c301539a0 0x7f4c30155dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:02.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.894+0000 7f4c37947640 1 --2- 172.21.15.70:0/4242994880 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4c300bf3b0 0x7f4c3006f960 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:02.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.894+0000 7f4c37947640 1 -- 172.21.15.70:0/4242994880 >> 172.21.15.70:0/4242994880 conn(0x7f4c300bd160 msgr2=0x7f4c300bd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:02.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.894+0000 7f4c37947640 1 -- 172.21.15.70:0/4242994880 shutdown_connections 2024-05-16T22:27:02.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.894+0000 7f4c37947640 1 -- 172.21.15.70:0/4242994880 wait complete. 2024-05-16T22:27:02.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.895+0000 7f4c37947640 1 Processor -- start 2024-05-16T22:27:02.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.895+0000 7f4c37947640 1 -- start start 2024-05-16T22:27:02.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.896+0000 7f4c37947640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c300bb3f0 0x7f4c3014a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:02.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.896+0000 7f4c37947640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4c300bf3b0 0x7f4c301e5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:02.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.896+0000 7f4c37947640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c301539a0 0x7f4c301409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:02.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.896+0000 7f4c37947640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4c300c0270 con 0x7f4c301539a0 2024-05-16T22:27:02.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.896+0000 7f4c37947640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4c3014bcb0 con 0x7f4c300bb3f0 2024-05-16T22:27:02.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.896+0000 7f4c37947640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f4c3014b940 con 0x7f4c300bf3b0 2024-05-16T22:27:02.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.897+0000 7f4c34ee2640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4c300bf3b0 0x7f4c301e5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:02.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.897+0000 7f4c356e3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c300bb3f0 0x7f4c3014a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:02.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.897+0000 7f4c356e3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c300bb3f0 0x7f4c3014a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39086/0 (socket says 172.21.15.70:39086) 2024-05-16T22:27:02.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.897+0000 7f4c34ee2640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4c300bf3b0 0x7f4c301e5570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.70:54898/0 (socket says 172.21.15.70:54898) 2024-05-16T22:27:02.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.897+0000 7f4c356e3640 1 -- 172.21.15.70:0/2378253066 learned_addr learned my addr 172.21.15.70:0/2378253066 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-16T22:27:02.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.897+0000 7f4c35ee4640 1 --2- 172.21.15.70:0/2378253066 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c301539a0 0x7f4c301409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:02.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.897+0000 7f4c34ee2640 1 -- 172.21.15.70:0/2378253066 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c300bb3f0 msgr2=0x7f4c3014a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:02.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.897+0000 7f4c34ee2640 1 --2- 172.21.15.70:0/2378253066 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c300bb3f0 0x7f4c3014a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:02.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.897+0000 7f4c34ee2640 1 -- 172.21.15.70:0/2378253066 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c301539a0 msgr2=0x7f4c301409d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:02.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.897+0000 7f4c34ee2640 1 --2- 172.21.15.70:0/2378253066 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c301539a0 0x7f4c301409d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:02.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.897+0000 7f4c34ee2640 1 -- 172.21.15.70:0/2378253066 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c3014a5f0 con 0x7f4c300bf3b0 2024-05-16T22:27:02.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.897+0000 7f4c34ee2640 1 --2- 172.21.15.70:0/2378253066 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4c300bf3b0 0x7f4c301e5570 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c0015e0 tx=0x7f4c2c001aa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:02.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.897+0000 7f4c25ffb640 1 -- 172.21.15.70:0/2378253066 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c001cf0 con 0x7f4c300bf3b0 2024-05-16T22:27:02.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.897+0000 7f4c25ffb640 1 -- 172.21.15.70:0/2378253066 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c2c00e280 con 0x7f4c300bf3b0 2024-05-16T22:27:02.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.897+0000 7f4c37947640 1 -- 172.21.15.70:0/2378253066 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c301e5ab0 con 0x7f4c300bf3b0 2024-05-16T22:27:02.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.897+0000 7f4c25ffb640 1 -- 172.21.15.70:0/2378253066 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c007350 con 0x7f4c300bf3b0 2024-05-16T22:27:02.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.897+0000 7f4c37947640 1 -- 172.21.15.70:0/2378253066 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c30145d50 con 0x7f4c300bf3b0 2024-05-16T22:27:02.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.897+0000 7f4c25ffb640 1 -- 172.21.15.70:0/2378253066 <== mon.2 v2:172.21.15.70:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4c2c004b70 con 0x7f4c300bf3b0 2024-05-16T22:27:02.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.898+0000 7f4c25ffb640 1 -- 172.21.15.70:0/2378253066 <== mon.2 v2:172.21.15.70:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f4c2c010630 con 0x7f4c300bf3b0 2024-05-16T22:27:02.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.899+0000 7f4c37947640 1 -- 172.21.15.70:0/2378253066 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c30069b50 con 0x7f4c300bf3b0 2024-05-16T22:27:02.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.901+0000 7f4c25ffb640 1 -- 172.21.15.70:0/2378253066 <== mon.2 v2:172.21.15.70:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f4c2c010830 con 0x7f4c300bf3b0 2024-05-16T22:27:02.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.973+0000 7f4c37947640 1 -- 172.21.15.70:0/2378253066 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a7003e89-c706-4562-9f25-670bb35ae108", "id": 0} v 0) -- 0x7f4c30070ac0 con 0x7f4c300bf3b0 2024-05-16T22:27:02.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.976+0000 7f4c25ffb640 1 -- 172.21.15.70:0/2378253066 <== mon.2 v2:172.21.15.70:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a7003e89-c706-4562-9f25-670bb35ae108", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f4c2c010a10 con 0x7f4c300bf3b0 2024-05-16T22:27:02.976 INFO:teuthology.orchestra.run.smithi070.stdout:0 2024-05-16T22:27:02.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.977+0000 7f4c37947640 1 -- 172.21.15.70:0/2378253066 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4c300bf3b0 msgr2=0x7f4c301e5570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:02.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.977+0000 7f4c37947640 1 --2- 172.21.15.70:0/2378253066 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4c300bf3b0 0x7f4c301e5570 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c0015e0 tx=0x7f4c2c001aa0 comp rx=0 tx=0).stop 2024-05-16T22:27:02.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.977+0000 7f4c37947640 1 -- 172.21.15.70:0/2378253066 shutdown_connections 2024-05-16T22:27:02.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.977+0000 7f4c37947640 1 --2- 172.21.15.70:0/2378253066 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4c300bf3b0 0x7f4c301e5570 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:02.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.977+0000 7f4c37947640 1 --2- 172.21.15.70:0/2378253066 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c301539a0 0x7f4c301409d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:02.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.977+0000 7f4c37947640 1 --2- 172.21.15.70:0/2378253066 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c300bb3f0 0x7f4c3014a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:02.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.977+0000 7f4c37947640 1 -- 172.21.15.70:0/2378253066 >> 172.21.15.70:0/2378253066 conn(0x7f4c300bd160 msgr2=0x7f4c3006cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:02.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.978+0000 7f4c37947640 1 -- 172.21.15.70:0/2378253066 shutdown_connections 2024-05-16T22:27:02.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:02.978+0000 7f4c37947640 1 -- 172.21.15.70:0/2378253066 wait complete. 2024-05-16T22:27:02.987 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd new a4d5169d-8327-4494-9c7c-58db21b00636 1 2024-05-16T22:27:03.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.135+0000 7fd420c9a640 1 Processor -- start 2024-05-16T22:27:03.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.135+0000 7fd420c9a640 1 -- start start 2024-05-16T22:27:03.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.136+0000 7fd420c9a640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd41c154a10 0x7fd41c156e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:03.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.136+0000 7fd420c9a640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd41c14bff0 con 0x7fd41c14b0b0 2024-05-16T22:27:03.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.136+0000 7fd420c9a640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd41c0bab00 con 0x7fd41c0b95f0 2024-05-16T22:27:03.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.136+0000 7fd420c9a640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fd41c0bb7f0 con 0x7fd41c154a10 2024-05-16T22:27:03.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.136+0000 7fd413fff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fd41c0b95f0 0x7fd41c0b7ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:46314/0 (socket says 172.21.15.70:46314) 2024-05-16T22:27:03.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.136+0000 7fd413fff640 1 -- 172.21.15.70:0/3208848193 learned_addr learned my addr 172.21.15.70:0/3208848193 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-16T22:27:03.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.136+0000 7fd41ad9d640 1 --2- 172.21.15.70:0/3208848193 >> v2:172.21.15.44:3300/0 conn(0x7fd41c154a10 0x7fd41c156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:03.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.136+0000 7fd419d9b640 1 -- 172.21.15.70:0/3208848193 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3481064885 0 0) 0x7fd41c0bab00 con 0x7fd41c0b95f0 2024-05-16T22:27:03.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.136+0000 7fd419d9b640 1 -- 172.21.15.70:0/3208848193 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd408003520 con 0x7fd41c0b95f0 2024-05-16T22:27:03.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.136+0000 7fd419d9b640 1 -- 172.21.15.70:0/3208848193 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3328925444 0 0) 0x7fd41c14bff0 con 0x7fd41c14b0b0 2024-05-16T22:27:03.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.136+0000 7fd419d9b640 1 -- 172.21.15.70:0/3208848193 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd41c0bab00 con 0x7fd41c14b0b0 2024-05-16T22:27:03.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.136+0000 7fd419d9b640 1 -- 172.21.15.70:0/3208848193 <== mon.1 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3621790792 0 0) 0x7fd408003520 con 0x7fd41c0b95f0 2024-05-16T22:27:03.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.136+0000 7fd41ad9d640 1 -- 172.21.15.70:0/3208848193 >> v1:172.21.15.70:6789/0 conn(0x7fd41c0b95f0 legacy=0x7fd41c0b7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:03.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.136+0000 7fd41ad9d640 1 -- 172.21.15.70:0/3208848193 >> v1:172.21.15.44:6789/0 conn(0x7fd41c14b0b0 legacy=0x7fd41c0bbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:03.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.136+0000 7fd41ad9d640 1 -- 172.21.15.70:0/3208848193 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd41c0b81f0 con 0x7fd41c154a10 2024-05-16T22:27:03.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.137+0000 7fd41ad9d640 1 --2- 172.21.15.70:0/3208848193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd41c154a10 0x7fd41c156e30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd414009d90 tx=0x7fd41402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2722c04618a7f91 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:03.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.137+0000 7fd419d9b640 1 -- 172.21.15.70:0/3208848193 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4040016f0 con 0x7fd41c154a10 2024-05-16T22:27:03.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.137+0000 7fd419d9b640 1 -- 172.21.15.70:0/3208848193 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd414007540 con 0x7fd41c154a10 2024-05-16T22:27:03.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.137+0000 7fd419d9b640 1 -- 172.21.15.70:0/3208848193 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd414007710 con 0x7fd41c154a10 2024-05-16T22:27:03.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.138+0000 7fd420c9a640 1 -- 172.21.15.70:0/3208848193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd41c154a10 msgr2=0x7fd41c156e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:03.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.138+0000 7fd420c9a640 1 --2- 172.21.15.70:0/3208848193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd41c154a10 0x7fd41c156e30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd414009d90 tx=0x7fd41402a6a0 comp rx=0 tx=0).stop 2024-05-16T22:27:03.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.138+0000 7fd420c9a640 1 -- 172.21.15.70:0/3208848193 shutdown_connections 2024-05-16T22:27:03.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.138+0000 7fd420c9a640 1 --2- 172.21.15.70:0/3208848193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd41c154a10 0x7fd41c156e30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:03.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.138+0000 7fd420c9a640 1 -- 172.21.15.70:0/3208848193 >> 172.21.15.70:0/3208848193 conn(0x7fd41c06e220 msgr2=0x7fd41c0c05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:03.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.138+0000 7fd420c9a640 1 -- 172.21.15.70:0/3208848193 shutdown_connections 2024-05-16T22:27:03.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.138+0000 7fd420c9a640 1 -- 172.21.15.70:0/3208848193 wait complete. 2024-05-16T22:27:03.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.140+0000 7fd420c9a640 1 Processor -- start 2024-05-16T22:27:03.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.140+0000 7fd420c9a640 1 -- start start 2024-05-16T22:27:03.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.141+0000 7fd420c9a640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd41c0b95f0 0x7fd41c1e2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:03.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.141+0000 7fd420c9a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd41c14b0b0 0x7fd41c14c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:03.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.141+0000 7fd420c9a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd41c154a10 0x7fd41c13c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:03.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.141+0000 7fd420c9a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd41c1457a0 con 0x7fd41c14b0b0 2024-05-16T22:27:03.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.141+0000 7fd420c9a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd41c0b9ed0 con 0x7fd41c154a10 2024-05-16T22:27:03.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.141+0000 7fd420c9a640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fd41c0bafe0 con 0x7fd41c0b95f0 2024-05-16T22:27:03.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.141+0000 7fd41a59c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd41c0b95f0 0x7fd41c1e2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:03.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.141+0000 7fd41a59c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd41c0b95f0 0x7fd41c1e2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.70:54908/0 (socket says 172.21.15.70:54908) 2024-05-16T22:27:03.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.141+0000 7fd41ad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd41c154a10 0x7fd41c13c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:03.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.141+0000 7fd41a59c640 1 -- 172.21.15.70:0/3558444855 learned_addr learned my addr 172.21.15.70:0/3558444855 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-16T22:27:03.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.141+0000 7fd413fff640 1 --2- 172.21.15.70:0/3558444855 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd41c14b0b0 0x7fd41c14c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:03.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.141+0000 7fd41a59c640 1 -- 172.21.15.70:0/3558444855 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd41c154a10 msgr2=0x7fd41c13c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:03.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.141+0000 7fd41a59c640 1 --2- 172.21.15.70:0/3558444855 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd41c154a10 0x7fd41c13c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:03.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.141+0000 7fd41a59c640 1 -- 172.21.15.70:0/3558444855 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd41c14b0b0 msgr2=0x7fd41c14c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:03.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.141+0000 7fd41a59c640 1 --2- 172.21.15.70:0/3558444855 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd41c14b0b0 0x7fd41c14c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:03.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.141+0000 7fd41a59c640 1 -- 172.21.15.70:0/3558444855 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd41c142830 con 0x7fd41c0b95f0 2024-05-16T22:27:03.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.141+0000 7fd41ad9d640 1 --2- 172.21.15.70:0/3558444855 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd41c154a10 0x7fd41c13c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:27:03.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.142+0000 7fd41a59c640 1 --2- 172.21.15.70:0/3558444855 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd41c0b95f0 0x7fd41c1e2780 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd40c00c430 tx=0x7fd40c00c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:03.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.142+0000 7fd412ffd640 1 -- 172.21.15.70:0/3558444855 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd40c017070 con 0x7fd41c0b95f0 2024-05-16T22:27:03.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.142+0000 7fd412ffd640 1 -- 172.21.15.70:0/3558444855 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd40c0052f0 con 0x7fd41c0b95f0 2024-05-16T22:27:03.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.142+0000 7fd420c9a640 1 -- 172.21.15.70:0/3558444855 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd41c14dc50 con 0x7fd41c0b95f0 2024-05-16T22:27:03.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.142+0000 7fd412ffd640 1 -- 172.21.15.70:0/3558444855 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd40c003830 con 0x7fd41c0b95f0 2024-05-16T22:27:03.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.142+0000 7fd420c9a640 1 -- 172.21.15.70:0/3558444855 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd41c141730 con 0x7fd41c0b95f0 2024-05-16T22:27:03.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.142+0000 7fd412ffd640 1 -- 172.21.15.70:0/3558444855 <== mon.2 v2:172.21.15.70:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd40c01a070 con 0x7fd41c0b95f0 2024-05-16T22:27:03.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.142+0000 7fd412ffd640 1 -- 172.21.15.70:0/3558444855 <== mon.2 v2:172.21.15.70:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fd40c011bb0 con 0x7fd41c0b95f0 2024-05-16T22:27:03.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.143+0000 7fd420c9a640 1 -- 172.21.15.70:0/3558444855 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd41c14ae70 con 0x7fd41c0b95f0 2024-05-16T22:27:03.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.145+0000 7fd412ffd640 1 -- 172.21.15.70:0/3558444855 <== mon.2 v2:172.21.15.70:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fd41c14ae70 con 0x7fd41c0b95f0 2024-05-16T22:27:03.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.218+0000 7fd420c9a640 1 -- 172.21.15.70:0/3558444855 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a4d5169d-8327-4494-9c7c-58db21b00636", "id": 1} v 0) -- 0x7fd41c074930 con 0x7fd41c0b95f0 2024-05-16T22:27:03.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.221+0000 7fd412ffd640 1 -- 172.21.15.70:0/3558444855 <== mon.2 v2:172.21.15.70:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a4d5169d-8327-4494-9c7c-58db21b00636", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fd41c074930 con 0x7fd41c0b95f0 2024-05-16T22:27:03.220 INFO:teuthology.orchestra.run.smithi070.stdout:1 2024-05-16T22:27:03.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.222+0000 7fd420c9a640 1 -- 172.21.15.70:0/3558444855 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd41c0b95f0 msgr2=0x7fd41c1e2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:03.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.222+0000 7fd420c9a640 1 --2- 172.21.15.70:0/3558444855 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd41c0b95f0 0x7fd41c1e2780 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd40c00c430 tx=0x7fd40c00c8f0 comp rx=0 tx=0).stop 2024-05-16T22:27:03.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.222+0000 7fd420c9a640 1 -- 172.21.15.70:0/3558444855 shutdown_connections 2024-05-16T22:27:03.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.222+0000 7fd420c9a640 1 --2- 172.21.15.70:0/3558444855 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd41c154a10 0x7fd41c13c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:03.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.222+0000 7fd420c9a640 1 --2- 172.21.15.70:0/3558444855 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd41c14b0b0 0x7fd41c14c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:03.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.222+0000 7fd420c9a640 1 --2- 172.21.15.70:0/3558444855 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd41c0b95f0 0x7fd41c1e2780 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:03.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.222+0000 7fd420c9a640 1 -- 172.21.15.70:0/3558444855 >> 172.21.15.70:0/3558444855 conn(0x7fd41c06e220 msgr2=0x7fd41c0ba290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:03.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.222+0000 7fd420c9a640 1 -- 172.21.15.70:0/3558444855 shutdown_connections 2024-05-16T22:27:03.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.222+0000 7fd420c9a640 1 -- 172.21.15.70:0/3558444855 wait complete. 2024-05-16T22:27:03.233 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd new d4a834f8-83a5-400f-9814-eb0a25124df4 2 2024-05-16T22:27:03.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.341+0000 7f7551da8640 1 Processor -- start 2024-05-16T22:27:03.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.341+0000 7f7551da8640 1 -- start start 2024-05-16T22:27:03.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.342+0000 7f7551da8640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f754c0bc690 0x7f754c148860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:03.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.342+0000 7f7551da8640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f754c0bbf10 con 0x7f754c0b5bc0 2024-05-16T22:27:03.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.342+0000 7f7551da8640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f754c0bc1f0 con 0x7f754c06d6f0 2024-05-16T22:27:03.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.342+0000 7f7551da8640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f754c0a2d70 con 0x7f754c0bc690 2024-05-16T22:27:03.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.342+0000 7f7543fff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f754c0bc690 0x7f754c148860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:03.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.342+0000 7f7543fff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f754c0bc690 0x7f754c148860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39098/0 (socket says 172.21.15.70:39098) 2024-05-16T22:27:03.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.342+0000 7f7543fff640 1 -- 172.21.15.70:0/3831063936 learned_addr learned my addr 172.21.15.70:0/3831063936 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-16T22:27:03.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.342+0000 7f754bfff640 1 --1- 172.21.15.70:0/3831063936 >> v1:172.21.15.70:6789/0 conn(0x7f754c06d6f0 0x7f754c155ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:46318/0 (socket says 172.21.15.70:46318) 2024-05-16T22:27:03.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.342+0000 7f7543fff640 1 -- 172.21.15.70:0/3831063936 >> v1:172.21.15.70:6789/0 conn(0x7f754c06d6f0 legacy=0x7f754c155ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:03.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.342+0000 7f7543fff640 1 -- 172.21.15.70:0/3831063936 >> v1:172.21.15.44:6789/0 conn(0x7f754c0b5bc0 legacy=0x7f754c14bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:03.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.342+0000 7f7543fff640 1 -- 172.21.15.70:0/3831063936 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f754c14b410 con 0x7f754c0bc690 2024-05-16T22:27:03.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.343+0000 7f7543fff640 1 --2- 172.21.15.70:0/3831063936 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f754c0bc690 0x7f754c148860 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7534009870 tx=0x7f753402a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c40b1a5a59c5f27 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:03.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.343+0000 7f754affd640 1 -- 172.21.15.70:0/3831063936 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7534037070 con 0x7f754c0bc690 2024-05-16T22:27:03.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.343+0000 7f754affd640 1 -- 172.21.15.70:0/3831063936 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f753402ae50 con 0x7f754c0bc690 2024-05-16T22:27:03.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.343+0000 7f754affd640 1 -- 172.21.15.70:0/3831063936 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7534032860 con 0x7f754c0bc690 2024-05-16T22:27:03.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.344+0000 7f7551da8640 1 -- 172.21.15.70:0/3831063936 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f754c0bc690 msgr2=0x7f754c148860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:03.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.344+0000 7f7551da8640 1 --2- 172.21.15.70:0/3831063936 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f754c0bc690 0x7f754c148860 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7534009870 tx=0x7f753402a300 comp rx=0 tx=0).stop 2024-05-16T22:27:03.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.344+0000 7f7551da8640 1 -- 172.21.15.70:0/3831063936 shutdown_connections 2024-05-16T22:27:03.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.344+0000 7f7551da8640 1 --2- 172.21.15.70:0/3831063936 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f754c0bc690 0x7f754c148860 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:03.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.344+0000 7f7551da8640 1 -- 172.21.15.70:0/3831063936 >> 172.21.15.70:0/3831063936 conn(0x7f754c06f280 msgr2=0x7f754c06f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:03.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.344+0000 7f7551da8640 1 -- 172.21.15.70:0/3831063936 shutdown_connections 2024-05-16T22:27:03.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.344+0000 7f7551da8640 1 -- 172.21.15.70:0/3831063936 wait complete. 2024-05-16T22:27:03.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.345+0000 7f7551da8640 1 Processor -- start 2024-05-16T22:27:03.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.345+0000 7f7551da8640 1 -- start start 2024-05-16T22:27:03.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.346+0000 7f7551da8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f754c06d6f0 0x7f754c0b9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:03.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.346+0000 7f7551da8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f754c0b5bc0 0x7f754c145290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:03.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.346+0000 7f7551da8640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f754c0bc690 0x7f754c1457d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:03.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.346+0000 7f7551da8640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f754c0bbba0 con 0x7f754c06d6f0 2024-05-16T22:27:03.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.346+0000 7f7551da8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f754c148da0 con 0x7f754c0b5bc0 2024-05-16T22:27:03.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.346+0000 7f7551da8640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f754c0b5370 con 0x7f754c0bc690 2024-05-16T22:27:03.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.346+0000 7f7543fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f754c0b5bc0 0x7f754c145290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:03.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.346+0000 7f7543fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f754c0b5bc0 0x7f754c145290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39112/0 (socket says 172.21.15.70:39112) 2024-05-16T22:27:03.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.346+0000 7f7543fff640 1 -- 172.21.15.70:0/2546747486 learned_addr learned my addr 172.21.15.70:0/2546747486 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-16T22:27:03.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.346+0000 7f754bfff640 1 --2- 172.21.15.70:0/2546747486 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f754c0bc690 0x7f754c1457d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:03.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.347+0000 7f754b7fe640 1 --2- 172.21.15.70:0/2546747486 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f754c06d6f0 0x7f754c0b9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:03.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.347+0000 7f7543fff640 1 -- 172.21.15.70:0/2546747486 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f754c0bc690 msgr2=0x7f754c1457d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:03.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.347+0000 7f7543fff640 1 --2- 172.21.15.70:0/2546747486 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f754c0bc690 0x7f754c1457d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:03.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.347+0000 7f7543fff640 1 -- 172.21.15.70:0/2546747486 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f754c06d6f0 msgr2=0x7f754c0b9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:03.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.347+0000 7f7543fff640 1 --2- 172.21.15.70:0/2546747486 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f754c06d6f0 0x7f754c0b9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:03.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.347+0000 7f7543fff640 1 -- 172.21.15.70:0/2546747486 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f754c0ba2a0 con 0x7f754c0b5bc0 2024-05-16T22:27:03.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.347+0000 7f754bfff640 1 --2- 172.21.15.70:0/2546747486 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f754c0bc690 0x7f754c1457d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:27:03.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.347+0000 7f7543fff640 1 --2- 172.21.15.70:0/2546747486 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f754c0b5bc0 0x7f754c145290 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7534000c00 tx=0x7f75340046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:03.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.347+0000 7f7548ff9640 1 -- 172.21.15.70:0/2546747486 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7534041070 con 0x7f754c0b5bc0 2024-05-16T22:27:03.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.347+0000 7f7548ff9640 1 -- 172.21.15.70:0/2546747486 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f753403c890 con 0x7f754c0b5bc0 2024-05-16T22:27:03.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.347+0000 7f7548ff9640 1 -- 172.21.15.70:0/2546747486 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7534037040 con 0x7f754c0b5bc0 2024-05-16T22:27:03.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.347+0000 7f7551da8640 1 -- 172.21.15.70:0/2546747486 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f754c0b7cd0 con 0x7f754c0b5bc0 2024-05-16T22:27:03.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.347+0000 7f7551da8640 1 -- 172.21.15.70:0/2546747486 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f754c1d4a90 con 0x7f754c0b5bc0 2024-05-16T22:27:03.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.347+0000 7f7548ff9640 1 -- 172.21.15.70:0/2546747486 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7534044070 con 0x7f754c0b5bc0 2024-05-16T22:27:03.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.347+0000 7f7548ff9640 1 -- 172.21.15.70:0/2546747486 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f7534046c00 con 0x7f754c0b5bc0 2024-05-16T22:27:03.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.348+0000 7f7551da8640 1 -- 172.21.15.70:0/2546747486 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f754c145d10 con 0x7f754c0b5bc0 2024-05-16T22:27:03.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.351+0000 7f7548ff9640 1 -- 172.21.15.70:0/2546747486 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f754c0ba2a0 con 0x7f754c0b5bc0 2024-05-16T22:27:03.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.422+0000 7f7551da8640 1 -- 172.21.15.70:0/2546747486 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d4a834f8-83a5-400f-9814-eb0a25124df4", "id": 2} v 0) -- 0x7f754c069b50 con 0x7f754c0b5bc0 2024-05-16T22:27:03.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.429+0000 7f7548ff9640 1 -- 172.21.15.70:0/2546747486 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d4a834f8-83a5-400f-9814-eb0a25124df4", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f753403cc80 con 0x7f754c0b5bc0 2024-05-16T22:27:03.428 INFO:teuthology.orchestra.run.smithi070.stdout:2 2024-05-16T22:27:03.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.429+0000 7f7551da8640 1 -- 172.21.15.70:0/2546747486 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f754c0b5bc0 msgr2=0x7f754c145290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:03.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.429+0000 7f7551da8640 1 --2- 172.21.15.70:0/2546747486 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f754c0b5bc0 0x7f754c145290 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7534000c00 tx=0x7f75340046c0 comp rx=0 tx=0).stop 2024-05-16T22:27:03.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.429+0000 7f7551da8640 1 -- 172.21.15.70:0/2546747486 shutdown_connections 2024-05-16T22:27:03.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.429+0000 7f7551da8640 1 --2- 172.21.15.70:0/2546747486 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f754c0bc690 0x7f754c1457d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:03.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.429+0000 7f7551da8640 1 --2- 172.21.15.70:0/2546747486 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f754c0b5bc0 0x7f754c145290 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:03.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.429+0000 7f7551da8640 1 --2- 172.21.15.70:0/2546747486 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f754c06d6f0 0x7f754c0b9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:03.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.430+0000 7f7551da8640 1 -- 172.21.15.70:0/2546747486 >> 172.21.15.70:0/2546747486 conn(0x7f754c06f280 msgr2=0x7f754c146390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:03.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.430+0000 7f7551da8640 1 -- 172.21.15.70:0/2546747486 shutdown_connections 2024-05-16T22:27:03.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.430+0000 7f7551da8640 1 -- 172.21.15.70:0/2546747486 wait complete. 2024-05-16T22:27:03.440 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd new b9d24a56-ad43-4674-a395-5ec24d135ae8 3 2024-05-16T22:27:03.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.548+0000 7f8756d1f640 1 Processor -- start 2024-05-16T22:27:03.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.548+0000 7f8756d1f640 1 -- start start 2024-05-16T22:27:03.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.549+0000 7f8756d1f640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8750074590 0x7f87500bc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:03.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.549+0000 7f8756d1f640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87500bc9b0 con 0x7f8750151bf0 2024-05-16T22:27:03.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.549+0000 7f8756d1f640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f875006de00 con 0x7f87500b6890 2024-05-16T22:27:03.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.549+0000 7f8756d1f640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f87500749a0 con 0x7f8750074590 2024-05-16T22:27:03.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.549+0000 7f874ffff640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8750074590 0x7f87500bc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:03.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.549+0000 7f8754abb640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f87500b6890 0x7f875006d6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:46324/0 (socket says 172.21.15.70:46324) 2024-05-16T22:27:03.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.549+0000 7f8754abb640 1 -- 172.21.15.70:0/1059160109 learned_addr learned my addr 172.21.15.70:0/1059160109 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-16T22:27:03.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.549+0000 7f874f7fe640 1 -- 172.21.15.70:0/1059160109 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1642814292 0 0) 0x7f8744001110 con 0x7f87500b6890 2024-05-16T22:27:03.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.549+0000 7f874ffff640 1 -- 172.21.15.70:0/1059160109 >> v1:172.21.15.70:6789/0 conn(0x7f87500b6890 legacy=0x7f875006d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:03.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.549+0000 7f874ffff640 1 -- 172.21.15.70:0/1059160109 >> v1:172.21.15.44:6789/0 conn(0x7f8750151bf0 legacy=0x7f8750152000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:03.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.549+0000 7f874ffff640 1 -- 172.21.15.70:0/1059160109 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8750072b40 con 0x7f8750074590 2024-05-16T22:27:03.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.550+0000 7f874ffff640 1 --2- 172.21.15.70:0/1059160109 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8750074590 0x7f87500bc310 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f873c0097d0 tx=0x7f873c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e02c48a17611691 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:03.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.550+0000 7f874f7fe640 1 -- 172.21.15.70:0/1059160109 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873c037070 con 0x7f8750074590 2024-05-16T22:27:03.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.550+0000 7f874f7fe640 1 -- 172.21.15.70:0/1059160109 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f873c032440 con 0x7f8750074590 2024-05-16T22:27:03.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.550+0000 7f874f7fe640 1 -- 172.21.15.70:0/1059160109 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873c032810 con 0x7f8750074590 2024-05-16T22:27:03.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.551+0000 7f8756d1f640 1 -- 172.21.15.70:0/1059160109 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8750074590 msgr2=0x7f87500bc310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:03.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.551+0000 7f8756d1f640 1 --2- 172.21.15.70:0/1059160109 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8750074590 0x7f87500bc310 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f873c0097d0 tx=0x7f873c02a210 comp rx=0 tx=0).stop 2024-05-16T22:27:03.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.551+0000 7f8756d1f640 1 -- 172.21.15.70:0/1059160109 shutdown_connections 2024-05-16T22:27:03.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.551+0000 7f8756d1f640 1 --2- 172.21.15.70:0/1059160109 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8750074590 0x7f87500bc310 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:03.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.551+0000 7f8756d1f640 1 -- 172.21.15.70:0/1059160109 >> 172.21.15.70:0/1059160109 conn(0x7f875006f280 msgr2=0x7f875006f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:03.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.551+0000 7f8756d1f640 1 -- 172.21.15.70:0/1059160109 shutdown_connections 2024-05-16T22:27:03.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.551+0000 7f8756d1f640 1 -- 172.21.15.70:0/1059160109 wait complete. 2024-05-16T22:27:03.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.552+0000 7f8756d1f640 1 Processor -- start 2024-05-16T22:27:03.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.552+0000 7f8756d1f640 1 -- start start 2024-05-16T22:27:03.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.554+0000 7f8756d1f640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8750074590 0x7f875014acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:03.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.554+0000 7f8756d1f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87500b6890 0x7f87501e4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:03.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.554+0000 7f8756d1f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8750151bf0 0x7f87501475e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:03.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.554+0000 7f8756d1f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8750159e90 con 0x7f8750151bf0 2024-05-16T22:27:03.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.554+0000 7f8756d1f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8750073190 con 0x7f87500b6890 2024-05-16T22:27:03.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.554+0000 7f8756d1f640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f875015a010 con 0x7f8750074590 2024-05-16T22:27:03.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.554+0000 7f8754abb640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8750074590 0x7f875014acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:03.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.554+0000 7f874ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87500b6890 0x7f87501e4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:03.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.554+0000 7f8754abb640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8750074590 0x7f875014acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.70:54944/0 (socket says 172.21.15.70:54944) 2024-05-16T22:27:03.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.554+0000 7f874ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87500b6890 0x7f87501e4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39118/0 (socket says 172.21.15.70:39118) 2024-05-16T22:27:03.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.554+0000 7f8754abb640 1 -- 172.21.15.70:0/1849022708 learned_addr learned my addr 172.21.15.70:0/1849022708 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-16T22:27:03.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.554+0000 7f87552bc640 1 --2- 172.21.15.70:0/1849022708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8750151bf0 0x7f87501475e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:03.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.554+0000 7f8754abb640 1 -- 172.21.15.70:0/1849022708 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87500b6890 msgr2=0x7f87501e4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:03.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.554+0000 7f8754abb640 1 --2- 172.21.15.70:0/1849022708 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87500b6890 0x7f87501e4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:03.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.554+0000 7f8754abb640 1 -- 172.21.15.70:0/1849022708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8750151bf0 msgr2=0x7f87501475e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:03.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.554+0000 7f8754abb640 1 --2- 172.21.15.70:0/1849022708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8750151bf0 0x7f87501475e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:03.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.554+0000 7f8754abb640 1 -- 172.21.15.70:0/1849022708 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f875014b1f0 con 0x7f8750074590 2024-05-16T22:27:03.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.554+0000 7f874ffff640 1 --2- 172.21.15.70:0/1849022708 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87500b6890 0x7f87501e4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:27:03.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.554+0000 7f87552bc640 1 --2- 172.21.15.70:0/1849022708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8750151bf0 0x7f87501475e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:27:03.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.554+0000 7f8754abb640 1 --2- 172.21.15.70:0/1849022708 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8750074590 0x7f875014acb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f874400c3d0 tx=0x7f874400c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:03.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.554+0000 7f874d7fa640 1 -- 172.21.15.70:0/1849022708 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87440074e0 con 0x7f8750074590 2024-05-16T22:27:03.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.554+0000 7f874d7fa640 1 -- 172.21.15.70:0/1849022708 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87440047e0 con 0x7f8750074590 2024-05-16T22:27:03.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.554+0000 7f8756d1f640 1 -- 172.21.15.70:0/1849022708 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87501e4d80 con 0x7f8750074590 2024-05-16T22:27:03.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.554+0000 7f874d7fa640 1 -- 172.21.15.70:0/1849022708 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8744004c10 con 0x7f8750074590 2024-05-16T22:27:03.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.555+0000 7f8756d1f640 1 -- 172.21.15.70:0/1849022708 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f875014db50 con 0x7f8750074590 2024-05-16T22:27:03.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.555+0000 7f874d7fa640 1 -- 172.21.15.70:0/1849022708 <== mon.2 v2:172.21.15.70:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8744011070 con 0x7f8750074590 2024-05-16T22:27:03.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.555+0000 7f874d7fa640 1 -- 172.21.15.70:0/1849022708 <== mon.2 v2:172.21.15.70:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f8744013850 con 0x7f8750074590 2024-05-16T22:27:03.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.555+0000 7f8756d1f640 1 -- 172.21.15.70:0/1849022708 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8750069b50 con 0x7f8750074590 2024-05-16T22:27:03.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.558+0000 7f874d7fa640 1 -- 172.21.15.70:0/1849022708 <== mon.2 v2:172.21.15.70:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f875006de00 con 0x7f8750074590 2024-05-16T22:27:03.604 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-05-16T22:27:03.605+0000 7f5ed2b17040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-16T22:27:03.605 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-16T22:27:03.606+0000 7fba1451c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-16T22:27:03.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.628+0000 7f8756d1f640 1 -- 172.21.15.70:0/1849022708 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b9d24a56-ad43-4674-a395-5ec24d135ae8", "id": 3} v 0) -- 0x7f875014e9b0 con 0x7f8750074590 2024-05-16T22:27:03.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.633+0000 7f874d7fa640 1 -- 172.21.15.70:0/1849022708 <== mon.2 v2:172.21.15.70:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b9d24a56-ad43-4674-a395-5ec24d135ae8", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f87440133c0 con 0x7f8750074590 2024-05-16T22:27:03.633 INFO:teuthology.orchestra.run.smithi070.stdout:3 2024-05-16T22:27:03.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.634+0000 7f8756d1f640 1 -- 172.21.15.70:0/1849022708 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8750074590 msgr2=0x7f875014acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:03.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.634+0000 7f8756d1f640 1 --2- 172.21.15.70:0/1849022708 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8750074590 0x7f875014acb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f874400c3d0 tx=0x7f874400c890 comp rx=0 tx=0).stop 2024-05-16T22:27:03.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.634+0000 7f8756d1f640 1 -- 172.21.15.70:0/1849022708 shutdown_connections 2024-05-16T22:27:03.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.634+0000 7f8756d1f640 1 --2- 172.21.15.70:0/1849022708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8750151bf0 0x7f87501475e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:03.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.634+0000 7f8756d1f640 1 --2- 172.21.15.70:0/1849022708 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87500b6890 0x7f87501e4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:03.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.634+0000 7f8756d1f640 1 --2- 172.21.15.70:0/1849022708 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8750074590 0x7f875014acb0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:03.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.634+0000 7f8756d1f640 1 -- 172.21.15.70:0/1849022708 >> 172.21.15.70:0/1849022708 conn(0x7f875006f280 msgr2=0x7f875006c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:03.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.634+0000 7f8756d1f640 1 -- 172.21.15.70:0/1849022708 shutdown_connections 2024-05-16T22:27:03.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.634+0000 7f8756d1f640 1 -- 172.21.15.70:0/1849022708 wait complete. 2024-05-16T22:27:03.644 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd new 9bd94af5-3e17-4cbe-995a-8f837a66c653 4 2024-05-16T22:27:03.697 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-05-16T22:27:03.698+0000 7f5ed2b17040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-16T22:27:03.698 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-16T22:27:03.699+0000 7fba1451c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-16T22:27:03.742 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-05-16T22:27:03.743+0000 7f5ed2b17040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-16T22:27:03.744 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-16T22:27:03.745+0000 7fba1451c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-16T22:27:03.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.753+0000 7f585477e640 1 Processor -- start 2024-05-16T22:27:03.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.753+0000 7f585477e640 1 -- start start 2024-05-16T22:27:03.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.754+0000 7f585477e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f584c148680 0x7f584c151f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:03.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.754+0000 7f585477e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f584c152440 0x7f584c158c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:03.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.754+0000 7f585477e640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f584c06de00 con 0x7f584c0bc360 2024-05-16T22:27:03.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.754+0000 7f585477e640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f584c151a70 con 0x7f584c152440 2024-05-16T22:27:03.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.754+0000 7f585477e640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f584c148a90 con 0x7f584c148680 2024-05-16T22:27:03.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.754+0000 7f5851d19640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f584c148680 0x7f584c151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:03.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.754+0000 7f5851d19640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f584c148680 0x7f584c151f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39130/0 (socket says 172.21.15.70:39130) 2024-05-16T22:27:03.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.754+0000 7f5851d19640 1 -- 172.21.15.70:0/3991938225 learned_addr learned my addr 172.21.15.70:0/3991938225 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-16T22:27:03.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.754+0000 7f5852d1b640 1 --2- 172.21.15.70:0/3991938225 >> v2:172.21.15.44:3300/0 conn(0x7f584c152440 0x7f584c158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:03.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.754+0000 7f5851d19640 1 -- 172.21.15.70:0/3991938225 >> v2:172.21.15.44:3300/0 conn(0x7f584c152440 msgr2=0x7f584c158c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:03.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.754+0000 7f5851d19640 1 --2- 172.21.15.70:0/3991938225 >> v2:172.21.15.44:3300/0 conn(0x7f584c152440 0x7f584c158c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:03.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.754+0000 7f5851d19640 1 -- 172.21.15.70:0/3991938225 >> v1:172.21.15.44:6789/0 conn(0x7f584c0bc360 legacy=0x7f584c06d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:03.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.754+0000 7f5851d19640 1 -- 172.21.15.70:0/3991938225 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f584c073600 con 0x7f584c148680 2024-05-16T22:27:03.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.755+0000 7f5851d19640 1 --2- 172.21.15.70:0/3991938225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f584c148680 0x7f584c151f00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f584c14bf30 tx=0x7f584802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e6411955dedecb9 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:03.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.755+0000 7f5851518640 1 -- 172.21.15.70:0/3991938225 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5848037070 con 0x7f584c148680 2024-05-16T22:27:03.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.755+0000 7f5851518640 1 -- 172.21.15.70:0/3991938225 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5848032440 con 0x7f584c148680 2024-05-16T22:27:03.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.755+0000 7f5851518640 1 -- 172.21.15.70:0/3991938225 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5848032810 con 0x7f584c148680 2024-05-16T22:27:03.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.756+0000 7f585477e640 1 -- 172.21.15.70:0/3991938225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f584c148680 msgr2=0x7f584c151f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:03.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.756+0000 7f585477e640 1 --2- 172.21.15.70:0/3991938225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f584c148680 0x7f584c151f00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f584c14bf30 tx=0x7f584802a270 comp rx=0 tx=0).stop 2024-05-16T22:27:03.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.756+0000 7f585477e640 1 -- 172.21.15.70:0/3991938225 shutdown_connections 2024-05-16T22:27:03.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.756+0000 7f585477e640 1 --2- 172.21.15.70:0/3991938225 >> v2:172.21.15.44:3300/0 conn(0x7f584c152440 0x7f584c158c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:03.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.756+0000 7f585477e640 1 --2- 172.21.15.70:0/3991938225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f584c148680 0x7f584c151f00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:03.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.756+0000 7f585477e640 1 -- 172.21.15.70:0/3991938225 >> 172.21.15.70:0/3991938225 conn(0x7f584c06f390 msgr2=0x7f584c06f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:03.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.756+0000 7f585477e640 1 -- 172.21.15.70:0/3991938225 shutdown_connections 2024-05-16T22:27:03.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.756+0000 7f585477e640 1 -- 172.21.15.70:0/3991938225 wait complete. 2024-05-16T22:27:03.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.758+0000 7f585477e640 1 Processor -- start 2024-05-16T22:27:03.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.758+0000 7f585477e640 1 -- start start 2024-05-16T22:27:03.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.759+0000 7f585477e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f584c0bc360 0x7f584c0a20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:03.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.759+0000 7f585477e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f584c148680 0x7f584c1e4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:03.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.759+0000 7f585477e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f584c152440 0x7f584c1472a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:03.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.759+0000 7f585477e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f584c074660 con 0x7f584c148680 2024-05-16T22:27:03.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.759+0000 7f585477e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f584c073bc0 con 0x7f584c152440 2024-05-16T22:27:03.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.759+0000 7f585477e640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f584c073ea0 con 0x7f584c0bc360 2024-05-16T22:27:03.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.759+0000 7f5852d1b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f584c152440 0x7f584c1472a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:03.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.759+0000 7f585251a640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f584c0bc360 0x7f584c0a20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:03.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.759+0000 7f5852d1b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f584c152440 0x7f584c1472a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39136/0 (socket says 172.21.15.70:39136) 2024-05-16T22:27:03.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.759+0000 7f5852d1b640 1 -- 172.21.15.70:0/2946638556 learned_addr learned my addr 172.21.15.70:0/2946638556 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-16T22:27:03.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.759+0000 7f5851d19640 1 --2- 172.21.15.70:0/2946638556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f584c148680 0x7f584c1e4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:03.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.759+0000 7f5852d1b640 1 -- 172.21.15.70:0/2946638556 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f584c0bc360 msgr2=0x7f584c0a20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:03.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.759+0000 7f5852d1b640 1 --2- 172.21.15.70:0/2946638556 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f584c0bc360 0x7f584c0a20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:03.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.759+0000 7f5852d1b640 1 -- 172.21.15.70:0/2946638556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f584c148680 msgr2=0x7f584c1e4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:03.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.759+0000 7f5852d1b640 1 --2- 172.21.15.70:0/2946638556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f584c148680 0x7f584c1e4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:03.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.759+0000 7f5852d1b640 1 -- 172.21.15.70:0/2946638556 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f584c0a2630 con 0x7f584c152440 2024-05-16T22:27:03.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.759+0000 7f5852d1b640 1 --2- 172.21.15.70:0/2946638556 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f584c152440 0x7f584c1472a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5844009d30 tx=0x7f584400c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:03.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.759+0000 7f5842ffd640 1 -- 172.21.15.70:0/2946638556 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5844018020 con 0x7f584c152440 2024-05-16T22:27:03.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.759+0000 7f5842ffd640 1 -- 172.21.15.70:0/2946638556 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5844014480 con 0x7f584c152440 2024-05-16T22:27:03.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.759+0000 7f585477e640 1 -- 172.21.15.70:0/2946638556 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f584c1e50b0 con 0x7f584c152440 2024-05-16T22:27:03.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.760+0000 7f5842ffd640 1 -- 172.21.15.70:0/2946638556 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5844014870 con 0x7f584c152440 2024-05-16T22:27:03.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.760+0000 7f585477e640 1 -- 172.21.15.70:0/2946638556 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f584c0a0ae0 con 0x7f584c152440 2024-05-16T22:27:03.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.760+0000 7f5842ffd640 1 -- 172.21.15.70:0/2946638556 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5844005d10 con 0x7f584c152440 2024-05-16T22:27:03.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.760+0000 7f5842ffd640 1 -- 172.21.15.70:0/2946638556 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f58440138f0 con 0x7f584c152440 2024-05-16T22:27:03.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.761+0000 7f585477e640 1 -- 172.21.15.70:0/2946638556 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f584c069b50 con 0x7f584c152440 2024-05-16T22:27:03.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.763+0000 7f5842ffd640 1 -- 172.21.15.70:0/2946638556 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f5844022070 con 0x7f584c152440 2024-05-16T22:27:03.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.835+0000 7f585477e640 1 -- 172.21.15.70:0/2946638556 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9bd94af5-3e17-4cbe-995a-8f837a66c653", "id": 4} v 0) -- 0x7f584c151690 con 0x7f584c152440 2024-05-16T22:27:03.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.840+0000 7f5842ffd640 1 -- 172.21.15.70:0/2946638556 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9bd94af5-3e17-4cbe-995a-8f837a66c653", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f5844010040 con 0x7f584c152440 2024-05-16T22:27:03.840 INFO:teuthology.orchestra.run.smithi070.stdout:4 2024-05-16T22:27:03.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.841+0000 7f585477e640 1 -- 172.21.15.70:0/2946638556 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f584c152440 msgr2=0x7f584c1472a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:03.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.841+0000 7f585477e640 1 --2- 172.21.15.70:0/2946638556 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f584c152440 0x7f584c1472a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5844009d30 tx=0x7f584400c490 comp rx=0 tx=0).stop 2024-05-16T22:27:03.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.841+0000 7f585477e640 1 -- 172.21.15.70:0/2946638556 shutdown_connections 2024-05-16T22:27:03.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.841+0000 7f585477e640 1 --2- 172.21.15.70:0/2946638556 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f584c152440 0x7f584c1472a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:03.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.841+0000 7f585477e640 1 --2- 172.21.15.70:0/2946638556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f584c148680 0x7f584c1e4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:03.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.841+0000 7f585477e640 1 --2- 172.21.15.70:0/2946638556 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f584c0bc360 0x7f584c0a20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:03.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.841+0000 7f585477e640 1 -- 172.21.15.70:0/2946638556 >> 172.21.15.70:0/2946638556 conn(0x7f584c06f390 msgr2=0x7f584c068d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:03.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.841+0000 7f585477e640 1 -- 172.21.15.70:0/2946638556 shutdown_connections 2024-05-16T22:27:03.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.841+0000 7f585477e640 1 -- 172.21.15.70:0/2946638556 wait complete. 2024-05-16T22:27:03.851 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd new a5b0cfa5-b259-48bd-98b6-96b44f5ebabd 5 2024-05-16T22:27:03.917 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-05-16T22:27:03.918+0000 7f5ed2b17040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-16T22:27:03.922 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-16T22:27:03.923+0000 7fba1451c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-16T22:27:03.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.959+0000 7f031f33f640 1 Processor -- start 2024-05-16T22:27:03.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.960+0000 7f031f33f640 1 -- start start 2024-05-16T22:27:03.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.961+0000 7f031f33f640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f03181455f0 0x7f031814ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:03.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.961+0000 7f031f33f640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03180bc710 con 0x7f03180bb470 2024-05-16T22:27:03.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.961+0000 7f031f33f640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f031814f1c0 con 0x7f03180bb060 2024-05-16T22:27:03.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.961+0000 7f031f33f640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f031814b590 con 0x7f03181455f0 2024-05-16T22:27:03.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.961+0000 7f031d0db640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f03181455f0 0x7f031814ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:03.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.961+0000 7f031d0db640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f03181455f0 0x7f031814ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39150/0 (socket says 172.21.15.70:39150) 2024-05-16T22:27:03.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.961+0000 7f031d0db640 1 -- 172.21.15.70:0/3532487760 learned_addr learned my addr 172.21.15.70:0/3532487760 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-16T22:27:03.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.961+0000 7f031c8da640 1 --1- 172.21.15.70:0/3532487760 >> v1:172.21.15.70:6789/0 conn(0x7f03180bb060 0x7f031814e680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:46340/0 (socket says 172.21.15.70:46340) 2024-05-16T22:27:03.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.961+0000 7f031d0db640 1 -- 172.21.15.70:0/3532487760 >> v1:172.21.15.70:6789/0 conn(0x7f03180bb060 legacy=0x7f031814e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:03.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.961+0000 7f031d0db640 1 -- 172.21.15.70:0/3532487760 >> v1:172.21.15.44:6789/0 conn(0x7f03180bb470 legacy=0x7f03181559d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:03.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.961+0000 7f031d0db640 1 -- 172.21.15.70:0/3532487760 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f031814b220 con 0x7f03181455f0 2024-05-16T22:27:03.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.962+0000 7f031d0db640 1 --2- 172.21.15.70:0/3532487760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03181455f0 0x7f031814ba20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0308009870 tx=0x7f030802a3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19386cda2a03a22f server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:03.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.962+0000 7f030ffff640 1 -- 172.21.15.70:0/3532487760 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0308037070 con 0x7f03181455f0 2024-05-16T22:27:03.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.962+0000 7f030ffff640 1 -- 172.21.15.70:0/3532487760 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0308032640 con 0x7f03181455f0 2024-05-16T22:27:03.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.962+0000 7f030ffff640 1 -- 172.21.15.70:0/3532487760 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0308032a10 con 0x7f03181455f0 2024-05-16T22:27:03.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.963+0000 7f031f33f640 1 -- 172.21.15.70:0/3532487760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03181455f0 msgr2=0x7f031814ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:03.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.963+0000 7f031f33f640 1 --2- 172.21.15.70:0/3532487760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03181455f0 0x7f031814ba20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0308009870 tx=0x7f030802a3c0 comp rx=0 tx=0).stop 2024-05-16T22:27:03.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.963+0000 7f031f33f640 1 -- 172.21.15.70:0/3532487760 shutdown_connections 2024-05-16T22:27:03.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.963+0000 7f031f33f640 1 --2- 172.21.15.70:0/3532487760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03181455f0 0x7f031814ba20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:03.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.963+0000 7f031f33f640 1 -- 172.21.15.70:0/3532487760 >> 172.21.15.70:0/3532487760 conn(0x7f03180bd160 msgr2=0x7f03180bd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:03.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.963+0000 7f031f33f640 1 -- 172.21.15.70:0/3532487760 shutdown_connections 2024-05-16T22:27:03.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.963+0000 7f031f33f640 1 -- 172.21.15.70:0/3532487760 wait complete. 2024-05-16T22:27:03.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.964+0000 7f031f33f640 1 Processor -- start 2024-05-16T22:27:03.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.965+0000 7f031f33f640 1 -- start start 2024-05-16T22:27:03.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.965+0000 7f031f33f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03180bb060 0x7f03180b9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:03.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.965+0000 7f031f33f640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f03180bb470 0x7f031814c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:03.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.966+0000 7f031f33f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03181455f0 0x7f0318144950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:03.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.966+0000 7f031f33f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0318073120 con 0x7f03181455f0 2024-05-16T22:27:03.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.966+0000 7f031f33f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f031814f4a0 con 0x7f03180bb060 2024-05-16T22:27:03.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.966+0000 7f031f33f640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f0318070bf0 con 0x7f03180bb470 2024-05-16T22:27:03.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.966+0000 7f031d0db640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03180bb060 0x7f03180b9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:03.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.966+0000 7f031d0db640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03180bb060 0x7f03180b9d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39166/0 (socket says 172.21.15.70:39166) 2024-05-16T22:27:03.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.966+0000 7f031d0db640 1 -- 172.21.15.70:0/1622582718 learned_addr learned my addr 172.21.15.70:0/1622582718 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-16T22:27:03.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.966+0000 7f031c8da640 1 --2- 172.21.15.70:0/1622582718 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f03180bb470 0x7f031814c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:03.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.966+0000 7f031d8dc640 1 --2- 172.21.15.70:0/1622582718 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03181455f0 0x7f0318144950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:03.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.966+0000 7f031d0db640 1 -- 172.21.15.70:0/1622582718 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f03180bb470 msgr2=0x7f031814c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:03.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.966+0000 7f031d0db640 1 --2- 172.21.15.70:0/1622582718 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f03180bb470 0x7f031814c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:03.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.966+0000 7f031d0db640 1 -- 172.21.15.70:0/1622582718 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03181455f0 msgr2=0x7f0318144950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:03.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.966+0000 7f031d0db640 1 --2- 172.21.15.70:0/1622582718 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03181455f0 0x7f0318144950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:03.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.966+0000 7f031d0db640 1 -- 172.21.15.70:0/1622582718 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f031814dcc0 con 0x7f03180bb060 2024-05-16T22:27:03.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.966+0000 7f031d0db640 1 --2- 172.21.15.70:0/1622582718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03180bb060 0x7f03180b9d30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0308009870 tx=0x7f03080046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:03.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.966+0000 7f030dffb640 1 -- 172.21.15.70:0/1622582718 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0308037040 con 0x7f03180bb060 2024-05-16T22:27:03.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.966+0000 7f030dffb640 1 -- 172.21.15.70:0/1622582718 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0308042070 con 0x7f03180bb060 2024-05-16T22:27:03.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.966+0000 7f031f33f640 1 -- 172.21.15.70:0/1622582718 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03180709e0 con 0x7f03180bb060 2024-05-16T22:27:03.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.966+0000 7f030dffb640 1 -- 172.21.15.70:0/1622582718 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0308030bd0 con 0x7f03180bb060 2024-05-16T22:27:03.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.967+0000 7f031f33f640 1 -- 172.21.15.70:0/1622582718 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f031814d720 con 0x7f03180bb060 2024-05-16T22:27:03.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.967+0000 7f030dffb640 1 -- 172.21.15.70:0/1622582718 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0308032500 con 0x7f03180bb060 2024-05-16T22:27:03.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.967+0000 7f030dffb640 1 -- 172.21.15.70:0/1622582718 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f0308047d70 con 0x7f03180bb060 2024-05-16T22:27:03.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.967+0000 7f031f33f640 1 -- 172.21.15.70:0/1622582718 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0318069b50 con 0x7f03180bb060 2024-05-16T22:27:03.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:03.970+0000 7f030dffb640 1 -- 172.21.15.70:0/1622582718 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f031814dcc0 con 0x7f03180bb060 2024-05-16T22:27:03.977 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-16T22:27:03.978+0000 7fba1451c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-16T22:27:03.978 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-05-16T22:27:03.979+0000 7f5ed2b17040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-16T22:27:04.032 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-16T22:27:04.033+0000 7fba1451c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-16T22:27:04.034 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-05-16T22:27:04.034+0000 7f5ed2b17040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-16T22:27:04.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.042+0000 7f031f33f640 1 -- 172.21.15.70:0/1622582718 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a5b0cfa5-b259-48bd-98b6-96b44f5ebabd", "id": 5} v 0) -- 0x7f0318050940 con 0x7f03180bb060 2024-05-16T22:27:04.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.048+0000 7f030dffb640 1 -- 172.21.15.70:0/1622582718 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a5b0cfa5-b259-48bd-98b6-96b44f5ebabd", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f0308047460 con 0x7f03180bb060 2024-05-16T22:27:04.047 INFO:teuthology.orchestra.run.smithi070.stdout:5 2024-05-16T22:27:04.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.049+0000 7f031f33f640 1 -- 172.21.15.70:0/1622582718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03180bb060 msgr2=0x7f03180b9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:04.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.049+0000 7f031f33f640 1 --2- 172.21.15.70:0/1622582718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03180bb060 0x7f03180b9d30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0308009870 tx=0x7f03080046c0 comp rx=0 tx=0).stop 2024-05-16T22:27:04.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.049+0000 7f031f33f640 1 -- 172.21.15.70:0/1622582718 shutdown_connections 2024-05-16T22:27:04.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.049+0000 7f031f33f640 1 --2- 172.21.15.70:0/1622582718 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f03180bb470 0x7f031814c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:04.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.049+0000 7f031f33f640 1 --2- 172.21.15.70:0/1622582718 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03181455f0 0x7f0318144950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:04.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.049+0000 7f031f33f640 1 --2- 172.21.15.70:0/1622582718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03180bb060 0x7f03180b9d30 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:04.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.049+0000 7f031f33f640 1 -- 172.21.15.70:0/1622582718 >> 172.21.15.70:0/1622582718 conn(0x7f03180bd160 msgr2=0x7f031814a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:04.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.049+0000 7f031f33f640 1 -- 172.21.15.70:0/1622582718 shutdown_connections 2024-05-16T22:27:04.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.049+0000 7f031f33f640 1 -- 172.21.15.70:0/1622582718 wait complete. 2024-05-16T22:27:04.059 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd new 0b6af6df-1358-4fc6-a62c-ba57e02914ce 6 2024-05-16T22:27:04.152 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-05-16T22:27:04.153+0000 7f5ed2b17040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-16T22:27:04.152 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-16T22:27:04.153+0000 7fba1451c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-16T22:27:04.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.167+0000 7fb186e13640 1 Processor -- start 2024-05-16T22:27:04.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.167+0000 7fb186e13640 1 -- start start 2024-05-16T22:27:04.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.168+0000 7fb186e13640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb18014f850 0x7fb18006cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:04.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.168+0000 7fb186e13640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb180073100 0x7fb180146670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:04.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.168+0000 7fb186e13640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb1800bfeb0 0x7fb1800745e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:04.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.168+0000 7fb186e13640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fb1800bfa20 con 0x7fb180073100 2024-05-16T22:27:04.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.168+0000 7fb186e13640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fb1800bf710 con 0x7fb1800bfeb0 2024-05-16T22:27:04.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.168+0000 7fb186e13640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fb180073720 con 0x7fb18014f850 2024-05-16T22:27:04.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.168+0000 7fb184baf640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb18014f850 0x7fb18006cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:04.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.168+0000 7fb1853b0640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb1800bfeb0 0x7fb1800745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:04.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.168+0000 7fb184baf640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb18014f850 0x7fb18006cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.70:54976/0 (socket says 172.21.15.70:54976) 2024-05-16T22:27:04.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.168+0000 7fb184baf640 1 -- 172.21.15.70:0/2385627197 learned_addr learned my addr 172.21.15.70:0/2385627197 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-16T22:27:04.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.168+0000 7fb17ffff640 1 --2- 172.21.15.70:0/2385627197 >> v2:172.21.15.44:3300/0 conn(0x7fb180073100 0x7fb180146670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:04.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.169+0000 7fb184baf640 1 -- 172.21.15.70:0/2385627197 >> v2:172.21.15.70:3300/0 conn(0x7fb1800bfeb0 msgr2=0x7fb1800745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:04.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.169+0000 7fb184baf640 1 --2- 172.21.15.70:0/2385627197 >> v2:172.21.15.70:3300/0 conn(0x7fb1800bfeb0 0x7fb1800745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:04.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.169+0000 7fb184baf640 1 -- 172.21.15.70:0/2385627197 >> v2:172.21.15.44:3300/0 conn(0x7fb180073100 msgr2=0x7fb180146670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:04.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.169+0000 7fb184baf640 1 --2- 172.21.15.70:0/2385627197 >> v2:172.21.15.44:3300/0 conn(0x7fb180073100 0x7fb180146670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:04.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.169+0000 7fb184baf640 1 -- 172.21.15.70:0/2385627197 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb180073a00 con 0x7fb18014f850 2024-05-16T22:27:04.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.169+0000 7fb1853b0640 1 --2- 172.21.15.70:0/2385627197 >> v2:172.21.15.70:3300/0 conn(0x7fb1800bfeb0 0x7fb1800745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:27:04.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.169+0000 7fb184baf640 1 --2- 172.21.15.70:0/2385627197 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb18014f850 0x7fb18006cbc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb180070b80 tx=0x7fb17402a1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e77a9d5ea80f0f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:04.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.169+0000 7fb17f7fe640 1 -- 172.21.15.70:0/2385627197 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb174037070 con 0x7fb18014f850 2024-05-16T22:27:04.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.169+0000 7fb17f7fe640 1 -- 172.21.15.70:0/2385627197 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb174032440 con 0x7fb18014f850 2024-05-16T22:27:04.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.169+0000 7fb17f7fe640 1 -- 172.21.15.70:0/2385627197 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb174032810 con 0x7fb18014f850 2024-05-16T22:27:04.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.170+0000 7fb186e13640 1 -- 172.21.15.70:0/2385627197 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb18014f850 msgr2=0x7fb18006cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:04.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.170+0000 7fb186e13640 1 --2- 172.21.15.70:0/2385627197 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb18014f850 0x7fb18006cbc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb180070b80 tx=0x7fb17402a1e0 comp rx=0 tx=0).stop 2024-05-16T22:27:04.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.170+0000 7fb186e13640 1 -- 172.21.15.70:0/2385627197 shutdown_connections 2024-05-16T22:27:04.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.170+0000 7fb186e13640 1 --2- 172.21.15.70:0/2385627197 >> v2:172.21.15.70:3300/0 conn(0x7fb1800bfeb0 0x7fb1800745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:04.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.170+0000 7fb186e13640 1 --2- 172.21.15.70:0/2385627197 >> v2:172.21.15.44:3300/0 conn(0x7fb180073100 0x7fb180146670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:04.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.170+0000 7fb186e13640 1 --2- 172.21.15.70:0/2385627197 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb18014f850 0x7fb18006cbc0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:04.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.170+0000 7fb186e13640 1 -- 172.21.15.70:0/2385627197 >> 172.21.15.70:0/2385627197 conn(0x7fb1800bd1d0 msgr2=0x7fb1800bd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:04.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.170+0000 7fb186e13640 1 -- 172.21.15.70:0/2385627197 shutdown_connections 2024-05-16T22:27:04.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.170+0000 7fb186e13640 1 -- 172.21.15.70:0/2385627197 wait complete. 2024-05-16T22:27:04.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.172+0000 7fb186e13640 1 Processor -- start 2024-05-16T22:27:04.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.172+0000 7fb186e13640 1 -- start start 2024-05-16T22:27:04.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.173+0000 7fb186e13640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb180073100 0x7fb1801e4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:04.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.173+0000 7fb186e13640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb1800bfeb0 0x7fb18014bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:04.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.173+0000 7fb186e13640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb18014f850 0x7fb180149a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:04.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.173+0000 7fb186e13640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb1800c0440 con 0x7fb180073100 2024-05-16T22:27:04.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.173+0000 7fb186e13640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb1800c02c0 con 0x7fb1800bfeb0 2024-05-16T22:27:04.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.173+0000 7fb186e13640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fb180074b20 con 0x7fb18014f850 2024-05-16T22:27:04.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.173+0000 7fb17ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb1800bfeb0 0x7fb18014bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:04.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.173+0000 7fb1853b0640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb18014f850 0x7fb180149a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:04.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.173+0000 7fb17ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb1800bfeb0 0x7fb18014bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39180/0 (socket says 172.21.15.70:39180) 2024-05-16T22:27:04.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.173+0000 7fb1853b0640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb18014f850 0x7fb180149a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.70:54980/0 (socket says 172.21.15.70:54980) 2024-05-16T22:27:04.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.173+0000 7fb17ffff640 1 -- 172.21.15.70:0/532456750 learned_addr learned my addr 172.21.15.70:0/532456750 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-16T22:27:04.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.173+0000 7fb184baf640 1 --2- 172.21.15.70:0/532456750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb180073100 0x7fb1801e4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:04.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.173+0000 7fb17ffff640 1 -- 172.21.15.70:0/532456750 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb18014f850 msgr2=0x7fb180149a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:04.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.173+0000 7fb17ffff640 1 --2- 172.21.15.70:0/532456750 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb18014f850 0x7fb180149a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:04.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.173+0000 7fb17ffff640 1 -- 172.21.15.70:0/532456750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb180073100 msgr2=0x7fb1801e4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:04.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.173+0000 7fb17ffff640 1 --2- 172.21.15.70:0/532456750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb180073100 0x7fb1801e4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:04.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.173+0000 7fb17ffff640 1 -- 172.21.15.70:0/532456750 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb180149fd0 con 0x7fb1800bfeb0 2024-05-16T22:27:04.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.173+0000 7fb1853b0640 1 --2- 172.21.15.70:0/532456750 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb18014f850 0x7fb180149a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:27:04.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.174+0000 7fb17ffff640 1 --2- 172.21.15.70:0/532456750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb1800bfeb0 0x7fb18014bf90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb1800a6a40 tx=0x7fb16c00ea00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:04.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.174+0000 7fb17d7fa640 1 -- 172.21.15.70:0/532456750 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb16c017070 con 0x7fb1800bfeb0 2024-05-16T22:27:04.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.174+0000 7fb17d7fa640 1 -- 172.21.15.70:0/532456750 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb16c013680 con 0x7fb1800bfeb0 2024-05-16T22:27:04.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.174+0000 7fb186e13640 1 -- 172.21.15.70:0/532456750 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb18014c6e0 con 0x7fb1800bfeb0 2024-05-16T22:27:04.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.174+0000 7fb17d7fa640 1 -- 172.21.15.70:0/532456750 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb16c013a70 con 0x7fb1800bfeb0 2024-05-16T22:27:04.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.174+0000 7fb186e13640 1 -- 172.21.15.70:0/532456750 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1801e4810 con 0x7fb1800bfeb0 2024-05-16T22:27:04.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.174+0000 7fb17d7fa640 1 -- 172.21.15.70:0/532456750 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb16c01a070 con 0x7fb1800bfeb0 2024-05-16T22:27:04.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.174+0000 7fb17d7fa640 1 -- 172.21.15.70:0/532456750 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fb16c01ce00 con 0x7fb1800bfeb0 2024-05-16T22:27:04.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.175+0000 7fb186e13640 1 -- 172.21.15.70:0/532456750 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb180069b50 con 0x7fb1800bfeb0 2024-05-16T22:27:04.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.177+0000 7fb17d7fa640 1 -- 172.21.15.70:0/532456750 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fb16c013d20 con 0x7fb1800bfeb0 2024-05-16T22:27:04.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.251+0000 7fb186e13640 1 -- 172.21.15.70:0/532456750 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0b6af6df-1358-4fc6-a62c-ba57e02914ce", "id": 6} v 0) -- 0x7fb180050940 con 0x7fb1800bfeb0 2024-05-16T22:27:04.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.254+0000 7fb17d7fa640 1 -- 172.21.15.70:0/532456750 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0b6af6df-1358-4fc6-a62c-ba57e02914ce", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fb16c012b70 con 0x7fb1800bfeb0 2024-05-16T22:27:04.253 INFO:teuthology.orchestra.run.smithi070.stdout:6 2024-05-16T22:27:04.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.255+0000 7fb186e13640 1 -- 172.21.15.70:0/532456750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb1800bfeb0 msgr2=0x7fb18014bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:04.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.255+0000 7fb186e13640 1 --2- 172.21.15.70:0/532456750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb1800bfeb0 0x7fb18014bf90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb1800a6a40 tx=0x7fb16c00ea00 comp rx=0 tx=0).stop 2024-05-16T22:27:04.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.255+0000 7fb186e13640 1 -- 172.21.15.70:0/532456750 shutdown_connections 2024-05-16T22:27:04.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.255+0000 7fb186e13640 1 --2- 172.21.15.70:0/532456750 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb18014f850 0x7fb180149a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:04.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.255+0000 7fb186e13640 1 --2- 172.21.15.70:0/532456750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb1800bfeb0 0x7fb18014bf90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:04.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.255+0000 7fb186e13640 1 --2- 172.21.15.70:0/532456750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb180073100 0x7fb1801e4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:04.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.255+0000 7fb186e13640 1 -- 172.21.15.70:0/532456750 >> 172.21.15.70:0/532456750 conn(0x7fb1800bd1d0 msgr2=0x7fb18006f970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:04.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.255+0000 7fb186e13640 1 -- 172.21.15.70:0/532456750 shutdown_connections 2024-05-16T22:27:04.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.255+0000 7fb186e13640 1 -- 172.21.15.70:0/532456750 wait complete. 2024-05-16T22:27:04.265 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd new eb1a2c5d-42cf-47d0-9e03-b9d26944a589 7 2024-05-16T22:27:04.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.371+0000 7f7b3f4af640 1 Processor -- start 2024-05-16T22:27:04.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.371+0000 7f7b3f4af640 1 -- start start 2024-05-16T22:27:04.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.372+0000 7f7b3f4af640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7b381455f0 0x7f7b3814ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:04.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.372+0000 7f7b3f4af640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7b380bb060 0x7f7b3814e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:04.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.372+0000 7f7b3f4af640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7b380bb470 0x7f7b3814ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:04.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.372+0000 7f7b3f4af640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f7b3814b590 con 0x7f7b381455f0 2024-05-16T22:27:04.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.372+0000 7f7b3f4af640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f7b380bc710 con 0x7f7b380bb060 2024-05-16T22:27:04.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.372+0000 7f7b3f4af640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f7b3814f1c0 con 0x7f7b380bb470 2024-05-16T22:27:04.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.372+0000 7f7b3da4c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7b380bb470 0x7f7b3814ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:04.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.372+0000 7f7b3ca4a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7b380bb060 0x7f7b3814e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:04.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.372+0000 7f7b3da4c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7b380bb470 0x7f7b3814ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.70:54984/0 (socket says 172.21.15.70:54984) 2024-05-16T22:27:04.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.372+0000 7f7b3ca4a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7b380bb060 0x7f7b3814e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39188/0 (socket says 172.21.15.70:39188) 2024-05-16T22:27:04.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.372+0000 7f7b3da4c640 1 -- 172.21.15.70:0/31350241 learned_addr learned my addr 172.21.15.70:0/31350241 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-16T22:27:04.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.372+0000 7f7b3d24b640 1 --2- 172.21.15.70:0/31350241 >> v2:172.21.15.44:3300/0 conn(0x7f7b381455f0 0x7f7b3814ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:04.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.373+0000 7f7b3da4c640 1 -- 172.21.15.70:0/31350241 >> v2:172.21.15.70:3300/0 conn(0x7f7b380bb060 msgr2=0x7f7b3814e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:04.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.373+0000 7f7b3da4c640 1 --2- 172.21.15.70:0/31350241 >> v2:172.21.15.70:3300/0 conn(0x7f7b380bb060 0x7f7b3814e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:04.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.373+0000 7f7b3da4c640 1 -- 172.21.15.70:0/31350241 >> v2:172.21.15.44:3300/0 conn(0x7f7b381455f0 msgr2=0x7f7b3814ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:04.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.373+0000 7f7b3da4c640 1 --2- 172.21.15.70:0/31350241 >> v2:172.21.15.44:3300/0 conn(0x7f7b381455f0 0x7f7b3814ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:04.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.373+0000 7f7b3da4c640 1 -- 172.21.15.70:0/31350241 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b3814b220 con 0x7f7b380bb470 2024-05-16T22:27:04.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.373+0000 7f7b3ca4a640 1 --2- 172.21.15.70:0/31350241 >> v2:172.21.15.70:3300/0 conn(0x7f7b380bb060 0x7f7b3814e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:27:04.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.374+0000 7f7b3da4c640 1 --2- 172.21.15.70:0/31350241 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7b380bb470 0x7f7b3814ebc0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7b380bbf90 tx=0x7f7b3002c930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=154bc7a0ef0f6f09 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:04.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.374+0000 7f7b2ffff640 1 -- 172.21.15.70:0/31350241 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b30009600 con 0x7f7b380bb470 2024-05-16T22:27:04.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.374+0000 7f7b2ffff640 1 -- 172.21.15.70:0/31350241 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b30037070 con 0x7f7b380bb470 2024-05-16T22:27:04.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.374+0000 7f7b2ffff640 1 -- 172.21.15.70:0/31350241 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b300099c0 con 0x7f7b380bb470 2024-05-16T22:27:04.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.375+0000 7f7b3f4af640 1 -- 172.21.15.70:0/31350241 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7b380bb470 msgr2=0x7f7b3814ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:04.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.375+0000 7f7b3f4af640 1 --2- 172.21.15.70:0/31350241 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7b380bb470 0x7f7b3814ebc0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7b380bbf90 tx=0x7f7b3002c930 comp rx=0 tx=0).stop 2024-05-16T22:27:04.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.375+0000 7f7b3f4af640 1 -- 172.21.15.70:0/31350241 shutdown_connections 2024-05-16T22:27:04.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.375+0000 7f7b3f4af640 1 --2- 172.21.15.70:0/31350241 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7b380bb470 0x7f7b3814ebc0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:04.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.375+0000 7f7b3f4af640 1 --2- 172.21.15.70:0/31350241 >> v2:172.21.15.70:3300/0 conn(0x7f7b380bb060 0x7f7b3814e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:04.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.375+0000 7f7b3f4af640 1 --2- 172.21.15.70:0/31350241 >> v2:172.21.15.44:3300/0 conn(0x7f7b381455f0 0x7f7b3814ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:04.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.375+0000 7f7b3f4af640 1 -- 172.21.15.70:0/31350241 >> 172.21.15.70:0/31350241 conn(0x7f7b380bd160 msgr2=0x7f7b380bd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:04.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.375+0000 7f7b3f4af640 1 -- 172.21.15.70:0/31350241 shutdown_connections 2024-05-16T22:27:04.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.375+0000 7f7b3f4af640 1 -- 172.21.15.70:0/31350241 wait complete. 2024-05-16T22:27:04.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.377+0000 7f7b3f4af640 1 Processor -- start 2024-05-16T22:27:04.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.377+0000 7f7b3f4af640 1 -- start start 2024-05-16T22:27:04.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.378+0000 7f7b3f4af640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b380bb060 0x7f7b38070bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:04.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.378+0000 7f7b3f4af640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b380bb470 0x7f7b381e37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:04.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.378+0000 7f7b3f4af640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7b381455f0 0x7f7b381447c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:04.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.378+0000 7f7b3f4af640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7b38073120 con 0x7f7b380bb470 2024-05-16T22:27:04.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.378+0000 7f7b3f4af640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7b3814f4a0 con 0x7f7b380bb060 2024-05-16T22:27:04.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.378+0000 7f7b3f4af640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f7b3806e680 con 0x7f7b381455f0 2024-05-16T22:27:04.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.378+0000 7f7b3da4c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7b381455f0 0x7f7b381447c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:04.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.378+0000 7f7b3d24b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b380bb060 0x7f7b38070bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:04.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.378+0000 7f7b3d24b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b380bb060 0x7f7b38070bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39204/0 (socket says 172.21.15.70:39204) 2024-05-16T22:27:04.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.378+0000 7f7b3da4c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7b381455f0 0x7f7b381447c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.70:55000/0 (socket says 172.21.15.70:55000) 2024-05-16T22:27:04.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.378+0000 7f7b3d24b640 1 -- 172.21.15.70:0/2997122066 learned_addr learned my addr 172.21.15.70:0/2997122066 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-16T22:27:04.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.378+0000 7f7b3ca4a640 1 --2- 172.21.15.70:0/2997122066 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b380bb470 0x7f7b381e37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:04.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.378+0000 7f7b3da4c640 1 -- 172.21.15.70:0/2997122066 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b380bb060 msgr2=0x7f7b38070bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:04.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.378+0000 7f7b3da4c640 1 --2- 172.21.15.70:0/2997122066 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b380bb060 0x7f7b38070bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:04.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.378+0000 7f7b3da4c640 1 -- 172.21.15.70:0/2997122066 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b380bb470 msgr2=0x7f7b381e37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:04.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.378+0000 7f7b3da4c640 1 --2- 172.21.15.70:0/2997122066 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b380bb470 0x7f7b381e37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:04.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.378+0000 7f7b3da4c640 1 -- 172.21.15.70:0/2997122066 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b38071100 con 0x7f7b381455f0 2024-05-16T22:27:04.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.378+0000 7f7b3d24b640 1 --2- 172.21.15.70:0/2997122066 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b380bb060 0x7f7b38070bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:27:04.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.378+0000 7f7b3da4c640 1 --2- 172.21.15.70:0/2997122066 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7b381455f0 0x7f7b381447c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7b3814f340 tx=0x7f7b30004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:04.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.378+0000 7f7b2dffb640 1 -- 172.21.15.70:0/2997122066 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b30009dc0 con 0x7f7b381455f0 2024-05-16T22:27:04.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.379+0000 7f7b2dffb640 1 -- 172.21.15.70:0/2997122066 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b30047480 con 0x7f7b381455f0 2024-05-16T22:27:04.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.379+0000 7f7b3f4af640 1 -- 172.21.15.70:0/2997122066 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b381e3d30 con 0x7f7b381455f0 2024-05-16T22:27:04.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.379+0000 7f7b2dffb640 1 -- 172.21.15.70:0/2997122066 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b30047870 con 0x7f7b381455f0 2024-05-16T22:27:04.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.379+0000 7f7b3f4af640 1 -- 172.21.15.70:0/2997122066 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b3806de20 con 0x7f7b381455f0 2024-05-16T22:27:04.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.379+0000 7f7b2dffb640 1 -- 172.21.15.70:0/2997122066 <== mon.2 v2:172.21.15.70:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7b30032420 con 0x7f7b381455f0 2024-05-16T22:27:04.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.379+0000 7f7b2dffb640 1 -- 172.21.15.70:0/2997122066 <== mon.2 v2:172.21.15.70:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f7b30047df0 con 0x7f7b381455f0 2024-05-16T22:27:04.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.380+0000 7f7b3f4af640 1 -- 172.21.15.70:0/2997122066 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b38069b50 con 0x7f7b381455f0 2024-05-16T22:27:04.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.382+0000 7f7b2dffb640 1 -- 172.21.15.70:0/2997122066 <== mon.2 v2:172.21.15.70:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f7b3004c060 con 0x7f7b381455f0 2024-05-16T22:27:04.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.453+0000 7f7b3f4af640 1 -- 172.21.15.70:0/2997122066 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "osd new", "uuid": "eb1a2c5d-42cf-47d0-9e03-b9d26944a589", "id": 7} v 0) -- 0x7f7b38050940 con 0x7f7b381455f0 2024-05-16T22:27:04.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.456+0000 7f7b2dffb640 1 -- 172.21.15.70:0/2997122066 <== mon.2 v2:172.21.15.70:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "eb1a2c5d-42cf-47d0-9e03-b9d26944a589", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f7b3003cb80 con 0x7f7b381455f0 2024-05-16T22:27:04.456 INFO:teuthology.orchestra.run.smithi070.stdout:7 2024-05-16T22:27:04.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.457+0000 7f7b3f4af640 1 -- 172.21.15.70:0/2997122066 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7b381455f0 msgr2=0x7f7b381447c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:04.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.457+0000 7f7b3f4af640 1 --2- 172.21.15.70:0/2997122066 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7b381455f0 0x7f7b381447c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7b3814f340 tx=0x7f7b30004a40 comp rx=0 tx=0).stop 2024-05-16T22:27:04.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.457+0000 7f7b3f4af640 1 -- 172.21.15.70:0/2997122066 shutdown_connections 2024-05-16T22:27:04.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.457+0000 7f7b3f4af640 1 --2- 172.21.15.70:0/2997122066 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7b381455f0 0x7f7b381447c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:04.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.457+0000 7f7b3f4af640 1 --2- 172.21.15.70:0/2997122066 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b380bb470 0x7f7b381e37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:04.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.457+0000 7f7b3f4af640 1 --2- 172.21.15.70:0/2997122066 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b380bb060 0x7f7b38070bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:04.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.457+0000 7f7b3f4af640 1 -- 172.21.15.70:0/2997122066 >> 172.21.15.70:0/2997122066 conn(0x7f7b380bd160 msgr2=0x7f7b380a1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:04.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.457+0000 7f7b3f4af640 1 -- 172.21.15.70:0/2997122066 shutdown_connections 2024-05-16T22:27:04.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-16T22:27:04.457+0000 7f7b3f4af640 1 -- 172.21.15.70:0/2997122066 wait complete. 2024-05-16T22:27:04.468 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-16T22:27:04.468 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-16T22:27:04.470 INFO:tasks.ceph.osd.0:Started 2024-05-16T22:27:04.470 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-16T22:27:04.471 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-16T22:27:04.473 INFO:tasks.ceph.osd.1:Started 2024-05-16T22:27:04.473 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-16T22:27:04.473 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-16T22:27:04.475 INFO:tasks.ceph.osd.2:Started 2024-05-16T22:27:04.475 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-16T22:27:04.475 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-16T22:27:04.477 INFO:tasks.ceph.osd.3:Started 2024-05-16T22:27:04.477 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-16T22:27:04.478 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-16T22:27:04.480 INFO:tasks.ceph.osd.4:Started 2024-05-16T22:27:04.480 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-16T22:27:04.480 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-16T22:27:04.482 INFO:tasks.ceph.osd.5:Started 2024-05-16T22:27:04.482 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-16T22:27:04.482 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-16T22:27:04.484 INFO:tasks.ceph.osd.6:Started 2024-05-16T22:27:04.484 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-16T22:27:04.484 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-16T22:27:04.487 INFO:tasks.ceph.osd.7:Started 2024-05-16T22:27:04.487 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-16T22:27:04.572 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-16T22:27:04.573+0000 7fba1451c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-16T22:27:04.600 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-05-16T22:27:04.601+0000 7f5ed2b17040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-16T22:27:04.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.630+0000 7eff22908640 1 Processor -- start 2024-05-16T22:27:04.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.630+0000 7eff22908640 1 -- start start 2024-05-16T22:27:04.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.631+0000 7eff22908640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7eff1c0b8d70 0x7eff1c0b9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:04.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.631+0000 7eff22908640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff1c14ece0 con 0x7eff1c14e530 2024-05-16T22:27:04.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.631+0000 7eff22908640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff1c14efc0 con 0x7eff1c0bd440 2024-05-16T22:27:04.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.631+0000 7eff22908640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7eff1c0b88e0 con 0x7eff1c0b8d70 2024-05-16T22:27:04.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.631+0000 7eff1bfff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7eff1c14e530 0x7eff1c0ba320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:32932/0 (socket says 172.21.15.44:32932) 2024-05-16T22:27:04.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.631+0000 7eff1bfff640 1 -- 172.21.15.44:0/4213564040 learned_addr learned my addr 172.21.15.44:0/4213564040 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:27:04.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.631+0000 7eff20ea5640 1 --2- 172.21.15.44:0/4213564040 >> v2:172.21.15.70:3300/0 conn(0x7eff1c0b8d70 0x7eff1c0b9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:04.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.631+0000 7eff1affd640 1 -- 172.21.15.44:0/4213564040 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2352599205 0 0) 0x7eff1c14efc0 con 0x7eff1c0bd440 2024-05-16T22:27:04.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.631+0000 7eff1affd640 1 -- 172.21.15.44:0/4213564040 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff04003520 con 0x7eff1c0bd440 2024-05-16T22:27:04.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.631+0000 7eff1affd640 1 -- 172.21.15.44:0/4213564040 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1887030704 0 0) 0x7eff1c14ece0 con 0x7eff1c14e530 2024-05-16T22:27:04.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.631+0000 7eff1affd640 1 -- 172.21.15.44:0/4213564040 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff1c14efc0 con 0x7eff1c14e530 2024-05-16T22:27:04.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.631+0000 7eff20ea5640 1 -- 172.21.15.44:0/4213564040 >> v1:172.21.15.70:6789/0 conn(0x7eff1c0bd440 legacy=0x7eff1c0bd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:04.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.631+0000 7eff20ea5640 1 -- 172.21.15.44:0/4213564040 >> v1:172.21.15.44:6789/0 conn(0x7eff1c14e530 legacy=0x7eff1c0ba320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:04.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.631+0000 7eff20ea5640 1 -- 172.21.15.44:0/4213564040 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff1c14f2a0 con 0x7eff1c0b8d70 2024-05-16T22:27:04.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.632+0000 7eff20ea5640 1 --2- 172.21.15.44:0/4213564040 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff1c0b8d70 0x7eff1c0b9180 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7eff14009d90 tx=0x7eff1402a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96904186573d2a5d server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:04.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.632+0000 7eff1affd640 1 -- 172.21.15.44:0/4213564040 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff14007740 con 0x7eff1c0b8d70 2024-05-16T22:27:04.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.632+0000 7eff1affd640 1 -- 172.21.15.44:0/4213564040 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff140078e0 con 0x7eff1c0b8d70 2024-05-16T22:27:04.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.632+0000 7eff1affd640 1 -- 172.21.15.44:0/4213564040 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff14007cb0 con 0x7eff1c0b8d70 2024-05-16T22:27:04.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.633+0000 7eff22908640 1 -- 172.21.15.44:0/4213564040 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff1c0b8d70 msgr2=0x7eff1c0b9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:04.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.633+0000 7eff22908640 1 --2- 172.21.15.44:0/4213564040 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff1c0b8d70 0x7eff1c0b9180 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7eff14009d90 tx=0x7eff1402a6f0 comp rx=0 tx=0).stop 2024-05-16T22:27:04.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.633+0000 7eff22908640 1 -- 172.21.15.44:0/4213564040 shutdown_connections 2024-05-16T22:27:04.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.633+0000 7eff22908640 1 --2- 172.21.15.44:0/4213564040 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff1c0b8d70 0x7eff1c0b9180 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:04.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.633+0000 7eff22908640 1 -- 172.21.15.44:0/4213564040 >> 172.21.15.44:0/4213564040 conn(0x7eff1c0c0570 msgr2=0x7eff1c0c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:04.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.633+0000 7eff22908640 1 -- 172.21.15.44:0/4213564040 shutdown_connections 2024-05-16T22:27:04.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.633+0000 7eff22908640 1 -- 172.21.15.44:0/4213564040 wait complete. 2024-05-16T22:27:04.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.635+0000 7eff22908640 1 Processor -- start 2024-05-16T22:27:04.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.635+0000 7eff22908640 1 -- start start 2024-05-16T22:27:04.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.636+0000 7eff22908640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff1c0b8d70 0x7eff1c1496a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:04.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.636+0000 7eff22908640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7eff1c0bd440 0x7eff1c1d71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:04.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.636+0000 7eff22908640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff1c14e530 0x7eff1c1d7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:04.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.636+0000 7eff22908640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7eff1c14e940 con 0x7eff1c14e530 2024-05-16T22:27:04.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.636+0000 7eff22908640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7eff1c0b96c0 con 0x7eff1c0b8d70 2024-05-16T22:27:04.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.636+0000 7eff22908640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7eff1c14eac0 con 0x7eff1c0bd440 2024-05-16T22:27:04.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.636+0000 7eff1bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff1c0b8d70 0x7eff1c1496a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:04.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.636+0000 7eff1bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff1c0b8d70 0x7eff1c1496a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.44:57436/0 (socket says 172.21.15.44:57436) 2024-05-16T22:27:04.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.636+0000 7eff1bfff640 1 -- 172.21.15.44:0/2123353014 learned_addr learned my addr 172.21.15.44:0/2123353014 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:04.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.636+0000 7eff1b7fe640 1 --2- 172.21.15.44:0/2123353014 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7eff1c0bd440 0x7eff1c1d71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:04.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.637+0000 7eff20ea5640 1 --2- 172.21.15.44:0/2123353014 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff1c14e530 0x7eff1c1d7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:04.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.637+0000 7eff1bfff640 1 -- 172.21.15.44:0/2123353014 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7eff1c0bd440 msgr2=0x7eff1c1d71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:04.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.637+0000 7eff1bfff640 1 --2- 172.21.15.44:0/2123353014 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7eff1c0bd440 0x7eff1c1d71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:04.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.637+0000 7eff1bfff640 1 -- 172.21.15.44:0/2123353014 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff1c14e530 msgr2=0x7eff1c1d7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:04.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.637+0000 7eff1bfff640 1 --2- 172.21.15.44:0/2123353014 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff1c14e530 0x7eff1c1d7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:04.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.637+0000 7eff1bfff640 1 -- 172.21.15.44:0/2123353014 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff1c149be0 con 0x7eff1c0b8d70 2024-05-16T22:27:04.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.637+0000 7eff1bfff640 1 --2- 172.21.15.44:0/2123353014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff1c0b8d70 0x7eff1c1496a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7eff0c00c400 tx=0x7eff0c00c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:04.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.637+0000 7eff18ff9640 1 -- 172.21.15.44:0/2123353014 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff0c017070 con 0x7eff1c0b8d70 2024-05-16T22:27:04.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.637+0000 7eff18ff9640 1 -- 172.21.15.44:0/2123353014 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff0c0074e0 con 0x7eff1c0b8d70 2024-05-16T22:27:04.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.637+0000 7eff22908640 1 -- 172.21.15.44:0/2123353014 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff1c1e44b0 con 0x7eff1c0b8d70 2024-05-16T22:27:04.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.637+0000 7eff18ff9640 1 -- 172.21.15.44:0/2123353014 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff0c0059e0 con 0x7eff1c0b8d70 2024-05-16T22:27:04.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.637+0000 7eff22908640 1 -- 172.21.15.44:0/2123353014 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff1c1e4a70 con 0x7eff1c0b8d70 2024-05-16T22:27:04.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.637+0000 7eff18ff9640 1 -- 172.21.15.44:0/2123353014 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7eff0c01a070 con 0x7eff1c0b8d70 2024-05-16T22:27:04.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.637+0000 7eff18ff9640 1 -- 172.21.15.44:0/2123353014 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7eff0c005b80 con 0x7eff1c0b8d70 2024-05-16T22:27:04.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.638+0000 7eff22908640 1 -- 172.21.15.44:0/2123353014 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff1c050940 con 0x7eff1c0b8d70 2024-05-16T22:27:04.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.641+0000 7eff18ff9640 1 -- 172.21.15.44:0/2123353014 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7eff0c021020 con 0x7eff1c0b8d70 2024-05-16T22:27:04.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.703+0000 7eff22908640 1 -- 172.21.15.44:0/2123353014 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7eff1c0bdb30 con 0x7eff1c0b8d70 2024-05-16T22:27:04.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.703+0000 7eff18ff9640 1 -- 172.21.15.44:0/2123353014 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7eff0c01c440 con 0x7eff1c0b8d70 2024-05-16T22:27:04.703 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:27:04.703 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":10,"fsid":"572ab7cc-b103-4548-ae8f-c6614d57f0c8","created":"2024-05-16T22:27:02.216874+0000","modified":"2024-05-16T22:27:04.455119+0000","last_up_change":"0.000000","last_in_change":"2024-05-16T22:27:04.455119+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a7003e89-c706-4562-9f25-670bb35ae108","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a4d5169d-8327-4494-9c7c-58db21b00636","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d4a834f8-83a5-400f-9814-eb0a25124df4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b9d24a56-ad43-4674-a395-5ec24d135ae8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9bd94af5-3e17-4cbe-995a-8f837a66c653","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a5b0cfa5-b259-48bd-98b6-96b44f5ebabd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0b6af6df-1358-4fc6-a62c-ba57e02914ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"eb1a2c5d-42cf-47d0-9e03-b9d26944a589","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T22:27:04.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.704+0000 7eff22908640 1 -- 172.21.15.44:0/2123353014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff1c0b8d70 msgr2=0x7eff1c1496a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:04.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.704+0000 7eff22908640 1 --2- 172.21.15.44:0/2123353014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff1c0b8d70 0x7eff1c1496a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7eff0c00c400 tx=0x7eff0c00c8c0 comp rx=0 tx=0).stop 2024-05-16T22:27:04.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.704+0000 7eff22908640 1 -- 172.21.15.44:0/2123353014 shutdown_connections 2024-05-16T22:27:04.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.704+0000 7eff22908640 1 --2- 172.21.15.44:0/2123353014 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7eff1c0bd440 0x7eff1c1d71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:04.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.704+0000 7eff22908640 1 --2- 172.21.15.44:0/2123353014 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff1c14e530 0x7eff1c1d7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:04.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.704+0000 7eff22908640 1 --2- 172.21.15.44:0/2123353014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff1c0b8d70 0x7eff1c1496a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:04.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.704+0000 7eff22908640 1 -- 172.21.15.44:0/2123353014 >> 172.21.15.44:0/2123353014 conn(0x7eff1c0c0570 msgr2=0x7eff1c0bedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:04.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.704+0000 7eff22908640 1 -- 172.21.15.44:0/2123353014 shutdown_connections 2024-05-16T22:27:04.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:04.705+0000 7eff22908640 1 -- 172.21.15.44:0/2123353014 wait complete. 2024-05-16T22:27:04.715 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-16T22:27:04.715 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-16T22:27:04.723 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-16T22:27:04.724+0000 7fba1451c040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-16T22:27:04.751 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-05-16T22:27:04.752+0000 7f5ed2b17040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-16T22:27:04.979 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-16T22:27:04.980+0000 7fba1451c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-16T22:27:05.025 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-05-16T22:27:05.026+0000 7f5ed2b17040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-16T22:27:05.031 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-16T22:27:05.031+0000 7fba1451c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-16T22:27:05.080 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-05-16T22:27:05.081+0000 7f5ed2b17040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-16T22:27:05.095 INFO:tasks.ceph.osd.5.smithi070.stderr:2024-05-16T22:27:05.095+0000 7f43d740e640 -1 Falling back to public interface 2024-05-16T22:27:05.095 INFO:tasks.ceph.osd.6.smithi070.stderr:2024-05-16T22:27:05.095+0000 7fb4af014640 -1 Falling back to public interface 2024-05-16T22:27:05.095 INFO:tasks.ceph.osd.5.smithi070.stderr:2024-05-16T22:27:05.096+0000 7f43d5d1d640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2024-05-16T22:27:05.095 INFO:tasks.ceph.osd.5.smithi070.stderr:2024-05-16T22:27:05.096+0000 7f43d5d1d640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6801/0: (98) Address already in use 2024-05-16T22:27:05.110 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-05-16T22:27:05.110+0000 7ff95ea24640 -1 Falling back to public interface 2024-05-16T22:27:05.110 INFO:tasks.ceph.osd.7.smithi070.stderr:2024-05-16T22:27:05.110+0000 7f21a3614640 -1 Falling back to public interface 2024-05-16T22:27:05.110 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-05-16T22:27:05.111+0000 7fb219c2f640 -1 Falling back to public interface 2024-05-16T22:27:05.111 INFO:tasks.ceph.osd.4.smithi070.stderr:2024-05-16T22:27:05.112+0000 7f363dd01640 -1 Falling back to public interface 2024-05-16T22:27:05.122 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-05-16T22:27:05.122+0000 7fdc55a1b640 -1 Falling back to public interface 2024-05-16T22:27:05.126 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-05-16T22:27:05.127+0000 7f1980415640 -1 Falling back to public interface 2024-05-16T22:27:05.152 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-16T22:27:05.153+0000 7fba1451c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-16T22:27:05.205 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-05-16T22:27:05.205+0000 7f5ed2b17040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-16T22:27:05.433 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-16T22:27:05.433+0000 7fba1451c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-16T22:27:05.480 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-16T22:27:05.481+0000 7fba1451c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-16T22:27:05.503 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-05-16T22:27:05.504+0000 7f5ed2b17040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-16T22:27:05.520 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-16T22:27:05.554 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-05-16T22:27:05.555+0000 7f5ed2b17040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-16T22:27:05.623 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.624+0000 7f646a4c6640 1 Processor -- start 2024-05-16T22:27:05.624 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.624+0000 7f646a4c6640 1 -- start start 2024-05-16T22:27:05.625 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.625+0000 7f646a4c6640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f64640bd870 0x7f64640b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:05.625 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.625+0000 7f646a4c6640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f646414c320 0x7f646414c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:05.625 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.625+0000 7f646a4c6640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f646414cc70 con 0x7f6464146690 2024-05-16T22:27:05.625 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.625+0000 7f646a4c6640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f64640ba240 con 0x7f646414c320 2024-05-16T22:27:05.625 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.625+0000 7f646a4c6640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f6464072290 con 0x7f64640bd870 2024-05-16T22:27:05.626 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.626+0000 7f6468a63640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f646414c320 0x7f646414c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:05.626 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.626+0000 7f6463fff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f6464146690 0x7f6464071b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:32948/0 (socket says 172.21.15.44:32948) 2024-05-16T22:27:05.626 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.626+0000 7f6463fff640 1 -- 172.21.15.44:0/255882949 learned_addr learned my addr 172.21.15.44:0/255882949 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:27:05.626 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.626+0000 7f64637fe640 1 --2- 172.21.15.44:0/255882949 >> v2:172.21.15.70:3300/0 conn(0x7f64640bd870 0x7f64640b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:05.626 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.626+0000 7f6468a63640 1 -- 172.21.15.44:0/255882949 >> v2:172.21.15.70:3300/0 conn(0x7f64640bd870 msgr2=0x7f64640b8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:05.626 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.626+0000 7f6468a63640 1 --2- 172.21.15.44:0/255882949 >> v2:172.21.15.70:3300/0 conn(0x7f64640bd870 0x7f64640b8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:05.626 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.626+0000 7f6468a63640 1 -- 172.21.15.44:0/255882949 >> v1:172.21.15.44:6789/0 conn(0x7f6464146690 legacy=0x7f6464071b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:05.626 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.626+0000 7f6468a63640 1 -- 172.21.15.44:0/255882949 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64640bde90 con 0x7f646414c320 2024-05-16T22:27:05.626 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.626+0000 7f6462ffd640 1 -- 172.21.15.44:0/255882949 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 295379466 0 0) 0x7f646414cc70 con 0x7f6464146690 2024-05-16T22:27:05.628 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.627+0000 7f6468a63640 1 --2- 172.21.15.44:0/255882949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f646414c320 0x7f646414c730 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f64640735c0 tx=0x7f645c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=751bf0572615140 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:05.628 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.627+0000 7f6462ffd640 1 -- 172.21.15.44:0/255882949 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645c007740 con 0x7f646414c320 2024-05-16T22:27:05.628 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.627+0000 7f6462ffd640 1 -- 172.21.15.44:0/255882949 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f645c0078e0 con 0x7f646414c320 2024-05-16T22:27:05.628 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.627+0000 7f6462ffd640 1 -- 172.21.15.44:0/255882949 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645c007cb0 con 0x7f646414c320 2024-05-16T22:27:05.628 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.628+0000 7f646a4c6640 1 -- 172.21.15.44:0/255882949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f646414c320 msgr2=0x7f646414c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:05.628 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.628+0000 7f646a4c6640 1 --2- 172.21.15.44:0/255882949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f646414c320 0x7f646414c730 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f64640735c0 tx=0x7f645c02a5f0 comp rx=0 tx=0).stop 2024-05-16T22:27:05.628 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.628+0000 7f646a4c6640 1 -- 172.21.15.44:0/255882949 shutdown_connections 2024-05-16T22:27:05.628 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.628+0000 7f646a4c6640 1 --2- 172.21.15.44:0/255882949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f646414c320 0x7f646414c730 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:05.628 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.628+0000 7f646a4c6640 1 --2- 172.21.15.44:0/255882949 >> v2:172.21.15.70:3300/0 conn(0x7f64640bd870 0x7f64640b8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:05.629 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.628+0000 7f646a4c6640 1 -- 172.21.15.44:0/255882949 >> 172.21.15.44:0/255882949 conn(0x7f64640c1680 msgr2=0x7f64640c1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:05.629 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.628+0000 7f646a4c6640 1 -- 172.21.15.44:0/255882949 shutdown_connections 2024-05-16T22:27:05.629 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.628+0000 7f646a4c6640 1 -- 172.21.15.44:0/255882949 wait complete. 2024-05-16T22:27:05.629 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.629+0000 7f646a4c6640 1 Processor -- start 2024-05-16T22:27:05.629 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.629+0000 7f646a4c6640 1 -- start start 2024-05-16T22:27:05.631 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.630+0000 7f646a4c6640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f64640bd870 0x7f646413a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:05.632 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.630+0000 7f646a4c6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6464146690 0x7f6464145490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:05.632 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.630+0000 7f646a4c6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f646414c320 0x7f64641e48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:05.632 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.630+0000 7f646a4c6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6464156ba0 con 0x7f646414c320 2024-05-16T22:27:05.632 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.630+0000 7f646a4c6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f64640b9ed0 con 0x7f6464146690 2024-05-16T22:27:05.632 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.630+0000 7f646a4c6640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f6464156d20 con 0x7f64640bd870 2024-05-16T22:27:05.632 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.631+0000 7f6468a63640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f646414c320 0x7f64641e48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:05.632 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.631+0000 7f6468a63640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f646414c320 0x7f64641e48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56262/0 (socket says 172.21.15.44:56262) 2024-05-16T22:27:05.632 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.631+0000 7f6468a63640 1 -- 172.21.15.44:0/3317616888 learned_addr learned my addr 172.21.15.44:0/3317616888 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:05.632 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.631+0000 7f64637fe640 1 --2- 172.21.15.44:0/3317616888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6464146690 0x7f6464145490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:05.632 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.631+0000 7f6463fff640 1 --2- 172.21.15.44:0/3317616888 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f64640bd870 0x7f646413a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:05.632 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.631+0000 7f6468a63640 1 -- 172.21.15.44:0/3317616888 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f64640bd870 msgr2=0x7f646413a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:05.632 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.631+0000 7f6468a63640 1 --2- 172.21.15.44:0/3317616888 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f64640bd870 0x7f646413a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:05.633 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.631+0000 7f6468a63640 1 -- 172.21.15.44:0/3317616888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6464146690 msgr2=0x7f6464145490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:05.633 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.631+0000 7f6468a63640 1 --2- 172.21.15.44:0/3317616888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6464146690 0x7f6464145490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:05.633 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.631+0000 7f6468a63640 1 -- 172.21.15.44:0/3317616888 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f646413a5f0 con 0x7f646414c320 2024-05-16T22:27:05.633 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.631+0000 7f6468a63640 1 --2- 172.21.15.44:0/3317616888 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f646414c320 0x7f64641e48f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f645c009e50 tx=0x7f645c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:05.633 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.631+0000 7f6460ff9640 1 -- 172.21.15.44:0/3317616888 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645c03f070 con 0x7f646414c320 2024-05-16T22:27:05.633 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.631+0000 7f6460ff9640 1 -- 172.21.15.44:0/3317616888 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f645c031bf0 con 0x7f646414c320 2024-05-16T22:27:05.633 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.631+0000 7f6460ff9640 1 -- 172.21.15.44:0/3317616888 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645c009450 con 0x7f646414c320 2024-05-16T22:27:05.633 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.631+0000 7f646a4c6640 1 -- 172.21.15.44:0/3317616888 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64641444a0 con 0x7f646414c320 2024-05-16T22:27:05.633 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.631+0000 7f646a4c6640 1 -- 172.21.15.44:0/3317616888 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6464145be0 con 0x7f646414c320 2024-05-16T22:27:05.633 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.632+0000 7f6460ff9640 1 -- 172.21.15.44:0/3317616888 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f645c044460 con 0x7f646414c320 2024-05-16T22:27:05.633 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.632+0000 7f6460ff9640 1 -- 172.21.15.44:0/3317616888 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f645c03bb30 con 0x7f646414c320 2024-05-16T22:27:05.633 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.632+0000 7f646a4c6640 1 -- 172.21.15.44:0/3317616888 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f646406a050 con 0x7f646414c320 2024-05-16T22:27:05.634 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.635+0000 7f6460ff9640 1 -- 172.21.15.44:0/3317616888 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f64641444a0 con 0x7f646414c320 2024-05-16T22:27:05.637 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-16T22:27:05.636+0000 7fba1451c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-16T22:27:05.697 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.698+0000 7f646a4c6640 1 -- 172.21.15.44:0/3317616888 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f646413bdb0 con 0x7f646414c320 2024-05-16T22:27:05.697 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.698+0000 7f6460ff9640 1 -- 172.21.15.44:0/3317616888 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f645c03be10 con 0x7f646414c320 2024-05-16T22:27:05.698 INFO:teuthology.misc.health.smithi044.stdout: 2024-05-16T22:27:05.698 INFO:teuthology.misc.health.smithi044.stdout:{"epoch":10,"fsid":"572ab7cc-b103-4548-ae8f-c6614d57f0c8","created":"2024-05-16T22:27:02.216874+0000","modified":"2024-05-16T22:27:04.455119+0000","last_up_change":"0.000000","last_in_change":"2024-05-16T22:27:04.455119+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a7003e89-c706-4562-9f25-670bb35ae108","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a4d5169d-8327-4494-9c7c-58db21b00636","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d4a834f8-83a5-400f-9814-eb0a25124df4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b9d24a56-ad43-4674-a395-5ec24d135ae8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9bd94af5-3e17-4cbe-995a-8f837a66c653","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a5b0cfa5-b259-48bd-98b6-96b44f5ebabd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0b6af6df-1358-4fc6-a62c-ba57e02914ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"eb1a2c5d-42cf-47d0-9e03-b9d26944a589","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T22:27:05.699 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.699+0000 7f646a4c6640 1 -- 172.21.15.44:0/3317616888 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f646414c320 msgr2=0x7f64641e48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:05.699 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.699+0000 7f646a4c6640 1 --2- 172.21.15.44:0/3317616888 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f646414c320 0x7f64641e48f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f645c009e50 tx=0x7f645c004a40 comp rx=0 tx=0).stop 2024-05-16T22:27:05.699 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.699+0000 7f646a4c6640 1 -- 172.21.15.44:0/3317616888 shutdown_connections 2024-05-16T22:27:05.699 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.699+0000 7f646a4c6640 1 --2- 172.21.15.44:0/3317616888 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f646414c320 0x7f64641e48f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:05.699 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.699+0000 7f646a4c6640 1 --2- 172.21.15.44:0/3317616888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6464146690 0x7f6464145490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:05.699 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.699+0000 7f646a4c6640 1 --2- 172.21.15.44:0/3317616888 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f64640bd870 0x7f646413a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:05.699 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.699+0000 7f646a4c6640 1 -- 172.21.15.44:0/3317616888 >> 172.21.15.44:0/3317616888 conn(0x7f64640c1680 msgr2=0x7f646413a950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:05.699 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.699+0000 7f646a4c6640 1 -- 172.21.15.44:0/3317616888 shutdown_connections 2024-05-16T22:27:05.699 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:05.699+0000 7f646a4c6640 1 -- 172.21.15.44:0/3317616888 wait complete. 2024-05-16T22:27:05.708 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-16T22:27:05.725 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-05-16T22:27:05.726+0000 7f5ed2b17040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-16T22:27:05.772 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-16T22:27:05.773+0000 7fba1451c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-16T22:27:05.820 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-16T22:27:05.821+0000 7fba1451c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-16T22:27:05.870 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-05-16T22:27:05.871+0000 7f5ed2b17040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-16T22:27:05.889 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-16T22:27:05.890+0000 7fba1451c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-16T22:27:05.923 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-05-16T22:27:05.923+0000 7f5ed2b17040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-16T22:27:05.935 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-16T22:27:05.935+0000 7fba1451c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-16T22:27:05.997 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-05-16T22:27:05.998+0000 7f5ed2b17040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-16T22:27:06.045 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-05-16T22:27:06.046+0000 7f5ed2b17040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-16T22:27:06.415 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-16T22:27:06.415+0000 7fba1451c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-16T22:27:06.532 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-16T22:27:06.532+0000 7fba1451c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-16T22:27:06.553 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-05-16T22:27:06.554+0000 7f5ed2b17040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-16T22:27:06.678 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-05-16T22:27:06.677+0000 7f5ed2b17040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-16T22:27:07.549 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-16T22:27:07.550+0000 7fb9b3e95640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-16T22:27:07.550 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-05-16T22:27:07.551+0000 7fb9b3e95640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-16T22:27:08.569 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-05-16T22:27:08.570+0000 7ff95ea24640 -1 osd.2 0 log_to_monitors true 2024-05-16T22:27:08.589 INFO:tasks.ceph.osd.6.smithi070.stderr:2024-05-16T22:27:08.590+0000 7fb4af014640 -1 osd.6 0 log_to_monitors true 2024-05-16T22:27:08.622 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-05-16T22:27:08.623+0000 7fb219c2f640 -1 osd.3 0 log_to_monitors true 2024-05-16T22:27:08.641 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-05-16T22:27:08.642+0000 7fdc55a1b640 -1 osd.1 0 log_to_monitors true 2024-05-16T22:27:08.648 INFO:tasks.ceph.osd.7.smithi070.stderr:2024-05-16T22:27:08.649+0000 7f21a3614640 -1 osd.7 0 log_to_monitors true 2024-05-16T22:27:08.652 INFO:tasks.ceph.osd.5.smithi070.stderr:2024-05-16T22:27:08.653+0000 7f43d740e640 -1 osd.5 0 log_to_monitors true 2024-05-16T22:27:08.652 INFO:tasks.ceph.osd.4.smithi070.stderr:2024-05-16T22:27:08.653+0000 7f363dd01640 -1 osd.4 0 log_to_monitors true 2024-05-16T22:27:08.654 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-05-16T22:27:08.655+0000 7f1980415640 -1 osd.0 0 log_to_monitors true 2024-05-16T22:27:11.581 INFO:tasks.ceph.osd.4.smithi070.stderr:2024-05-16T22:27:11.581+0000 7f3639c97640 -1 osd.4 0 waiting for initial osdmap 2024-05-16T22:27:11.601 INFO:tasks.ceph.osd.6.smithi070.stderr:2024-05-16T22:27:11.602+0000 7fb4aa8a5640 -1 osd.6 0 waiting for initial osdmap 2024-05-16T22:27:11.620 INFO:tasks.ceph.osd.4.smithi070.stderr:2024-05-16T22:27:11.621+0000 7f3631a92640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-16T22:27:11.620 INFO:tasks.ceph.osd.6.smithi070.stderr:2024-05-16T22:27:11.621+0000 7fb4a26a0640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-16T22:27:11.816 INFO:tasks.ceph.osd.5.smithi070.stderr:2024-05-16T22:27:11.817+0000 7f43d2d04640 -1 osd.5 0 waiting for initial osdmap 2024-05-16T22:27:11.842 INFO:tasks.ceph.osd.5.smithi070.stderr:2024-05-16T22:27:11.843+0000 7f43caaff640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-16T22:27:12.515 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-16T22:27:12.538 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-05-16T22:27:12.538+0000 7fb215180640 -1 osd.3 0 waiting for initial osdmap 2024-05-16T22:27:12.541 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-05-16T22:27:12.542+0000 7fdc519b1640 -1 osd.1 0 waiting for initial osdmap 2024-05-16T22:27:12.554 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-05-16T22:27:12.555+0000 7fb20cf8c640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-16T22:27:12.558 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-05-16T22:27:12.559+0000 7fdc497ac640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-16T22:27:12.597 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-05-16T22:27:12.597+0000 7ff95a31a640 -1 osd.2 0 waiting for initial osdmap 2024-05-16T22:27:12.617 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-05-16T22:27:12.618+0000 7ff952115640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-16T22:27:12.638 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-05-16T22:27:12.639+0000 7f197bcfb640 -1 osd.0 0 waiting for initial osdmap 2024-05-16T22:27:12.650 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-05-16T22:27:12.651+0000 7f1973af6640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-16T22:27:12.664 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.664+0000 7f4150100640 1 Processor -- start 2024-05-16T22:27:12.664 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.665+0000 7f4150100640 1 -- start start 2024-05-16T22:27:12.666 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.665+0000 7f4150100640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f41480a9160 0x7f414806d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:12.666 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.666+0000 7f4150100640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f41480be210 0x7f41480be620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:12.666 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.666+0000 7f4150100640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4148151ac0 0x7f4148151ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:12.666 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.666+0000 7f4150100640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f414814f250 con 0x7f41480a9160 2024-05-16T22:27:12.666 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.666+0000 7f4150100640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f414814e920 con 0x7f4148151ac0 2024-05-16T22:27:12.667 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.666+0000 7f4150100640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f414814ec00 con 0x7f41480be210 2024-05-16T22:27:12.667 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.666+0000 7f414de9c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f41480a9160 0x7f414806d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:12.667 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.666+0000 7f414de9c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f41480a9160 0x7f414806d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37972/0 (socket says 172.21.15.44:37972) 2024-05-16T22:27:12.667 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.666+0000 7f414de9c640 1 -- 172.21.15.44:0/566414799 learned_addr learned my addr 172.21.15.44:0/566414799 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:12.667 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.666+0000 7f414e69d640 1 --2- 172.21.15.44:0/566414799 >> v2:172.21.15.70:3300/0 conn(0x7f4148151ac0 0x7f4148151ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:12.667 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.666+0000 7f414d69b640 1 --2- 172.21.15.44:0/566414799 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f41480be210 0x7f41480be620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:12.667 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.666+0000 7f414de9c640 1 -- 172.21.15.44:0/566414799 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f41480be210 msgr2=0x7f41480be620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:12.667 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.666+0000 7f414de9c640 1 --2- 172.21.15.44:0/566414799 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f41480be210 0x7f41480be620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:12.667 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.666+0000 7f414de9c640 1 -- 172.21.15.44:0/566414799 >> v2:172.21.15.70:3300/0 conn(0x7f4148151ac0 msgr2=0x7f4148151ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:12.667 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.666+0000 7f414de9c640 1 --2- 172.21.15.44:0/566414799 >> v2:172.21.15.70:3300/0 conn(0x7f4148151ac0 0x7f4148151ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:12.667 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.666+0000 7f414de9c640 1 -- 172.21.15.44:0/566414799 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f414814eee0 con 0x7f41480a9160 2024-05-16T22:27:12.667 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.667+0000 7f414de9c640 1 --2- 172.21.15.44:0/566414799 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41480a9160 0x7f414806d960 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f414808df20 tx=0x7f413802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4834be5bdcd16c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:12.668 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.667+0000 7f414ce9a640 1 -- 172.21.15.44:0/566414799 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4138036070 con 0x7f41480a9160 2024-05-16T22:27:12.668 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.667+0000 7f414ce9a640 1 -- 172.21.15.44:0/566414799 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4138031600 con 0x7f41480a9160 2024-05-16T22:27:12.668 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.667+0000 7f414ce9a640 1 -- 172.21.15.44:0/566414799 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41380319d0 con 0x7f41480a9160 2024-05-16T22:27:12.669 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.667+0000 7f4150100640 1 -- 172.21.15.44:0/566414799 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41480a9160 msgr2=0x7f414806d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:12.669 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.667+0000 7f4150100640 1 --2- 172.21.15.44:0/566414799 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41480a9160 0x7f414806d960 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f414808df20 tx=0x7f413802a730 comp rx=0 tx=0).stop 2024-05-16T22:27:12.669 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.668+0000 7f4150100640 1 -- 172.21.15.44:0/566414799 shutdown_connections 2024-05-16T22:27:12.669 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.668+0000 7f4150100640 1 --2- 172.21.15.44:0/566414799 >> v2:172.21.15.70:3300/0 conn(0x7f4148151ac0 0x7f4148151ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:12.669 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.668+0000 7f4150100640 1 --2- 172.21.15.44:0/566414799 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f41480be210 0x7f41480be620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:12.669 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.668+0000 7f4150100640 1 --2- 172.21.15.44:0/566414799 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41480a9160 0x7f414806d960 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:12.669 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.668+0000 7f4150100640 1 -- 172.21.15.44:0/566414799 >> 172.21.15.44:0/566414799 conn(0x7f41480c3bb0 msgr2=0x7f41480c3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:12.669 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.668+0000 7f4150100640 1 -- 172.21.15.44:0/566414799 shutdown_connections 2024-05-16T22:27:12.669 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.668+0000 7f4150100640 1 -- 172.21.15.44:0/566414799 wait complete. 2024-05-16T22:27:12.669 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.669+0000 7f4150100640 1 Processor -- start 2024-05-16T22:27:12.670 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.669+0000 7f4150100640 1 -- start start 2024-05-16T22:27:12.672 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.670+0000 7f4150100640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41480a9160 0x7f41480b9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:12.672 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.670+0000 7f4150100640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f41480be210 0x7f41480b7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:12.672 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.670+0000 7f4150100640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4148151ac0 0x7f414814a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:12.672 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.670+0000 7f4150100640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f41480bff00 con 0x7f41480a9160 2024-05-16T22:27:12.672 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.670+0000 7f4150100640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f41480a9570 con 0x7f41480be210 2024-05-16T22:27:12.672 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.670+0000 7f4150100640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f41480a2e00 con 0x7f4148151ac0 2024-05-16T22:27:12.672 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.670+0000 7f414de9c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41480a9160 0x7f41480b9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:12.672 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.670+0000 7f414de9c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41480a9160 0x7f41480b9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37988/0 (socket says 172.21.15.44:37988) 2024-05-16T22:27:12.672 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.670+0000 7f414de9c640 1 -- 172.21.15.44:0/3793798358 learned_addr learned my addr 172.21.15.44:0/3793798358 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:12.672 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.670+0000 7f414d69b640 1 --2- 172.21.15.44:0/3793798358 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f41480be210 0x7f41480b7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:12.673 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.670+0000 7f414e69d640 1 --2- 172.21.15.44:0/3793798358 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4148151ac0 0x7f414814a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:12.673 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.671+0000 7f414de9c640 1 -- 172.21.15.44:0/3793798358 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4148151ac0 msgr2=0x7f414814a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:12.673 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.671+0000 7f414de9c640 1 --2- 172.21.15.44:0/3793798358 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4148151ac0 0x7f414814a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:12.673 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.671+0000 7f414de9c640 1 -- 172.21.15.44:0/3793798358 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f41480be210 msgr2=0x7f41480b7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:12.673 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.671+0000 7f414de9c640 1 --2- 172.21.15.44:0/3793798358 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f41480be210 0x7f41480b7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:12.673 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.671+0000 7f414de9c640 1 -- 172.21.15.44:0/3793798358 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41480ba0c0 con 0x7f41480a9160 2024-05-16T22:27:12.673 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.671+0000 7f414de9c640 1 --2- 172.21.15.44:0/3793798358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41480a9160 0x7f41480b9b80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4138034040 tx=0x7f4138004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:12.673 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.671+0000 7f41467fc640 1 -- 172.21.15.44:0/3793798358 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4138036050 con 0x7f41480a9160 2024-05-16T22:27:12.673 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.671+0000 7f41467fc640 1 -- 172.21.15.44:0/3793798358 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4138042070 con 0x7f41480a9160 2024-05-16T22:27:12.673 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.671+0000 7f4150100640 1 -- 172.21.15.44:0/3793798358 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41480b8350 con 0x7f41480a9160 2024-05-16T22:27:12.673 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.671+0000 7f41467fc640 1 -- 172.21.15.44:0/3793798358 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4138009510 con 0x7f41480a9160 2024-05-16T22:27:12.673 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.671+0000 7f4150100640 1 -- 172.21.15.44:0/3793798358 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41480c1ba0 con 0x7f41480a9160 2024-05-16T22:27:12.673 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.672+0000 7f4150100640 1 -- 172.21.15.44:0/3793798358 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4148069940 con 0x7f41480a9160 2024-05-16T22:27:12.674 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.673+0000 7f41467fc640 1 -- 172.21.15.44:0/3793798358 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7f4138007c70 con 0x7f41480a9160 2024-05-16T22:27:12.674 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.673+0000 7f41467fc640 1 --2- 172.21.15.44:0/3793798358 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4134076240 0x7f4134078750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:12.674 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.673+0000 7f41467fc640 1 -- 172.21.15.44:0/3793798358 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f41380b7340 con 0x7f41480a9160 2024-05-16T22:27:12.674 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.673+0000 7f414d69b640 1 --2- 172.21.15.44:0/3793798358 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4134076240 0x7f4134078750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:12.674 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.674+0000 7f414d69b640 1 --2- 172.21.15.44:0/3793798358 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4134076240 0x7f4134078750 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f414808d530 tx=0x7f413c009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:12.677 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.678+0000 7f41467fc640 1 -- 172.21.15.44:0/3793798358 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4138081550 con 0x7f41480a9160 2024-05-16T22:27:12.874 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.875+0000 7f4150100640 1 -- 172.21.15.44:0/3793798358 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f41480c3120 con 0x7f41480a9160 2024-05-16T22:27:12.875 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.876+0000 7f41467fc640 1 -- 172.21.15.44:0/3793798358 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+10399 (secure 0 0 0) 0x7f4138085850 con 0x7f41480a9160 2024-05-16T22:27:12.875 INFO:teuthology.misc.health.smithi044.stdout: 2024-05-16T22:27:12.875 INFO:teuthology.misc.health.smithi044.stdout:{"epoch":13,"fsid":"572ab7cc-b103-4548-ae8f-c6614d57f0c8","created":"2024-05-16T22:27:02.216874+0000","modified":"2024-05-16T22:27:12.684175+0000","last_up_change":"2024-05-16T22:27:12.684175+0000","last_in_change":"2024-05-16T22:27:04.455119+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a7003e89-c706-4562-9f25-670bb35ae108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6825","nonce":1074109859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6827","nonce":1074109859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6831","nonce":1074109859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6829","nonce":1074109859}]},"public_addr":"172.21.15.44:6825/1074109859","cluster_addr":"172.21.15.44:6827/1074109859","heartbeat_back_addr":"172.21.15.44:6831/1074109859","heartbeat_front_addr":"172.21.15.44:6829/1074109859","state":["exists","up"]},{"osd":1,"uuid":"a4d5169d-8327-4494-9c7c-58db21b00636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6817","nonce":2909429972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6819","nonce":2909429972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6823","nonce":2909429972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6821","nonce":2909429972}]},"public_addr":"172.21.15.44:6817/2909429972","cluster_addr":"172.21.15.44:6819/2909429972","heartbeat_back_addr":"172.21.15.44:6823/2909429972","heartbeat_front_addr":"172.21.15.44:6821/2909429972","state":["exists","up"]},{"osd":2,"uuid":"d4a834f8-83a5-400f-9814-eb0a25124df4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6801","nonce":2908194156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6803","nonce":2908194156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6807","nonce":2908194156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6805","nonce":2908194156}]},"public_addr":"172.21.15.44:6801/2908194156","cluster_addr":"172.21.15.44:6803/2908194156","heartbeat_back_addr":"172.21.15.44:6807/2908194156","heartbeat_front_addr":"172.21.15.44:6805/2908194156","state":["exists","up"]},{"osd":3,"uuid":"b9d24a56-ad43-4674-a395-5ec24d135ae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6809","nonce":2168695793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6811","nonce":2168695793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6815","nonce":2168695793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6813","nonce":2168695793}]},"public_addr":"172.21.15.44:6809/2168695793","cluster_addr":"172.21.15.44:6811/2168695793","heartbeat_back_addr":"172.21.15.44:6815/2168695793","heartbeat_front_addr":"172.21.15.44:6813/2168695793","state":["exists","up"]},{"osd":4,"uuid":"9bd94af5-3e17-4cbe-995a-8f837a66c653","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6823","nonce":1540297751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6825","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6827","nonce":1540297751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6831","nonce":1540297751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6829","nonce":1540297751}]},"public_addr":"172.21.15.70:6823/1540297751","cluster_addr":"172.21.15.70:6827/1540297751","heartbeat_back_addr":"172.21.15.70:6831/1540297751","heartbeat_front_addr":"172.21.15.70:6829/1540297751","state":["exists","up"]},{"osd":5,"uuid":"a5b0cfa5-b259-48bd-98b6-96b44f5ebabd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6804","nonce":4218901987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6808","nonce":4218901987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6815","nonce":4218901987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6812","nonce":4218901987}]},"public_addr":"172.21.15.70:6804/4218901987","cluster_addr":"172.21.15.70:6808/4218901987","heartbeat_back_addr":"172.21.15.70:6815/4218901987","heartbeat_front_addr":"172.21.15.70:6812/4218901987","state":["exists","up"]},{"osd":6,"uuid":"0b6af6df-1358-4fc6-a62c-ba57e02914ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6801","nonce":2389556489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6805","nonce":2389556489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6813","nonce":2389556489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6807","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6809","nonce":2389556489}]},"public_addr":"172.21.15.70:6801/2389556489","cluster_addr":"172.21.15.70:6805/2389556489","heartbeat_back_addr":"172.21.15.70:6813/2389556489","heartbeat_front_addr":"172.21.15.70:6809/2389556489","state":["exists","up"]},{"osd":7,"uuid":"eb1a2c5d-42cf-47d0-9e03-b9d26944a589","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T22:27:12.877 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.878+0000 7f4150100640 1 -- 172.21.15.44:0/3793798358 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4134076240 msgr2=0x7f4134078750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:12.878 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.878+0000 7f4150100640 1 --2- 172.21.15.44:0/3793798358 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4134076240 0x7f4134078750 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f414808d530 tx=0x7f413c009190 comp rx=0 tx=0).stop 2024-05-16T22:27:12.878 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.878+0000 7f4150100640 1 -- 172.21.15.44:0/3793798358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41480a9160 msgr2=0x7f41480b9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:12.878 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.878+0000 7f4150100640 1 --2- 172.21.15.44:0/3793798358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41480a9160 0x7f41480b9b80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4138034040 tx=0x7f4138004a40 comp rx=0 tx=0).stop 2024-05-16T22:27:12.878 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.878+0000 7f4150100640 1 -- 172.21.15.44:0/3793798358 shutdown_connections 2024-05-16T22:27:12.878 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.878+0000 7f4150100640 1 --2- 172.21.15.44:0/3793798358 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4134076240 0x7f4134078750 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:12.878 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.878+0000 7f4150100640 1 --2- 172.21.15.44:0/3793798358 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4148151ac0 0x7f414814a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:12.878 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.878+0000 7f4150100640 1 --2- 172.21.15.44:0/3793798358 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f41480be210 0x7f41480b7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:12.878 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.878+0000 7f4150100640 1 --2- 172.21.15.44:0/3793798358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41480a9160 0x7f41480b9b80 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:12.878 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.878+0000 7f4150100640 1 -- 172.21.15.44:0/3793798358 >> 172.21.15.44:0/3793798358 conn(0x7f41480c3bb0 msgr2=0x7f414806d870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:12.878 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.878+0000 7f4150100640 1 -- 172.21.15.44:0/3793798358 shutdown_connections 2024-05-16T22:27:12.878 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:12.878+0000 7f4150100640 1 -- 172.21.15.44:0/3793798358 wait complete. 2024-05-16T22:27:12.887 DEBUG:teuthology.misc:7 of 8 OSDs are up 2024-05-16T22:27:13.412 INFO:tasks.ceph.osd.7.smithi070.stderr:2024-05-16T22:27:13.412+0000 7f219f059640 -1 osd.7 0 waiting for initial osdmap 2024-05-16T22:27:13.421 INFO:tasks.ceph.osd.7.smithi070.stderr:2024-05-16T22:27:13.422+0000 7f2196e54640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-16T22:27:19.695 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-16T22:27:19.813 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.813+0000 7f9985c69640 1 Processor -- start 2024-05-16T22:27:19.813 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.814+0000 7f9985c69640 1 -- start start 2024-05-16T22:27:19.814 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.815+0000 7f9985c69640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f99800ba5e0 0x7f99800bd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:19.815 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.815+0000 7f9985c69640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f99800ba9f0 0x7f99800bd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:19.815 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.815+0000 7f9985c69640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9980150650 con 0x7f99800bedf0 2024-05-16T22:27:19.815 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.815+0000 7f9985c69640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f998014fab0 con 0x7f99800ba9f0 2024-05-16T22:27:19.815 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.815+0000 7f9985c69640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f9980074c50 con 0x7f99800ba5e0 2024-05-16T22:27:19.815 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.815+0000 7f997ffff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f99800ba9f0 0x7f99800bd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:19.815 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.815+0000 7f997f7fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f99800bedf0 0x7f998014ff40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49458/0 (socket says 172.21.15.44:49458) 2024-05-16T22:27:19.815 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.815+0000 7f997f7fe640 1 -- 172.21.15.44:0/4182073745 learned_addr learned my addr 172.21.15.44:0/4182073745 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:27:19.815 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.815+0000 7f997effd640 1 --2- 172.21.15.44:0/4182073745 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f99800ba5e0 0x7f99800bd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:19.815 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.815+0000 7f997ffff640 1 -- 172.21.15.44:0/4182073745 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f99800ba5e0 msgr2=0x7f99800bd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:19.815 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.815+0000 7f997ffff640 1 --2- 172.21.15.44:0/4182073745 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f99800ba5e0 0x7f99800bd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:19.815 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.815+0000 7f997ffff640 1 -- 172.21.15.44:0/4182073745 >> v1:172.21.15.44:6789/0 conn(0x7f99800bedf0 legacy=0x7f998014ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:19.816 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.815+0000 7f997ffff640 1 -- 172.21.15.44:0/4182073745 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f998006eba0 con 0x7f99800ba9f0 2024-05-16T22:27:19.816 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.815+0000 7f997e7fc640 1 -- 172.21.15.44:0/4182073745 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3729204780 0 0) 0x7f9980150650 con 0x7f99800bedf0 2024-05-16T22:27:19.817 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.816+0000 7f997ffff640 1 --2- 172.21.15.44:0/4182073745 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99800ba9f0 0x7f99800bd920 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9978009d90 tx=0x7f997802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59d8830543a312d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:19.817 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.816+0000 7f997e7fc640 1 -- 172.21.15.44:0/4182073745 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9978007740 con 0x7f99800ba9f0 2024-05-16T22:27:19.817 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.816+0000 7f997e7fc640 1 -- 172.21.15.44:0/4182073745 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99780078e0 con 0x7f99800ba9f0 2024-05-16T22:27:19.817 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.816+0000 7f997e7fc640 1 -- 172.21.15.44:0/4182073745 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9978007cb0 con 0x7f99800ba9f0 2024-05-16T22:27:19.817 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.817+0000 7f9985c69640 1 -- 172.21.15.44:0/4182073745 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99800ba9f0 msgr2=0x7f99800bd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:19.817 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.817+0000 7f9985c69640 1 --2- 172.21.15.44:0/4182073745 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99800ba9f0 0x7f99800bd920 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9978009d90 tx=0x7f997802a660 comp rx=0 tx=0).stop 2024-05-16T22:27:19.818 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.817+0000 7f9985c69640 1 -- 172.21.15.44:0/4182073745 shutdown_connections 2024-05-16T22:27:19.818 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.817+0000 7f9985c69640 1 --2- 172.21.15.44:0/4182073745 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99800ba9f0 0x7f99800bd920 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:19.818 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.817+0000 7f9985c69640 1 --2- 172.21.15.44:0/4182073745 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f99800ba5e0 0x7f99800bd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:19.818 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.817+0000 7f9985c69640 1 -- 172.21.15.44:0/4182073745 >> 172.21.15.44:0/4182073745 conn(0x7f99800a1390 msgr2=0x7f99800a17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:19.818 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.817+0000 7f9985c69640 1 -- 172.21.15.44:0/4182073745 shutdown_connections 2024-05-16T22:27:19.818 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.817+0000 7f9985c69640 1 -- 172.21.15.44:0/4182073745 wait complete. 2024-05-16T22:27:19.819 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.819+0000 7f9985c69640 1 Processor -- start 2024-05-16T22:27:19.819 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.819+0000 7f9985c69640 1 -- start start 2024-05-16T22:27:19.821 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.820+0000 7f9985c69640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f99800ba5e0 0x7f99801436f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:19.821 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.820+0000 7f9985c69640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99800ba9f0 0x7f9980072210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:19.821 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.820+0000 7f9985c69640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99800bedf0 0x7f99800b4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:19.821 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.820+0000 7f9985c69640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f99801467c0 con 0x7f99800ba9f0 2024-05-16T22:27:19.821 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.820+0000 7f9985c69640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f998014f740 con 0x7f99800bedf0 2024-05-16T22:27:19.821 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.820+0000 7f9985c69640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f9980146940 con 0x7f99800ba5e0 2024-05-16T22:27:19.821 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.820+0000 7f997effd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99800ba9f0 0x7f9980072210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:19.821 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.820+0000 7f997effd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99800ba9f0 0x7f9980072210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54098/0 (socket says 172.21.15.44:54098) 2024-05-16T22:27:19.822 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.820+0000 7f997effd640 1 -- 172.21.15.44:0/3198186532 learned_addr learned my addr 172.21.15.44:0/3198186532 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:19.822 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.820+0000 7f997f7fe640 1 --2- 172.21.15.44:0/3198186532 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f99800ba5e0 0x7f99801436f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:19.822 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.820+0000 7f997ffff640 1 --2- 172.21.15.44:0/3198186532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99800bedf0 0x7f99800b4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:19.822 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.820+0000 7f997effd640 1 -- 172.21.15.44:0/3198186532 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f99800ba5e0 msgr2=0x7f99801436f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:19.822 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.820+0000 7f997effd640 1 --2- 172.21.15.44:0/3198186532 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f99800ba5e0 0x7f99801436f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:19.822 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.820+0000 7f997effd640 1 -- 172.21.15.44:0/3198186532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99800bedf0 msgr2=0x7f99800b4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:19.822 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.820+0000 7f997effd640 1 --2- 172.21.15.44:0/3198186532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99800bedf0 0x7f99800b4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:19.822 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.820+0000 7f997effd640 1 -- 172.21.15.44:0/3198186532 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9980143c30 con 0x7f99800ba9f0 2024-05-16T22:27:19.822 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.820+0000 7f997ffff640 1 --2- 172.21.15.44:0/3198186532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99800bedf0 0x7f99800b4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:27:19.822 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.821+0000 7f997effd640 1 --2- 172.21.15.44:0/3198186532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99800ba9f0 0x7f9980072210 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f997400e800 tx=0x7f997400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:19.822 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.821+0000 7f9967fff640 1 -- 172.21.15.44:0/3198186532 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9974017070 con 0x7f99800ba9f0 2024-05-16T22:27:19.823 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.821+0000 7f9967fff640 1 -- 172.21.15.44:0/3198186532 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f997400c940 con 0x7f99800ba9f0 2024-05-16T22:27:19.823 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.821+0000 7f9967fff640 1 -- 172.21.15.44:0/3198186532 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997400ccf0 con 0x7f99800ba9f0 2024-05-16T22:27:19.823 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.821+0000 7f9985c69640 1 -- 172.21.15.44:0/3198186532 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f998014d1b0 con 0x7f99800ba9f0 2024-05-16T22:27:19.823 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.821+0000 7f9985c69640 1 -- 172.21.15.44:0/3198186532 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99800b5c70 con 0x7f99800ba9f0 2024-05-16T22:27:19.824 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.822+0000 7f9985c69640 1 -- 172.21.15.44:0/3198186532 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99800b5a60 con 0x7f99800ba9f0 2024-05-16T22:27:19.824 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.822+0000 7f9967fff640 1 -- 172.21.15.44:0/3198186532 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f997401a070 con 0x7f99800ba9f0 2024-05-16T22:27:19.824 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.823+0000 7f9967fff640 1 --2- 172.21.15.44:0/3198186532 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f996c0762d0 0x7f996c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:19.824 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.823+0000 7f9967fff640 1 -- 172.21.15.44:0/3198186532 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f9974097580 con 0x7f99800ba9f0 2024-05-16T22:27:19.824 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.823+0000 7f997f7fe640 1 --2- 172.21.15.44:0/3198186532 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f996c0762d0 0x7f996c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:19.824 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.824+0000 7f997f7fe640 1 --2- 172.21.15.44:0/3198186532 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f996c0762d0 0x7f996c0787e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9970007fd0 tx=0x7f9970007de0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:19.827 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:19.828+0000 7f9967fff640 1 -- 172.21.15.44:0/3198186532 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9974060b50 con 0x7f99800ba9f0 2024-05-16T22:27:20.018 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:20.019+0000 7f9985c69640 1 -- 172.21.15.44:0/3198186532 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9980069940 con 0x7f99800ba9f0 2024-05-16T22:27:20.019 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:20.019+0000 7f9967fff640 1 -- 172.21.15.44:0/3198186532 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12848 (secure 0 0 0) 0x7f9974069220 con 0x7f99800ba9f0 2024-05-16T22:27:20.019 INFO:teuthology.misc.health.smithi044.stdout: 2024-05-16T22:27:20.019 INFO:teuthology.misc.health.smithi044.stdout:{"epoch":17,"fsid":"572ab7cc-b103-4548-ae8f-c6614d57f0c8","created":"2024-05-16T22:27:02.216874+0000","modified":"2024-05-16T22:27:16.715465+0000","last_up_change":"2024-05-16T22:27:13.693953+0000","last_in_change":"2024-05-16T22:27:04.455119+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-16T22:27:14.562409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a7003e89-c706-4562-9f25-670bb35ae108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6825","nonce":1074109859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6827","nonce":1074109859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6831","nonce":1074109859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6829","nonce":1074109859}]},"public_addr":"172.21.15.44:6825/1074109859","cluster_addr":"172.21.15.44:6827/1074109859","heartbeat_back_addr":"172.21.15.44:6831/1074109859","heartbeat_front_addr":"172.21.15.44:6829/1074109859","state":["exists","up"]},{"osd":1,"uuid":"a4d5169d-8327-4494-9c7c-58db21b00636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6817","nonce":2909429972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6819","nonce":2909429972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6823","nonce":2909429972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6821","nonce":2909429972}]},"public_addr":"172.21.15.44:6817/2909429972","cluster_addr":"172.21.15.44:6819/2909429972","heartbeat_back_addr":"172.21.15.44:6823/2909429972","heartbeat_front_addr":"172.21.15.44:6821/2909429972","state":["exists","up"]},{"osd":2,"uuid":"d4a834f8-83a5-400f-9814-eb0a25124df4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6801","nonce":2908194156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6803","nonce":2908194156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6807","nonce":2908194156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6805","nonce":2908194156}]},"public_addr":"172.21.15.44:6801/2908194156","cluster_addr":"172.21.15.44:6803/2908194156","heartbeat_back_addr":"172.21.15.44:6807/2908194156","heartbeat_front_addr":"172.21.15.44:6805/2908194156","state":["exists","up"]},{"osd":3,"uuid":"b9d24a56-ad43-4674-a395-5ec24d135ae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6809","nonce":2168695793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6811","nonce":2168695793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6815","nonce":2168695793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6813","nonce":2168695793}]},"public_addr":"172.21.15.44:6809/2168695793","cluster_addr":"172.21.15.44:6811/2168695793","heartbeat_back_addr":"172.21.15.44:6815/2168695793","heartbeat_front_addr":"172.21.15.44:6813/2168695793","state":["exists","up"]},{"osd":4,"uuid":"9bd94af5-3e17-4cbe-995a-8f837a66c653","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6823","nonce":1540297751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6825","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6827","nonce":1540297751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6831","nonce":1540297751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6829","nonce":1540297751}]},"public_addr":"172.21.15.70:6823/1540297751","cluster_addr":"172.21.15.70:6827/1540297751","heartbeat_back_addr":"172.21.15.70:6831/1540297751","heartbeat_front_addr":"172.21.15.70:6829/1540297751","state":["exists","up"]},{"osd":5,"uuid":"a5b0cfa5-b259-48bd-98b6-96b44f5ebabd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6804","nonce":4218901987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6808","nonce":4218901987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6815","nonce":4218901987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6812","nonce":4218901987}]},"public_addr":"172.21.15.70:6804/4218901987","cluster_addr":"172.21.15.70:6808/4218901987","heartbeat_back_addr":"172.21.15.70:6815/4218901987","heartbeat_front_addr":"172.21.15.70:6812/4218901987","state":["exists","up"]},{"osd":6,"uuid":"0b6af6df-1358-4fc6-a62c-ba57e02914ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6801","nonce":2389556489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6805","nonce":2389556489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6813","nonce":2389556489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6807","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6809","nonce":2389556489}]},"public_addr":"172.21.15.70:6801/2389556489","cluster_addr":"172.21.15.70:6805/2389556489","heartbeat_back_addr":"172.21.15.70:6813/2389556489","heartbeat_front_addr":"172.21.15.70:6809/2389556489","state":["exists","up"]},{"osd":7,"uuid":"eb1a2c5d-42cf-47d0-9e03-b9d26944a589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6817","nonce":3619691281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6819","nonce":3619691281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6826","nonce":3619691281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6822","nonce":3619691281}]},"public_addr":"172.21.15.70:6817/3619691281","cluster_addr":"172.21.15.70:6819/3619691281","heartbeat_back_addr":"172.21.15.70:6826/3619691281","heartbeat_front_addr":"172.21.15.70:6822/3619691281","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.652256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.613348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.528454+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.625204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.678845+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.680829+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.556200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.647030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T22:27:20.021 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:20.021+0000 7f9985c69640 1 -- 172.21.15.44:0/3198186532 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f996c0762d0 msgr2=0x7f996c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:20.021 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:20.021+0000 7f9985c69640 1 --2- 172.21.15.44:0/3198186532 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f996c0762d0 0x7f996c0787e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9970007fd0 tx=0x7f9970007de0 comp rx=0 tx=0).stop 2024-05-16T22:27:20.021 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:20.021+0000 7f9985c69640 1 -- 172.21.15.44:0/3198186532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99800ba9f0 msgr2=0x7f9980072210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:20.022 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:20.021+0000 7f9985c69640 1 --2- 172.21.15.44:0/3198186532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99800ba9f0 0x7f9980072210 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f997400e800 tx=0x7f997400ecc0 comp rx=0 tx=0).stop 2024-05-16T22:27:20.022 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:20.021+0000 7f9985c69640 1 -- 172.21.15.44:0/3198186532 shutdown_connections 2024-05-16T22:27:20.022 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:20.021+0000 7f9985c69640 1 --2- 172.21.15.44:0/3198186532 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f996c0762d0 0x7f996c0787e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:20.022 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:20.021+0000 7f9985c69640 1 --2- 172.21.15.44:0/3198186532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99800bedf0 0x7f99800b4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:20.022 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:20.021+0000 7f9985c69640 1 --2- 172.21.15.44:0/3198186532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99800ba9f0 0x7f9980072210 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:20.022 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:20.021+0000 7f9985c69640 1 --2- 172.21.15.44:0/3198186532 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f99800ba5e0 0x7f99801436f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:20.022 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:20.021+0000 7f9985c69640 1 -- 172.21.15.44:0/3198186532 >> 172.21.15.44:0/3198186532 conn(0x7f99800a1390 msgr2=0x7f9980145e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:20.022 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:20.022+0000 7f9985c69640 1 -- 172.21.15.44:0/3198186532 shutdown_connections 2024-05-16T22:27:20.022 INFO:teuthology.misc.health.smithi044.stderr:2024-05-16T22:27:20.022+0000 7f9985c69640 1 -- 172.21.15.44:0/3198186532 wait complete. 2024-05-16T22:27:20.031 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-16T22:27:20.031 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-16T22:27:20.031 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-16T22:27:20.032 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-16T22:27:20.034 INFO:tasks.ceph.mds.a:Started 2024-05-16T22:27:20.034 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-16T22:27:20.034 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-16T22:27:20.036 INFO:tasks.ceph.mds.c:Started 2024-05-16T22:27:20.036 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-16T22:27:20.036 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-16T22:27:20.039 INFO:tasks.ceph.mds.b:Started 2024-05-16T22:27:20.039 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-16T22:27:20.039 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T22:27:20.120 INFO:tasks.ceph.mds.a.smithi044.stdout:starting mds.a at 2024-05-16T22:27:20.122 INFO:tasks.ceph.mds.c.smithi044.stdout:starting mds.c at 2024-05-16T22:27:20.134 INFO:tasks.ceph.mds.b.smithi070.stdout:starting mds.b at 2024-05-16T22:27:20.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.158+0000 7ff29aa1e640 1 Processor -- start 2024-05-16T22:27:20.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.158+0000 7ff29aa1e640 1 -- start start 2024-05-16T22:27:20.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.159+0000 7ff29aa1e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff29414e530 0x7ff2940ba320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:20.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.159+0000 7ff29aa1e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff2940b8d70 0x7ff2940b9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:20.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.159+0000 7ff29aa1e640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2940ba860 con 0x7ff2940bd440 2024-05-16T22:27:20.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.159+0000 7ff29aa1e640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7ff2940b88e0 con 0x7ff29414e530 2024-05-16T22:27:20.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.159+0000 7ff29aa1e640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7ff29414ece0 con 0x7ff2940b8d70 2024-05-16T22:27:20.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.159+0000 7ff293fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff29414e530 0x7ff2940ba320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:20.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.159+0000 7ff293fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff29414e530 0x7ff2940ba320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54126/0 (socket says 172.21.15.44:54126) 2024-05-16T22:27:20.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.159+0000 7ff293fff640 1 -- 172.21.15.44:0/649497446 learned_addr learned my addr 172.21.15.44:0/649497446 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:20.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.159+0000 7ff293fff640 1 -- 172.21.15.44:0/649497446 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff2940b8d70 msgr2=0x7ff2940b9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:20.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.159+0000 7ff298fbb640 1 --2- 172.21.15.44:0/649497446 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff2940b8d70 0x7ff2940b9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:20.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.159+0000 7ff293fff640 1 --2- 172.21.15.44:0/649497446 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff2940b8d70 0x7ff2940b9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:20.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.159+0000 7ff293fff640 1 -- 172.21.15.44:0/649497446 >> v1:172.21.15.70:6789/0 conn(0x7ff2940bd440 legacy=0x7ff2940bd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:20.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.159+0000 7ff293fff640 1 -- 172.21.15.44:0/649497446 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff29414efc0 con 0x7ff29414e530 2024-05-16T22:27:20.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.160+0000 7ff293fff640 1 --2- 172.21.15.44:0/649497446 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff29414e530 0x7ff2940ba320 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff27c009850 tx=0x7ff27c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea6dbb49ea92c3fe server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:20.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.160+0000 7ff292ffd640 1 -- 172.21.15.44:0/649497446 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff27c004030 con 0x7ff29414e530 2024-05-16T22:27:20.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.160+0000 7ff292ffd640 1 -- 172.21.15.44:0/649497446 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff27c0041d0 con 0x7ff29414e530 2024-05-16T22:27:20.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.160+0000 7ff292ffd640 1 -- 172.21.15.44:0/649497446 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff27c003610 con 0x7ff29414e530 2024-05-16T22:27:20.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.161+0000 7ff29aa1e640 1 -- 172.21.15.44:0/649497446 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff29414e530 msgr2=0x7ff2940ba320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:20.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.161+0000 7ff29aa1e640 1 --2- 172.21.15.44:0/649497446 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff29414e530 0x7ff2940ba320 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff27c009850 tx=0x7ff27c02a230 comp rx=0 tx=0).stop 2024-05-16T22:27:20.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.161+0000 7ff29aa1e640 1 -- 172.21.15.44:0/649497446 shutdown_connections 2024-05-16T22:27:20.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.161+0000 7ff29aa1e640 1 --2- 172.21.15.44:0/649497446 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff2940b8d70 0x7ff2940b9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:20.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.161+0000 7ff29aa1e640 1 --2- 172.21.15.44:0/649497446 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff29414e530 0x7ff2940ba320 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:20.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.161+0000 7ff29aa1e640 1 -- 172.21.15.44:0/649497446 >> 172.21.15.44:0/649497446 conn(0x7ff2940c0570 msgr2=0x7ff2940c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:20.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.161+0000 7ff29aa1e640 1 -- 172.21.15.44:0/649497446 shutdown_connections 2024-05-16T22:27:20.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.161+0000 7ff29aa1e640 1 -- 172.21.15.44:0/649497446 wait complete. 2024-05-16T22:27:20.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.162+0000 7ff29aa1e640 1 Processor -- start 2024-05-16T22:27:20.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.163+0000 7ff29aa1e640 1 -- start start 2024-05-16T22:27:20.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.163+0000 7ff29aa1e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2940b8d70 0x7ff29414c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:20.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.164+0000 7ff29aa1e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2940bd440 0x7ff29413db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:20.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.164+0000 7ff29aa1e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff29414e530 0x7ff2941e7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:20.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.164+0000 7ff29aa1e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff2940b96c0 con 0x7ff2940bd440 2024-05-16T22:27:20.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.164+0000 7ff29aa1e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff2940bbb70 con 0x7ff2940b8d70 2024-05-16T22:27:20.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.164+0000 7ff29aa1e640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7ff29414e940 con 0x7ff29414e530 2024-05-16T22:27:20.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.164+0000 7ff2937fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2940bd440 0x7ff29413db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:20.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.164+0000 7ff2937fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2940bd440 0x7ff29413db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54142/0 (socket says 172.21.15.44:54142) 2024-05-16T22:27:20.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.164+0000 7ff2937fe640 1 -- 172.21.15.44:0/797160294 learned_addr learned my addr 172.21.15.44:0/797160294 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:20.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.164+0000 7ff298fbb640 1 --2- 172.21.15.44:0/797160294 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff29414e530 0x7ff2941e7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:20.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.164+0000 7ff293fff640 1 --2- 172.21.15.44:0/797160294 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2940b8d70 0x7ff29414c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:20.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.164+0000 7ff2937fe640 1 -- 172.21.15.44:0/797160294 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff29414e530 msgr2=0x7ff2941e7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:20.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.164+0000 7ff2937fe640 1 --2- 172.21.15.44:0/797160294 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff29414e530 0x7ff2941e7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:20.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.164+0000 7ff2937fe640 1 -- 172.21.15.44:0/797160294 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2940b8d70 msgr2=0x7ff29414c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:20.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.164+0000 7ff2937fe640 1 --2- 172.21.15.44:0/797160294 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2940b8d70 0x7ff29414c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:20.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.164+0000 7ff2937fe640 1 -- 172.21.15.44:0/797160294 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff29414cb50 con 0x7ff2940bd440 2024-05-16T22:27:20.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.164+0000 7ff2937fe640 1 --2- 172.21.15.44:0/797160294 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2940bd440 0x7ff29413db90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff28400c3a0 tx=0x7ff28400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:20.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.164+0000 7ff290ff9640 1 -- 172.21.15.44:0/797160294 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff284017070 con 0x7ff2940bd440 2024-05-16T22:27:20.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.164+0000 7ff290ff9640 1 -- 172.21.15.44:0/797160294 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2840052d0 con 0x7ff2940bd440 2024-05-16T22:27:20.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.164+0000 7ff290ff9640 1 -- 172.21.15.44:0/797160294 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff284003830 con 0x7ff2940bd440 2024-05-16T22:27:20.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.164+0000 7ff29aa1e640 1 -- 172.21.15.44:0/797160294 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff29413abe0 con 0x7ff2940bd440 2024-05-16T22:27:20.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.164+0000 7ff29aa1e640 1 -- 172.21.15.44:0/797160294 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff29413e880 con 0x7ff2940bd440 2024-05-16T22:27:20.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.166+0000 7ff29aa1e640 1 -- 172.21.15.44:0/797160294 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff294050940 con 0x7ff2940bd440 2024-05-16T22:27:20.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.166+0000 7ff290ff9640 1 -- 172.21.15.44:0/797160294 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff28401a070 con 0x7ff2940bd440 2024-05-16T22:27:20.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.166+0000 7ff290ff9640 1 --2- 172.21.15.44:0/797160294 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7ff2740762d0 0x7ff2740787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:20.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.166+0000 7ff290ff9640 1 -- 172.21.15.44:0/797160294 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7ff284096680 con 0x7ff2940bd440 2024-05-16T22:27:20.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.167+0000 7ff293fff640 1 --2- 172.21.15.44:0/797160294 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7ff2740762d0 0x7ff2740787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:20.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.167+0000 7ff293fff640 1 --2- 172.21.15.44:0/797160294 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7ff2740762d0 0x7ff2740787e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff27c033000 tx=0x7ff27c02e000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:20.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.171+0000 7ff290ff9640 1 -- 172.21.15.44:0/797160294 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff2840602a0 con 0x7ff2940bd440 2024-05-16T22:27:20.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.401+0000 7ff29aa1e640 1 -- 172.21.15.44:0/797160294 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff2941417e0 con 0x7ff2940bd440 2024-05-16T22:27:20.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.402+0000 7ff290ff9640 1 -- 172.21.15.44:0/797160294 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7ff284068320 con 0x7ff2940bd440 2024-05-16T22:27:20.401 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:27:20.401 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2940970977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2940970977},{"type":"v1","addr":"172.21.15.44:6833","nonce":2940970977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-16T22:27:20.402 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 2 2024-05-16T22:27:20.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.404+0000 7ff29aa1e640 1 -- 172.21.15.44:0/797160294 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7ff2740762d0 msgr2=0x7ff2740787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:20.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.404+0000 7ff29aa1e640 1 --2- 172.21.15.44:0/797160294 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7ff2740762d0 0x7ff2740787e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff27c033000 tx=0x7ff27c02e000 comp rx=0 tx=0).stop 2024-05-16T22:27:20.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.404+0000 7ff29aa1e640 1 -- 172.21.15.44:0/797160294 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2940bd440 msgr2=0x7ff29413db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:20.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.404+0000 7ff29aa1e640 1 --2- 172.21.15.44:0/797160294 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2940bd440 0x7ff29413db90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff28400c3a0 tx=0x7ff28400c860 comp rx=0 tx=0).stop 2024-05-16T22:27:20.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.404+0000 7ff29aa1e640 1 -- 172.21.15.44:0/797160294 shutdown_connections 2024-05-16T22:27:20.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.404+0000 7ff29aa1e640 1 --2- 172.21.15.44:0/797160294 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7ff2740762d0 0x7ff2740787e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:20.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.404+0000 7ff29aa1e640 1 --2- 172.21.15.44:0/797160294 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff29414e530 0x7ff2941e7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:20.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.404+0000 7ff29aa1e640 1 --2- 172.21.15.44:0/797160294 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2940bd440 0x7ff29413db90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:20.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.404+0000 7ff29aa1e640 1 --2- 172.21.15.44:0/797160294 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2940b8d70 0x7ff29414c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:20.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.404+0000 7ff29aa1e640 1 -- 172.21.15.44:0/797160294 >> 172.21.15.44:0/797160294 conn(0x7ff2940c0570 msgr2=0x7ff2940bcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:20.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.404+0000 7ff29aa1e640 1 -- 172.21.15.44:0/797160294 shutdown_connections 2024-05-16T22:27:20.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:20.404+0000 7ff29aa1e640 1 -- 172.21.15.44:0/797160294 wait complete. 2024-05-16T22:27:22.415 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T22:27:22.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.541+0000 7fefc5c22640 1 Processor -- start 2024-05-16T22:27:22.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.541+0000 7fefc5c22640 1 -- start start 2024-05-16T22:27:22.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.542+0000 7fefc5c22640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fefc0151fc0 0x7fefc00bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:22.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.542+0000 7fefc5c22640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fefc00bf050 0x7fefc0158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:22.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.542+0000 7fefc5c22640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefc00c36f0 con 0x7fefc006da30 2024-05-16T22:27:22.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.542+0000 7fefc5c22640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fefc00bdc10 con 0x7fefc00bf050 2024-05-16T22:27:22.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.542+0000 7fefc5c22640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fefc0152530 con 0x7fefc0151fc0 2024-05-16T22:27:22.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.542+0000 7fefbffff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fefc00bf050 0x7fefc0158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:22.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.542+0000 7fefbeffd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fefc006da30 0x7fefc00be940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49504/0 (socket says 172.21.15.44:49504) 2024-05-16T22:27:22.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.542+0000 7fefbeffd640 1 -- 172.21.15.44:0/800105267 learned_addr learned my addr 172.21.15.44:0/800105267 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:27:22.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.543+0000 7fefbf7fe640 1 --2- 172.21.15.44:0/800105267 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fefc0151fc0 0x7fefc00bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:22.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.543+0000 7fefbffff640 1 -- 172.21.15.44:0/800105267 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fefc0151fc0 msgr2=0x7fefc00bd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:22.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.543+0000 7fefbffff640 1 --2- 172.21.15.44:0/800105267 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fefc0151fc0 0x7fefc00bd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:22.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.543+0000 7fefbffff640 1 -- 172.21.15.44:0/800105267 >> v1:172.21.15.44:6789/0 conn(0x7fefc006da30 legacy=0x7fefc00be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:22.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.543+0000 7fefbffff640 1 -- 172.21.15.44:0/800105267 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefc0152810 con 0x7fefc00bf050 2024-05-16T22:27:22.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.543+0000 7fefbffff640 1 --2- 172.21.15.44:0/800105267 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefc00bf050 0x7fefc0158e90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fefb8009d90 tx=0x7fefb802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7da5cc442975e26e server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:22.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.544+0000 7fefbe7fc640 1 -- 172.21.15.44:0/800105267 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb8031600 con 0x7fefc00bf050 2024-05-16T22:27:22.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.544+0000 7fefbe7fc640 1 -- 172.21.15.44:0/800105267 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefb80317a0 con 0x7fefc00bf050 2024-05-16T22:27:22.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.544+0000 7fefbe7fc640 1 -- 172.21.15.44:0/800105267 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb8031b70 con 0x7fefc00bf050 2024-05-16T22:27:22.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.544+0000 7fefc5c22640 1 -- 172.21.15.44:0/800105267 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefc00bf050 msgr2=0x7fefc0158e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:22.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.544+0000 7fefc5c22640 1 --2- 172.21.15.44:0/800105267 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefc00bf050 0x7fefc0158e90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fefb8009d90 tx=0x7fefb802a5d0 comp rx=0 tx=0).stop 2024-05-16T22:27:22.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.544+0000 7fefc5c22640 1 -- 172.21.15.44:0/800105267 shutdown_connections 2024-05-16T22:27:22.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.544+0000 7fefc5c22640 1 --2- 172.21.15.44:0/800105267 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefc00bf050 0x7fefc0158e90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:22.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.544+0000 7fefc5c22640 1 --2- 172.21.15.44:0/800105267 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fefc0151fc0 0x7fefc00bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:22.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.544+0000 7fefc5c22640 1 -- 172.21.15.44:0/800105267 >> 172.21.15.44:0/800105267 conn(0x7fefc00c3d20 msgr2=0x7fefc00c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:22.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.544+0000 7fefc5c22640 1 -- 172.21.15.44:0/800105267 shutdown_connections 2024-05-16T22:27:22.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.544+0000 7fefc5c22640 1 -- 172.21.15.44:0/800105267 wait complete. 2024-05-16T22:27:22.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.546+0000 7fefc5c22640 1 Processor -- start 2024-05-16T22:27:22.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.546+0000 7fefc5c22640 1 -- start start 2024-05-16T22:27:22.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.547+0000 7fefc5c22640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefc006da30 0x7fefc00b7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:22.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.547+0000 7fefc5c22640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefc00bf050 0x7fefc00b82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:22.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.547+0000 7fefc5c22640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fefc0151fc0 0x7fefc01506c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:22.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.547+0000 7fefc5c22640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fefc00a3050 con 0x7fefc006da30 2024-05-16T22:27:22.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.547+0000 7fefc5c22640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fefc00a2ed0 con 0x7fefc00bf050 2024-05-16T22:27:22.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.547+0000 7fefc5c22640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fefc006de40 con 0x7fefc0151fc0 2024-05-16T22:27:22.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.547+0000 7fefbf7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefc006da30 0x7fefc00b7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:22.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.547+0000 7fefbf7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefc006da30 0x7fefc00b7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54154/0 (socket says 172.21.15.44:54154) 2024-05-16T22:27:22.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.547+0000 7fefbf7fe640 1 -- 172.21.15.44:0/2756191070 learned_addr learned my addr 172.21.15.44:0/2756191070 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:22.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.548+0000 7fefbffff640 1 --2- 172.21.15.44:0/2756191070 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fefc0151fc0 0x7fefc01506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:22.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.548+0000 7fefbeffd640 1 --2- 172.21.15.44:0/2756191070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefc00bf050 0x7fefc00b82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:22.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.548+0000 7fefbf7fe640 1 -- 172.21.15.44:0/2756191070 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fefc0151fc0 msgr2=0x7fefc01506c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:22.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.548+0000 7fefbf7fe640 1 --2- 172.21.15.44:0/2756191070 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fefc0151fc0 0x7fefc01506c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:22.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.548+0000 7fefbf7fe640 1 -- 172.21.15.44:0/2756191070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefc00bf050 msgr2=0x7fefc00b82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:22.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.548+0000 7fefbf7fe640 1 --2- 172.21.15.44:0/2756191070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefc00bf050 0x7fefc00b82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:22.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.548+0000 7fefbf7fe640 1 -- 172.21.15.44:0/2756191070 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefc00b7b50 con 0x7fefc006da30 2024-05-16T22:27:22.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.548+0000 7fefbf7fe640 1 --2- 172.21.15.44:0/2756191070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefc006da30 0x7fefc00b7610 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fefb000d5f0 tx=0x7fefb000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:22.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.548+0000 7fefa7fff640 1 -- 172.21.15.44:0/2756191070 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb00125f0 con 0x7fefc006da30 2024-05-16T22:27:22.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.548+0000 7fefa7fff640 1 -- 172.21.15.44:0/2756191070 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefb0019070 con 0x7fefc006da30 2024-05-16T22:27:22.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.548+0000 7fefc5c22640 1 -- 172.21.15.44:0/2756191070 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefc00b87f0 con 0x7fefc006da30 2024-05-16T22:27:22.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.548+0000 7fefa7fff640 1 -- 172.21.15.44:0/2756191070 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb00129d0 con 0x7fefc006da30 2024-05-16T22:27:22.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.548+0000 7fefc5c22640 1 -- 172.21.15.44:0/2756191070 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefc01e48c0 con 0x7fefc006da30 2024-05-16T22:27:22.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.549+0000 7fefc5c22640 1 -- 172.21.15.44:0/2756191070 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefc00c10e0 con 0x7fefc006da30 2024-05-16T22:27:22.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.550+0000 7fefa7fff640 1 -- 172.21.15.44:0/2756191070 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fefb0012b70 con 0x7fefc006da30 2024-05-16T22:27:22.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.551+0000 7fefa7fff640 1 --2- 172.21.15.44:0/2756191070 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fefac0762d0 0x7fefac0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:22.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.551+0000 7fefa7fff640 1 -- 172.21.15.44:0/2756191070 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fefb0097770 con 0x7fefc006da30 2024-05-16T22:27:22.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.551+0000 7fefbeffd640 1 --2- 172.21.15.44:0/2756191070 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fefac0762d0 0x7fefac0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:22.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.551+0000 7fefbeffd640 1 --2- 172.21.15.44:0/2756191070 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fefac0762d0 0x7fefac0787e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fefc00ba4a0 tx=0x7fefb4009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:22.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.556+0000 7fefa7fff640 1 -- 172.21.15.44:0/2756191070 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fefc00c10e0 con 0x7fefc006da30 2024-05-16T22:27:22.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.785+0000 7fefc5c22640 1 -- 172.21.15.44:0/2756191070 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fefc0050940 con 0x7fefc006da30 2024-05-16T22:27:22.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.786+0000 7fefa7fff640 1 -- 172.21.15.44:0/2756191070 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3040 (secure 0 0 0) 0x7fefb0061390 con 0x7fefc006da30 2024-05-16T22:27:22.785 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:27:22.786 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2940970977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2940970977},{"type":"v1","addr":"172.21.15.44:6833","nonce":2940970977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1653435882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1653435882},{"type":"v1","addr":"172.21.15.70:6835","nonce":1653435882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/3060763624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3060763624},{"type":"v1","addr":"172.21.15.44:6835","nonce":3060763624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-16T22:27:22.786 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 3 2024-05-16T22:27:22.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.788+0000 7fefc5c22640 1 -- 172.21.15.44:0/2756191070 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fefac0762d0 msgr2=0x7fefac0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:22.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.788+0000 7fefc5c22640 1 --2- 172.21.15.44:0/2756191070 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fefac0762d0 0x7fefac0787e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fefc00ba4a0 tx=0x7fefb4009040 comp rx=0 tx=0).stop 2024-05-16T22:27:22.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.788+0000 7fefc5c22640 1 -- 172.21.15.44:0/2756191070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefc006da30 msgr2=0x7fefc00b7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:22.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.788+0000 7fefc5c22640 1 --2- 172.21.15.44:0/2756191070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefc006da30 0x7fefc00b7610 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fefb000d5f0 tx=0x7fefb000dab0 comp rx=0 tx=0).stop 2024-05-16T22:27:22.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.788+0000 7fefc5c22640 1 -- 172.21.15.44:0/2756191070 shutdown_connections 2024-05-16T22:27:22.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.788+0000 7fefc5c22640 1 --2- 172.21.15.44:0/2756191070 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fefac0762d0 0x7fefac0787e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:22.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.788+0000 7fefc5c22640 1 --2- 172.21.15.44:0/2756191070 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fefc0151fc0 0x7fefc01506c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:22.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.788+0000 7fefc5c22640 1 --2- 172.21.15.44:0/2756191070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefc00bf050 0x7fefc00b82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:22.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.788+0000 7fefc5c22640 1 --2- 172.21.15.44:0/2756191070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefc006da30 0x7fefc00b7610 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:22.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.788+0000 7fefc5c22640 1 -- 172.21.15.44:0/2756191070 >> 172.21.15.44:0/2756191070 conn(0x7fefc00c3d20 msgr2=0x7fefc00c09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:22.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.788+0000 7fefc5c22640 1 -- 172.21.15.44:0/2756191070 shutdown_connections 2024-05-16T22:27:22.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.788+0000 7fefc5c22640 1 -- 172.21.15.44:0/2756191070 wait complete. 2024-05-16T22:27:22.798 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-16T22:27:22.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.910+0000 7fd18e36c640 1 Processor -- start 2024-05-16T22:27:22.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.910+0000 7fd18e36c640 1 -- start start 2024-05-16T22:27:22.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.911+0000 7fd18e36c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd188151fc0 0x7fd1880bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:22.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.911+0000 7fd18e36c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd1880bf050 0x7fd188158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:22.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.911+0000 7fd18e36c640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1880c36f0 con 0x7fd18806da30 2024-05-16T22:27:22.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.911+0000 7fd18e36c640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fd1880bdc10 con 0x7fd188151fc0 2024-05-16T22:27:22.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.911+0000 7fd18e36c640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fd188152530 con 0x7fd1880bf050 2024-05-16T22:27:22.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.911+0000 7fd187fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd188151fc0 0x7fd1880bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:22.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.911+0000 7fd187fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd188151fc0 0x7fd1880bd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54162/0 (socket says 172.21.15.44:54162) 2024-05-16T22:27:22.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.911+0000 7fd187fff640 1 -- 172.21.15.44:0/3805033699 learned_addr learned my addr 172.21.15.44:0/3805033699 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:22.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.911+0000 7fd18c909640 1 --2- 172.21.15.44:0/3805033699 >> v2:172.21.15.70:3300/0 conn(0x7fd1880bf050 0x7fd188158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:22.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.912+0000 7fd187fff640 1 -- 172.21.15.44:0/3805033699 >> v2:172.21.15.70:3300/0 conn(0x7fd1880bf050 msgr2=0x7fd188158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:22.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.912+0000 7fd187fff640 1 --2- 172.21.15.44:0/3805033699 >> v2:172.21.15.70:3300/0 conn(0x7fd1880bf050 0x7fd188158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:22.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.912+0000 7fd187fff640 1 -- 172.21.15.44:0/3805033699 >> v1:172.21.15.70:6789/0 conn(0x7fd18806da30 legacy=0x7fd1880be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:22.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.912+0000 7fd187fff640 1 -- 172.21.15.44:0/3805033699 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd188152810 con 0x7fd188151fc0 2024-05-16T22:27:22.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.912+0000 7fd187fff640 1 --2- 172.21.15.44:0/3805033699 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd188151fc0 0x7fd1880bd6d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd18808d300 tx=0x7fd17802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a080e9eddcfad8fa server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:22.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.912+0000 7fd186ffd640 1 -- 172.21.15.44:0/3805033699 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd178037070 con 0x7fd188151fc0 2024-05-16T22:27:22.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.912+0000 7fd186ffd640 1 -- 172.21.15.44:0/3805033699 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd178032440 con 0x7fd188151fc0 2024-05-16T22:27:22.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.912+0000 7fd186ffd640 1 -- 172.21.15.44:0/3805033699 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd178032810 con 0x7fd188151fc0 2024-05-16T22:27:22.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.913+0000 7fd18e36c640 1 -- 172.21.15.44:0/3805033699 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd188151fc0 msgr2=0x7fd1880bd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:22.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.913+0000 7fd18e36c640 1 --2- 172.21.15.44:0/3805033699 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd188151fc0 0x7fd1880bd6d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd18808d300 tx=0x7fd17802a1c0 comp rx=0 tx=0).stop 2024-05-16T22:27:22.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.913+0000 7fd18e36c640 1 -- 172.21.15.44:0/3805033699 shutdown_connections 2024-05-16T22:27:22.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.913+0000 7fd18e36c640 1 --2- 172.21.15.44:0/3805033699 >> v2:172.21.15.70:3300/0 conn(0x7fd1880bf050 0x7fd188158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:22.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.913+0000 7fd18e36c640 1 --2- 172.21.15.44:0/3805033699 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd188151fc0 0x7fd1880bd6d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:22.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.913+0000 7fd18e36c640 1 -- 172.21.15.44:0/3805033699 >> 172.21.15.44:0/3805033699 conn(0x7fd1880c3d20 msgr2=0x7fd1880c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:22.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.913+0000 7fd18e36c640 1 -- 172.21.15.44:0/3805033699 shutdown_connections 2024-05-16T22:27:22.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.913+0000 7fd18e36c640 1 -- 172.21.15.44:0/3805033699 wait complete. 2024-05-16T22:27:22.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.915+0000 7fd18e36c640 1 Processor -- start 2024-05-16T22:27:22.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.915+0000 7fd18e36c640 1 -- start start 2024-05-16T22:27:22.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.916+0000 7fd18e36c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd18806da30 0x7fd1881e4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:22.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.916+0000 7fd18e36c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd1880bf050 0x7fd1880b7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:22.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.916+0000 7fd18e36c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd188151fc0 0x7fd1880a1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:22.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.916+0000 7fd18e36c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd1880a3050 con 0x7fd188151fc0 2024-05-16T22:27:22.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.916+0000 7fd18e36c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd1880a2ed0 con 0x7fd18806da30 2024-05-16T22:27:22.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.916+0000 7fd18e36c640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fd18806de40 con 0x7fd1880bf050 2024-05-16T22:27:22.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.916+0000 7fd18c909640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd188151fc0 0x7fd1880a1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:22.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.916+0000 7fd18c909640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd188151fc0 0x7fd1880a1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54174/0 (socket says 172.21.15.44:54174) 2024-05-16T22:27:22.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.916+0000 7fd18c909640 1 -- 172.21.15.44:0/3831530739 learned_addr learned my addr 172.21.15.44:0/3831530739 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:22.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.916+0000 7fd1877fe640 1 --2- 172.21.15.44:0/3831530739 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd1880bf050 0x7fd1880b7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:22.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.916+0000 7fd187fff640 1 --2- 172.21.15.44:0/3831530739 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd18806da30 0x7fd1881e4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:22.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.916+0000 7fd18c909640 1 -- 172.21.15.44:0/3831530739 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd1880bf050 msgr2=0x7fd1880b7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:22.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.916+0000 7fd18c909640 1 --2- 172.21.15.44:0/3831530739 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd1880bf050 0x7fd1880b7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:22.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.916+0000 7fd18c909640 1 -- 172.21.15.44:0/3831530739 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd18806da30 msgr2=0x7fd1881e4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:22.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.916+0000 7fd18c909640 1 --2- 172.21.15.44:0/3831530739 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd18806da30 0x7fd1881e4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:22.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.916+0000 7fd18c909640 1 -- 172.21.15.44:0/3831530739 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd18814dc80 con 0x7fd188151fc0 2024-05-16T22:27:22.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.917+0000 7fd18c909640 1 --2- 172.21.15.44:0/3831530739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd188151fc0 0x7fd1880a1d50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd180007e60 tx=0x7fd18000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:22.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.917+0000 7fd184ff9640 1 -- 172.21.15.44:0/3831530739 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd180014420 con 0x7fd188151fc0 2024-05-16T22:27:22.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.917+0000 7fd184ff9640 1 -- 172.21.15.44:0/3831530739 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd180019070 con 0x7fd188151fc0 2024-05-16T22:27:22.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.917+0000 7fd18e36c640 1 -- 172.21.15.44:0/3831530739 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1880b7b50 con 0x7fd188151fc0 2024-05-16T22:27:22.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.917+0000 7fd184ff9640 1 -- 172.21.15.44:0/3831530739 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd180014820 con 0x7fd188151fc0 2024-05-16T22:27:22.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.917+0000 7fd18e36c640 1 -- 172.21.15.44:0/3831530739 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1881e44e0 con 0x7fd188151fc0 2024-05-16T22:27:22.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.918+0000 7fd18e36c640 1 -- 172.21.15.44:0/3831530739 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1880a2b50 con 0x7fd188151fc0 2024-05-16T22:27:22.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.919+0000 7fd184ff9640 1 -- 172.21.15.44:0/3831530739 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd1800149c0 con 0x7fd188151fc0 2024-05-16T22:27:22.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.919+0000 7fd184ff9640 1 --2- 172.21.15.44:0/3831530739 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd1680762d0 0x7fd1680787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:22.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.919+0000 7fd184ff9640 1 -- 172.21.15.44:0/3831530739 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fd180097b10 con 0x7fd188151fc0 2024-05-16T22:27:22.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.919+0000 7fd187fff640 1 --2- 172.21.15.44:0/3831530739 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd1680762d0 0x7fd1680787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:22.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.920+0000 7fd187fff640 1 --2- 172.21.15.44:0/3831530739 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd1680762d0 0x7fd1680787e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd178034000 tx=0x7fd17802e000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:22.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:22.924+0000 7fd184ff9640 1 -- 172.21.15.44:0/3831530739 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd180061060 con 0x7fd188151fc0 2024-05-16T22:27:23.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.114+0000 7fd18e36c640 1 -- 172.21.15.44:0/3831530739 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fd188050940 con 0x7fd188151fc0 2024-05-16T22:27:23.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.115+0000 7fd184ff9640 1 -- 172.21.15.44:0/3831530739 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7fd180065360 con 0x7fd188151fc0 2024-05-16T22:27:23.114 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:27:23.114 INFO:teuthology.orchestra.run.smithi044.stdout:[ 2024-05-16T22:27:23.114 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-05-16T22:27:23.114 INFO:teuthology.orchestra.run.smithi044.stdout: "poolnum": 1, 2024-05-16T22:27:23.115 INFO:teuthology.orchestra.run.smithi044.stdout: "poolname": ".mgr" 2024-05-16T22:27:23.115 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-05-16T22:27:23.115 INFO:teuthology.orchestra.run.smithi044.stdout:] 2024-05-16T22:27:23.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.116+0000 7fd18e36c640 1 -- 172.21.15.44:0/3831530739 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd1680762d0 msgr2=0x7fd1680787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:23.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.116+0000 7fd18e36c640 1 --2- 172.21.15.44:0/3831530739 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd1680762d0 0x7fd1680787e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd178034000 tx=0x7fd17802e000 comp rx=0 tx=0).stop 2024-05-16T22:27:23.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.117+0000 7fd18e36c640 1 -- 172.21.15.44:0/3831530739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd188151fc0 msgr2=0x7fd1880a1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:23.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.117+0000 7fd18e36c640 1 --2- 172.21.15.44:0/3831530739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd188151fc0 0x7fd1880a1d50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd180007e60 tx=0x7fd18000e4b0 comp rx=0 tx=0).stop 2024-05-16T22:27:23.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.117+0000 7fd18e36c640 1 -- 172.21.15.44:0/3831530739 shutdown_connections 2024-05-16T22:27:23.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.117+0000 7fd18e36c640 1 --2- 172.21.15.44:0/3831530739 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd1680762d0 0x7fd1680787e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:23.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.117+0000 7fd18e36c640 1 --2- 172.21.15.44:0/3831530739 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd1880bf050 0x7fd1880b7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:23.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.117+0000 7fd18e36c640 1 --2- 172.21.15.44:0/3831530739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd188151fc0 0x7fd1880a1d50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:23.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.117+0000 7fd18e36c640 1 --2- 172.21.15.44:0/3831530739 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd18806da30 0x7fd1881e4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:23.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.117+0000 7fd18e36c640 1 -- 172.21.15.44:0/3831530739 >> 172.21.15.44:0/3831530739 conn(0x7fd1880c3d20 msgr2=0x7fd1880c09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:23.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.117+0000 7fd18e36c640 1 -- 172.21.15.44:0/3831530739 shutdown_connections 2024-05-16T22:27:23.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.117+0000 7fd18e36c640 1 -- 172.21.15.44:0/3831530739 wait complete. 2024-05-16T22:27:23.127 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-16T22:27:23.127 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-16T22:27:23.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.243+0000 7fb0d815e640 1 Processor -- start 2024-05-16T22:27:23.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.243+0000 7fb0d815e640 1 -- start start 2024-05-16T22:27:23.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.244+0000 7fb0d815e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb0d0072870 0x7fb0d0148450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:23.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.244+0000 7fb0d815e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb0d00bc2a0 0x7fb0d006d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:23.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.245+0000 7fb0d815e640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0d0073370 con 0x7fb0d0151a90 2024-05-16T22:27:23.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.245+0000 7fb0d815e640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fb0d0073ca0 con 0x7fb0d0072870 2024-05-16T22:27:23.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.245+0000 7fb0d815e640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fb0d0073650 con 0x7fb0d00bc2a0 2024-05-16T22:27:23.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.245+0000 7fb0d66fb640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fb0d0151a90 0x7fb0d0151ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49510/0 (socket says 172.21.15.44:49510) 2024-05-16T22:27:23.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.245+0000 7fb0d66fb640 1 -- 172.21.15.44:0/1928118902 learned_addr learned my addr 172.21.15.44:0/1928118902 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:27:23.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.245+0000 7fb0d5efa640 1 --2- 172.21.15.44:0/1928118902 >> v2:172.21.15.70:3300/0 conn(0x7fb0d0072870 0x7fb0d0148450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:23.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.245+0000 7fb0d4ef8640 1 -- 172.21.15.44:0/1928118902 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1589606140 0 0) 0x7fb0d0073370 con 0x7fb0d0151a90 2024-05-16T22:27:23.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.245+0000 7fb0d56f9640 1 --2- 172.21.15.44:0/1928118902 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb0d00bc2a0 0x7fb0d006d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:23.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.245+0000 7fb0d4ef8640 1 -- 172.21.15.44:0/1928118902 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0b8003520 con 0x7fb0d0151a90 2024-05-16T22:27:23.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.245+0000 7fb0d4ef8640 1 -- 172.21.15.44:0/1928118902 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2600783456 0 0) 0x7fb0b8003520 con 0x7fb0d0151a90 2024-05-16T22:27:23.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.245+0000 7fb0d4ef8640 1 -- 172.21.15.44:0/1928118902 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb0d00bc2a0 msgr2=0x7fb0d006d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:23.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.245+0000 7fb0d4ef8640 1 --2- 172.21.15.44:0/1928118902 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb0d00bc2a0 0x7fb0d006d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:23.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.245+0000 7fb0d4ef8640 1 -- 172.21.15.44:0/1928118902 >> v2:172.21.15.70:3300/0 conn(0x7fb0d0072870 msgr2=0x7fb0d0148450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:23.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.245+0000 7fb0d4ef8640 1 --2- 172.21.15.44:0/1928118902 >> v2:172.21.15.70:3300/0 conn(0x7fb0d0072870 0x7fb0d0148450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:23.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.245+0000 7fb0d4ef8640 1 -- 172.21.15.44:0/1928118902 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0d0073930 con 0x7fb0d0151a90 2024-05-16T22:27:23.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.245+0000 7fb0d4ef8640 1 -- 172.21.15.44:0/1928118902 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 568431863 0 0) 0x7fb0c0001a70 con 0x7fb0d0151a90 2024-05-16T22:27:23.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.245+0000 7fb0d4ef8640 1 -- 172.21.15.44:0/1928118902 >> v1:172.21.15.44:6789/0 conn(0x7fb0d0151a90 legacy=0x7fb0d0151ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:23.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.245+0000 7fb0d4ef8640 1 --2- 172.21.15.44:0/1928118902 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb0b8003a50 0x7fb0b8003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:23.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.245+0000 7fb0d4ef8640 1 --2- 172.21.15.44:0/1928118902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0b8004800 0x7fb0b8004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:23.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.245+0000 7fb0d4ef8640 1 --2- 172.21.15.44:0/1928118902 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb0d00bc2a0 0x7fb0b8005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:23.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.245+0000 7fb0d4ef8640 1 -- 172.21.15.44:0/1928118902 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d0073ca0 con 0x7fb0b8004800 2024-05-16T22:27:23.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.245+0000 7fb0d4ef8640 1 -- 172.21.15.44:0/1928118902 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d0073650 con 0x7fb0b8003a50 2024-05-16T22:27:23.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.245+0000 7fb0d4ef8640 1 -- 172.21.15.44:0/1928118902 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fb0b800bb30 con 0x7fb0d00bc2a0 2024-05-16T22:27:23.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.245+0000 7fb0d56f9640 1 --2- 172.21.15.44:0/1928118902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0b8004800 0x7fb0b8004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:23.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.245+0000 7fb0d5efa640 1 --2- 172.21.15.44:0/1928118902 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb0b8003a50 0x7fb0b8003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:23.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.245+0000 7fb0d66fb640 1 --2- 172.21.15.44:0/1928118902 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb0d00bc2a0 0x7fb0b8005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:23.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.246+0000 7fb0d56f9640 1 -- 172.21.15.44:0/1928118902 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb0d00bc2a0 msgr2=0x7fb0b8005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:23.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.246+0000 7fb0d56f9640 1 --2- 172.21.15.44:0/1928118902 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb0d00bc2a0 0x7fb0b8005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:23.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.246+0000 7fb0d56f9640 1 -- 172.21.15.44:0/1928118902 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb0b8003a50 msgr2=0x7fb0b8003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:23.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.246+0000 7fb0d56f9640 1 --2- 172.21.15.44:0/1928118902 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb0b8003a50 0x7fb0b8003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:23.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.246+0000 7fb0d56f9640 1 -- 172.21.15.44:0/1928118902 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0b8003520 con 0x7fb0b8004800 2024-05-16T22:27:23.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.246+0000 7fb0d56f9640 1 --2- 172.21.15.44:0/1928118902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0b8004800 0x7fb0b8004c10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4009a90 tx=0x7fb0b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9baf3ef1ae1818f server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:23.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.246+0000 7fb0d4ef8640 1 -- 172.21.15.44:0/1928118902 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c4036070 con 0x7fb0b8004800 2024-05-16T22:27:23.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.247+0000 7fb0d4ef8640 1 -- 172.21.15.44:0/1928118902 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0c4031400 con 0x7fb0b8004800 2024-05-16T22:27:23.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.247+0000 7fb0d4ef8640 1 -- 172.21.15.44:0/1928118902 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c4009690 con 0x7fb0b8004800 2024-05-16T22:27:23.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.247+0000 7fb0d815e640 1 -- 172.21.15.44:0/1928118902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0b8004800 msgr2=0x7fb0b8004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:23.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.247+0000 7fb0d815e640 1 --2- 172.21.15.44:0/1928118902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0b8004800 0x7fb0b8004c10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4009a90 tx=0x7fb0b8005830 comp rx=0 tx=0).stop 2024-05-16T22:27:23.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.247+0000 7fb0d66fb640 1 -- 172.21.15.44:0/1928118902 reap_dead start 2024-05-16T22:27:23.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.247+0000 7fb0d815e640 1 -- 172.21.15.44:0/1928118902 shutdown_connections 2024-05-16T22:27:23.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.247+0000 7fb0d815e640 1 -- 172.21.15.44:0/1928118902 >> 172.21.15.44:0/1928118902 conn(0x7fb0d006f2c0 msgr2=0x7fb0d006f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:23.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.247+0000 7fb0d815e640 1 -- 172.21.15.44:0/1928118902 shutdown_connections 2024-05-16T22:27:23.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.247+0000 7fb0d815e640 1 -- 172.21.15.44:0/1928118902 wait complete. 2024-05-16T22:27:23.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.249+0000 7fb0d815e640 1 Processor -- start 2024-05-16T22:27:23.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.249+0000 7fb0d815e640 1 -- start start 2024-05-16T22:27:23.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.250+0000 7fb0d815e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb0b8004800 0x7fb0d00bf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:23.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.250+0000 7fb0d815e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb0d01504c0 0x7fb0d013efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:23.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.250+0000 7fb0d815e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0d013f4f0 0x7fb0d01e7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:23.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.250+0000 7fb0d815e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d006d870 con 0x7fb0d013f4f0 2024-05-16T22:27:23.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.250+0000 7fb0d815e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d006d6f0 con 0x7fb0d01504c0 2024-05-16T22:27:23.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.250+0000 7fb0d815e640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fb0d006d9f0 con 0x7fb0b8004800 2024-05-16T22:27:23.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.250+0000 7fb0d66fb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0d013f4f0 0x7fb0d01e7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:23.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.250+0000 7fb0d66fb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0d013f4f0 0x7fb0d01e7340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54204/0 (socket says 172.21.15.44:54204) 2024-05-16T22:27:23.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.250+0000 7fb0d66fb640 1 -- 172.21.15.44:0/1952551682 learned_addr learned my addr 172.21.15.44:0/1952551682 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:23.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.250+0000 7fb0d56f9640 1 --2- 172.21.15.44:0/1952551682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb0d01504c0 0x7fb0d013efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:23.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.250+0000 7fb0d5efa640 1 --2- 172.21.15.44:0/1952551682 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb0b8004800 0x7fb0d00bf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:23.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.250+0000 7fb0d66fb640 1 -- 172.21.15.44:0/1952551682 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb0b8004800 msgr2=0x7fb0d00bf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:23.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.250+0000 7fb0d66fb640 1 --2- 172.21.15.44:0/1952551682 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb0b8004800 0x7fb0d00bf2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:23.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.250+0000 7fb0d66fb640 1 -- 172.21.15.44:0/1952551682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb0d01504c0 msgr2=0x7fb0d013efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:23.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.250+0000 7fb0d66fb640 1 --2- 172.21.15.44:0/1952551682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb0d01504c0 0x7fb0d013efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:23.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.250+0000 7fb0d66fb640 1 -- 172.21.15.44:0/1952551682 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0d00bf810 con 0x7fb0d013f4f0 2024-05-16T22:27:23.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.251+0000 7fb0d66fb640 1 --2- 172.21.15.44:0/1952551682 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0d013f4f0 0x7fb0d01e7340 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb0d014f460 tx=0x7fb0c0007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:23.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.251+0000 7fb0ce7fc640 1 -- 172.21.15.44:0/1952551682 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c000abf0 con 0x7fb0d013f4f0 2024-05-16T22:27:23.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.251+0000 7fb0ce7fc640 1 -- 172.21.15.44:0/1952551682 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0c0018070 con 0x7fb0d013f4f0 2024-05-16T22:27:23.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.251+0000 7fb0d815e640 1 -- 172.21.15.44:0/1952551682 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0d01d7630 con 0x7fb0d013f4f0 2024-05-16T22:27:23.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.251+0000 7fb0ce7fc640 1 -- 172.21.15.44:0/1952551682 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c00133f0 con 0x7fb0d013f4f0 2024-05-16T22:27:23.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.251+0000 7fb0d815e640 1 -- 172.21.15.44:0/1952551682 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0d01d7bf0 con 0x7fb0d013f4f0 2024-05-16T22:27:23.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.252+0000 7fb0d815e640 1 -- 172.21.15.44:0/1952551682 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0d0050940 con 0x7fb0d013f4f0 2024-05-16T22:27:23.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.253+0000 7fb0ce7fc640 1 -- 172.21.15.44:0/1952551682 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb0c0013590 con 0x7fb0d013f4f0 2024-05-16T22:27:23.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.253+0000 7fb0ce7fc640 1 --2- 172.21.15.44:0/1952551682 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fb0bc0762d0 0x7fb0bc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:23.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.253+0000 7fb0ce7fc640 1 -- 172.21.15.44:0/1952551682 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fb0c00978f0 con 0x7fb0d013f4f0 2024-05-16T22:27:23.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.253+0000 7fb0d5efa640 1 --2- 172.21.15.44:0/1952551682 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fb0bc0762d0 0x7fb0bc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:23.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.254+0000 7fb0d5efa640 1 --2- 172.21.15.44:0/1952551682 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fb0bc0762d0 0x7fb0bc0787e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8009b00 tx=0x7fb0c8008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:23.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.258+0000 7fb0ce7fc640 1 -- 172.21.15.44:0/1952551682 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb0c00615a0 con 0x7fb0d013f4f0 2024-05-16T22:27:23.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:23.454+0000 7fb0d815e640 1 -- 172.21.15.44:0/1952551682 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fb0d00bbba0 con 0x7fb0d013f4f0 2024-05-16T22:27:24.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.143+0000 7fb0ce7fc640 1 -- 172.21.15.44:0/1952551682 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7fb0c0060ea0 con 0x7fb0d013f4f0 2024-05-16T22:27:24.143 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' created 2024-05-16T22:27:24.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.146+0000 7fb0d815e640 1 -- 172.21.15.44:0/1952551682 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fb0bc0762d0 msgr2=0x7fb0bc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:24.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.146+0000 7fb0d815e640 1 --2- 172.21.15.44:0/1952551682 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fb0bc0762d0 0x7fb0bc0787e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8009b00 tx=0x7fb0c8008040 comp rx=0 tx=0).stop 2024-05-16T22:27:24.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.146+0000 7fb0d815e640 1 -- 172.21.15.44:0/1952551682 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0d013f4f0 msgr2=0x7fb0d01e7340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:24.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.146+0000 7fb0d815e640 1 --2- 172.21.15.44:0/1952551682 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0d013f4f0 0x7fb0d01e7340 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb0d014f460 tx=0x7fb0c0007bd0 comp rx=0 tx=0).stop 2024-05-16T22:27:24.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.146+0000 7fb0d815e640 1 -- 172.21.15.44:0/1952551682 shutdown_connections 2024-05-16T22:27:24.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.146+0000 7fb0d815e640 1 --2- 172.21.15.44:0/1952551682 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fb0bc0762d0 0x7fb0bc0787e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:24.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.146+0000 7fb0d815e640 1 --2- 172.21.15.44:0/1952551682 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0d013f4f0 0x7fb0d01e7340 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:24.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.146+0000 7fb0d815e640 1 --2- 172.21.15.44:0/1952551682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb0d01504c0 0x7fb0d013efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:24.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.146+0000 7fb0d815e640 1 --2- 172.21.15.44:0/1952551682 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb0b8004800 0x7fb0d00bf2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:24.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.146+0000 7fb0d815e640 1 -- 172.21.15.44:0/1952551682 >> 172.21.15.44:0/1952551682 conn(0x7fb0d006f2c0 msgr2=0x7fb0d0141590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:24.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.146+0000 7fb0d815e640 1 -- 172.21.15.44:0/1952551682 shutdown_connections 2024-05-16T22:27:24.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.146+0000 7fb0d815e640 1 -- 172.21.15.44:0/1952551682 wait complete. 2024-05-16T22:27:24.162 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-16T22:27:24.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.284+0000 7f281ed5e640 1 Processor -- start 2024-05-16T22:27:24.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.284+0000 7f281ed5e640 1 -- start start 2024-05-16T22:27:24.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.285+0000 7f281ed5e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2818148440 0x7f281814ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:24.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.285+0000 7f281ed5e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f281814f120 0x7f2818158ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:24.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.285+0000 7f281ed5e640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f281814e440 con 0x7f281806c8c0 2024-05-16T22:27:24.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.285+0000 7f281ed5e640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f281814e750 con 0x7f2818148440 2024-05-16T22:27:24.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.285+0000 7f281ed5e640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f2818151970 con 0x7f281814f120 2024-05-16T22:27:24.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.285+0000 7f2817fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2818148440 0x7f281814ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:24.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.285+0000 7f2817fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2818148440 0x7f281814ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54210/0 (socket says 172.21.15.44:54210) 2024-05-16T22:27:24.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.285+0000 7f2817fff640 1 -- 172.21.15.44:0/3747303984 learned_addr learned my addr 172.21.15.44:0/3747303984 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:24.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.285+0000 7f281d2fb640 1 --2- 172.21.15.44:0/3747303984 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f281814f120 0x7f2818158ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:24.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.285+0000 7f2817fff640 1 -- 172.21.15.44:0/3747303984 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f281814f120 msgr2=0x7f2818158ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:24.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.285+0000 7f2817fff640 1 --2- 172.21.15.44:0/3747303984 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f281814f120 0x7f2818158ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:24.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.285+0000 7f2817fff640 1 -- 172.21.15.44:0/3747303984 >> v1:172.21.15.70:6789/0 conn(0x7f281806c8c0 legacy=0x7f28180bf2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:24.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.285+0000 7f2817fff640 1 -- 172.21.15.44:0/3747303984 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28180bfae0 con 0x7f2818148440 2024-05-16T22:27:24.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.286+0000 7f2817fff640 1 --2- 172.21.15.44:0/3747303984 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2818148440 0x7f281814ebe0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f280c009870 tx=0x7f280c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1da656b4b09a46 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:24.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.286+0000 7f28177fe640 1 -- 172.21.15.44:0/3747303984 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f280c037070 con 0x7f2818148440 2024-05-16T22:27:24.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.286+0000 7f28177fe640 1 -- 172.21.15.44:0/3747303984 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f280c02ae50 con 0x7f2818148440 2024-05-16T22:27:24.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.286+0000 7f28177fe640 1 -- 172.21.15.44:0/3747303984 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f280c032860 con 0x7f2818148440 2024-05-16T22:27:24.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.287+0000 7f281ed5e640 1 -- 172.21.15.44:0/3747303984 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2818148440 msgr2=0x7f281814ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:24.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.287+0000 7f281ed5e640 1 --2- 172.21.15.44:0/3747303984 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2818148440 0x7f281814ebe0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f280c009870 tx=0x7f280c02a300 comp rx=0 tx=0).stop 2024-05-16T22:27:24.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.287+0000 7f281ed5e640 1 -- 172.21.15.44:0/3747303984 shutdown_connections 2024-05-16T22:27:24.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.287+0000 7f281ed5e640 1 --2- 172.21.15.44:0/3747303984 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f281814f120 0x7f2818158ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:24.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.287+0000 7f281ed5e640 1 --2- 172.21.15.44:0/3747303984 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2818148440 0x7f281814ebe0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:24.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.287+0000 7f281ed5e640 1 -- 172.21.15.44:0/3747303984 >> 172.21.15.44:0/3747303984 conn(0x7f28180bd160 msgr2=0x7f28180bd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:24.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.287+0000 7f281ed5e640 1 -- 172.21.15.44:0/3747303984 shutdown_connections 2024-05-16T22:27:24.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.287+0000 7f281ed5e640 1 -- 172.21.15.44:0/3747303984 wait complete. 2024-05-16T22:27:24.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.288+0000 7f281ed5e640 1 Processor -- start 2024-05-16T22:27:24.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.288+0000 7f281ed5e640 1 -- start start 2024-05-16T22:27:24.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.289+0000 7f281ed5e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f281806c8c0 0x7f28180bc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:24.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.289+0000 7f281ed5e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2818148440 0x7f28181427c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:24.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.289+0000 7f281ed5e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f281814f120 0x7f2818142d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:24.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.290+0000 7f281ed5e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f281806ccd0 con 0x7f281806c8c0 2024-05-16T22:27:24.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.290+0000 7f281ed5e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f281806d460 con 0x7f2818148440 2024-05-16T22:27:24.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.290+0000 7f281ed5e640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f281806ce50 con 0x7f281814f120 2024-05-16T22:27:24.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.290+0000 7f281cafa640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f281806c8c0 0x7f28180bc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:24.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.290+0000 7f281cafa640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f281806c8c0 0x7f28180bc0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54222/0 (socket says 172.21.15.44:54222) 2024-05-16T22:27:24.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.290+0000 7f281cafa640 1 -- 172.21.15.44:0/1664342296 learned_addr learned my addr 172.21.15.44:0/1664342296 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:24.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.290+0000 7f281d2fb640 1 --2- 172.21.15.44:0/1664342296 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f281814f120 0x7f2818142d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:24.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.290+0000 7f2817fff640 1 --2- 172.21.15.44:0/1664342296 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2818148440 0x7f28181427c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:24.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.290+0000 7f281cafa640 1 -- 172.21.15.44:0/1664342296 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f281814f120 msgr2=0x7f2818142d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:24.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.290+0000 7f281cafa640 1 --2- 172.21.15.44:0/1664342296 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f281814f120 0x7f2818142d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:24.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.290+0000 7f281cafa640 1 -- 172.21.15.44:0/1664342296 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2818148440 msgr2=0x7f28181427c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:24.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.290+0000 7f281cafa640 1 --2- 172.21.15.44:0/1664342296 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2818148440 0x7f28181427c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:24.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.290+0000 7f281cafa640 1 -- 172.21.15.44:0/1664342296 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28180bc5f0 con 0x7f281806c8c0 2024-05-16T22:27:24.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.290+0000 7f281d2fb640 1 --2- 172.21.15.44:0/1664342296 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f281814f120 0x7f2818142d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:27:24.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.290+0000 7f2817fff640 1 --2- 172.21.15.44:0/1664342296 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2818148440 0x7f28181427c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:27:24.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.290+0000 7f281cafa640 1 --2- 172.21.15.44:0/1664342296 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f281806c8c0 0x7f28180bc0b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f281000c730 tx=0x7f281000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:24.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.290+0000 7f28157fa640 1 -- 172.21.15.44:0/1664342296 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2810003b70 con 0x7f281806c8c0 2024-05-16T22:27:24.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.290+0000 7f28157fa640 1 -- 172.21.15.44:0/1664342296 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2810003d30 con 0x7f281806c8c0 2024-05-16T22:27:24.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.290+0000 7f281ed5e640 1 -- 172.21.15.44:0/1664342296 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28181da170 con 0x7f281806c8c0 2024-05-16T22:27:24.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.290+0000 7f28157fa640 1 -- 172.21.15.44:0/1664342296 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f281000aa90 con 0x7f281806c8c0 2024-05-16T22:27:24.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.290+0000 7f281ed5e640 1 -- 172.21.15.44:0/1664342296 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2818150e20 con 0x7f281806c8c0 2024-05-16T22:27:24.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.291+0000 7f281ed5e640 1 -- 172.21.15.44:0/1664342296 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2818069b50 con 0x7f281806c8c0 2024-05-16T22:27:24.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.292+0000 7f28157fa640 1 -- 172.21.15.44:0/1664342296 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f281000ac30 con 0x7f281806c8c0 2024-05-16T22:27:24.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.293+0000 7f28157fa640 1 --2- 172.21.15.44:0/1664342296 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f28040762d0 0x7f28040787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:24.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.293+0000 7f28157fa640 1 -- 172.21.15.44:0/1664342296 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7f2810097360 con 0x7f281806c8c0 2024-05-16T22:27:24.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.293+0000 7f2817fff640 1 --2- 172.21.15.44:0/1664342296 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f28040762d0 0x7f28040787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:24.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.293+0000 7f2817fff640 1 --2- 172.21.15.44:0/1664342296 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f28040762d0 0x7f28040787e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f280c034000 tx=0x7f280c02e000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:24.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.298+0000 7f28157fa640 1 -- 172.21.15.44:0/1664342296 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f28181da170 con 0x7f281806c8c0 2024-05-16T22:27:24.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:24.491+0000 7f281ed5e640 1 -- 172.21.15.44:0/1664342296 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f2818074d70 con 0x7f281806c8c0 2024-05-16T22:27:25.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.149+0000 7f28157fa640 1 -- 172.21.15.44:0/1664342296 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) ==== 170+0+0 (secure 0 0 0) 0x7f281814e440 con 0x7f281806c8c0 2024-05-16T22:27:25.149 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' created 2024-05-16T22:27:25.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.153+0000 7f281ed5e640 1 -- 172.21.15.44:0/1664342296 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f28040762d0 msgr2=0x7f28040787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:25.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.153+0000 7f281ed5e640 1 --2- 172.21.15.44:0/1664342296 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f28040762d0 0x7f28040787e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f280c034000 tx=0x7f280c02e000 comp rx=0 tx=0).stop 2024-05-16T22:27:25.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.153+0000 7f281ed5e640 1 -- 172.21.15.44:0/1664342296 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f281806c8c0 msgr2=0x7f28180bc0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:25.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.153+0000 7f281ed5e640 1 --2- 172.21.15.44:0/1664342296 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f281806c8c0 0x7f28180bc0b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f281000c730 tx=0x7f281000cbf0 comp rx=0 tx=0).stop 2024-05-16T22:27:25.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.153+0000 7f281ed5e640 1 -- 172.21.15.44:0/1664342296 shutdown_connections 2024-05-16T22:27:25.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.153+0000 7f281ed5e640 1 --2- 172.21.15.44:0/1664342296 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f28040762d0 0x7f28040787e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:25.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.153+0000 7f281ed5e640 1 --2- 172.21.15.44:0/1664342296 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f281814f120 0x7f2818142d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:25.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.153+0000 7f281ed5e640 1 --2- 172.21.15.44:0/1664342296 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2818148440 0x7f28181427c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:25.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.153+0000 7f281ed5e640 1 --2- 172.21.15.44:0/1664342296 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f281806c8c0 0x7f28180bc0b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:25.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.153+0000 7f281ed5e640 1 -- 172.21.15.44:0/1664342296 >> 172.21.15.44:0/1664342296 conn(0x7f28180bd160 msgr2=0x7f28180a0380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:25.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.153+0000 7f281ed5e640 1 -- 172.21.15.44:0/1664342296 shutdown_connections 2024-05-16T22:27:25.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.153+0000 7f281ed5e640 1 -- 172.21.15.44:0/1664342296 wait complete. 2024-05-16T22:27:25.176 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-16T22:27:25.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.297+0000 7f36b2934640 1 Processor -- start 2024-05-16T22:27:25.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.297+0000 7f36b2934640 1 -- start start 2024-05-16T22:27:25.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.298+0000 7f36b2934640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f36ac148450 0x7f36ac06d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:25.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.298+0000 7f36b2934640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f36ac151a90 0x7f36ac151ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:25.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.298+0000 7f36b2934640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36ac073370 con 0x7f36ac072870 2024-05-16T22:27:25.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.298+0000 7f36b2934640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f36ac073ca0 con 0x7f36ac148450 2024-05-16T22:27:25.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.298+0000 7f36b2934640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f36ac073650 con 0x7f36ac151a90 2024-05-16T22:27:25.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.298+0000 7f36ab7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f36ac148450 0x7f36ac06d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:25.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.298+0000 7f36abfff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f36ac072870 0x7f36ac0bc2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49524/0 (socket says 172.21.15.44:49524) 2024-05-16T22:27:25.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.298+0000 7f36abfff640 1 -- 172.21.15.44:0/3652161978 learned_addr learned my addr 172.21.15.44:0/3652161978 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:27:25.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.299+0000 7f36b0ed1640 1 --2- 172.21.15.44:0/3652161978 >> v2:172.21.15.70:3300/0 conn(0x7f36ac151a90 0x7f36ac151ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:25.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.299+0000 7f36ab7fe640 1 -- 172.21.15.44:0/3652161978 >> v2:172.21.15.70:3300/0 conn(0x7f36ac151a90 msgr2=0x7f36ac151ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:25.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.299+0000 7f36ab7fe640 1 --2- 172.21.15.44:0/3652161978 >> v2:172.21.15.70:3300/0 conn(0x7f36ac151a90 0x7f36ac151ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:25.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.299+0000 7f36ab7fe640 1 -- 172.21.15.44:0/3652161978 >> v1:172.21.15.44:6789/0 conn(0x7f36ac072870 legacy=0x7f36ac0bc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:25.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.299+0000 7f36ab7fe640 1 -- 172.21.15.44:0/3652161978 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36ac073930 con 0x7f36ac148450 2024-05-16T22:27:25.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.299+0000 7f36b0ed1640 1 --2- 172.21.15.44:0/3652161978 >> v2:172.21.15.70:3300/0 conn(0x7f36ac151a90 0x7f36ac151ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T22:27:25.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.299+0000 7f36ab7fe640 1 --2- 172.21.15.44:0/3652161978 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36ac148450 0x7f36ac06d6f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f36ac073e20 tx=0x7f369c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ec87214f85320e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:25.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.299+0000 7f36aaffd640 1 -- 172.21.15.44:0/3652161978 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f369c037070 con 0x7f36ac148450 2024-05-16T22:27:25.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.300+0000 7f36aaffd640 1 -- 172.21.15.44:0/3652161978 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f369c032440 con 0x7f36ac148450 2024-05-16T22:27:25.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.300+0000 7f36aaffd640 1 -- 172.21.15.44:0/3652161978 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f369c032810 con 0x7f36ac148450 2024-05-16T22:27:25.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.300+0000 7f36b2934640 1 -- 172.21.15.44:0/3652161978 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36ac148450 msgr2=0x7f36ac06d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:25.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.300+0000 7f36b2934640 1 --2- 172.21.15.44:0/3652161978 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36ac148450 0x7f36ac06d6f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f36ac073e20 tx=0x7f369c02a230 comp rx=0 tx=0).stop 2024-05-16T22:27:25.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.300+0000 7f36b2934640 1 -- 172.21.15.44:0/3652161978 shutdown_connections 2024-05-16T22:27:25.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.300+0000 7f36b2934640 1 --2- 172.21.15.44:0/3652161978 >> v2:172.21.15.70:3300/0 conn(0x7f36ac151a90 0x7f36ac151ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:25.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.300+0000 7f36b2934640 1 --2- 172.21.15.44:0/3652161978 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36ac148450 0x7f36ac06d6f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:25.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.300+0000 7f36b2934640 1 -- 172.21.15.44:0/3652161978 >> 172.21.15.44:0/3652161978 conn(0x7f36ac06f2c0 msgr2=0x7f36ac06f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:25.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.300+0000 7f36b2934640 1 -- 172.21.15.44:0/3652161978 shutdown_connections 2024-05-16T22:27:25.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.300+0000 7f36b2934640 1 -- 172.21.15.44:0/3652161978 wait complete. 2024-05-16T22:27:25.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.302+0000 7f36b2934640 1 Processor -- start 2024-05-16T22:27:25.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.302+0000 7f36b2934640 1 -- start start 2024-05-16T22:27:25.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.303+0000 7f36b2934640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36ac072870 0x7f36ac150260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:25.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.303+0000 7f36b2934640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f36ac148450 0x7f36ac0a3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:25.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.303+0000 7f36b2934640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36ac151a90 0x7f36ac0a5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:25.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.303+0000 7f36b2934640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f36ac06ddb0 con 0x7f36ac151a90 2024-05-16T22:27:25.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.303+0000 7f36b2934640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f36ac06dc30 con 0x7f36ac072870 2024-05-16T22:27:25.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.303+0000 7f36b2934640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f36ac158c70 con 0x7f36ac148450 2024-05-16T22:27:25.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.303+0000 7f36b0ed1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36ac151a90 0x7f36ac0a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:25.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.303+0000 7f36b0ed1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36ac151a90 0x7f36ac0a5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54234/0 (socket says 172.21.15.44:54234) 2024-05-16T22:27:25.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.303+0000 7f36b0ed1640 1 -- 172.21.15.44:0/1730662663 learned_addr learned my addr 172.21.15.44:0/1730662663 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:25.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.303+0000 7f36abfff640 1 --2- 172.21.15.44:0/1730662663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36ac072870 0x7f36ac150260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:25.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.303+0000 7f36ab7fe640 1 --2- 172.21.15.44:0/1730662663 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f36ac148450 0x7f36ac0a3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:25.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.303+0000 7f36b0ed1640 1 -- 172.21.15.44:0/1730662663 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f36ac148450 msgr2=0x7f36ac0a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:25.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.303+0000 7f36b0ed1640 1 --2- 172.21.15.44:0/1730662663 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f36ac148450 0x7f36ac0a3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:25.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.303+0000 7f36b0ed1640 1 -- 172.21.15.44:0/1730662663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36ac072870 msgr2=0x7f36ac150260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:25.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.303+0000 7f36b0ed1640 1 --2- 172.21.15.44:0/1730662663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36ac072870 0x7f36ac150260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:25.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.303+0000 7f36b0ed1640 1 -- 172.21.15.44:0/1730662663 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36ac1507a0 con 0x7f36ac151a90 2024-05-16T22:27:25.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.303+0000 7f36abfff640 1 --2- 172.21.15.44:0/1730662663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36ac072870 0x7f36ac150260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T22:27:25.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.304+0000 7f36b0ed1640 1 --2- 172.21.15.44:0/1730662663 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36ac151a90 0x7f36ac0a5890 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f36a400cd80 tx=0x7f36a400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:25.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.304+0000 7f36a8ff9640 1 -- 172.21.15.44:0/1730662663 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a400f680 con 0x7f36ac151a90 2024-05-16T22:27:25.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.304+0000 7f36a8ff9640 1 -- 172.21.15.44:0/1730662663 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36a400f840 con 0x7f36ac151a90 2024-05-16T22:27:25.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.304+0000 7f36b2934640 1 -- 172.21.15.44:0/1730662663 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36ac0a3950 con 0x7f36ac151a90 2024-05-16T22:27:25.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.304+0000 7f36a8ff9640 1 -- 172.21.15.44:0/1730662663 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a400fc30 con 0x7f36ac151a90 2024-05-16T22:27:25.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.304+0000 7f36b2934640 1 -- 172.21.15.44:0/1730662663 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36ac1e7eb0 con 0x7f36ac151a90 2024-05-16T22:27:25.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.305+0000 7f36b2934640 1 -- 172.21.15.44:0/1730662663 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36ac050940 con 0x7f36ac151a90 2024-05-16T22:27:25.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.305+0000 7f36a8ff9640 1 -- 172.21.15.44:0/1730662663 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f36a40213f0 con 0x7f36ac151a90 2024-05-16T22:27:25.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.306+0000 7f36a8ff9640 1 --2- 172.21.15.44:0/1730662663 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f368c0762d0 0x7f368c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:25.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.306+0000 7f36a8ff9640 1 -- 172.21.15.44:0/1730662663 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7f36a40983f0 con 0x7f36ac151a90 2024-05-16T22:27:25.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.306+0000 7f36abfff640 1 --2- 172.21.15.44:0/1730662663 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f368c0762d0 0x7f368c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:25.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.307+0000 7f36abfff640 1 --2- 172.21.15.44:0/1730662663 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f368c0762d0 0x7f368c0787e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3694000f60 tx=0x7f3694009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:25.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.311+0000 7f36a8ff9640 1 -- 172.21.15.44:0/1730662663 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f36a4014030 con 0x7f36ac151a90 2024-05-16T22:27:25.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:25.546+0000 7f36b2934640 1 -- 172.21.15.44:0/1730662663 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f36ac0bbba0 con 0x7f36ac151a90 2024-05-16T22:27:26.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.151+0000 7f36a8ff9640 1 -- 172.21.15.44:0/1730662663 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f36a4061d20 con 0x7f36ac151a90 2024-05-16T22:27:26.150 INFO:teuthology.orchestra.run.smithi044.stderr:new fs with metadata pool 2 and data pool 3 2024-05-16T22:27:26.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.155+0000 7f36b2934640 1 -- 172.21.15.44:0/1730662663 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f368c0762d0 msgr2=0x7f368c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:26.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.155+0000 7f36b2934640 1 --2- 172.21.15.44:0/1730662663 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f368c0762d0 0x7f368c0787e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3694000f60 tx=0x7f3694009040 comp rx=0 tx=0).stop 2024-05-16T22:27:26.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.155+0000 7f36b2934640 1 -- 172.21.15.44:0/1730662663 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36ac151a90 msgr2=0x7f36ac0a5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:26.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.155+0000 7f36b2934640 1 --2- 172.21.15.44:0/1730662663 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36ac151a90 0x7f36ac0a5890 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f36a400cd80 tx=0x7f36a400a650 comp rx=0 tx=0).stop 2024-05-16T22:27:26.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.155+0000 7f36b2934640 1 -- 172.21.15.44:0/1730662663 shutdown_connections 2024-05-16T22:27:26.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.155+0000 7f36b2934640 1 --2- 172.21.15.44:0/1730662663 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f368c0762d0 0x7f368c0787e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:26.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.155+0000 7f36b2934640 1 --2- 172.21.15.44:0/1730662663 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f36ac148450 0x7f36ac0a3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:26.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.155+0000 7f36b2934640 1 --2- 172.21.15.44:0/1730662663 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36ac151a90 0x7f36ac0a5890 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:26.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.155+0000 7f36b2934640 1 --2- 172.21.15.44:0/1730662663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36ac072870 0x7f36ac150260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:26.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.155+0000 7f36b2934640 1 -- 172.21.15.44:0/1730662663 >> 172.21.15.44:0/1730662663 conn(0x7f36ac06f2c0 msgr2=0x7f36ac06d110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:26.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.157+0000 7f36b2934640 1 -- 172.21.15.44:0/1730662663 shutdown_connections 2024-05-16T22:27:26.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.157+0000 7f36b2934640 1 -- 172.21.15.44:0/1730662663 wait complete. 2024-05-16T22:27:26.183 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-16T22:27:26.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.304+0000 7f3fe5451640 1 Processor -- start 2024-05-16T22:27:26.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.304+0000 7f3fe5451640 1 -- start start 2024-05-16T22:27:26.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.305+0000 7f3fe5451640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3fe0145580 0x7f3fe00bcb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:26.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.305+0000 7f3fe5451640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3fe014bd60 0x7f3fe0155a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:26.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.305+0000 7f3fe5451640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fe00a5b60 con 0x7f3fe00baff0 2024-05-16T22:27:26.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.305+0000 7f3fe5451640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f3fe014eef0 con 0x7f3fe014bd60 2024-05-16T22:27:26.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.305+0000 7f3fe5451640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f3fe014f1d0 con 0x7f3fe0145580 2024-05-16T22:27:26.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.305+0000 7f3fdf7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3fe014bd60 0x7f3fe0155a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:26.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.305+0000 7f3fdf7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3fe014bd60 0x7f3fe0155a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54248/0 (socket says 172.21.15.44:54248) 2024-05-16T22:27:26.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.305+0000 7f3fdf7fe640 1 -- 172.21.15.44:0/1051071903 learned_addr learned my addr 172.21.15.44:0/1051071903 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:26.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.305+0000 7f3fdeffd640 1 --2- 172.21.15.44:0/1051071903 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3fe0145580 0x7f3fe00bcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:26.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.305+0000 7f3fdf7fe640 1 -- 172.21.15.44:0/1051071903 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3fe0145580 msgr2=0x7f3fe00bcb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:26.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.305+0000 7f3fdf7fe640 1 --2- 172.21.15.44:0/1051071903 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3fe0145580 0x7f3fe00bcb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:26.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.305+0000 7f3fdf7fe640 1 -- 172.21.15.44:0/1051071903 >> v1:172.21.15.70:6789/0 conn(0x7f3fe00baff0 legacy=0x7f3fe014b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:26.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.305+0000 7f3fdf7fe640 1 -- 172.21.15.44:0/1051071903 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fe014f4b0 con 0x7f3fe014bd60 2024-05-16T22:27:26.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.305+0000 7f3fdeffd640 1 --2- 172.21.15.44:0/1051071903 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3fe0145580 0x7f3fe00bcb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:27:26.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.306+0000 7f3fdf7fe640 1 --2- 172.21.15.44:0/1051071903 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3fe014bd60 0x7f3fe0155a40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3fd8009e80 tx=0x7f3fd802a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a32eda02251cbf27 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:26.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.306+0000 7f3fddffb640 1 -- 172.21.15.44:0/1051071903 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd8036070 con 0x7f3fe014bd60 2024-05-16T22:27:26.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.306+0000 7f3fddffb640 1 -- 172.21.15.44:0/1051071903 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fd8031600 con 0x7f3fe014bd60 2024-05-16T22:27:26.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.306+0000 7f3fddffb640 1 -- 172.21.15.44:0/1051071903 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd80319d0 con 0x7f3fe014bd60 2024-05-16T22:27:26.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.307+0000 7f3fe5451640 1 -- 172.21.15.44:0/1051071903 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3fe014bd60 msgr2=0x7f3fe0155a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:26.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.307+0000 7f3fe5451640 1 --2- 172.21.15.44:0/1051071903 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3fe014bd60 0x7f3fe0155a40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3fd8009e80 tx=0x7f3fd802a750 comp rx=0 tx=0).stop 2024-05-16T22:27:26.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.307+0000 7f3fe5451640 1 -- 172.21.15.44:0/1051071903 shutdown_connections 2024-05-16T22:27:26.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.307+0000 7f3fe5451640 1 --2- 172.21.15.44:0/1051071903 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3fe014bd60 0x7f3fe0155a40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:26.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.307+0000 7f3fe5451640 1 --2- 172.21.15.44:0/1051071903 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3fe0145580 0x7f3fe00bcb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:26.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.307+0000 7f3fe5451640 1 -- 172.21.15.44:0/1051071903 >> 172.21.15.44:0/1051071903 conn(0x7f3fe00bd0f0 msgr2=0x7f3fe00bd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:26.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.307+0000 7f3fe5451640 1 -- 172.21.15.44:0/1051071903 shutdown_connections 2024-05-16T22:27:26.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.307+0000 7f3fe5451640 1 -- 172.21.15.44:0/1051071903 wait complete. 2024-05-16T22:27:26.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.309+0000 7f3fe5451640 1 Processor -- start 2024-05-16T22:27:26.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.309+0000 7f3fe5451640 1 -- start start 2024-05-16T22:27:26.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.310+0000 7f3fe5451640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3fe00baff0 0x7f3fe014a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:26.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.310+0000 7f3fe5451640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3fe0145580 0x7f3fe01446e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:26.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.310+0000 7f3fe5451640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fe014bd60 0x7f3fe0144c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:26.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.310+0000 7f3fe5451640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe00bb400 con 0x7f3fe00baff0 2024-05-16T22:27:26.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.310+0000 7f3fe5451640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe014eb90 con 0x7f3fe014bd60 2024-05-16T22:27:26.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.310+0000 7f3fe5451640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f3fe00bb580 con 0x7f3fe0145580 2024-05-16T22:27:26.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.310+0000 7f3fdeffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3fe00baff0 0x7f3fe014a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:26.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.310+0000 7f3fdeffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3fe00baff0 0x7f3fe014a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54260/0 (socket says 172.21.15.44:54260) 2024-05-16T22:27:26.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.310+0000 7f3fdeffd640 1 -- 172.21.15.44:0/345436479 learned_addr learned my addr 172.21.15.44:0/345436479 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:26.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.310+0000 7f3fde7fc640 1 --2- 172.21.15.44:0/345436479 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3fe0145580 0x7f3fe01446e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:26.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.310+0000 7f3fdf7fe640 1 --2- 172.21.15.44:0/345436479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fe014bd60 0x7f3fe0144c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:26.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.310+0000 7f3fdeffd640 1 -- 172.21.15.44:0/345436479 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3fe0145580 msgr2=0x7f3fe01446e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:26.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.310+0000 7f3fdeffd640 1 --2- 172.21.15.44:0/345436479 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3fe0145580 0x7f3fe01446e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:26.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.310+0000 7f3fdeffd640 1 -- 172.21.15.44:0/345436479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fe014bd60 msgr2=0x7f3fe0144c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:26.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.310+0000 7f3fdeffd640 1 --2- 172.21.15.44:0/345436479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fe014bd60 0x7f3fe0144c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:26.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.310+0000 7f3fdeffd640 1 -- 172.21.15.44:0/345436479 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fe014a880 con 0x7f3fe00baff0 2024-05-16T22:27:26.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.310+0000 7f3fdeffd640 1 --2- 172.21.15.44:0/345436479 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3fe00baff0 0x7f3fe014a340 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3fd000d800 tx=0x7f3fd000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:26.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.310+0000 7f3fc77fe640 1 -- 172.21.15.44:0/345436479 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd0004030 con 0x7f3fe00baff0 2024-05-16T22:27:26.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.310+0000 7f3fc77fe640 1 -- 172.21.15.44:0/345436479 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fd00041d0 con 0x7f3fe00baff0 2024-05-16T22:27:26.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.311+0000 7f3fe5451640 1 -- 172.21.15.44:0/345436479 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fe01d8270 con 0x7f3fe00baff0 2024-05-16T22:27:26.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.311+0000 7f3fc77fe640 1 -- 172.21.15.44:0/345436479 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd00096a0 con 0x7f3fe00baff0 2024-05-16T22:27:26.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.311+0000 7f3fe5451640 1 -- 172.21.15.44:0/345436479 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fe00a3c20 con 0x7f3fe00baff0 2024-05-16T22:27:26.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.311+0000 7f3fe5451640 1 -- 172.21.15.44:0/345436479 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fe0069b50 con 0x7f3fe00baff0 2024-05-16T22:27:26.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.312+0000 7f3fc77fe640 1 -- 172.21.15.44:0/345436479 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3fd0009840 con 0x7f3fe00baff0 2024-05-16T22:27:26.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.313+0000 7f3fc77fe640 1 --2- 172.21.15.44:0/345436479 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f3fcc076300 0x7f3fcc078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:26.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.313+0000 7f3fc77fe640 1 -- 172.21.15.44:0/345436479 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3fd0097790 con 0x7f3fe00baff0 2024-05-16T22:27:26.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.313+0000 7f3fde7fc640 1 --2- 172.21.15.44:0/345436479 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f3fcc076300 0x7f3fcc078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:26.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.313+0000 7f3fde7fc640 1 --2- 172.21.15.44:0/345436479 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f3fcc076300 0x7f3fcc078810 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3fe01e1ff0 tx=0x7f3fd4009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:26.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.318+0000 7f3fc77fe640 1 -- 172.21.15.44:0/345436479 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3fd0060a10 con 0x7f3fe00baff0 2024-05-16T22:27:26.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.508+0000 7f3fe5451640 1 -- 172.21.15.44:0/345436479 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3fe0050940 con 0x7f3fe00baff0 2024-05-16T22:27:26.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.510+0000 7f3fc77fe640 1 -- 172.21.15.44:0/345436479 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16582 (secure 0 0 0) 0x7f3fd0064d10 con 0x7f3fe00baff0 2024-05-16T22:27:26.510 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:27:26.510 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":20,"fsid":"572ab7cc-b103-4548-ae8f-c6614d57f0c8","created":"2024-05-16T22:27:02.216874+0000","modified":"2024-05-16T22:27:25.548107+0000","last_up_change":"2024-05-16T22:27:13.693953+0000","last_in_change":"2024-05-16T22:27:04.455119+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-16T22:27:14.562409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-16T22:27:23.458618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-16T22:27:24.495231+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a7003e89-c706-4562-9f25-670bb35ae108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6825","nonce":1074109859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6827","nonce":1074109859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6831","nonce":1074109859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6829","nonce":1074109859}]},"public_addr":"172.21.15.44:6825/1074109859","cluster_addr":"172.21.15.44:6827/1074109859","heartbeat_back_addr":"172.21.15.44:6831/1074109859","heartbeat_front_addr":"172.21.15.44:6829/1074109859","state":["exists","up"]},{"osd":1,"uuid":"a4d5169d-8327-4494-9c7c-58db21b00636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6817","nonce":2909429972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6819","nonce":2909429972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6823","nonce":2909429972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6821","nonce":2909429972}]},"public_addr":"172.21.15.44:6817/2909429972","cluster_addr":"172.21.15.44:6819/2909429972","heartbeat_back_addr":"172.21.15.44:6823/2909429972","heartbeat_front_addr":"172.21.15.44:6821/2909429972","state":["exists","up"]},{"osd":2,"uuid":"d4a834f8-83a5-400f-9814-eb0a25124df4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6801","nonce":2908194156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6803","nonce":2908194156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6807","nonce":2908194156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6805","nonce":2908194156}]},"public_addr":"172.21.15.44:6801/2908194156","cluster_addr":"172.21.15.44:6803/2908194156","heartbeat_back_addr":"172.21.15.44:6807/2908194156","heartbeat_front_addr":"172.21.15.44:6805/2908194156","state":["exists","up"]},{"osd":3,"uuid":"b9d24a56-ad43-4674-a395-5ec24d135ae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6809","nonce":2168695793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6811","nonce":2168695793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6815","nonce":2168695793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6813","nonce":2168695793}]},"public_addr":"172.21.15.44:6809/2168695793","cluster_addr":"172.21.15.44:6811/2168695793","heartbeat_back_addr":"172.21.15.44:6815/2168695793","heartbeat_front_addr":"172.21.15.44:6813/2168695793","state":["exists","up"]},{"osd":4,"uuid":"9bd94af5-3e17-4cbe-995a-8f837a66c653","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6823","nonce":1540297751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6825","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6827","nonce":1540297751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6831","nonce":1540297751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6829","nonce":1540297751}]},"public_addr":"172.21.15.70:6823/1540297751","cluster_addr":"172.21.15.70:6827/1540297751","heartbeat_back_addr":"172.21.15.70:6831/1540297751","heartbeat_front_addr":"172.21.15.70:6829/1540297751","state":["exists","up"]},{"osd":5,"uuid":"a5b0cfa5-b259-48bd-98b6-96b44f5ebabd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6804","nonce":4218901987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6808","nonce":4218901987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6815","nonce":4218901987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6812","nonce":4218901987}]},"public_addr":"172.21.15.70:6804/4218901987","cluster_addr":"172.21.15.70:6808/4218901987","heartbeat_back_addr":"172.21.15.70:6815/4218901987","heartbeat_front_addr":"172.21.15.70:6812/4218901987","state":["exists","up"]},{"osd":6,"uuid":"0b6af6df-1358-4fc6-a62c-ba57e02914ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6801","nonce":2389556489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6805","nonce":2389556489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6813","nonce":2389556489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6807","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6809","nonce":2389556489}]},"public_addr":"172.21.15.70:6801/2389556489","cluster_addr":"172.21.15.70:6805/2389556489","heartbeat_back_addr":"172.21.15.70:6813/2389556489","heartbeat_front_addr":"172.21.15.70:6809/2389556489","state":["exists","up"]},{"osd":7,"uuid":"eb1a2c5d-42cf-47d0-9e03-b9d26944a589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6817","nonce":3619691281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6819","nonce":3619691281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6826","nonce":3619691281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6822","nonce":3619691281}]},"public_addr":"172.21.15.70:6817/3619691281","cluster_addr":"172.21.15.70:6819/3619691281","heartbeat_back_addr":"172.21.15.70:6826/3619691281","heartbeat_front_addr":"172.21.15.70:6822/3619691281","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.652256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.613348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.528454+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.625204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.678845+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.680829+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.556200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.647030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T22:27:26.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.512+0000 7f3fe5451640 1 -- 172.21.15.44:0/345436479 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f3fcc076300 msgr2=0x7f3fcc078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:26.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.512+0000 7f3fe5451640 1 --2- 172.21.15.44:0/345436479 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f3fcc076300 0x7f3fcc078810 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3fe01e1ff0 tx=0x7f3fd4009040 comp rx=0 tx=0).stop 2024-05-16T22:27:26.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.512+0000 7f3fe5451640 1 -- 172.21.15.44:0/345436479 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3fe00baff0 msgr2=0x7f3fe014a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:26.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.512+0000 7f3fe5451640 1 --2- 172.21.15.44:0/345436479 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3fe00baff0 0x7f3fe014a340 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3fd000d800 tx=0x7f3fd000dcc0 comp rx=0 tx=0).stop 2024-05-16T22:27:26.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.512+0000 7f3fe5451640 1 -- 172.21.15.44:0/345436479 shutdown_connections 2024-05-16T22:27:26.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.512+0000 7f3fe5451640 1 --2- 172.21.15.44:0/345436479 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f3fcc076300 0x7f3fcc078810 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:26.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.512+0000 7f3fe5451640 1 --2- 172.21.15.44:0/345436479 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3fe0145580 0x7f3fe01446e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:26.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.512+0000 7f3fe5451640 1 --2- 172.21.15.44:0/345436479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fe014bd60 0x7f3fe0144c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:26.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.512+0000 7f3fe5451640 1 --2- 172.21.15.44:0/345436479 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3fe00baff0 0x7f3fe014a340 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:26.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.512+0000 7f3fe5451640 1 -- 172.21.15.44:0/345436479 >> 172.21.15.44:0/345436479 conn(0x7f3fe00bd0f0 msgr2=0x7f3fe006df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:26.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.512+0000 7f3fe5451640 1 -- 172.21.15.44:0/345436479 shutdown_connections 2024-05-16T22:27:26.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.512+0000 7f3fe5451640 1 -- 172.21.15.44:0/345436479 wait complete. 2024-05-16T22:27:26.523 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-16T22:27:26.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.636+0000 7f054d5dc640 1 Processor -- start 2024-05-16T22:27:26.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.636+0000 7f054d5dc640 1 -- start start 2024-05-16T22:27:26.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.637+0000 7f054d5dc640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f0548148330 0x7f05480be2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:26.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.637+0000 7f054d5dc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f054814e670 0x7f0548158bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:26.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.637+0000 7f054d5dc640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05481518d0 con 0x7f054814e260 2024-05-16T22:27:26.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.637+0000 7f054d5dc640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f0548148740 con 0x7f054814e670 2024-05-16T22:27:26.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.637+0000 7f054d5dc640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f0548151bb0 con 0x7f0548148330 2024-05-16T22:27:26.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.637+0000 7f05477fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f054814e670 0x7f0548158bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:26.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.637+0000 7f05477fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f054814e670 0x7f0548158bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54274/0 (socket says 172.21.15.44:54274) 2024-05-16T22:27:26.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.637+0000 7f05467fc640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f054814e260 0x7f05480bfaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49538/0 (socket says 172.21.15.44:49538) 2024-05-16T22:27:26.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.637+0000 7f05477fe640 1 -- 172.21.15.44:0/2511071304 learned_addr learned my addr 172.21.15.44:0/2511071304 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:26.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.637+0000 7f0546ffd640 1 --2- 172.21.15.44:0/2511071304 >> v2:172.21.15.70:3300/0 conn(0x7f0548148330 0x7f05480be2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:26.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.637+0000 7f05477fe640 1 -- 172.21.15.44:0/2511071304 >> v2:172.21.15.70:3300/0 conn(0x7f0548148330 msgr2=0x7f05480be2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:26.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.637+0000 7f05477fe640 1 --2- 172.21.15.44:0/2511071304 >> v2:172.21.15.70:3300/0 conn(0x7f0548148330 0x7f05480be2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:26.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.637+0000 7f05477fe640 1 -- 172.21.15.44:0/2511071304 >> v1:172.21.15.44:6789/0 conn(0x7f054814e260 legacy=0x7f05480bfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:26.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.637+0000 7f05477fe640 1 -- 172.21.15.44:0/2511071304 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0548151e90 con 0x7f054814e670 2024-05-16T22:27:26.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.637+0000 7f0545ffb640 1 -- 172.21.15.44:0/2511071304 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1020965713 0 0) 0x7f05481518d0 con 0x7f054814e260 2024-05-16T22:27:26.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.638+0000 7f05477fe640 1 --2- 172.21.15.44:0/2511071304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f054814e670 0x7f0548158bc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f05480a45b0 tx=0x7f053802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=299bebd7d0c220c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:26.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.638+0000 7f0545ffb640 1 -- 172.21.15.44:0/2511071304 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0538036070 con 0x7f054814e670 2024-05-16T22:27:26.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.638+0000 7f0545ffb640 1 -- 172.21.15.44:0/2511071304 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0538031600 con 0x7f054814e670 2024-05-16T22:27:26.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.638+0000 7f0545ffb640 1 -- 172.21.15.44:0/2511071304 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05380319d0 con 0x7f054814e670 2024-05-16T22:27:26.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.639+0000 7f054d5dc640 1 -- 172.21.15.44:0/2511071304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f054814e670 msgr2=0x7f0548158bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:26.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.639+0000 7f054d5dc640 1 --2- 172.21.15.44:0/2511071304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f054814e670 0x7f0548158bc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f05480a45b0 tx=0x7f053802a730 comp rx=0 tx=0).stop 2024-05-16T22:27:26.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.639+0000 7f054d5dc640 1 -- 172.21.15.44:0/2511071304 shutdown_connections 2024-05-16T22:27:26.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.639+0000 7f054d5dc640 1 --2- 172.21.15.44:0/2511071304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f054814e670 0x7f0548158bc0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:26.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.639+0000 7f054d5dc640 1 --2- 172.21.15.44:0/2511071304 >> v2:172.21.15.70:3300/0 conn(0x7f0548148330 0x7f05480be2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:26.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.639+0000 7f054d5dc640 1 -- 172.21.15.44:0/2511071304 >> 172.21.15.44:0/2511071304 conn(0x7f05480c17c0 msgr2=0x7f05480c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:26.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.639+0000 7f054d5dc640 1 -- 172.21.15.44:0/2511071304 shutdown_connections 2024-05-16T22:27:26.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.639+0000 7f054d5dc640 1 -- 172.21.15.44:0/2511071304 wait complete. 2024-05-16T22:27:26.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.640+0000 7f054d5dc640 1 Processor -- start 2024-05-16T22:27:26.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.640+0000 7f054d5dc640 1 -- start start 2024-05-16T22:27:26.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.641+0000 7f054d5dc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0548148330 0x7f05481e3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:26.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.641+0000 7f054d5dc640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f054814e260 0x7f05481da940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:26.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.641+0000 7f054d5dc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f054814e670 0x7f0548143bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:26.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.641+0000 7f054d5dc640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0548152690 con 0x7f054814e670 2024-05-16T22:27:26.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.641+0000 7f054d5dc640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f05480c10b0 con 0x7f0548148330 2024-05-16T22:27:26.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.641+0000 7f054d5dc640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f05480c01b0 con 0x7f054814e260 2024-05-16T22:27:26.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.642+0000 7f05477fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f054814e670 0x7f0548143bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:26.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.642+0000 7f05477fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f054814e670 0x7f0548143bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54284/0 (socket says 172.21.15.44:54284) 2024-05-16T22:27:26.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.642+0000 7f05477fe640 1 -- 172.21.15.44:0/338376874 learned_addr learned my addr 172.21.15.44:0/338376874 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:26.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.642+0000 7f0546ffd640 1 --2- 172.21.15.44:0/338376874 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0548148330 0x7f05481e3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:26.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.642+0000 7f05467fc640 1 --2- 172.21.15.44:0/338376874 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f054814e260 0x7f05481da940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:26.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.642+0000 7f05477fe640 1 -- 172.21.15.44:0/338376874 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f054814e260 msgr2=0x7f05481da940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:26.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.642+0000 7f05477fe640 1 --2- 172.21.15.44:0/338376874 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f054814e260 0x7f05481da940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:26.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.642+0000 7f05477fe640 1 -- 172.21.15.44:0/338376874 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0548148330 msgr2=0x7f05481e3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:26.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.642+0000 7f05477fe640 1 --2- 172.21.15.44:0/338376874 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0548148330 0x7f05481e3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:26.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.642+0000 7f05477fe640 1 -- 172.21.15.44:0/338376874 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05481dae80 con 0x7f054814e670 2024-05-16T22:27:26.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.642+0000 7f05477fe640 1 --2- 172.21.15.44:0/338376874 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f054814e670 0x7f0548143bc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0538009f40 tx=0x7f0538004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:26.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.642+0000 7f053f7fe640 1 -- 172.21.15.44:0/338376874 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0538041020 con 0x7f054814e670 2024-05-16T22:27:26.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.642+0000 7f053f7fe640 1 -- 172.21.15.44:0/338376874 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0538037040 con 0x7f054814e670 2024-05-16T22:27:26.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.642+0000 7f053f7fe640 1 -- 172.21.15.44:0/338376874 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0538036050 con 0x7f054814e670 2024-05-16T22:27:26.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.642+0000 7f054d5dc640 1 -- 172.21.15.44:0/338376874 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05480b8100 con 0x7f054814e670 2024-05-16T22:27:26.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.642+0000 7f054d5dc640 1 -- 172.21.15.44:0/338376874 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f054814cf50 con 0x7f054814e670 2024-05-16T22:27:26.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.643+0000 7f054d5dc640 1 -- 172.21.15.44:0/338376874 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f054814bbf0 con 0x7f054814e670 2024-05-16T22:27:26.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.644+0000 7f053f7fe640 1 -- 172.21.15.44:0/338376874 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0538007bd0 con 0x7f054814e670 2024-05-16T22:27:26.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.644+0000 7f053f7fe640 1 --2- 172.21.15.44:0/338376874 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f05280762d0 0x7f05280787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:26.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.645+0000 7f053f7fe640 1 -- 172.21.15.44:0/338376874 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f05380b7d50 con 0x7f054814e670 2024-05-16T22:27:26.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.645+0000 7f0546ffd640 1 --2- 172.21.15.44:0/338376874 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f05280762d0 0x7f05280787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:26.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.645+0000 7f0546ffd640 1 --2- 172.21.15.44:0/338376874 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f05280762d0 0x7f05280787e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0540006fd0 tx=0x7f0540008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:26.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.649+0000 7f053f7fe640 1 -- 172.21.15.44:0/338376874 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f053804b060 con 0x7f054814e670 2024-05-16T22:27:26.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.844+0000 7f054d5dc640 1 -- 172.21.15.44:0/338376874 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0548050940 con 0x7f054814e670 2024-05-16T22:27:26.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.845+0000 7f053f7fe640 1 -- 172.21.15.44:0/338376874 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16582 (secure 0 0 0) 0x7f05380816a0 con 0x7f054814e670 2024-05-16T22:27:26.844 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:27:26.845 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":20,"fsid":"572ab7cc-b103-4548-ae8f-c6614d57f0c8","created":"2024-05-16T22:27:02.216874+0000","modified":"2024-05-16T22:27:25.548107+0000","last_up_change":"2024-05-16T22:27:13.693953+0000","last_in_change":"2024-05-16T22:27:04.455119+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-16T22:27:14.562409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-16T22:27:23.458618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-16T22:27:24.495231+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a7003e89-c706-4562-9f25-670bb35ae108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6825","nonce":1074109859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6827","nonce":1074109859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6831","nonce":1074109859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6829","nonce":1074109859}]},"public_addr":"172.21.15.44:6825/1074109859","cluster_addr":"172.21.15.44:6827/1074109859","heartbeat_back_addr":"172.21.15.44:6831/1074109859","heartbeat_front_addr":"172.21.15.44:6829/1074109859","state":["exists","up"]},{"osd":1,"uuid":"a4d5169d-8327-4494-9c7c-58db21b00636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6817","nonce":2909429972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6819","nonce":2909429972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6823","nonce":2909429972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6821","nonce":2909429972}]},"public_addr":"172.21.15.44:6817/2909429972","cluster_addr":"172.21.15.44:6819/2909429972","heartbeat_back_addr":"172.21.15.44:6823/2909429972","heartbeat_front_addr":"172.21.15.44:6821/2909429972","state":["exists","up"]},{"osd":2,"uuid":"d4a834f8-83a5-400f-9814-eb0a25124df4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6801","nonce":2908194156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6803","nonce":2908194156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6807","nonce":2908194156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6805","nonce":2908194156}]},"public_addr":"172.21.15.44:6801/2908194156","cluster_addr":"172.21.15.44:6803/2908194156","heartbeat_back_addr":"172.21.15.44:6807/2908194156","heartbeat_front_addr":"172.21.15.44:6805/2908194156","state":["exists","up"]},{"osd":3,"uuid":"b9d24a56-ad43-4674-a395-5ec24d135ae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6809","nonce":2168695793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6811","nonce":2168695793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6815","nonce":2168695793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6813","nonce":2168695793}]},"public_addr":"172.21.15.44:6809/2168695793","cluster_addr":"172.21.15.44:6811/2168695793","heartbeat_back_addr":"172.21.15.44:6815/2168695793","heartbeat_front_addr":"172.21.15.44:6813/2168695793","state":["exists","up"]},{"osd":4,"uuid":"9bd94af5-3e17-4cbe-995a-8f837a66c653","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6823","nonce":1540297751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6825","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6827","nonce":1540297751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6831","nonce":1540297751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6829","nonce":1540297751}]},"public_addr":"172.21.15.70:6823/1540297751","cluster_addr":"172.21.15.70:6827/1540297751","heartbeat_back_addr":"172.21.15.70:6831/1540297751","heartbeat_front_addr":"172.21.15.70:6829/1540297751","state":["exists","up"]},{"osd":5,"uuid":"a5b0cfa5-b259-48bd-98b6-96b44f5ebabd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6804","nonce":4218901987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6808","nonce":4218901987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6815","nonce":4218901987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6812","nonce":4218901987}]},"public_addr":"172.21.15.70:6804/4218901987","cluster_addr":"172.21.15.70:6808/4218901987","heartbeat_back_addr":"172.21.15.70:6815/4218901987","heartbeat_front_addr":"172.21.15.70:6812/4218901987","state":["exists","up"]},{"osd":6,"uuid":"0b6af6df-1358-4fc6-a62c-ba57e02914ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6801","nonce":2389556489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6805","nonce":2389556489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6813","nonce":2389556489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6807","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6809","nonce":2389556489}]},"public_addr":"172.21.15.70:6801/2389556489","cluster_addr":"172.21.15.70:6805/2389556489","heartbeat_back_addr":"172.21.15.70:6813/2389556489","heartbeat_front_addr":"172.21.15.70:6809/2389556489","state":["exists","up"]},{"osd":7,"uuid":"eb1a2c5d-42cf-47d0-9e03-b9d26944a589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6817","nonce":3619691281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6819","nonce":3619691281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6826","nonce":3619691281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6822","nonce":3619691281}]},"public_addr":"172.21.15.70:6817/3619691281","cluster_addr":"172.21.15.70:6819/3619691281","heartbeat_back_addr":"172.21.15.70:6826/3619691281","heartbeat_front_addr":"172.21.15.70:6822/3619691281","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.652256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.613348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.528454+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.625204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.678845+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.680829+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.556200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.647030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T22:27:26.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.847+0000 7f054d5dc640 1 -- 172.21.15.44:0/338376874 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f05280762d0 msgr2=0x7f05280787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:26.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.847+0000 7f054d5dc640 1 --2- 172.21.15.44:0/338376874 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f05280762d0 0x7f05280787e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0540006fd0 tx=0x7f0540008040 comp rx=0 tx=0).stop 2024-05-16T22:27:26.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.847+0000 7f054d5dc640 1 -- 172.21.15.44:0/338376874 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f054814e670 msgr2=0x7f0548143bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:26.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.847+0000 7f054d5dc640 1 --2- 172.21.15.44:0/338376874 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f054814e670 0x7f0548143bc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0538009f40 tx=0x7f0538004a40 comp rx=0 tx=0).stop 2024-05-16T22:27:26.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.847+0000 7f054d5dc640 1 -- 172.21.15.44:0/338376874 shutdown_connections 2024-05-16T22:27:26.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.847+0000 7f054d5dc640 1 --2- 172.21.15.44:0/338376874 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f05280762d0 0x7f05280787e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:26.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.847+0000 7f054d5dc640 1 --2- 172.21.15.44:0/338376874 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f054814e260 0x7f05481da940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:26.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.847+0000 7f054d5dc640 1 --2- 172.21.15.44:0/338376874 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f054814e670 0x7f0548143bc0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:26.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.847+0000 7f054d5dc640 1 --2- 172.21.15.44:0/338376874 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0548148330 0x7f05481e3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:26.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.847+0000 7f054d5dc640 1 -- 172.21.15.44:0/338376874 >> 172.21.15.44:0/338376874 conn(0x7f05480c17c0 msgr2=0x7f054814c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:26.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.847+0000 7f054d5dc640 1 -- 172.21.15.44:0/338376874 shutdown_connections 2024-05-16T22:27:26.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.847+0000 7f054d5dc640 1 -- 172.21.15.44:0/338376874 wait complete. 2024-05-16T22:27:26.858 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-16T22:27:26.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.973+0000 7fccd3aa8640 1 Processor -- start 2024-05-16T22:27:26.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.973+0000 7fccd3aa8640 1 -- start start 2024-05-16T22:27:26.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.974+0000 7fccd3aa8640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fcccc151fc0 0x7fcccc0bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:26.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.974+0000 7fccd3aa8640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcccc0bf050 0x7fcccc158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:26.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.974+0000 7fccd3aa8640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcccc0c36f0 con 0x7fcccc06da30 2024-05-16T22:27:26.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.974+0000 7fccd3aa8640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fcccc0bdc10 con 0x7fcccc151fc0 2024-05-16T22:27:26.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.974+0000 7fccd3aa8640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fcccc152530 con 0x7fcccc0bf050 2024-05-16T22:27:26.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.974+0000 7fccd1043640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fcccc06da30 0x7fcccc0be940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49554/0 (socket says 172.21.15.44:49554) 2024-05-16T22:27:26.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.974+0000 7fccd1043640 1 -- 172.21.15.44:0/1399526176 learned_addr learned my addr 172.21.15.44:0/1399526176 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:27:26.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.974+0000 7fccd1844640 1 --2- 172.21.15.44:0/1399526176 >> v2:172.21.15.70:3300/0 conn(0x7fcccc151fc0 0x7fcccc0bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:26.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.974+0000 7fccd2045640 1 --2- 172.21.15.44:0/1399526176 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcccc0bf050 0x7fcccc158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:26.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.974+0000 7fccd0842640 1 -- 172.21.15.44:0/1399526176 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3757521406 0 0) 0x7fcccc0c36f0 con 0x7fcccc06da30 2024-05-16T22:27:26.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.974+0000 7fccd0842640 1 -- 172.21.15.44:0/1399526176 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fccb8003520 con 0x7fcccc06da30 2024-05-16T22:27:26.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.975+0000 7fccd1844640 1 -- 172.21.15.44:0/1399526176 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcccc0bf050 msgr2=0x7fcccc158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:26.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.975+0000 7fccd1844640 1 --2- 172.21.15.44:0/1399526176 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcccc0bf050 0x7fcccc158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:26.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.975+0000 7fccd1844640 1 -- 172.21.15.44:0/1399526176 >> v1:172.21.15.44:6789/0 conn(0x7fcccc06da30 legacy=0x7fcccc0be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:26.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.975+0000 7fccd0842640 1 -- 172.21.15.44:0/1399526176 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 494632698 0 0) 0x7fccb8003520 con 0x7fcccc06da30 2024-05-16T22:27:26.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.975+0000 7fccd1844640 1 -- 172.21.15.44:0/1399526176 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcccc152810 con 0x7fcccc151fc0 2024-05-16T22:27:26.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.975+0000 7fccd1844640 1 --2- 172.21.15.44:0/1399526176 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcccc151fc0 0x7fcccc0bd6d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fccc80097a0 tx=0x7fccc802a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd0d88a492d9c467 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:26.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.976+0000 7fccd0842640 1 -- 172.21.15.44:0/1399526176 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc8037070 con 0x7fcccc151fc0 2024-05-16T22:27:26.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.976+0000 7fccd0842640 1 -- 172.21.15.44:0/1399526176 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccc802ab10 con 0x7fcccc151fc0 2024-05-16T22:27:26.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.976+0000 7fccd0842640 1 -- 172.21.15.44:0/1399526176 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccbc0016f0 con 0x7fcccc151fc0 2024-05-16T22:27:26.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.976+0000 7fccd3aa8640 1 -- 172.21.15.44:0/1399526176 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcccc151fc0 msgr2=0x7fcccc0bd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:26.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.976+0000 7fccd3aa8640 1 --2- 172.21.15.44:0/1399526176 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcccc151fc0 0x7fcccc0bd6d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fccc80097a0 tx=0x7fccc802a080 comp rx=0 tx=0).stop 2024-05-16T22:27:26.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.976+0000 7fccd3aa8640 1 -- 172.21.15.44:0/1399526176 shutdown_connections 2024-05-16T22:27:26.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.976+0000 7fccd3aa8640 1 --2- 172.21.15.44:0/1399526176 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcccc0bf050 0x7fcccc158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:26.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.976+0000 7fccd3aa8640 1 --2- 172.21.15.44:0/1399526176 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcccc151fc0 0x7fcccc0bd6d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:26.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.976+0000 7fccd3aa8640 1 -- 172.21.15.44:0/1399526176 >> 172.21.15.44:0/1399526176 conn(0x7fcccc0c3d20 msgr2=0x7fcccc0c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:26.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.976+0000 7fccd3aa8640 1 -- 172.21.15.44:0/1399526176 shutdown_connections 2024-05-16T22:27:26.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.976+0000 7fccd3aa8640 1 -- 172.21.15.44:0/1399526176 wait complete. 2024-05-16T22:27:26.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.978+0000 7fccd3aa8640 1 Processor -- start 2024-05-16T22:27:26.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.978+0000 7fccd3aa8640 1 -- start start 2024-05-16T22:27:26.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.979+0000 7fccd3aa8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcccc06da30 0x7fcccc1d7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:26.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.979+0000 7fccd3aa8640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcccc0bf050 0x7fcccc14db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:26.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.979+0000 7fccd3aa8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcccc151fc0 0x7fcccc1e77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:26.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.979+0000 7fccd3aa8640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcccc0a3050 con 0x7fcccc151fc0 2024-05-16T22:27:26.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.979+0000 7fccd3aa8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcccc0a2ed0 con 0x7fcccc06da30 2024-05-16T22:27:26.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.979+0000 7fccd3aa8640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fcccc06de40 con 0x7fcccc0bf050 2024-05-16T22:27:26.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.979+0000 7fccd2045640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcccc151fc0 0x7fcccc1e77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:26.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.979+0000 7fccd2045640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcccc151fc0 0x7fcccc1e77d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54288/0 (socket says 172.21.15.44:54288) 2024-05-16T22:27:26.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.979+0000 7fccd2045640 1 -- 172.21.15.44:0/3394762683 learned_addr learned my addr 172.21.15.44:0/3394762683 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:26.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.979+0000 7fccd1844640 1 --2- 172.21.15.44:0/3394762683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcccc06da30 0x7fcccc1d7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:26.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.979+0000 7fccd1043640 1 --2- 172.21.15.44:0/3394762683 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcccc0bf050 0x7fcccc14db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:26.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.980+0000 7fccd2045640 1 -- 172.21.15.44:0/3394762683 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcccc0bf050 msgr2=0x7fcccc14db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:26.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.980+0000 7fccd2045640 1 --2- 172.21.15.44:0/3394762683 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcccc0bf050 0x7fcccc14db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:26.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.980+0000 7fccd2045640 1 -- 172.21.15.44:0/3394762683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcccc06da30 msgr2=0x7fcccc1d7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:26.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.980+0000 7fccd2045640 1 --2- 172.21.15.44:0/3394762683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcccc06da30 0x7fcccc1d7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:26.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.980+0000 7fccd2045640 1 -- 172.21.15.44:0/3394762683 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcccc14e050 con 0x7fcccc151fc0 2024-05-16T22:27:26.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.980+0000 7fccd2045640 1 --2- 172.21.15.44:0/3394762683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcccc151fc0 0x7fcccc1e77d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fccc400efc0 tx=0x7fccc400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:26.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.980+0000 7fccc27fc640 1 -- 172.21.15.44:0/3394762683 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc4018020 con 0x7fcccc151fc0 2024-05-16T22:27:26.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.980+0000 7fccc27fc640 1 -- 172.21.15.44:0/3394762683 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccc4014480 con 0x7fcccc151fc0 2024-05-16T22:27:26.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.980+0000 7fccd3aa8640 1 -- 172.21.15.44:0/3394762683 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcccc14c780 con 0x7fcccc151fc0 2024-05-16T22:27:26.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.980+0000 7fccc27fc640 1 -- 172.21.15.44:0/3394762683 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc4014870 con 0x7fcccc151fc0 2024-05-16T22:27:26.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.980+0000 7fccd3aa8640 1 -- 172.21.15.44:0/3394762683 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcccc14cd40 con 0x7fcccc151fc0 2024-05-16T22:27:26.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.981+0000 7fccd3aa8640 1 -- 172.21.15.44:0/3394762683 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcccc0a5210 con 0x7fcccc151fc0 2024-05-16T22:27:26.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.982+0000 7fccc27fc640 1 -- 172.21.15.44:0/3394762683 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fccc4005d10 con 0x7fcccc151fc0 2024-05-16T22:27:26.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.982+0000 7fccc27fc640 1 --2- 172.21.15.44:0/3394762683 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fccb0076300 0x7fccb0078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:26.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.982+0000 7fccc27fc640 1 -- 172.21.15.44:0/3394762683 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fccc4097f20 con 0x7fcccc151fc0 2024-05-16T22:27:26.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.982+0000 7fccd1844640 1 --2- 172.21.15.44:0/3394762683 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fccb0076300 0x7fccb0078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:26.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.983+0000 7fccd1844640 1 --2- 172.21.15.44:0/3394762683 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fccb0076300 0x7fccb0078810 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fccc8034000 tx=0x7fccc802e000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:26.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:26.987+0000 7fccc27fc640 1 -- 172.21.15.44:0/3394762683 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fccc4022070 con 0x7fcccc151fc0 2024-05-16T22:27:27.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:27.222+0000 7fccd3aa8640 1 -- 172.21.15.44:0/3394762683 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fcccc0c45f0 con 0x7fcccc151fc0 2024-05-16T22:27:28.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.168+0000 7fccc27fc640 1 -- 172.21.15.44:0/3394762683 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) ==== 118+0+0 (secure 0 0 0) 0x7fccc4010040 con 0x7fcccc151fc0 2024-05-16T22:27:28.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.171+0000 7fccd3aa8640 1 -- 172.21.15.44:0/3394762683 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fccb0076300 msgr2=0x7fccb0078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:28.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.171+0000 7fccd3aa8640 1 --2- 172.21.15.44:0/3394762683 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fccb0076300 0x7fccb0078810 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fccc8034000 tx=0x7fccc802e000 comp rx=0 tx=0).stop 2024-05-16T22:27:28.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.171+0000 7fccd3aa8640 1 -- 172.21.15.44:0/3394762683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcccc151fc0 msgr2=0x7fcccc1e77d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:28.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.171+0000 7fccd3aa8640 1 --2- 172.21.15.44:0/3394762683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcccc151fc0 0x7fcccc1e77d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fccc400efc0 tx=0x7fccc400c490 comp rx=0 tx=0).stop 2024-05-16T22:27:28.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.171+0000 7fccd3aa8640 1 -- 172.21.15.44:0/3394762683 shutdown_connections 2024-05-16T22:27:28.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.171+0000 7fccd3aa8640 1 --2- 172.21.15.44:0/3394762683 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fccb0076300 0x7fccb0078810 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:28.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.171+0000 7fccd3aa8640 1 --2- 172.21.15.44:0/3394762683 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcccc0bf050 0x7fcccc14db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:28.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.171+0000 7fccd3aa8640 1 --2- 172.21.15.44:0/3394762683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcccc151fc0 0x7fcccc1e77d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:28.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.171+0000 7fccd3aa8640 1 --2- 172.21.15.44:0/3394762683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcccc06da30 0x7fcccc1d7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:28.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.171+0000 7fccd3aa8640 1 -- 172.21.15.44:0/3394762683 >> 172.21.15.44:0/3394762683 conn(0x7fcccc0c3d20 msgr2=0x7fcccc0c09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:28.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.171+0000 7fccd3aa8640 1 -- 172.21.15.44:0/3394762683 shutdown_connections 2024-05-16T22:27:28.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.171+0000 7fccd3aa8640 1 -- 172.21.15.44:0/3394762683 wait complete. 2024-05-16T22:27:28.184 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-16T22:27:28.184 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-16T22:27:28.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.307+0000 7f07cdaa8640 1 Processor -- start 2024-05-16T22:27:28.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.307+0000 7f07cdaa8640 1 -- start start 2024-05-16T22:27:28.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.309+0000 7f07cdaa8640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f07c80bd6d0 0x7f07c80be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:28.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.309+0000 7f07cdaa8640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07c806e140 con 0x7f07c8151fc0 2024-05-16T22:27:28.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.309+0000 7f07cdaa8640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07c80c36f0 con 0x7f07c80bee80 2024-05-16T22:27:28.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.309+0000 7f07cdaa8640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f07c8152530 con 0x7f07c80bd6d0 2024-05-16T22:27:28.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.309+0000 7f07c77fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f07c8151fc0 0x7f07c806da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49566/0 (socket says 172.21.15.44:49566) 2024-05-16T22:27:28.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.309+0000 7f07c77fe640 1 -- 172.21.15.44:0/1851791156 learned_addr learned my addr 172.21.15.44:0/1851791156 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:27:28.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.309+0000 7f07c6ffd640 1 --2- 172.21.15.44:0/1851791156 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f07c80bd6d0 0x7f07c80be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:28.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.309+0000 7f07c67fc640 1 -- 172.21.15.44:0/1851791156 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3020006077 0 0) 0x7f07b8001110 con 0x7f07c8151fc0 2024-05-16T22:27:28.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.309+0000 7f07c67fc640 1 -- 172.21.15.44:0/1851791156 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07b0003520 con 0x7f07c8151fc0 2024-05-16T22:27:28.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.309+0000 7f07c67fc640 1 -- 172.21.15.44:0/1851791156 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1222508099 0 0) 0x7f07c80c36f0 con 0x7f07c80bee80 2024-05-16T22:27:28.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.309+0000 7f07c67fc640 1 -- 172.21.15.44:0/1851791156 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07b8001110 con 0x7f07c80bee80 2024-05-16T22:27:28.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.309+0000 7f07c67fc640 1 -- 172.21.15.44:0/1851791156 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 461778362 0 0) 0x7f07b0003520 con 0x7f07c8151fc0 2024-05-16T22:27:28.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.309+0000 7f07c67fc640 1 -- 172.21.15.44:0/1851791156 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f07c80bd6d0 msgr2=0x7f07c80be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:28.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.309+0000 7f07c67fc640 1 --2- 172.21.15.44:0/1851791156 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f07c80bd6d0 0x7f07c80be940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:28.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.309+0000 7f07c67fc640 1 -- 172.21.15.44:0/1851791156 >> v1:172.21.15.70:6789/0 conn(0x7f07c80bee80 legacy=0x7f07c8158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:28.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.309+0000 7f07c67fc640 1 -- 172.21.15.44:0/1851791156 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07c8152810 con 0x7f07c8151fc0 2024-05-16T22:27:28.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.309+0000 7f07c67fc640 1 -- 172.21.15.44:0/1851791156 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 568431863 0 0) 0x7f07b80018c0 con 0x7f07c8151fc0 2024-05-16T22:27:28.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.309+0000 7f07c67fc640 1 -- 172.21.15.44:0/1851791156 >> v1:172.21.15.44:6789/0 conn(0x7f07c8151fc0 legacy=0x7f07c806da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:28.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.309+0000 7f07c67fc640 1 --2- 172.21.15.44:0/1851791156 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07b0003c10 0x7f07b0004060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:28.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.309+0000 7f07c67fc640 1 --2- 172.21.15.44:0/1851791156 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f07c80bd6d0 0x7f07b0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:28.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.309+0000 7f07c67fc640 1 --2- 172.21.15.44:0/1851791156 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07b0004d90 0x7f07b0005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:28.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.309+0000 7f07c67fc640 1 -- 172.21.15.44:0/1851791156 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f07c8152530 con 0x7f07b0004d90 2024-05-16T22:27:28.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.309+0000 7f07c67fc640 1 -- 172.21.15.44:0/1851791156 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f07b000bc00 con 0x7f07b0003c10 2024-05-16T22:27:28.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.309+0000 7f07c67fc640 1 -- 172.21.15.44:0/1851791156 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f07b000be00 con 0x7f07c80bd6d0 2024-05-16T22:27:28.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.310+0000 7f07c77fe640 1 --2- 172.21.15.44:0/1851791156 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07b0003c10 0x7f07b0004060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:28.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.310+0000 7f07c7fff640 1 --2- 172.21.15.44:0/1851791156 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07b0004d90 0x7f07b0005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:28.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.310+0000 7f07c6ffd640 1 --2- 172.21.15.44:0/1851791156 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f07c80bd6d0 0x7f07b0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:28.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.310+0000 7f07c7fff640 1 -- 172.21.15.44:0/1851791156 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f07c80bd6d0 msgr2=0x7f07b0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:28.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.310+0000 7f07c7fff640 1 --2- 172.21.15.44:0/1851791156 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f07c80bd6d0 0x7f07b0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:28.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.310+0000 7f07c7fff640 1 -- 172.21.15.44:0/1851791156 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07b0003c10 msgr2=0x7f07b0004060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:28.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.310+0000 7f07c7fff640 1 --2- 172.21.15.44:0/1851791156 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07b0003c10 0x7f07b0004060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:28.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.310+0000 7f07c7fff640 1 -- 172.21.15.44:0/1851791156 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07b0003520 con 0x7f07b0004d90 2024-05-16T22:27:28.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.311+0000 7f07c7fff640 1 --2- 172.21.15.44:0/1851791156 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07b0004d90 0x7f07b0005220 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f07c0001fd0 tx=0x7f07b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=694f20856e856b5b server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:28.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.311+0000 7f07c67fc640 1 -- 172.21.15.44:0/1851791156 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c0001c20 con 0x7f07b0004d90 2024-05-16T22:27:28.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.311+0000 7f07c67fc640 1 -- 172.21.15.44:0/1851791156 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07c0006d70 con 0x7f07b0004d90 2024-05-16T22:27:28.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.311+0000 7f07c67fc640 1 -- 172.21.15.44:0/1851791156 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c0003bb0 con 0x7f07b0004d90 2024-05-16T22:27:28.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.311+0000 7f07cdaa8640 1 -- 172.21.15.44:0/1851791156 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07b0004d90 msgr2=0x7f07b0005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:28.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.311+0000 7f07cdaa8640 1 --2- 172.21.15.44:0/1851791156 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07b0004d90 0x7f07b0005220 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f07c0001fd0 tx=0x7f07b0005830 comp rx=0 tx=0).stop 2024-05-16T22:27:28.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.311+0000 7f07c7fff640 1 -- 172.21.15.44:0/1851791156 reap_dead start 2024-05-16T22:27:28.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.311+0000 7f07cdaa8640 1 -- 172.21.15.44:0/1851791156 shutdown_connections 2024-05-16T22:27:28.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.311+0000 7f07cdaa8640 1 -- 172.21.15.44:0/1851791156 >> 172.21.15.44:0/1851791156 conn(0x7f07c80c3d20 msgr2=0x7f07c80c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:28.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.311+0000 7f07cdaa8640 1 -- 172.21.15.44:0/1851791156 shutdown_connections 2024-05-16T22:27:28.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.311+0000 7f07cdaa8640 1 -- 172.21.15.44:0/1851791156 wait complete. 2024-05-16T22:27:28.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.313+0000 7f07cdaa8640 1 Processor -- start 2024-05-16T22:27:28.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.313+0000 7f07cdaa8640 1 -- start start 2024-05-16T22:27:28.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.314+0000 7f07cdaa8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07b0004d90 0x7f07c80b8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:28.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.314+0000 7f07cdaa8640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f07c80b8250 0x7f07c81da200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:28.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.314+0000 7f07cdaa8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07c814a950 0x7f07c814ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:28.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.314+0000 7f07cdaa8640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f07c80bdae0 con 0x7f07b0004d90 2024-05-16T22:27:28.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.314+0000 7f07cdaa8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f07c80c0070 con 0x7f07c814a950 2024-05-16T22:27:28.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.314+0000 7f07cdaa8640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f07c80a2ed0 con 0x7f07c80b8250 2024-05-16T22:27:28.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.314+0000 7f07c77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07b0004d90 0x7f07c80b8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:28.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.314+0000 7f07c77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07b0004d90 0x7f07c80b8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54296/0 (socket says 172.21.15.44:54296) 2024-05-16T22:27:28.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.314+0000 7f07c77fe640 1 -- 172.21.15.44:0/3293512149 learned_addr learned my addr 172.21.15.44:0/3293512149 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:28.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.315+0000 7f07c7fff640 1 --2- 172.21.15.44:0/3293512149 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07c814a950 0x7f07c814ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:28.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.315+0000 7f07c6ffd640 1 --2- 172.21.15.44:0/3293512149 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f07c80b8250 0x7f07c81da200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:28.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.315+0000 7f07c77fe640 1 -- 172.21.15.44:0/3293512149 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f07c80b8250 msgr2=0x7f07c81da200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:28.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.315+0000 7f07c77fe640 1 --2- 172.21.15.44:0/3293512149 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f07c80b8250 0x7f07c81da200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:28.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.315+0000 7f07c77fe640 1 -- 172.21.15.44:0/3293512149 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07c814a950 msgr2=0x7f07c814ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:28.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.315+0000 7f07c77fe640 1 --2- 172.21.15.44:0/3293512149 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07c814a950 0x7f07c814ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:28.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.315+0000 7f07c77fe640 1 -- 172.21.15.44:0/3293512149 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07c81e42b0 con 0x7f07b0004d90 2024-05-16T22:27:28.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.315+0000 7f07c77fe640 1 --2- 172.21.15.44:0/3293512149 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07b0004d90 0x7f07c80b8d40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f07b8007310 tx=0x7f07b80077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:28.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.315+0000 7f07affff640 1 -- 172.21.15.44:0/3293512149 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b800fa80 con 0x7f07b0004d90 2024-05-16T22:27:28.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.315+0000 7f07affff640 1 -- 172.21.15.44:0/3293512149 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07b8018070 con 0x7f07b0004d90 2024-05-16T22:27:28.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.315+0000 7f07affff640 1 -- 172.21.15.44:0/3293512149 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b800fea0 con 0x7f07b0004d90 2024-05-16T22:27:28.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.315+0000 7f07cdaa8640 1 -- 172.21.15.44:0/3293512149 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07c81da740 con 0x7f07b0004d90 2024-05-16T22:27:28.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.315+0000 7f07cdaa8640 1 -- 172.21.15.44:0/3293512149 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07c80b9f20 con 0x7f07b0004d90 2024-05-16T22:27:28.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.316+0000 7f07cdaa8640 1 -- 172.21.15.44:0/3293512149 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07c8050940 con 0x7f07b0004d90 2024-05-16T22:27:28.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.317+0000 7f07affff640 1 -- 172.21.15.44:0/3293512149 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f07b801d460 con 0x7f07b0004d90 2024-05-16T22:27:28.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.317+0000 7f07affff640 1 --2- 172.21.15.44:0/3293512149 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f07b40762d0 0x7f07b40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:28.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.317+0000 7f07affff640 1 -- 172.21.15.44:0/3293512149 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f07b80977a0 con 0x7f07b0004d90 2024-05-16T22:27:28.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.317+0000 7f07c6ffd640 1 --2- 172.21.15.44:0/3293512149 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f07b40762d0 0x7f07b40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:28.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.318+0000 7f07c6ffd640 1 --2- 172.21.15.44:0/3293512149 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f07b40762d0 0x7f07b40787e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f07c80bbac0 tx=0x7f07bc008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:28.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.322+0000 7f07affff640 1 -- 172.21.15.44:0/3293512149 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f07c806e140 con 0x7f07b0004d90 2024-05-16T22:27:28.363 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:27:28.366 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:27:28.369 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:27:28.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:28.553+0000 7f07cdaa8640 1 -- 172.21.15.44:0/3293512149 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f07c806eb40 con 0x7f07b0004d90 2024-05-16T22:27:29.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.173+0000 7f07affff640 1 -- 172.21.15.44:0/3293512149 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) ==== 122+0+0 (secure 0 0 0) 0x7f07b80610f0 con 0x7f07b0004d90 2024-05-16T22:27:29.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.175+0000 7f07cdaa8640 1 -- 172.21.15.44:0/3293512149 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f07b40762d0 msgr2=0x7f07b40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:29.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.175+0000 7f07cdaa8640 1 --2- 172.21.15.44:0/3293512149 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f07b40762d0 0x7f07b40787e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f07c80bbac0 tx=0x7f07bc008040 comp rx=0 tx=0).stop 2024-05-16T22:27:29.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.175+0000 7f07cdaa8640 1 -- 172.21.15.44:0/3293512149 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07b0004d90 msgr2=0x7f07c80b8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:29.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.175+0000 7f07cdaa8640 1 --2- 172.21.15.44:0/3293512149 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07b0004d90 0x7f07c80b8d40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f07b8007310 tx=0x7f07b80077d0 comp rx=0 tx=0).stop 2024-05-16T22:27:29.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.175+0000 7f07cdaa8640 1 -- 172.21.15.44:0/3293512149 shutdown_connections 2024-05-16T22:27:29.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.175+0000 7f07cdaa8640 1 --2- 172.21.15.44:0/3293512149 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f07b40762d0 0x7f07b40787e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:29.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.175+0000 7f07cdaa8640 1 --2- 172.21.15.44:0/3293512149 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f07c80b8250 0x7f07c81da200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:29.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.175+0000 7f07cdaa8640 1 --2- 172.21.15.44:0/3293512149 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07c814a950 0x7f07c814ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:29.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.175+0000 7f07cdaa8640 1 --2- 172.21.15.44:0/3293512149 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07b0004d90 0x7f07c80b8d40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:29.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.175+0000 7f07cdaa8640 1 -- 172.21.15.44:0/3293512149 >> 172.21.15.44:0/3293512149 conn(0x7f07c80c3d20 msgr2=0x7f07c80c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:29.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.176+0000 7f07cdaa8640 1 -- 172.21.15.44:0/3293512149 shutdown_connections 2024-05-16T22:27:29.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.176+0000 7f07cdaa8640 1 -- 172.21.15.44:0/3293512149 wait complete. 2024-05-16T22:27:29.189 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-16T22:27:29.189 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T22:27:29.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.308+0000 7f0c98e13640 1 Processor -- start 2024-05-16T22:27:29.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.308+0000 7f0c98e13640 1 -- start start 2024-05-16T22:27:29.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.310+0000 7f0c98e13640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0c9414e440 0x7f0c940b99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:29.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.310+0000 7f0c98e13640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c940ba950 con 0x7f0c940b8a20 2024-05-16T22:27:29.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.310+0000 7f0c98e13640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c9414e9b0 con 0x7f0c940bd770 2024-05-16T22:27:29.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.310+0000 7f0c98e13640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f0c9414ec90 con 0x7f0c9414e440 2024-05-16T22:27:29.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.310+0000 7f0c9259c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0c9414e440 0x7f0c940b99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:29.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.310+0000 7f0c92d9d640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f0c940b8a20 0x7f0c940b8e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49582/0 (socket says 172.21.15.44:49582) 2024-05-16T22:27:29.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.310+0000 7f0c92d9d640 1 -- 172.21.15.44:0/3273155566 learned_addr learned my addr 172.21.15.44:0/3273155566 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:27:29.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.310+0000 7f0c9259c640 1 -- 172.21.15.44:0/3273155566 >> v1:172.21.15.70:6789/0 conn(0x7f0c940bd770 legacy=0x7f0c940ba240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:29.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.310+0000 7f0c9259c640 1 -- 172.21.15.44:0/3273155566 >> v1:172.21.15.44:6789/0 conn(0x7f0c940b8a20 legacy=0x7f0c940b8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:29.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.310+0000 7f0c9259c640 1 -- 172.21.15.44:0/3273155566 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c9414ef70 con 0x7f0c9414e440 2024-05-16T22:27:29.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.311+0000 7f0c9259c640 1 --2- 172.21.15.44:0/3273155566 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c9414e440 0x7f0c940b99c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c0097a0 tx=0x7f0c8c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24ff1fdc3f0d72d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:29.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.311+0000 7f0c9159a640 1 -- 172.21.15.44:0/3273155566 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c037070 con 0x7f0c9414e440 2024-05-16T22:27:29.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.311+0000 7f0c9159a640 1 -- 172.21.15.44:0/3273155566 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c8c032440 con 0x7f0c9414e440 2024-05-16T22:27:29.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.311+0000 7f0c9159a640 1 -- 172.21.15.44:0/3273155566 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c032810 con 0x7f0c9414e440 2024-05-16T22:27:29.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.312+0000 7f0c98e13640 1 -- 172.21.15.44:0/3273155566 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c9414e440 msgr2=0x7f0c940b99c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:29.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.312+0000 7f0c98e13640 1 --2- 172.21.15.44:0/3273155566 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c9414e440 0x7f0c940b99c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c0097a0 tx=0x7f0c8c02a180 comp rx=0 tx=0).stop 2024-05-16T22:27:29.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.312+0000 7f0c98e13640 1 -- 172.21.15.44:0/3273155566 shutdown_connections 2024-05-16T22:27:29.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.312+0000 7f0c98e13640 1 --2- 172.21.15.44:0/3273155566 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c9414e440 0x7f0c940b99c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:29.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.312+0000 7f0c98e13640 1 -- 172.21.15.44:0/3273155566 >> 172.21.15.44:0/3273155566 conn(0x7f0c940c0390 msgr2=0x7f0c940c07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:29.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.312+0000 7f0c98e13640 1 -- 172.21.15.44:0/3273155566 shutdown_connections 2024-05-16T22:27:29.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.312+0000 7f0c98e13640 1 -- 172.21.15.44:0/3273155566 wait complete. 2024-05-16T22:27:29.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.314+0000 7f0c98e13640 1 Processor -- start 2024-05-16T22:27:29.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.314+0000 7f0c98e13640 1 -- start start 2024-05-16T22:27:29.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.315+0000 7f0c98e13640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c940b8a20 0x7f0c940c1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:29.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.315+0000 7f0c98e13640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c940bd770 0x7f0c9414a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:29.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.315+0000 7f0c98e13640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0c9414e440 0x7f0c94146c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:29.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.315+0000 7f0c98e13640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0c940bdb80 con 0x7f0c940b8a20 2024-05-16T22:27:29.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.315+0000 7f0c98e13640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0c9408d720 con 0x7f0c940bd770 2024-05-16T22:27:29.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.315+0000 7f0c98e13640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f0c940bdd00 con 0x7f0c9414e440 2024-05-16T22:27:29.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.315+0000 7f0c9259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c940b8a20 0x7f0c940c1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:29.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.315+0000 7f0c9259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c940b8a20 0x7f0c940c1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54300/0 (socket says 172.21.15.44:54300) 2024-05-16T22:27:29.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.315+0000 7f0c9259c640 1 -- 172.21.15.44:0/41822366 learned_addr learned my addr 172.21.15.44:0/41822366 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:29.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.315+0000 7f0c91d9b640 1 --2- 172.21.15.44:0/41822366 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c940bd770 0x7f0c9414a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:29.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.315+0000 7f0c92d9d640 1 --2- 172.21.15.44:0/41822366 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0c9414e440 0x7f0c94146c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:29.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.315+0000 7f0c9259c640 1 -- 172.21.15.44:0/41822366 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0c9414e440 msgr2=0x7f0c94146c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:29.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.315+0000 7f0c9259c640 1 --2- 172.21.15.44:0/41822366 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0c9414e440 0x7f0c94146c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:29.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.315+0000 7f0c9259c640 1 -- 172.21.15.44:0/41822366 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c940bd770 msgr2=0x7f0c9414a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:29.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.315+0000 7f0c9259c640 1 --2- 172.21.15.44:0/41822366 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c940bd770 0x7f0c9414a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:29.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.315+0000 7f0c9259c640 1 -- 172.21.15.44:0/41822366 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c9414b580 con 0x7f0c940b8a20 2024-05-16T22:27:29.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.315+0000 7f0c92d9d640 1 --2- 172.21.15.44:0/41822366 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0c9414e440 0x7f0c94146c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:27:29.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.315+0000 7f0c9259c640 1 --2- 172.21.15.44:0/41822366 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c940b8a20 0x7f0c940c1e80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c000c00 tx=0x7f0c8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:29.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.315+0000 7f0c82ffd640 1 -- 172.21.15.44:0/41822366 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c037040 con 0x7f0c940b8a20 2024-05-16T22:27:29.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.315+0000 7f0c82ffd640 1 -- 172.21.15.44:0/41822366 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c8c042070 con 0x7f0c940b8a20 2024-05-16T22:27:29.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.316+0000 7f0c98e13640 1 -- 172.21.15.44:0/41822366 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c940c23c0 con 0x7f0c940b8a20 2024-05-16T22:27:29.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.316+0000 7f0c82ffd640 1 -- 172.21.15.44:0/41822366 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c030a70 con 0x7f0c940b8a20 2024-05-16T22:27:29.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.316+0000 7f0c98e13640 1 -- 172.21.15.44:0/41822366 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c940c2be0 con 0x7f0c940b8a20 2024-05-16T22:27:29.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.316+0000 7f0c98e13640 1 -- 172.21.15.44:0/41822366 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c94050940 con 0x7f0c940b8a20 2024-05-16T22:27:29.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.317+0000 7f0c82ffd640 1 -- 172.21.15.44:0/41822366 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0c8c030c10 con 0x7f0c940b8a20 2024-05-16T22:27:29.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.318+0000 7f0c82ffd640 1 --2- 172.21.15.44:0/41822366 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0c740762d0 0x7f0c740787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:29.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.318+0000 7f0c82ffd640 1 -- 172.21.15.44:0/41822366 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0c8c0b8090 con 0x7f0c940b8a20 2024-05-16T22:27:29.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.318+0000 7f0c91d9b640 1 --2- 172.21.15.44:0/41822366 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0c740762d0 0x7f0c740787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:29.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.318+0000 7f0c91d9b640 1 --2- 172.21.15.44:0/41822366 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0c740762d0 0x7f0c740787e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0c9414d2c0 tx=0x7f0c88009060 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:29.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.322+0000 7f0c82ffd640 1 -- 172.21.15.44:0/41822366 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0c8c081960 con 0x7f0c940b8a20 2024-05-16T22:27:29.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.550+0000 7f0c98e13640 1 -- 172.21.15.44:0/41822366 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0c9414b7f0 con 0x7f0c940b8a20 2024-05-16T22:27:29.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.550+0000 7f0c82ffd640 1 -- 172.21.15.44:0/41822366 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+4351 (secure 0 0 0) 0x7f0c8c081260 con 0x7f0c940b8a20 2024-05-16T22:27:29.550 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:27:29.550 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2940970977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2940970977},{"type":"v1","addr":"172.21.15.44:6833","nonce":2940970977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1653435882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1653435882},{"type":"v1","addr":"172.21.15.70:6835","nonce":1653435882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T22:27:25.548066+0000","modified":"2024-05-16T22:27:28.554539+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/3060763624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3060763624},{"type":"v1","addr":"172.21.15.44:6835","nonce":3060763624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-05-16T22:27:29.551 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 7 2024-05-16T22:27:29.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.552+0000 7f0c98e13640 1 -- 172.21.15.44:0/41822366 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0c740762d0 msgr2=0x7f0c740787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:29.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.552+0000 7f0c98e13640 1 --2- 172.21.15.44:0/41822366 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0c740762d0 0x7f0c740787e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0c9414d2c0 tx=0x7f0c88009060 comp rx=0 tx=0).stop 2024-05-16T22:27:29.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.552+0000 7f0c98e13640 1 -- 172.21.15.44:0/41822366 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c940b8a20 msgr2=0x7f0c940c1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:29.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.552+0000 7f0c98e13640 1 --2- 172.21.15.44:0/41822366 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c940b8a20 0x7f0c940c1e80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c000c00 tx=0x7f0c8c0046c0 comp rx=0 tx=0).stop 2024-05-16T22:27:29.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.552+0000 7f0c98e13640 1 -- 172.21.15.44:0/41822366 shutdown_connections 2024-05-16T22:27:29.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.552+0000 7f0c98e13640 1 --2- 172.21.15.44:0/41822366 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0c740762d0 0x7f0c740787e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:29.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.552+0000 7f0c98e13640 1 --2- 172.21.15.44:0/41822366 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0c9414e440 0x7f0c94146c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:29.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.552+0000 7f0c98e13640 1 --2- 172.21.15.44:0/41822366 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c940bd770 0x7f0c9414a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:29.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.552+0000 7f0c98e13640 1 --2- 172.21.15.44:0/41822366 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c940b8a20 0x7f0c940c1e80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:29.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.552+0000 7f0c98e13640 1 -- 172.21.15.44:0/41822366 >> 172.21.15.44:0/41822366 conn(0x7f0c940c0390 msgr2=0x7f0c940b8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:29.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.552+0000 7f0c98e13640 1 -- 172.21.15.44:0/41822366 shutdown_connections 2024-05-16T22:27:29.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.552+0000 7f0c98e13640 1 -- 172.21.15.44:0/41822366 wait complete. 2024-05-16T22:27:29.563 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-16T22:27:29.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.675+0000 7f4f142f2640 1 Processor -- start 2024-05-16T22:27:29.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.675+0000 7f4f142f2640 1 -- start start 2024-05-16T22:27:29.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.677+0000 7f4f142f2640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4f0c14e530 0x7f4f0c0ba320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:29.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.677+0000 7f4f142f2640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4f0c0b8d70 0x7f4f0c0b9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:29.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.677+0000 7f4f142f2640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f0c0ba860 con 0x7f4f0c0bd440 2024-05-16T22:27:29.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.677+0000 7f4f142f2640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f4f0c0b88e0 con 0x7f4f0c0b8d70 2024-05-16T22:27:29.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.677+0000 7f4f142f2640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f4f0c14ece0 con 0x7f4f0c14e530 2024-05-16T22:27:29.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.677+0000 7f4f1188d640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f4f0c0bd440 0x7f4f0c0bd850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49596/0 (socket says 172.21.15.44:49596) 2024-05-16T22:27:29.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.677+0000 7f4f1188d640 1 -- 172.21.15.44:0/1769723437 learned_addr learned my addr 172.21.15.44:0/1769723437 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:27:29.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.677+0000 7f4f1288f640 1 --2- 172.21.15.44:0/1769723437 >> v2:172.21.15.70:3300/0 conn(0x7f4f0c0b8d70 0x7f4f0c0b9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:29.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.677+0000 7f4f1208e640 1 --2- 172.21.15.44:0/1769723437 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4f0c14e530 0x7f4f0c0ba320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:29.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.677+0000 7f4f1108c640 1 -- 172.21.15.44:0/1769723437 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1995726129 0 0) 0x7f4f0c0ba860 con 0x7f4f0c0bd440 2024-05-16T22:27:29.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.677+0000 7f4f1108c640 1 -- 172.21.15.44:0/1769723437 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ef4003520 con 0x7f4f0c0bd440 2024-05-16T22:27:29.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.677+0000 7f4f1288f640 1 -- 172.21.15.44:0/1769723437 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4f0c14e530 msgr2=0x7f4f0c0ba320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:29.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.677+0000 7f4f1288f640 1 --2- 172.21.15.44:0/1769723437 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4f0c14e530 0x7f4f0c0ba320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:29.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.677+0000 7f4f1288f640 1 -- 172.21.15.44:0/1769723437 >> v1:172.21.15.44:6789/0 conn(0x7f4f0c0bd440 legacy=0x7f4f0c0bd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:29.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.677+0000 7f4f1288f640 1 -- 172.21.15.44:0/1769723437 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f0c14efc0 con 0x7f4f0c0b8d70 2024-05-16T22:27:29.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.678+0000 7f4f1288f640 1 --2- 172.21.15.44:0/1769723437 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f0c0b8d70 0x7f4f0c0b9180 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4efc009d90 tx=0x7f4efc02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ad880a64c6b234a server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:29.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.678+0000 7f4f1108c640 1 -- 172.21.15.44:0/1769723437 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4efc007740 con 0x7f4f0c0b8d70 2024-05-16T22:27:29.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.678+0000 7f4f1108c640 1 -- 172.21.15.44:0/1769723437 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4efc0078e0 con 0x7f4f0c0b8d70 2024-05-16T22:27:29.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.678+0000 7f4f1108c640 1 -- 172.21.15.44:0/1769723437 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4efc007c90 con 0x7f4f0c0b8d70 2024-05-16T22:27:29.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.679+0000 7f4f142f2640 1 -- 172.21.15.44:0/1769723437 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f0c0b8d70 msgr2=0x7f4f0c0b9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:29.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.679+0000 7f4f142f2640 1 --2- 172.21.15.44:0/1769723437 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f0c0b8d70 0x7f4f0c0b9180 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4efc009d90 tx=0x7f4efc02a660 comp rx=0 tx=0).stop 2024-05-16T22:27:29.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.679+0000 7f4f142f2640 1 -- 172.21.15.44:0/1769723437 shutdown_connections 2024-05-16T22:27:29.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.679+0000 7f4f142f2640 1 --2- 172.21.15.44:0/1769723437 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f0c0b8d70 0x7f4f0c0b9180 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:29.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.679+0000 7f4f142f2640 1 --2- 172.21.15.44:0/1769723437 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4f0c14e530 0x7f4f0c0ba320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:29.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.679+0000 7f4f142f2640 1 -- 172.21.15.44:0/1769723437 >> 172.21.15.44:0/1769723437 conn(0x7f4f0c0c0570 msgr2=0x7f4f0c0c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:29.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.679+0000 7f4f142f2640 1 -- 172.21.15.44:0/1769723437 shutdown_connections 2024-05-16T22:27:29.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.679+0000 7f4f142f2640 1 -- 172.21.15.44:0/1769723437 wait complete. 2024-05-16T22:27:29.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.681+0000 7f4f142f2640 1 Processor -- start 2024-05-16T22:27:29.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.681+0000 7f4f142f2640 1 -- start start 2024-05-16T22:27:29.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.682+0000 7f4f142f2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f0c0b8d70 0x7f4f0c14dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:29.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.682+0000 7f4f142f2640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4f0c0bd440 0x7f4f0c1e76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:29.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.682+0000 7f4f142f2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f0c14e530 0x7f4f0c1413a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:29.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.682+0000 7f4f142f2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4f0c0b96c0 con 0x7f4f0c14e530 2024-05-16T22:27:29.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.682+0000 7f4f142f2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4f0c0bbb70 con 0x7f4f0c0b8d70 2024-05-16T22:27:29.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.682+0000 7f4f142f2640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f4f0c14e940 con 0x7f4f0c0bd440 2024-05-16T22:27:29.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.682+0000 7f4f1288f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f0c14e530 0x7f4f0c1413a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:29.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.682+0000 7f4f1288f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f0c14e530 0x7f4f0c1413a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54302/0 (socket says 172.21.15.44:54302) 2024-05-16T22:27:29.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.682+0000 7f4f1288f640 1 -- 172.21.15.44:0/2693875153 learned_addr learned my addr 172.21.15.44:0/2693875153 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:29.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.682+0000 7f4f1188d640 1 --2- 172.21.15.44:0/2693875153 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4f0c0bd440 0x7f4f0c1e76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:29.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.682+0000 7f4f1208e640 1 --2- 172.21.15.44:0/2693875153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f0c0b8d70 0x7f4f0c14dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:29.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.682+0000 7f4f1288f640 1 -- 172.21.15.44:0/2693875153 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4f0c0bd440 msgr2=0x7f4f0c1e76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:29.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.682+0000 7f4f1288f640 1 --2- 172.21.15.44:0/2693875153 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4f0c0bd440 0x7f4f0c1e76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:29.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.682+0000 7f4f1288f640 1 -- 172.21.15.44:0/2693875153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f0c0b8d70 msgr2=0x7f4f0c14dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:29.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.682+0000 7f4f1288f640 1 --2- 172.21.15.44:0/2693875153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f0c0b8d70 0x7f4f0c14dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:29.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.682+0000 7f4f1288f640 1 -- 172.21.15.44:0/2693875153 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f0c14e200 con 0x7f4f0c14e530 2024-05-16T22:27:29.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.682+0000 7f4f1288f640 1 --2- 172.21.15.44:0/2693875153 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f0c14e530 0x7f4f0c1413a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4efc009d90 tx=0x7f4efc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:29.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.683+0000 7f4f0affd640 1 -- 172.21.15.44:0/2693875153 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4efc03f070 con 0x7f4f0c14e530 2024-05-16T22:27:29.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.683+0000 7f4f0affd640 1 -- 172.21.15.44:0/2693875153 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4efc031c40 con 0x7f4f0c14e530 2024-05-16T22:27:29.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.683+0000 7f4f142f2640 1 -- 172.21.15.44:0/2693875153 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f0c140e70 con 0x7f4f0c14e530 2024-05-16T22:27:29.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.683+0000 7f4f0affd640 1 -- 172.21.15.44:0/2693875153 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4efc009450 con 0x7f4f0c14e530 2024-05-16T22:27:29.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.683+0000 7f4f142f2640 1 -- 172.21.15.44:0/2693875153 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f0c14c0c0 con 0x7f4f0c14e530 2024-05-16T22:27:29.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.684+0000 7f4f142f2640 1 -- 172.21.15.44:0/2693875153 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f0c0bfa50 con 0x7f4f0c14e530 2024-05-16T22:27:29.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.684+0000 7f4f0affd640 1 -- 172.21.15.44:0/2693875153 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4efc003990 con 0x7f4f0c14e530 2024-05-16T22:27:29.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.685+0000 7f4f0affd640 1 --2- 172.21.15.44:0/2693875153 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4ef80762d0 0x7f4ef80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:29.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.685+0000 7f4f0affd640 1 -- 172.21.15.44:0/2693875153 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4efc0b8610 con 0x7f4f0c14e530 2024-05-16T22:27:29.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.685+0000 7f4f1208e640 1 --2- 172.21.15.44:0/2693875153 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4ef80762d0 0x7f4ef80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:29.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.686+0000 7f4f1208e640 1 --2- 172.21.15.44:0/2693875153 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4ef80762d0 0x7f4ef80787e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4f04009a90 tx=0x7f4f04009110 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:29.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.690+0000 7f4f0affd640 1 -- 172.21.15.44:0/2693875153 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4f0c140e70 con 0x7f4f0c14e530 2024-05-16T22:27:29.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.879+0000 7f4f142f2640 1 -- 172.21.15.44:0/2693875153 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4f0c050940 con 0x7f4f0c14e530 2024-05-16T22:27:29.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.880+0000 7f4f0affd640 1 -- 172.21.15.44:0/2693875153 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16569 (secure 0 0 0) 0x7f4efc081880 con 0x7f4f0c14e530 2024-05-16T22:27:29.880 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:27:29.880 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":21,"fsid":"572ab7cc-b103-4548-ae8f-c6614d57f0c8","created":"2024-05-16T22:27:02.216874+0000","modified":"2024-05-16T22:27:27.151884+0000","last_up_change":"2024-05-16T22:27:13.693953+0000","last_in_change":"2024-05-16T22:27:04.455119+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-16T22:27:14.562409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-16T22:27:23.458618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-16T22:27:24.495231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a7003e89-c706-4562-9f25-670bb35ae108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6825","nonce":1074109859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6827","nonce":1074109859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6831","nonce":1074109859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6829","nonce":1074109859}]},"public_addr":"172.21.15.44:6825/1074109859","cluster_addr":"172.21.15.44:6827/1074109859","heartbeat_back_addr":"172.21.15.44:6831/1074109859","heartbeat_front_addr":"172.21.15.44:6829/1074109859","state":["exists","up"]},{"osd":1,"uuid":"a4d5169d-8327-4494-9c7c-58db21b00636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6817","nonce":2909429972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6819","nonce":2909429972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6823","nonce":2909429972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6821","nonce":2909429972}]},"public_addr":"172.21.15.44:6817/2909429972","cluster_addr":"172.21.15.44:6819/2909429972","heartbeat_back_addr":"172.21.15.44:6823/2909429972","heartbeat_front_addr":"172.21.15.44:6821/2909429972","state":["exists","up"]},{"osd":2,"uuid":"d4a834f8-83a5-400f-9814-eb0a25124df4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6801","nonce":2908194156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6803","nonce":2908194156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6807","nonce":2908194156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6805","nonce":2908194156}]},"public_addr":"172.21.15.44:6801/2908194156","cluster_addr":"172.21.15.44:6803/2908194156","heartbeat_back_addr":"172.21.15.44:6807/2908194156","heartbeat_front_addr":"172.21.15.44:6805/2908194156","state":["exists","up"]},{"osd":3,"uuid":"b9d24a56-ad43-4674-a395-5ec24d135ae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6809","nonce":2168695793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6811","nonce":2168695793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6815","nonce":2168695793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6813","nonce":2168695793}]},"public_addr":"172.21.15.44:6809/2168695793","cluster_addr":"172.21.15.44:6811/2168695793","heartbeat_back_addr":"172.21.15.44:6815/2168695793","heartbeat_front_addr":"172.21.15.44:6813/2168695793","state":["exists","up"]},{"osd":4,"uuid":"9bd94af5-3e17-4cbe-995a-8f837a66c653","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6823","nonce":1540297751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6825","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6827","nonce":1540297751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6831","nonce":1540297751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6829","nonce":1540297751}]},"public_addr":"172.21.15.70:6823/1540297751","cluster_addr":"172.21.15.70:6827/1540297751","heartbeat_back_addr":"172.21.15.70:6831/1540297751","heartbeat_front_addr":"172.21.15.70:6829/1540297751","state":["exists","up"]},{"osd":5,"uuid":"a5b0cfa5-b259-48bd-98b6-96b44f5ebabd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6804","nonce":4218901987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6808","nonce":4218901987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6815","nonce":4218901987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6812","nonce":4218901987}]},"public_addr":"172.21.15.70:6804/4218901987","cluster_addr":"172.21.15.70:6808/4218901987","heartbeat_back_addr":"172.21.15.70:6815/4218901987","heartbeat_front_addr":"172.21.15.70:6812/4218901987","state":["exists","up"]},{"osd":6,"uuid":"0b6af6df-1358-4fc6-a62c-ba57e02914ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6801","nonce":2389556489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6805","nonce":2389556489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6813","nonce":2389556489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6807","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6809","nonce":2389556489}]},"public_addr":"172.21.15.70:6801/2389556489","cluster_addr":"172.21.15.70:6805/2389556489","heartbeat_back_addr":"172.21.15.70:6813/2389556489","heartbeat_front_addr":"172.21.15.70:6809/2389556489","state":["exists","up"]},{"osd":7,"uuid":"eb1a2c5d-42cf-47d0-9e03-b9d26944a589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6817","nonce":3619691281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6819","nonce":3619691281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6826","nonce":3619691281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6822","nonce":3619691281}]},"public_addr":"172.21.15.70:6817/3619691281","cluster_addr":"172.21.15.70:6819/3619691281","heartbeat_back_addr":"172.21.15.70:6826/3619691281","heartbeat_front_addr":"172.21.15.70:6822/3619691281","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.652256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.613348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.528454+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.625204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.678845+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.680829+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.556200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.647030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T22:27:29.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.882+0000 7f4f142f2640 1 -- 172.21.15.44:0/2693875153 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4ef80762d0 msgr2=0x7f4ef80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:29.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.882+0000 7f4f142f2640 1 --2- 172.21.15.44:0/2693875153 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4ef80762d0 0x7f4ef80787e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4f04009a90 tx=0x7f4f04009110 comp rx=0 tx=0).stop 2024-05-16T22:27:29.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.882+0000 7f4f142f2640 1 -- 172.21.15.44:0/2693875153 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f0c14e530 msgr2=0x7f4f0c1413a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:29.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.882+0000 7f4f142f2640 1 --2- 172.21.15.44:0/2693875153 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f0c14e530 0x7f4f0c1413a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4efc009d90 tx=0x7f4efc004a40 comp rx=0 tx=0).stop 2024-05-16T22:27:29.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.882+0000 7f4f142f2640 1 -- 172.21.15.44:0/2693875153 shutdown_connections 2024-05-16T22:27:29.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.882+0000 7f4f142f2640 1 --2- 172.21.15.44:0/2693875153 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4ef80762d0 0x7f4ef80787e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:29.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.882+0000 7f4f142f2640 1 --2- 172.21.15.44:0/2693875153 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4f0c0bd440 0x7f4f0c1e76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:29.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.882+0000 7f4f142f2640 1 --2- 172.21.15.44:0/2693875153 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f0c14e530 0x7f4f0c1413a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:29.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.882+0000 7f4f142f2640 1 --2- 172.21.15.44:0/2693875153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f0c0b8d70 0x7f4f0c14dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:29.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.882+0000 7f4f142f2640 1 -- 172.21.15.44:0/2693875153 >> 172.21.15.44:0/2693875153 conn(0x7f4f0c0c0570 msgr2=0x7f4f0c0ba320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:29.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.882+0000 7f4f142f2640 1 -- 172.21.15.44:0/2693875153 shutdown_connections 2024-05-16T22:27:29.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:29.882+0000 7f4f142f2640 1 -- 172.21.15.44:0/2693875153 wait complete. 2024-05-16T22:27:29.893 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-16T22:27:29.893 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-16T22:27:30.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.004+0000 7fc93946e640 1 Processor -- start 2024-05-16T22:27:30.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.004+0000 7fc93946e640 1 -- start start 2024-05-16T22:27:30.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.005+0000 7fc93946e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc9340b99c0 0x7fc9340ba240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:30.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.005+0000 7fc93946e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc9340b8a20 0x7fc9340b8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:30.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.005+0000 7fc93946e640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc93414e9b0 con 0x7fc93414e440 2024-05-16T22:27:30.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.005+0000 7fc93946e640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fc93414ec90 con 0x7fc9340b99c0 2024-05-16T22:27:30.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.005+0000 7fc93946e640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fc93414ef70 con 0x7fc9340b8a20 2024-05-16T22:27:30.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.005+0000 7fc9327fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc9340b99c0 0x7fc9340ba240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:30.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.005+0000 7fc9327fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc9340b99c0 0x7fc9340ba240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57776/0 (socket says 172.21.15.44:57776) 2024-05-16T22:27:30.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.005+0000 7fc9327fc640 1 -- 172.21.15.44:0/312478441 learned_addr learned my addr 172.21.15.44:0/312478441 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:30.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.006+0000 7fc9337fe640 1 --2- 172.21.15.44:0/312478441 >> v2:172.21.15.70:3300/0 conn(0x7fc9340b8a20 0x7fc9340b8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:30.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.006+0000 7fc9327fc640 1 -- 172.21.15.44:0/312478441 >> v2:172.21.15.70:3300/0 conn(0x7fc9340b8a20 msgr2=0x7fc9340b8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:30.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.006+0000 7fc9327fc640 1 --2- 172.21.15.44:0/312478441 >> v2:172.21.15.70:3300/0 conn(0x7fc9340b8a20 0x7fc9340b8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:30.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.006+0000 7fc9327fc640 1 -- 172.21.15.44:0/312478441 >> v1:172.21.15.70:6789/0 conn(0x7fc93414e440 legacy=0x7fc9340bd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:30.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.006+0000 7fc9327fc640 1 -- 172.21.15.44:0/312478441 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc93414f250 con 0x7fc9340b99c0 2024-05-16T22:27:30.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.006+0000 7fc9327fc640 1 --2- 172.21.15.44:0/312478441 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9340b99c0 0x7fc9340ba240 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc9340bb470 tx=0x7fc91c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39f6b88f01c34517 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:30.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.007+0000 7fc931ffb640 1 -- 172.21.15.44:0/312478441 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91c037070 con 0x7fc9340b99c0 2024-05-16T22:27:30.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.007+0000 7fc931ffb640 1 -- 172.21.15.44:0/312478441 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc91c032440 con 0x7fc9340b99c0 2024-05-16T22:27:30.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.007+0000 7fc931ffb640 1 -- 172.21.15.44:0/312478441 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91c032810 con 0x7fc9340b99c0 2024-05-16T22:27:30.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.007+0000 7fc93946e640 1 -- 172.21.15.44:0/312478441 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9340b99c0 msgr2=0x7fc9340ba240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:30.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.007+0000 7fc93946e640 1 --2- 172.21.15.44:0/312478441 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9340b99c0 0x7fc9340ba240 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc9340bb470 tx=0x7fc91c02a270 comp rx=0 tx=0).stop 2024-05-16T22:27:30.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.007+0000 7fc93946e640 1 -- 172.21.15.44:0/312478441 shutdown_connections 2024-05-16T22:27:30.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.007+0000 7fc93946e640 1 --2- 172.21.15.44:0/312478441 >> v2:172.21.15.70:3300/0 conn(0x7fc9340b8a20 0x7fc9340b8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:30.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.007+0000 7fc93946e640 1 --2- 172.21.15.44:0/312478441 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9340b99c0 0x7fc9340ba240 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:30.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.007+0000 7fc93946e640 1 -- 172.21.15.44:0/312478441 >> 172.21.15.44:0/312478441 conn(0x7fc9340c0390 msgr2=0x7fc9340c07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:30.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.007+0000 7fc93946e640 1 -- 172.21.15.44:0/312478441 shutdown_connections 2024-05-16T22:27:30.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.007+0000 7fc93946e640 1 -- 172.21.15.44:0/312478441 wait complete. 2024-05-16T22:27:30.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.009+0000 7fc93946e640 1 Processor -- start 2024-05-16T22:27:30.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.009+0000 7fc93946e640 1 -- start start 2024-05-16T22:27:30.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.010+0000 7fc93946e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9340b8a20 0x7fc9340a8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:30.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.010+0000 7fc93946e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9340b99c0 0x7fc9341d7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:30.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.010+0000 7fc93946e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc93414e440 0x7fc9341d5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:30.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.010+0000 7fc93946e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc9340ba780 con 0x7fc9340b99c0 2024-05-16T22:27:30.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.010+0000 7fc93946e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc93408d720 con 0x7fc9340b8a20 2024-05-16T22:27:30.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.010+0000 7fc93946e640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fc9340ba900 con 0x7fc93414e440 2024-05-16T22:27:30.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.010+0000 7fc9327fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9340b99c0 0x7fc9341d7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:30.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.010+0000 7fc9327fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9340b99c0 0x7fc9341d7800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57790/0 (socket says 172.21.15.44:57790) 2024-05-16T22:27:30.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.010+0000 7fc9327fc640 1 -- 172.21.15.44:0/3392156669 learned_addr learned my addr 172.21.15.44:0/3392156669 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:30.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.010+0000 7fc932ffd640 1 --2- 172.21.15.44:0/3392156669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9340b8a20 0x7fc9340a8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:30.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.011+0000 7fc9337fe640 1 --2- 172.21.15.44:0/3392156669 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc93414e440 0x7fc9341d5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:30.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.011+0000 7fc9327fc640 1 -- 172.21.15.44:0/3392156669 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc93414e440 msgr2=0x7fc9341d5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:30.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.011+0000 7fc9327fc640 1 --2- 172.21.15.44:0/3392156669 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc93414e440 0x7fc9341d5690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:30.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.011+0000 7fc9327fc640 1 -- 172.21.15.44:0/3392156669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9340b8a20 msgr2=0x7fc9340a8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:30.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.011+0000 7fc9327fc640 1 --2- 172.21.15.44:0/3392156669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9340b8a20 0x7fc9340a8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:30.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.011+0000 7fc9327fc640 1 -- 172.21.15.44:0/3392156669 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9341d5bd0 con 0x7fc9340b99c0 2024-05-16T22:27:30.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.011+0000 7fc932ffd640 1 --2- 172.21.15.44:0/3392156669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9340b8a20 0x7fc9340a8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T22:27:30.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.011+0000 7fc9327fc640 1 --2- 172.21.15.44:0/3392156669 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9340b99c0 0x7fc9341d7800 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc91c02a2b0 tx=0x7fc91c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:30.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.011+0000 7fc92b7fe640 1 -- 172.21.15.44:0/3392156669 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91c041020 con 0x7fc9340b99c0 2024-05-16T22:27:30.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.011+0000 7fc92b7fe640 1 -- 172.21.15.44:0/3392156669 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc91c0306c0 con 0x7fc9340b99c0 2024-05-16T22:27:30.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.011+0000 7fc93946e640 1 -- 172.21.15.44:0/3392156669 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9341d70e0 con 0x7fc9340b99c0 2024-05-16T22:27:30.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.011+0000 7fc92b7fe640 1 -- 172.21.15.44:0/3392156669 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91c037040 con 0x7fc9340b99c0 2024-05-16T22:27:30.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.011+0000 7fc93946e640 1 -- 172.21.15.44:0/3392156669 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9341d6e00 con 0x7fc9340b99c0 2024-05-16T22:27:30.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.012+0000 7fc93946e640 1 -- 172.21.15.44:0/3392156669 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc934050940 con 0x7fc9340b99c0 2024-05-16T22:27:30.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.013+0000 7fc92b7fe640 1 -- 172.21.15.44:0/3392156669 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc91c044020 con 0x7fc9340b99c0 2024-05-16T22:27:30.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.013+0000 7fc92b7fe640 1 --2- 172.21.15.44:0/3392156669 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fc9140762d0 0x7fc9140787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:30.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.013+0000 7fc92b7fe640 1 -- 172.21.15.44:0/3392156669 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc91c0b7ec0 con 0x7fc9340b99c0 2024-05-16T22:27:30.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.014+0000 7fc932ffd640 1 --2- 172.21.15.44:0/3392156669 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fc9140762d0 0x7fc9140787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:30.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.014+0000 7fc932ffd640 1 --2- 172.21.15.44:0/3392156669 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fc9140762d0 0x7fc9140787e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc9340a9720 tx=0x7fc92c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:30.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.018+0000 7fc92b7fe640 1 -- 172.21.15.44:0/3392156669 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc91c04b030 con 0x7fc9340b99c0 2024-05-16T22:27:30.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.206+0000 7fc93946e640 1 -- 172.21.15.44:0/3392156669 --> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc93414be90 con 0x7fc9140762d0 2024-05-16T22:27:30.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.213+0000 7fc92b7fe640 1 -- 172.21.15.44:0/3392156669 <== mgr.4114 v2:172.21.15.70:6832/4049588098 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237499 (secure 0 0 0) 0x7fc92c001c50 con 0x7fc9140762d0 2024-05-16T22:27:30.215 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:27:30.216 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-05-16T22:27:30.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.216+0000 7fc93946e640 1 -- 172.21.15.44:0/3392156669 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fc9140762d0 msgr2=0x7fc9140787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:30.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.216+0000 7fc93946e640 1 --2- 172.21.15.44:0/3392156669 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fc9140762d0 0x7fc9140787e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc9340a9720 tx=0x7fc92c009040 comp rx=0 tx=0).stop 2024-05-16T22:27:30.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.216+0000 7fc93946e640 1 -- 172.21.15.44:0/3392156669 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9340b99c0 msgr2=0x7fc9341d7800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:30.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.216+0000 7fc93946e640 1 --2- 172.21.15.44:0/3392156669 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9340b99c0 0x7fc9341d7800 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc91c02a2b0 tx=0x7fc91c0046c0 comp rx=0 tx=0).stop 2024-05-16T22:27:30.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.216+0000 7fc93946e640 1 -- 172.21.15.44:0/3392156669 shutdown_connections 2024-05-16T22:27:30.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.216+0000 7fc93946e640 1 --2- 172.21.15.44:0/3392156669 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fc9140762d0 0x7fc9140787e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:30.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.216+0000 7fc93946e640 1 --2- 172.21.15.44:0/3392156669 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc93414e440 0x7fc9341d5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:30.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.216+0000 7fc93946e640 1 --2- 172.21.15.44:0/3392156669 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9340b99c0 0x7fc9341d7800 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:30.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.216+0000 7fc93946e640 1 --2- 172.21.15.44:0/3392156669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9340b8a20 0x7fc9340a8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:30.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.216+0000 7fc93946e640 1 -- 172.21.15.44:0/3392156669 >> 172.21.15.44:0/3392156669 conn(0x7fc9340c0390 msgr2=0x7fc9340c07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:30.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.216+0000 7fc93946e640 1 -- 172.21.15.44:0/3392156669 shutdown_connections 2024-05-16T22:27:30.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.216+0000 7fc93946e640 1 -- 172.21.15.44:0/3392156669 wait complete. 2024-05-16T22:27:30.227 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-05-16T22:27:28.545244+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":14,"acting":14,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":227432,"kb_used_data":2472,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754747288,"statfs":{"total":773094113280,"available":772861222912,"internally_reserved":0,"allocated":2531328,"data_stored":1582000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":229756465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.400164"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:24.138961+0000","last_change":"2024-05-16T22:27:24.138961+0000","last_active":"2024-05-16T22:27:24.138961+0000","last_peered":"2024-05-16T22:27:24.138961+0000","last_clean":"2024-05-16T22:27:24.138961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:24.138961+0000","last_undegraded":"2024-05-16T22:27:24.138961+0000","last_fullsized":"2024-05-16T22:27:24.138961+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:24.138961+0000","last_change":"2024-05-16T22:27:24.138961+0000","last_active":"2024-05-16T22:27:24.138961+0000","last_peered":"2024-05-16T22:27:24.138961+0000","last_clean":"2024-05-16T22:27:24.138961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:24.138961+0000","last_undegraded":"2024-05-16T22:27:24.138961+0000","last_fullsized":"2024-05-16T22:27:24.138961+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:24.138961+0000","last_change":"2024-05-16T22:27:24.138961+0000","last_active":"2024-05-16T22:27:24.138961+0000","last_peered":"2024-05-16T22:27:24.138961+0000","last_clean":"2024-05-16T22:27:24.138961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:24.138961+0000","last_undegraded":"2024-05-16T22:27:24.138961+0000","last_fullsized":"2024-05-16T22:27:24.138961+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:24.138961+0000","last_change":"2024-05-16T22:27:24.138961+0000","last_active":"2024-05-16T22:27:24.138961+0000","last_peered":"2024-05-16T22:27:24.138961+0000","last_clean":"2024-05-16T22:27:24.138961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:24.138961+0000","last_undegraded":"2024-05-16T22:27:24.138961+0000","last_fullsized":"2024-05-16T22:27:24.138961+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:24.138961+0000","last_change":"2024-05-16T22:27:24.138961+0000","last_active":"2024-05-16T22:27:24.138961+0000","last_peered":"2024-05-16T22:27:24.138961+0000","last_clean":"2024-05-16T22:27:24.138961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:24.138961+0000","last_undegraded":"2024-05-16T22:27:24.138961+0000","last_fullsized":"2024-05-16T22:27:24.138961+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:24.138961+0000","last_change":"2024-05-16T22:27:24.138961+0000","last_active":"2024-05-16T22:27:24.138961+0000","last_peered":"2024-05-16T22:27:24.138961+0000","last_clean":"2024-05-16T22:27:24.138961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:24.138961+0000","last_undegraded":"2024-05-16T22:27:24.138961+0000","last_fullsized":"2024-05-16T22:27:24.138961+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:24.138961+0000","last_change":"2024-05-16T22:27:24.138961+0000","last_active":"2024-05-16T22:27:24.138961+0000","last_peered":"2024-05-16T22:27:24.138961+0000","last_clean":"2024-05-16T22:27:24.138961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:24.138961+0000","last_undegraded":"2024-05-16T22:27:24.138961+0000","last_fullsized":"2024-05-16T22:27:24.138961+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:24.138961+0000","last_change":"2024-05-16T22:27:24.138961+0000","last_active":"2024-05-16T22:27:24.138961+0000","last_peered":"2024-05-16T22:27:24.138961+0000","last_clean":"2024-05-16T22:27:24.138961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:24.138961+0000","last_undegraded":"2024-05-16T22:27:24.138961+0000","last_fullsized":"2024-05-16T22:27:24.138961+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:24.138961+0000","last_change":"2024-05-16T22:27:24.138961+0000","last_active":"2024-05-16T22:27:24.138961+0000","last_peered":"2024-05-16T22:27:24.138961+0000","last_clean":"2024-05-16T22:27:24.138961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:24.138961+0000","last_undegraded":"2024-05-16T22:27:24.138961+0000","last_fullsized":"2024-05-16T22:27:24.138961+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:24.138961+0000","last_change":"2024-05-16T22:27:24.138961+0000","last_active":"2024-05-16T22:27:24.138961+0000","last_peered":"2024-05-16T22:27:24.138961+0000","last_clean":"2024-05-16T22:27:24.138961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:24.138961+0000","last_undegraded":"2024-05-16T22:27:24.138961+0000","last_fullsized":"2024-05-16T22:27:24.138961+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:24.138961+0000","last_change":"2024-05-16T22:27:24.138961+0000","last_active":"2024-05-16T22:27:24.138961+0000","last_peered":"2024-05-16T22:27:24.138961+0000","last_clean":"2024-05-16T22:27:24.138961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:24.138961+0000","last_undegraded":"2024-05-16T22:27:24.138961+0000","last_fullsized":"2024-05-16T22:27:24.138961+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:24.138961+0000","last_change":"2024-05-16T22:27:24.138961+0000","last_active":"2024-05-16T22:27:24.138961+0000","last_peered":"2024-05-16T22:27:24.138961+0000","last_clean":"2024-05-16T22:27:24.138961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:24.138961+0000","last_undegraded":"2024-05-16T22:27:24.138961+0000","last_fullsized":"2024-05-16T22:27:24.138961+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:24.138961+0000","last_change":"2024-05-16T22:27:24.138961+0000","last_active":"2024-05-16T22:27:24.138961+0000","last_peered":"2024-05-16T22:27:24.138961+0000","last_clean":"2024-05-16T22:27:24.138961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:24.138961+0000","last_undegraded":"2024-05-16T22:27:24.138961+0000","last_fullsized":"2024-05-16T22:27:24.138961+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:24.138961+0000","last_change":"2024-05-16T22:27:24.138961+0000","last_active":"2024-05-16T22:27:24.138961+0000","last_peered":"2024-05-16T22:27:24.138961+0000","last_clean":"2024-05-16T22:27:24.138961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:24.138961+0000","last_undegraded":"2024-05-16T22:27:24.138961+0000","last_fullsized":"2024-05-16T22:27:24.138961+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:24.138961+0000","last_change":"2024-05-16T22:27:24.138961+0000","last_active":"2024-05-16T22:27:24.138961+0000","last_peered":"2024-05-16T22:27:24.138961+0000","last_clean":"2024-05-16T22:27:24.138961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:24.138961+0000","last_undegraded":"2024-05-16T22:27:24.138961+0000","last_fullsized":"2024-05-16T22:27:24.138961+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:24.138961+0000","last_change":"2024-05-16T22:27:24.138961+0000","last_active":"2024-05-16T22:27:24.138961+0000","last_peered":"2024-05-16T22:27:24.138961+0000","last_clean":"2024-05-16T22:27:24.138961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:24.138961+0000","last_undegraded":"2024-05-16T22:27:24.138961+0000","last_fullsized":"2024-05-16T22:27:24.138961+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":104,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-16T22:27:24.155836+0000","last_change":"2024-05-16T22:27:15.950850+0000","last_active":"2024-05-16T22:27:24.155836+0000","last_peered":"2024-05-16T22:27:24.155836+0000","last_clean":"2024-05-16T22:27:24.155836+0000","last_became_active":"2024-05-16T22:27:15.949553+0000","last_became_peered":"2024-05-16T22:27:15.949553+0000","last_unstale":"2024-05-16T22:27:24.155836+0000","last_undegraded":"2024-05-16T22:27:24.155836+0000","last_fullsized":"2024-05-16T22:27:24.155836+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:14.702385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:14.702385+0000","last_clean_scrub_stamp":"2024-05-16T22:27:14.702385+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:46:07.495562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:24.138961+0000","last_change":"2024-05-16T22:27:24.138961+0000","last_active":"2024-05-16T22:27:24.138961+0000","last_peered":"2024-05-16T22:27:24.138961+0000","last_clean":"2024-05-16T22:27:24.138961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:24.138961+0000","last_undegraded":"2024-05-16T22:27:24.138961+0000","last_fullsized":"2024-05-16T22:27:24.138961+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-16T22:27:24.154553+0000","last_change":"2024-05-16T22:27:24.154553+0000","last_active":"2024-05-16T22:27:24.138961+0000","last_peered":"2024-05-16T22:27:24.138961+0000","last_clean":"2024-05-16T22:27:24.138961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:24.154553+0000","last_undegraded":"2024-05-16T22:27:24.154553+0000","last_fullsized":"2024-05-16T22:27:24.154553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:24.138961+0000","last_change":"2024-05-16T22:27:24.138961+0000","last_active":"2024-05-16T22:27:24.138961+0000","last_peered":"2024-05-16T22:27:24.138961+0000","last_clean":"2024-05-16T22:27:24.138961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:24.138961+0000","last_undegraded":"2024-05-16T22:27:24.138961+0000","last_fullsized":"2024-05-16T22:27:24.138961+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:24.138961+0000","last_change":"2024-05-16T22:27:24.138961+0000","last_active":"2024-05-16T22:27:24.138961+0000","last_peered":"2024-05-16T22:27:24.138961+0000","last_clean":"2024-05-16T22:27:24.138961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:24.138961+0000","last_undegraded":"2024-05-16T22:27:24.138961+0000","last_fullsized":"2024-05-16T22:27:24.138961+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:24.138961+0000","last_change":"2024-05-16T22:27:24.138961+0000","last_active":"2024-05-16T22:27:24.138961+0000","last_peered":"2024-05-16T22:27:24.138961+0000","last_clean":"2024-05-16T22:27:24.138961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:24.138961+0000","last_undegraded":"2024-05-16T22:27:24.138961+0000","last_fullsized":"2024-05-16T22:27:24.138961+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-16T22:27:24.154357+0000","last_change":"2024-05-16T22:27:24.154357+0000","last_active":"2024-05-16T22:27:24.138961+0000","last_peered":"2024-05-16T22:27:24.138961+0000","last_clean":"2024-05-16T22:27:24.138961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:24.154357+0000","last_undegraded":"2024-05-16T22:27:24.154357+0000","last_fullsized":"2024-05-16T22:27:24.154357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:24.138961+0000","last_change":"2024-05-16T22:27:24.138961+0000","last_active":"2024-05-16T22:27:24.138961+0000","last_peered":"2024-05-16T22:27:24.138961+0000","last_clean":"2024-05-16T22:27:24.138961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:24.138961+0000","last_undegraded":"2024-05-16T22:27:24.138961+0000","last_fullsized":"2024-05-16T22:27:24.138961+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:24.138961+0000","last_change":"2024-05-16T22:27:24.138961+0000","last_active":"2024-05-16T22:27:24.138961+0000","last_peered":"2024-05-16T22:27:24.138961+0000","last_clean":"2024-05-16T22:27:24.138961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:24.138961+0000","last_undegraded":"2024-05-16T22:27:24.138961+0000","last_fullsized":"2024-05-16T22:27:24.138961+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-16T22:27:24.155245+0000","last_change":"2024-05-16T22:27:24.155245+0000","last_active":"2024-05-16T22:27:24.138961+0000","last_peered":"2024-05-16T22:27:24.138961+0000","last_clean":"2024-05-16T22:27:24.138961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:24.155245+0000","last_undegraded":"2024-05-16T22:27:24.155245+0000","last_fullsized":"2024-05-16T22:27:24.155245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:24.138961+0000","last_change":"2024-05-16T22:27:24.138961+0000","last_active":"2024-05-16T22:27:24.138961+0000","last_peered":"2024-05-16T22:27:24.138961+0000","last_clean":"2024-05-16T22:27:24.138961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:24.138961+0000","last_undegraded":"2024-05-16T22:27:24.138961+0000","last_fullsized":"2024-05-16T22:27:24.138961+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:24.138961+0000","last_change":"2024-05-16T22:27:24.138961+0000","last_active":"2024-05-16T22:27:24.138961+0000","last_peered":"2024-05-16T22:27:24.138961+0000","last_clean":"2024-05-16T22:27:24.138961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:24.138961+0000","last_undegraded":"2024-05-16T22:27:24.138961+0000","last_fullsized":"2024-05-16T22:27:24.138961+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-16T22:27:24.154930+0000","last_change":"2024-05-16T22:27:24.154930+0000","last_active":"2024-05-16T22:27:24.138961+0000","last_peered":"2024-05-16T22:27:24.138961+0000","last_clean":"2024-05-16T22:27:24.138961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:24.154930+0000","last_undegraded":"2024-05-16T22:27:24.154930+0000","last_fullsized":"2024-05-16T22:27:24.154930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-16T22:27:24.154616+0000","last_change":"2024-05-16T22:27:24.154616+0000","last_active":"2024-05-16T22:27:24.138961+0000","last_peered":"2024-05-16T22:27:24.138961+0000","last_clean":"2024-05-16T22:27:24.138961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:24.154616+0000","last_undegraded":"2024-05-16T22:27:24.154616+0000","last_fullsized":"2024-05-16T22:27:24.154616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-16T22:27:24.155140+0000","last_change":"2024-05-16T22:27:24.155140+0000","last_active":"2024-05-16T22:27:24.138961+0000","last_peered":"2024-05-16T22:27:24.138961+0000","last_clean":"2024-05-16T22:27:24.138961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:24.155140+0000","last_undegraded":"2024-05-16T22:27:24.155140+0000","last_fullsized":"2024-05-16T22:27:24.155140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:24.138961+0000","last_change":"2024-05-16T22:27:24.138961+0000","last_active":"2024-05-16T22:27:24.138961+0000","last_peered":"2024-05-16T22:27:24.138961+0000","last_clean":"2024-05-16T22:27:24.138961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:24.138961+0000","last_undegraded":"2024-05-16T22:27:24.138961+0000","last_fullsized":"2024-05-16T22:27:24.138961+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:25.144982+0000","last_change":"2024-05-16T22:27:25.144982+0000","last_active":"2024-05-16T22:27:25.144982+0000","last_peered":"2024-05-16T22:27:25.144982+0000","last_clean":"2024-05-16T22:27:25.144982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:25.144982+0000","last_undegraded":"2024-05-16T22:27:25.144982+0000","last_fullsized":"2024-05-16T22:27:25.144982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-16T22:27:24.138961+0000","last_change":"2024-05-16T22:27:24.138961+0000","last_active":"2024-05-16T22:27:24.138961+0000","last_peered":"2024-05-16T22:27:24.138961+0000","last_clean":"2024-05-16T22:27:24.138961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-16T22:27:24.138961+0000","last_undegraded":"2024-05-16T22:27:24.138961+0000","last_fullsized":"2024-05-16T22:27:24.138961+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32112,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339728,"statfs":{"total":96636764160,"available":96603881472,"internally_reserved":0,"allocated":761856,"data_stored":640526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27188,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":167936,"data_stored":50158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31352,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":167936,"data_stored":50158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":50158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":50158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":50158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":50158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28012,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343828,"statfs":{"total":96636764160,"available":96608079872,"internally_reserved":0,"allocated":761856,"data_stored":640526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-16T22:27:30.230 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-16T22:27:30.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.379+0000 7f4317135640 1 Processor -- start 2024-05-16T22:27:30.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.379+0000 7f4317135640 1 -- start start 2024-05-16T22:27:30.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.380+0000 7f4317135640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f43100bd6d0 0x7f43100be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:30.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.380+0000 7f4317135640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f43100bee80 0x7f4310158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:30.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.380+0000 7f4317135640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f431006e140 con 0x7f4310151fc0 2024-05-16T22:27:30.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.380+0000 7f4317135640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f43100c36f0 con 0x7f43100bd6d0 2024-05-16T22:27:30.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.380+0000 7f4317135640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f4310152530 con 0x7f43100bee80 2024-05-16T22:27:30.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.380+0000 7f430ffff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f43100bd6d0 0x7f43100be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:30.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.380+0000 7f4314ed1640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f4310151fc0 0x7f431006da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:58934/0 (socket says 172.21.15.44:58934) 2024-05-16T22:27:30.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.380+0000 7f4314ed1640 1 -- 172.21.15.44:0/321634444 learned_addr learned my addr 172.21.15.44:0/321634444 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:27:30.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.381+0000 7f43156d2640 1 --2- 172.21.15.44:0/321634444 >> v2:172.21.15.70:3300/0 conn(0x7f43100bee80 0x7f4310158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:30.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.381+0000 7f430ffff640 1 -- 172.21.15.44:0/321634444 >> v2:172.21.15.70:3300/0 conn(0x7f43100bee80 msgr2=0x7f4310158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:30.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.381+0000 7f430ffff640 1 --2- 172.21.15.44:0/321634444 >> v2:172.21.15.70:3300/0 conn(0x7f43100bee80 0x7f4310158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:30.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.381+0000 7f430ffff640 1 -- 172.21.15.44:0/321634444 >> v1:172.21.15.44:6789/0 conn(0x7f4310151fc0 legacy=0x7f431006da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:30.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.381+0000 7f430ffff640 1 -- 172.21.15.44:0/321634444 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4310152810 con 0x7f43100bd6d0 2024-05-16T22:27:30.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.381+0000 7f430f7fe640 1 -- 172.21.15.44:0/321634444 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2556692368 0 0) 0x7f4300001110 con 0x7f4310151fc0 2024-05-16T22:27:30.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.381+0000 7f43156d2640 1 --2- 172.21.15.44:0/321634444 >> v2:172.21.15.70:3300/0 conn(0x7f43100bee80 0x7f4310158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T22:27:30.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.381+0000 7f430ffff640 1 --2- 172.21.15.44:0/321634444 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43100bd6d0 0x7f43100be940 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f43100bf8f0 tx=0x7f430402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e465384dd11e636 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:30.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.382+0000 7f430f7fe640 1 -- 172.21.15.44:0/321634444 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4304037070 con 0x7f43100bd6d0 2024-05-16T22:27:30.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.382+0000 7f430f7fe640 1 -- 172.21.15.44:0/321634444 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4304032440 con 0x7f43100bd6d0 2024-05-16T22:27:30.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.382+0000 7f430f7fe640 1 -- 172.21.15.44:0/321634444 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f430402ae60 con 0x7f43100bd6d0 2024-05-16T22:27:30.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.382+0000 7f4317135640 1 -- 172.21.15.44:0/321634444 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43100bd6d0 msgr2=0x7f43100be940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:30.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.382+0000 7f4317135640 1 --2- 172.21.15.44:0/321634444 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43100bd6d0 0x7f43100be940 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f43100bf8f0 tx=0x7f430402a110 comp rx=0 tx=0).stop 2024-05-16T22:27:30.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.382+0000 7f4317135640 1 -- 172.21.15.44:0/321634444 shutdown_connections 2024-05-16T22:27:30.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.382+0000 7f4317135640 1 --2- 172.21.15.44:0/321634444 >> v2:172.21.15.70:3300/0 conn(0x7f43100bee80 0x7f4310158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:30.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.382+0000 7f4317135640 1 --2- 172.21.15.44:0/321634444 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43100bd6d0 0x7f43100be940 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:30.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.382+0000 7f4317135640 1 -- 172.21.15.44:0/321634444 >> 172.21.15.44:0/321634444 conn(0x7f43100c3d20 msgr2=0x7f43100c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:30.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.382+0000 7f4317135640 1 -- 172.21.15.44:0/321634444 shutdown_connections 2024-05-16T22:27:30.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.382+0000 7f4317135640 1 -- 172.21.15.44:0/321634444 wait complete. 2024-05-16T22:27:30.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.384+0000 7f4317135640 1 Processor -- start 2024-05-16T22:27:30.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.384+0000 7f4317135640 1 -- start start 2024-05-16T22:27:30.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.385+0000 7f4317135640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43100bd6d0 0x7f43101d9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:30.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.385+0000 7f4317135640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43100bee80 0x7f43101d8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:30.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.385+0000 7f4317135640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4310151fc0 0x7f4310148ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:30.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.385+0000 7f4317135640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f43100bdae0 con 0x7f43100bee80 2024-05-16T22:27:30.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.385+0000 7f4317135640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f43100c0070 con 0x7f43100bd6d0 2024-05-16T22:27:30.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.385+0000 7f4317135640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f43100a2ed0 con 0x7f4310151fc0 2024-05-16T22:27:30.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.385+0000 7f430ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43100bee80 0x7f43101d8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:30.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.385+0000 7f430ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43100bee80 0x7f43101d8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57816/0 (socket says 172.21.15.44:57816) 2024-05-16T22:27:30.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.385+0000 7f430ffff640 1 -- 172.21.15.44:0/855564184 learned_addr learned my addr 172.21.15.44:0/855564184 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:30.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.385+0000 7f43156d2640 1 --2- 172.21.15.44:0/855564184 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4310151fc0 0x7f4310148ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:30.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.385+0000 7f4314ed1640 1 --2- 172.21.15.44:0/855564184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43100bd6d0 0x7f43101d9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:30.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.385+0000 7f430ffff640 1 -- 172.21.15.44:0/855564184 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4310151fc0 msgr2=0x7f4310148ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:30.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.385+0000 7f430ffff640 1 --2- 172.21.15.44:0/855564184 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4310151fc0 0x7f4310148ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:30.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.385+0000 7f430ffff640 1 -- 172.21.15.44:0/855564184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43100bd6d0 msgr2=0x7f43101d9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:30.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.385+0000 7f430ffff640 1 --2- 172.21.15.44:0/855564184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43100bd6d0 0x7f43101d9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:30.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.385+0000 7f430ffff640 1 -- 172.21.15.44:0/855564184 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43101d9fa0 con 0x7f43100bee80 2024-05-16T22:27:30.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.385+0000 7f43156d2640 1 --2- 172.21.15.44:0/855564184 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4310151fc0 0x7f4310148ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T22:27:30.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.385+0000 7f4314ed1640 1 --2- 172.21.15.44:0/855564184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43100bd6d0 0x7f43101d9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T22:27:30.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.386+0000 7f430ffff640 1 --2- 172.21.15.44:0/855564184 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43100bee80 0x7f43101d8c00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4304009890 tx=0x7f43040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:30.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.386+0000 7f430d7fa640 1 -- 172.21.15.44:0/855564184 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4304037040 con 0x7f43100bee80 2024-05-16T22:27:30.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.386+0000 7f430d7fa640 1 -- 172.21.15.44:0/855564184 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4304042070 con 0x7f43100bee80 2024-05-16T22:27:30.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.386+0000 7f4317135640 1 -- 172.21.15.44:0/855564184 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43100b6a70 con 0x7f43100bee80 2024-05-16T22:27:30.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.386+0000 7f430d7fa640 1 -- 172.21.15.44:0/855564184 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4304030a50 con 0x7f43100bee80 2024-05-16T22:27:30.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.386+0000 7f4317135640 1 -- 172.21.15.44:0/855564184 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43101e4c30 con 0x7f43100bee80 2024-05-16T22:27:30.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.387+0000 7f4317135640 1 -- 172.21.15.44:0/855564184 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4310050940 con 0x7f43100bee80 2024-05-16T22:27:30.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.388+0000 7f430d7fa640 1 -- 172.21.15.44:0/855564184 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4304030bf0 con 0x7f43100bee80 2024-05-16T22:27:30.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.388+0000 7f430d7fa640 1 --2- 172.21.15.44:0/855564184 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f42fc076300 0x7f42fc078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:30.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.388+0000 7f430d7fa640 1 -- 172.21.15.44:0/855564184 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f43040b8190 con 0x7f43100bee80 2024-05-16T22:27:30.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.388+0000 7f4314ed1640 1 --2- 172.21.15.44:0/855564184 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f42fc076300 0x7f42fc078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:30.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.389+0000 7f4314ed1640 1 --2- 172.21.15.44:0/855564184 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f42fc076300 0x7f42fc078810 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4300000f60 tx=0x7f4300009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:30.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.393+0000 7f430d7fa640 1 -- 172.21.15.44:0/855564184 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4304081940 con 0x7f43100bee80 2024-05-16T22:27:30.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.579+0000 7f4317135640 1 -- 172.21.15.44:0/855564184 --> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f431006eb40 con 0x7f42fc076300 2024-05-16T22:27:30.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.586+0000 7f430d7fa640 1 -- 172.21.15.44:0/855564184 <== mgr.4114 v2:172.21.15.70:6832/4049588098 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251936 (secure 0 0 0) 0x7f431006eb40 con 0x7f42fc076300 2024-05-16T22:27:30.588 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:27:30.589 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-05-16T22:27:30.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.588+0000 7f4317135640 1 -- 172.21.15.44:0/855564184 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f42fc076300 msgr2=0x7f42fc078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:30.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.588+0000 7f4317135640 1 --2- 172.21.15.44:0/855564184 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f42fc076300 0x7f42fc078810 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4300000f60 tx=0x7f4300009040 comp rx=0 tx=0).stop 2024-05-16T22:27:30.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.588+0000 7f4317135640 1 -- 172.21.15.44:0/855564184 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43100bee80 msgr2=0x7f43101d8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:30.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.588+0000 7f4317135640 1 --2- 172.21.15.44:0/855564184 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43100bee80 0x7f43101d8c00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4304009890 tx=0x7f43040046c0 comp rx=0 tx=0).stop 2024-05-16T22:27:30.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.589+0000 7f4317135640 1 -- 172.21.15.44:0/855564184 shutdown_connections 2024-05-16T22:27:30.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.589+0000 7f4317135640 1 --2- 172.21.15.44:0/855564184 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f42fc076300 0x7f42fc078810 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:30.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.589+0000 7f4317135640 1 --2- 172.21.15.44:0/855564184 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4310151fc0 0x7f4310148ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:30.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.589+0000 7f4317135640 1 --2- 172.21.15.44:0/855564184 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43100bee80 0x7f43101d8c00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:30.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.589+0000 7f4317135640 1 --2- 172.21.15.44:0/855564184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43100bd6d0 0x7f43101d9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:30.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.589+0000 7f4317135640 1 -- 172.21.15.44:0/855564184 >> 172.21.15.44:0/855564184 conn(0x7f43100c3d20 msgr2=0x7f43100c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:30.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.589+0000 7f4317135640 1 -- 172.21.15.44:0/855564184 shutdown_connections 2024-05-16T22:27:30.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.589+0000 7f4317135640 1 -- 172.21.15.44:0/855564184 wait complete. 2024-05-16T22:27:30.599 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-05-16T22:27:30.545689+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":156,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231560,"kb_used_data":2896,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754743160,"statfs":{"total":773094113280,"available":772856995840,"internally_reserved":0,"allocated":2965504,"data_stored":1775556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":234016305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001415"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.898292+0000","last_change":"2024-05-16T22:27:26.169639+0000","last_active":"2024-05-16T22:27:27.898292+0000","last_peered":"2024-05-16T22:27:27.898292+0000","last_clean":"2024-05-16T22:27:27.898292+0000","last_became_active":"2024-05-16T22:27:26.168686+0000","last_became_peered":"2024-05-16T22:27:26.168686+0000","last_unstale":"2024-05-16T22:27:27.898292+0000","last_undegraded":"2024-05-16T22:27:27.898292+0000","last_fullsized":"2024-05-16T22:27:27.898292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:39:13.259116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.155697+0000","last_change":"2024-05-16T22:27:26.188439+0000","last_active":"2024-05-16T22:27:27.155697+0000","last_peered":"2024-05-16T22:27:27.155697+0000","last_clean":"2024-05-16T22:27:27.155697+0000","last_became_active":"2024-05-16T22:27:26.188099+0000","last_became_peered":"2024-05-16T22:27:26.188099+0000","last_unstale":"2024-05-16T22:27:27.155697+0000","last_undegraded":"2024-05-16T22:27:27.155697+0000","last_fullsized":"2024-05-16T22:27:27.155697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:53:35.410252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.762271+0000","last_change":"2024-05-16T22:27:26.187026+0000","last_active":"2024-05-16T22:27:27.762271+0000","last_peered":"2024-05-16T22:27:27.762271+0000","last_clean":"2024-05-16T22:27:27.762271+0000","last_became_active":"2024-05-16T22:27:26.186037+0000","last_became_peered":"2024-05-16T22:27:26.186037+0000","last_unstale":"2024-05-16T22:27:27.762271+0000","last_undegraded":"2024-05-16T22:27:27.762271+0000","last_fullsized":"2024-05-16T22:27:27.762271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:00:54.570632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.156701+0000","last_change":"2024-05-16T22:27:26.179800+0000","last_active":"2024-05-16T22:27:27.156701+0000","last_peered":"2024-05-16T22:27:27.156701+0000","last_clean":"2024-05-16T22:27:27.156701+0000","last_became_active":"2024-05-16T22:27:26.178823+0000","last_became_peered":"2024-05-16T22:27:26.178823+0000","last_unstale":"2024-05-16T22:27:27.156701+0000","last_undegraded":"2024-05-16T22:27:27.156701+0000","last_fullsized":"2024-05-16T22:27:27.156701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:54:03.308645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897854+0000","last_change":"2024-05-16T22:27:26.180782+0000","last_active":"2024-05-16T22:27:27.897854+0000","last_peered":"2024-05-16T22:27:27.897854+0000","last_clean":"2024-05-16T22:27:27.897854+0000","last_became_active":"2024-05-16T22:27:26.180495+0000","last_became_peered":"2024-05-16T22:27:26.180495+0000","last_unstale":"2024-05-16T22:27:27.897854+0000","last_undegraded":"2024-05-16T22:27:27.897854+0000","last_fullsized":"2024-05-16T22:27:27.897854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:49:00.124634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.156432+0000","last_change":"2024-05-16T22:27:26.188526+0000","last_active":"2024-05-16T22:27:27.156432+0000","last_peered":"2024-05-16T22:27:27.156432+0000","last_clean":"2024-05-16T22:27:27.156432+0000","last_became_active":"2024-05-16T22:27:26.187884+0000","last_became_peered":"2024-05-16T22:27:26.187884+0000","last_unstale":"2024-05-16T22:27:27.156432+0000","last_undegraded":"2024-05-16T22:27:27.156432+0000","last_fullsized":"2024-05-16T22:27:27.156432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:51:58.232014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897445+0000","last_change":"2024-05-16T22:27:26.192943+0000","last_active":"2024-05-16T22:27:27.897445+0000","last_peered":"2024-05-16T22:27:27.897445+0000","last_clean":"2024-05-16T22:27:27.897445+0000","last_became_active":"2024-05-16T22:27:26.192498+0000","last_became_peered":"2024-05-16T22:27:26.192498+0000","last_unstale":"2024-05-16T22:27:27.897445+0000","last_undegraded":"2024-05-16T22:27:27.897445+0000","last_fullsized":"2024-05-16T22:27:27.897445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:51:58.232014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.830431+0000","last_change":"2024-05-16T22:27:26.186897+0000","last_active":"2024-05-16T22:27:27.830431+0000","last_peered":"2024-05-16T22:27:27.830431+0000","last_clean":"2024-05-16T22:27:27.830431+0000","last_became_active":"2024-05-16T22:27:26.186571+0000","last_became_peered":"2024-05-16T22:27:26.186571+0000","last_unstale":"2024-05-16T22:27:27.830431+0000","last_undegraded":"2024-05-16T22:27:27.830431+0000","last_fullsized":"2024-05-16T22:27:27.830431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:56:00.004438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.898457+0000","last_change":"2024-05-16T22:27:26.170959+0000","last_active":"2024-05-16T22:27:27.898457+0000","last_peered":"2024-05-16T22:27:27.898457+0000","last_clean":"2024-05-16T22:27:27.898457+0000","last_became_active":"2024-05-16T22:27:26.170095+0000","last_became_peered":"2024-05-16T22:27:26.170095+0000","last_unstale":"2024-05-16T22:27:27.898457+0000","last_undegraded":"2024-05-16T22:27:27.898457+0000","last_fullsized":"2024-05-16T22:27:27.898457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:23:26.496588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.164762+0000","last_change":"2024-05-16T22:27:26.177170+0000","last_active":"2024-05-16T22:27:27.164762+0000","last_peered":"2024-05-16T22:27:27.164762+0000","last_clean":"2024-05-16T22:27:27.164762+0000","last_became_active":"2024-05-16T22:27:26.176840+0000","last_became_peered":"2024-05-16T22:27:26.176840+0000","last_unstale":"2024-05-16T22:27:27.164762+0000","last_undegraded":"2024-05-16T22:27:27.164762+0000","last_fullsized":"2024-05-16T22:27:27.164762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:06:36.076585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.164865+0000","last_change":"2024-05-16T22:27:26.185020+0000","last_active":"2024-05-16T22:27:27.164865+0000","last_peered":"2024-05-16T22:27:27.164865+0000","last_clean":"2024-05-16T22:27:27.164865+0000","last_became_active":"2024-05-16T22:27:26.184695+0000","last_became_peered":"2024-05-16T22:27:26.184695+0000","last_unstale":"2024-05-16T22:27:27.164865+0000","last_undegraded":"2024-05-16T22:27:27.164865+0000","last_fullsized":"2024-05-16T22:27:27.164865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:53:35.410252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897534+0000","last_change":"2024-05-16T22:27:26.171746+0000","last_active":"2024-05-16T22:27:27.897534+0000","last_peered":"2024-05-16T22:27:27.897534+0000","last_clean":"2024-05-16T22:27:27.897534+0000","last_became_active":"2024-05-16T22:27:26.171394+0000","last_became_peered":"2024-05-16T22:27:26.171394+0000","last_unstale":"2024-05-16T22:27:27.897534+0000","last_undegraded":"2024-05-16T22:27:27.897534+0000","last_fullsized":"2024-05-16T22:27:27.897534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:00:20.440853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.830873+0000","last_change":"2024-05-16T22:27:26.173414+0000","last_active":"2024-05-16T22:27:27.830873+0000","last_peered":"2024-05-16T22:27:27.830873+0000","last_clean":"2024-05-16T22:27:27.830873+0000","last_became_active":"2024-05-16T22:27:26.173089+0000","last_became_peered":"2024-05-16T22:27:26.173089+0000","last_unstale":"2024-05-16T22:27:27.830873+0000","last_undegraded":"2024-05-16T22:27:27.830873+0000","last_fullsized":"2024-05-16T22:27:27.830873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:53:35.410252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.761942+0000","last_change":"2024-05-16T22:27:26.187223+0000","last_active":"2024-05-16T22:27:27.761942+0000","last_peered":"2024-05-16T22:27:27.761942+0000","last_clean":"2024-05-16T22:27:27.761942+0000","last_became_active":"2024-05-16T22:27:26.186573+0000","last_became_peered":"2024-05-16T22:27:26.186573+0000","last_unstale":"2024-05-16T22:27:27.761942+0000","last_undegraded":"2024-05-16T22:27:27.761942+0000","last_fullsized":"2024-05-16T22:27:27.761942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:00:57.160863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.155581+0000","last_change":"2024-05-16T22:27:26.159254+0000","last_active":"2024-05-16T22:27:27.155581+0000","last_peered":"2024-05-16T22:27:27.155581+0000","last_clean":"2024-05-16T22:27:27.155581+0000","last_became_active":"2024-05-16T22:27:26.158883+0000","last_became_peered":"2024-05-16T22:27:26.158883+0000","last_unstale":"2024-05-16T22:27:27.155581+0000","last_undegraded":"2024-05-16T22:27:27.155581+0000","last_fullsized":"2024-05-16T22:27:27.155581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:06:36.076585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.156375+0000","last_change":"2024-05-16T22:27:26.188285+0000","last_active":"2024-05-16T22:27:27.156375+0000","last_peered":"2024-05-16T22:27:27.156375+0000","last_clean":"2024-05-16T22:27:27.156375+0000","last_became_active":"2024-05-16T22:27:26.187895+0000","last_became_peered":"2024-05-16T22:27:26.187895+0000","last_unstale":"2024-05-16T22:27:27.156375+0000","last_undegraded":"2024-05-16T22:27:27.156375+0000","last_fullsized":"2024-05-16T22:27:27.156375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:53:35.410252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.157378+0000","last_change":"2024-05-16T22:27:26.170197+0000","last_active":"2024-05-16T22:27:27.157378+0000","last_peered":"2024-05-16T22:27:27.157378+0000","last_clean":"2024-05-16T22:27:27.157378+0000","last_became_active":"2024-05-16T22:27:26.169877+0000","last_became_peered":"2024-05-16T22:27:26.169877+0000","last_unstale":"2024-05-16T22:27:27.157378+0000","last_undegraded":"2024-05-16T22:27:27.157378+0000","last_fullsized":"2024-05-16T22:27:27.157378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:07:55.802033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897382+0000","last_change":"2024-05-16T22:27:26.168473+0000","last_active":"2024-05-16T22:27:27.897382+0000","last_peered":"2024-05-16T22:27:27.897382+0000","last_clean":"2024-05-16T22:27:27.897382+0000","last_became_active":"2024-05-16T22:27:26.168104+0000","last_became_peered":"2024-05-16T22:27:26.168104+0000","last_unstale":"2024-05-16T22:27:27.897382+0000","last_undegraded":"2024-05-16T22:27:27.897382+0000","last_fullsized":"2024-05-16T22:27:27.897382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:05:33.386159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.898203+0000","last_change":"2024-05-16T22:27:26.178885+0000","last_active":"2024-05-16T22:27:27.898203+0000","last_peered":"2024-05-16T22:27:27.898203+0000","last_clean":"2024-05-16T22:27:27.898203+0000","last_became_active":"2024-05-16T22:27:26.178192+0000","last_became_peered":"2024-05-16T22:27:26.178192+0000","last_unstale":"2024-05-16T22:27:27.898203+0000","last_undegraded":"2024-05-16T22:27:27.898203+0000","last_fullsized":"2024-05-16T22:27:27.898203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:38:13.961707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.164660+0000","last_change":"2024-05-16T22:27:26.178104+0000","last_active":"2024-05-16T22:27:27.164660+0000","last_peered":"2024-05-16T22:27:27.164660+0000","last_clean":"2024-05-16T22:27:27.164660+0000","last_became_active":"2024-05-16T22:27:26.177764+0000","last_became_peered":"2024-05-16T22:27:26.177764+0000","last_unstale":"2024-05-16T22:27:27.164660+0000","last_undegraded":"2024-05-16T22:27:27.164660+0000","last_fullsized":"2024-05-16T22:27:27.164660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:15:24.877779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.762260+0000","last_change":"2024-05-16T22:27:26.190476+0000","last_active":"2024-05-16T22:27:27.762260+0000","last_peered":"2024-05-16T22:27:27.762260+0000","last_clean":"2024-05-16T22:27:27.762260+0000","last_became_active":"2024-05-16T22:27:26.190058+0000","last_became_peered":"2024-05-16T22:27:26.190058+0000","last_unstale":"2024-05-16T22:27:27.762260+0000","last_undegraded":"2024-05-16T22:27:27.762260+0000","last_fullsized":"2024-05-16T22:27:27.762260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:15:24.877779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.156703+0000","last_change":"2024-05-16T22:27:26.177470+0000","last_active":"2024-05-16T22:27:27.156703+0000","last_peered":"2024-05-16T22:27:27.156703+0000","last_clean":"2024-05-16T22:27:27.156703+0000","last_became_active":"2024-05-16T22:27:26.170806+0000","last_became_peered":"2024-05-16T22:27:26.170806+0000","last_unstale":"2024-05-16T22:27:27.156703+0000","last_undegraded":"2024-05-16T22:27:27.156703+0000","last_fullsized":"2024-05-16T22:27:27.156703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:49:00.124634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.830542+0000","last_change":"2024-05-16T22:27:26.171962+0000","last_active":"2024-05-16T22:27:27.830542+0000","last_peered":"2024-05-16T22:27:27.830542+0000","last_clean":"2024-05-16T22:27:27.830542+0000","last_became_active":"2024-05-16T22:27:26.171144+0000","last_became_peered":"2024-05-16T22:27:26.171144+0000","last_unstale":"2024-05-16T22:27:27.830542+0000","last_undegraded":"2024-05-16T22:27:27.830542+0000","last_fullsized":"2024-05-16T22:27:27.830542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:09:35.504713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.156462+0000","last_change":"2024-05-16T22:27:26.179980+0000","last_active":"2024-05-16T22:27:27.156462+0000","last_peered":"2024-05-16T22:27:27.156462+0000","last_clean":"2024-05-16T22:27:27.156462+0000","last_became_active":"2024-05-16T22:27:26.179609+0000","last_became_peered":"2024-05-16T22:27:26.179609+0000","last_unstale":"2024-05-16T22:27:27.156462+0000","last_undegraded":"2024-05-16T22:27:27.156462+0000","last_fullsized":"2024-05-16T22:27:27.156462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:35:53.031312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.830937+0000","last_change":"2024-05-16T22:27:26.180257+0000","last_active":"2024-05-16T22:27:27.830937+0000","last_peered":"2024-05-16T22:27:27.830937+0000","last_clean":"2024-05-16T22:27:27.830937+0000","last_became_active":"2024-05-16T22:27:26.179478+0000","last_became_peered":"2024-05-16T22:27:26.179478+0000","last_unstale":"2024-05-16T22:27:27.830937+0000","last_undegraded":"2024-05-16T22:27:27.830937+0000","last_fullsized":"2024-05-16T22:27:27.830937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:35:53.031312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.164694+0000","last_change":"2024-05-16T22:27:26.176451+0000","last_active":"2024-05-16T22:27:27.164694+0000","last_peered":"2024-05-16T22:27:27.164694+0000","last_clean":"2024-05-16T22:27:27.164694+0000","last_became_active":"2024-05-16T22:27:26.176119+0000","last_became_peered":"2024-05-16T22:27:26.176119+0000","last_unstale":"2024-05-16T22:27:27.164694+0000","last_undegraded":"2024-05-16T22:27:27.164694+0000","last_fullsized":"2024-05-16T22:27:27.164694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:00:54.570632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.155780+0000","last_change":"2024-05-16T22:27:26.179933+0000","last_active":"2024-05-16T22:27:27.155780+0000","last_peered":"2024-05-16T22:27:27.155780+0000","last_clean":"2024-05-16T22:27:27.155780+0000","last_became_active":"2024-05-16T22:27:26.174184+0000","last_became_peered":"2024-05-16T22:27:26.174184+0000","last_unstale":"2024-05-16T22:27:27.155780+0000","last_undegraded":"2024-05-16T22:27:27.155780+0000","last_fullsized":"2024-05-16T22:27:27.155780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:51:58.232014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.830881+0000","last_change":"2024-05-16T22:27:26.176821+0000","last_active":"2024-05-16T22:27:27.830881+0000","last_peered":"2024-05-16T22:27:27.830881+0000","last_clean":"2024-05-16T22:27:27.830881+0000","last_became_active":"2024-05-16T22:27:26.176467+0000","last_became_peered":"2024-05-16T22:27:26.176467+0000","last_unstale":"2024-05-16T22:27:27.830881+0000","last_undegraded":"2024-05-16T22:27:27.830881+0000","last_fullsized":"2024-05-16T22:27:27.830881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:51:58.232014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.762287+0000","last_change":"2024-05-16T22:27:26.189691+0000","last_active":"2024-05-16T22:27:27.762287+0000","last_peered":"2024-05-16T22:27:27.762287+0000","last_clean":"2024-05-16T22:27:27.762287+0000","last_became_active":"2024-05-16T22:27:26.188674+0000","last_became_peered":"2024-05-16T22:27:26.188674+0000","last_unstale":"2024-05-16T22:27:27.762287+0000","last_undegraded":"2024-05-16T22:27:27.762287+0000","last_fullsized":"2024-05-16T22:27:27.762287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:06:36.076585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.157021+0000","last_change":"2024-05-16T22:27:26.181862+0000","last_active":"2024-05-16T22:27:27.157021+0000","last_peered":"2024-05-16T22:27:27.157021+0000","last_clean":"2024-05-16T22:27:27.157021+0000","last_became_active":"2024-05-16T22:27:26.181525+0000","last_became_peered":"2024-05-16T22:27:26.181525+0000","last_unstale":"2024-05-16T22:27:27.157021+0000","last_undegraded":"2024-05-16T22:27:27.157021+0000","last_fullsized":"2024-05-16T22:27:27.157021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:12:56.101802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897161+0000","last_change":"2024-05-16T22:27:26.176534+0000","last_active":"2024-05-16T22:27:27.897161+0000","last_peered":"2024-05-16T22:27:27.897161+0000","last_clean":"2024-05-16T22:27:27.897161+0000","last_became_active":"2024-05-16T22:27:26.176043+0000","last_became_peered":"2024-05-16T22:27:26.176043+0000","last_unstale":"2024-05-16T22:27:27.897161+0000","last_undegraded":"2024-05-16T22:27:27.897161+0000","last_fullsized":"2024-05-16T22:27:27.897161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:16:39.733997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.164555+0000","last_change":"2024-05-16T22:27:26.188282+0000","last_active":"2024-05-16T22:27:27.164555+0000","last_peered":"2024-05-16T22:27:27.164555+0000","last_clean":"2024-05-16T22:27:27.164555+0000","last_became_active":"2024-05-16T22:27:26.187967+0000","last_became_peered":"2024-05-16T22:27:26.187967+0000","last_unstale":"2024-05-16T22:27:27.164555+0000","last_undegraded":"2024-05-16T22:27:27.164555+0000","last_fullsized":"2024-05-16T22:27:27.164555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:56:00.004438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897616+0000","last_change":"2024-05-16T22:27:26.165300+0000","last_active":"2024-05-16T22:27:27.897616+0000","last_peered":"2024-05-16T22:27:27.897616+0000","last_clean":"2024-05-16T22:27:27.897616+0000","last_became_active":"2024-05-16T22:27:26.164962+0000","last_became_peered":"2024-05-16T22:27:26.164962+0000","last_unstale":"2024-05-16T22:27:27.897616+0000","last_undegraded":"2024-05-16T22:27:27.897616+0000","last_fullsized":"2024-05-16T22:27:27.897616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:16:39.733997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.831169+0000","last_change":"2024-05-16T22:27:25.175691+0000","last_active":"2024-05-16T22:27:27.831169+0000","last_peered":"2024-05-16T22:27:27.831169+0000","last_clean":"2024-05-16T22:27:27.831169+0000","last_became_active":"2024-05-16T22:27:25.175379+0000","last_became_peered":"2024-05-16T22:27:25.175379+0000","last_unstale":"2024-05-16T22:27:27.831169+0000","last_undegraded":"2024-05-16T22:27:27.831169+0000","last_fullsized":"2024-05-16T22:27:27.831169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:28:33.593207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.762390+0000","last_change":"2024-05-16T22:27:26.189662+0000","last_active":"2024-05-16T22:27:27.762390+0000","last_peered":"2024-05-16T22:27:27.762390+0000","last_clean":"2024-05-16T22:27:27.762390+0000","last_became_active":"2024-05-16T22:27:26.188320+0000","last_became_peered":"2024-05-16T22:27:26.188320+0000","last_unstale":"2024-05-16T22:27:27.762390+0000","last_undegraded":"2024-05-16T22:27:27.762390+0000","last_fullsized":"2024-05-16T22:27:27.762390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:35:53.031312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.164229+0000","last_change":"2024-05-16T22:27:25.165881+0000","last_active":"2024-05-16T22:27:27.164229+0000","last_peered":"2024-05-16T22:27:27.164229+0000","last_clean":"2024-05-16T22:27:27.164229+0000","last_became_active":"2024-05-16T22:27:25.165496+0000","last_became_peered":"2024-05-16T22:27:25.165496+0000","last_unstale":"2024-05-16T22:27:27.164229+0000","last_undegraded":"2024-05-16T22:27:27.164229+0000","last_fullsized":"2024-05-16T22:27:27.164229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:00:19.434832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.830593+0000","last_change":"2024-05-16T22:27:25.176342+0000","last_active":"2024-05-16T22:27:27.830593+0000","last_peered":"2024-05-16T22:27:27.830593+0000","last_clean":"2024-05-16T22:27:27.830593+0000","last_became_active":"2024-05-16T22:27:25.175687+0000","last_became_peered":"2024-05-16T22:27:25.175687+0000","last_unstale":"2024-05-16T22:27:27.830593+0000","last_undegraded":"2024-05-16T22:27:27.830593+0000","last_fullsized":"2024-05-16T22:27:27.830593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:56:06.681858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.830570+0000","last_change":"2024-05-16T22:27:26.193793+0000","last_active":"2024-05-16T22:27:27.830570+0000","last_peered":"2024-05-16T22:27:27.830570+0000","last_clean":"2024-05-16T22:27:27.830570+0000","last_became_active":"2024-05-16T22:27:26.193433+0000","last_became_peered":"2024-05-16T22:27:26.193433+0000","last_unstale":"2024-05-16T22:27:27.830570+0000","last_undegraded":"2024-05-16T22:27:27.830570+0000","last_fullsized":"2024-05-16T22:27:27.830570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:15:24.877779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.156512+0000","last_change":"2024-05-16T22:27:25.171113+0000","last_active":"2024-05-16T22:27:27.156512+0000","last_peered":"2024-05-16T22:27:27.156512+0000","last_clean":"2024-05-16T22:27:27.156512+0000","last_became_active":"2024-05-16T22:27:25.170779+0000","last_became_peered":"2024-05-16T22:27:25.170779+0000","last_unstale":"2024-05-16T22:27:27.156512+0000","last_undegraded":"2024-05-16T22:27:27.156512+0000","last_fullsized":"2024-05-16T22:27:27.156512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:38:18.098766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.155360+0000","last_change":"2024-05-16T22:27:26.174986+0000","last_active":"2024-05-16T22:27:27.155360+0000","last_peered":"2024-05-16T22:27:27.155360+0000","last_clean":"2024-05-16T22:27:27.155360+0000","last_became_active":"2024-05-16T22:27:26.173790+0000","last_became_peered":"2024-05-16T22:27:26.173790+0000","last_unstale":"2024-05-16T22:27:27.155360+0000","last_undegraded":"2024-05-16T22:27:27.155360+0000","last_fullsized":"2024-05-16T22:27:27.155360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:09:35.504713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.164660+0000","last_change":"2024-05-16T22:27:25.170470+0000","last_active":"2024-05-16T22:27:27.164660+0000","last_peered":"2024-05-16T22:27:27.164660+0000","last_clean":"2024-05-16T22:27:27.164660+0000","last_became_active":"2024-05-16T22:27:25.170149+0000","last_became_peered":"2024-05-16T22:27:25.170149+0000","last_unstale":"2024-05-16T22:27:27.164660+0000","last_undegraded":"2024-05-16T22:27:27.164660+0000","last_fullsized":"2024-05-16T22:27:27.164660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:14:19.598037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.156971+0000","last_change":"2024-05-16T22:27:26.170048+0000","last_active":"2024-05-16T22:27:27.156971+0000","last_peered":"2024-05-16T22:27:27.156971+0000","last_clean":"2024-05-16T22:27:27.156971+0000","last_became_active":"2024-05-16T22:27:26.169708+0000","last_became_peered":"2024-05-16T22:27:26.169708+0000","last_unstale":"2024-05-16T22:27:27.156971+0000","last_undegraded":"2024-05-16T22:27:27.156971+0000","last_fullsized":"2024-05-16T22:27:27.156971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:15:00.704481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.157006+0000","last_change":"2024-05-16T22:27:25.167775+0000","last_active":"2024-05-16T22:27:27.157006+0000","last_peered":"2024-05-16T22:27:27.157006+0000","last_clean":"2024-05-16T22:27:27.157006+0000","last_became_active":"2024-05-16T22:27:25.167459+0000","last_became_peered":"2024-05-16T22:27:25.167459+0000","last_unstale":"2024-05-16T22:27:27.157006+0000","last_undegraded":"2024-05-16T22:27:27.157006+0000","last_fullsized":"2024-05-16T22:27:27.157006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:14:19.598037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.762359+0000","last_change":"2024-05-16T22:27:26.188683+0000","last_active":"2024-05-16T22:27:27.762359+0000","last_peered":"2024-05-16T22:27:27.762359+0000","last_clean":"2024-05-16T22:27:27.762359+0000","last_became_active":"2024-05-16T22:27:26.187904+0000","last_became_peered":"2024-05-16T22:27:26.187904+0000","last_unstale":"2024-05-16T22:27:27.762359+0000","last_undegraded":"2024-05-16T22:27:27.762359+0000","last_fullsized":"2024-05-16T22:27:27.762359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:53:35.410252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.155764+0000","last_change":"2024-05-16T22:27:25.164952+0000","last_active":"2024-05-16T22:27:27.155764+0000","last_peered":"2024-05-16T22:27:27.155764+0000","last_clean":"2024-05-16T22:27:27.155764+0000","last_became_active":"2024-05-16T22:27:25.164597+0000","last_became_peered":"2024-05-16T22:27:25.164597+0000","last_unstale":"2024-05-16T22:27:27.155764+0000","last_undegraded":"2024-05-16T22:27:27.155764+0000","last_fullsized":"2024-05-16T22:27:27.155764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:16:38.727975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897760+0000","last_change":"2024-05-16T22:27:26.173240+0000","last_active":"2024-05-16T22:27:27.897760+0000","last_peered":"2024-05-16T22:27:27.897760+0000","last_clean":"2024-05-16T22:27:27.897760+0000","last_became_active":"2024-05-16T22:27:26.172926+0000","last_became_peered":"2024-05-16T22:27:26.172926+0000","last_unstale":"2024-05-16T22:27:27.897760+0000","last_undegraded":"2024-05-16T22:27:27.897760+0000","last_fullsized":"2024-05-16T22:27:27.897760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:05:33.386159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.164787+0000","last_change":"2024-05-16T22:27:25.172637+0000","last_active":"2024-05-16T22:27:27.164787+0000","last_peered":"2024-05-16T22:27:27.164787+0000","last_clean":"2024-05-16T22:27:27.164787+0000","last_became_active":"2024-05-16T22:27:25.172289+0000","last_became_peered":"2024-05-16T22:27:25.172289+0000","last_unstale":"2024-05-16T22:27:27.164787+0000","last_undegraded":"2024-05-16T22:27:27.164787+0000","last_fullsized":"2024-05-16T22:27:27.164787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:10:24.692416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897946+0000","last_change":"2024-05-16T22:27:26.174259+0000","last_active":"2024-05-16T22:27:27.897946+0000","last_peered":"2024-05-16T22:27:27.897946+0000","last_clean":"2024-05-16T22:27:27.897946+0000","last_became_active":"2024-05-16T22:27:26.173945+0000","last_became_peered":"2024-05-16T22:27:26.173945+0000","last_unstale":"2024-05-16T22:27:27.897946+0000","last_undegraded":"2024-05-16T22:27:27.897946+0000","last_fullsized":"2024-05-16T22:27:27.897946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:15:00.704481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.762422+0000","last_change":"2024-05-16T22:27:25.173178+0000","last_active":"2024-05-16T22:27:27.762422+0000","last_peered":"2024-05-16T22:27:27.762422+0000","last_clean":"2024-05-16T22:27:27.762422+0000","last_became_active":"2024-05-16T22:27:25.172768+0000","last_became_peered":"2024-05-16T22:27:25.172768+0000","last_unstale":"2024-05-16T22:27:27.762422+0000","last_undegraded":"2024-05-16T22:27:27.762422+0000","last_fullsized":"2024-05-16T22:27:27.762422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:56:06.681858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.762027+0000","last_change":"2024-05-16T22:27:26.187919+0000","last_active":"2024-05-16T22:27:27.762027+0000","last_peered":"2024-05-16T22:27:27.762027+0000","last_clean":"2024-05-16T22:27:27.762027+0000","last_became_active":"2024-05-16T22:27:26.187589+0000","last_became_peered":"2024-05-16T22:27:26.187589+0000","last_unstale":"2024-05-16T22:27:27.762027+0000","last_undegraded":"2024-05-16T22:27:27.762027+0000","last_fullsized":"2024-05-16T22:27:27.762027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:56:00.004438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.156849+0000","last_change":"2024-05-16T22:27:25.177083+0000","last_active":"2024-05-16T22:27:27.156849+0000","last_peered":"2024-05-16T22:27:27.156849+0000","last_clean":"2024-05-16T22:27:27.156849+0000","last_became_active":"2024-05-16T22:27:25.176737+0000","last_became_peered":"2024-05-16T22:27:25.176737+0000","last_unstale":"2024-05-16T22:27:27.156849+0000","last_undegraded":"2024-05-16T22:27:27.156849+0000","last_fullsized":"2024-05-16T22:27:27.156849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:00:19.434832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.898411+0000","last_change":"2024-05-16T22:27:26.173306+0000","last_active":"2024-05-16T22:27:27.898411+0000","last_peered":"2024-05-16T22:27:27.898411+0000","last_clean":"2024-05-16T22:27:27.898411+0000","last_became_active":"2024-05-16T22:27:26.173016+0000","last_became_peered":"2024-05-16T22:27:26.173016+0000","last_unstale":"2024-05-16T22:27:27.898411+0000","last_undegraded":"2024-05-16T22:27:27.898411+0000","last_fullsized":"2024-05-16T22:27:27.898411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:18:14.496079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.164327+0000","last_change":"2024-05-16T22:27:25.163375+0000","last_active":"2024-05-16T22:27:27.164327+0000","last_peered":"2024-05-16T22:27:27.164327+0000","last_clean":"2024-05-16T22:27:27.164327+0000","last_became_active":"2024-05-16T22:27:25.163055+0000","last_became_peered":"2024-05-16T22:27:25.163055+0000","last_unstale":"2024-05-16T22:27:27.164327+0000","last_undegraded":"2024-05-16T22:27:27.164327+0000","last_fullsized":"2024-05-16T22:27:27.164327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:28:33.593207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.164260+0000","last_change":"2024-05-16T22:27:26.188199+0000","last_active":"2024-05-16T22:27:27.164260+0000","last_peered":"2024-05-16T22:27:27.164260+0000","last_clean":"2024-05-16T22:27:27.164260+0000","last_became_active":"2024-05-16T22:27:26.187894+0000","last_became_peered":"2024-05-16T22:27:26.187894+0000","last_unstale":"2024-05-16T22:27:27.164260+0000","last_undegraded":"2024-05-16T22:27:27.164260+0000","last_fullsized":"2024-05-16T22:27:27.164260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:56:14.312711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897108+0000","last_change":"2024-05-16T22:27:25.171882+0000","last_active":"2024-05-16T22:27:27.897108+0000","last_peered":"2024-05-16T22:27:27.897108+0000","last_clean":"2024-05-16T22:27:27.897108+0000","last_became_active":"2024-05-16T22:27:25.171503+0000","last_became_peered":"2024-05-16T22:27:25.171503+0000","last_unstale":"2024-05-16T22:27:27.897108+0000","last_undegraded":"2024-05-16T22:27:27.897108+0000","last_fullsized":"2024-05-16T22:27:27.897108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:49:34.698714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897827+0000","last_change":"2024-05-16T22:27:26.172931+0000","last_active":"2024-05-16T22:27:27.897827+0000","last_peered":"2024-05-16T22:27:27.897827+0000","last_clean":"2024-05-16T22:27:27.897827+0000","last_became_active":"2024-05-16T22:27:26.172603+0000","last_became_peered":"2024-05-16T22:27:26.172603+0000","last_unstale":"2024-05-16T22:27:27.897827+0000","last_undegraded":"2024-05-16T22:27:27.897827+0000","last_fullsized":"2024-05-16T22:27:27.897827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:54:03.308645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897822+0000","last_change":"2024-05-16T22:27:25.174004+0000","last_active":"2024-05-16T22:27:27.897822+0000","last_peered":"2024-05-16T22:27:27.897822+0000","last_clean":"2024-05-16T22:27:27.897822+0000","last_became_active":"2024-05-16T22:27:25.173652+0000","last_became_peered":"2024-05-16T22:27:25.173652+0000","last_unstale":"2024-05-16T22:27:27.897822+0000","last_undegraded":"2024-05-16T22:27:27.897822+0000","last_fullsized":"2024-05-16T22:27:27.897822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:12:36.673821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897650+0000","last_change":"2024-05-16T22:27:26.173271+0000","last_active":"2024-05-16T22:27:27.897650+0000","last_peered":"2024-05-16T22:27:27.897650+0000","last_clean":"2024-05-16T22:27:27.897650+0000","last_became_active":"2024-05-16T22:27:26.172922+0000","last_became_peered":"2024-05-16T22:27:26.172922+0000","last_unstale":"2024-05-16T22:27:27.897650+0000","last_undegraded":"2024-05-16T22:27:27.897650+0000","last_fullsized":"2024-05-16T22:27:27.897650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:35:53.031312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897354+0000","last_change":"2024-05-16T22:27:25.173377+0000","last_active":"2024-05-16T22:27:27.897354+0000","last_peered":"2024-05-16T22:27:27.897354+0000","last_clean":"2024-05-16T22:27:27.897354+0000","last_became_active":"2024-05-16T22:27:25.172463+0000","last_became_peered":"2024-05-16T22:27:25.172463+0000","last_unstale":"2024-05-16T22:27:27.897354+0000","last_undegraded":"2024-05-16T22:27:27.897354+0000","last_fullsized":"2024-05-16T22:27:27.897354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:10:24.692416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.898476+0000","last_change":"2024-05-16T22:27:26.174266+0000","last_active":"2024-05-16T22:27:27.898476+0000","last_peered":"2024-05-16T22:27:27.898476+0000","last_clean":"2024-05-16T22:27:27.898476+0000","last_became_active":"2024-05-16T22:27:26.174003+0000","last_became_peered":"2024-05-16T22:27:26.174003+0000","last_unstale":"2024-05-16T22:27:27.898476+0000","last_undegraded":"2024-05-16T22:27:27.898476+0000","last_fullsized":"2024-05-16T22:27:27.898476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:07:55.802033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.155873+0000","last_change":"2024-05-16T22:27:25.159445+0000","last_active":"2024-05-16T22:27:27.155873+0000","last_peered":"2024-05-16T22:27:27.155873+0000","last_clean":"2024-05-16T22:27:27.155873+0000","last_became_active":"2024-05-16T22:27:25.159100+0000","last_became_peered":"2024-05-16T22:27:25.159100+0000","last_unstale":"2024-05-16T22:27:27.155873+0000","last_undegraded":"2024-05-16T22:27:27.155873+0000","last_fullsized":"2024-05-16T22:27:27.155873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:05:32.380138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.157069+0000","last_change":"2024-05-16T22:27:26.179538+0000","last_active":"2024-05-16T22:27:27.157069+0000","last_peered":"2024-05-16T22:27:27.157069+0000","last_clean":"2024-05-16T22:27:27.157069+0000","last_became_active":"2024-05-16T22:27:26.179179+0000","last_became_peered":"2024-05-16T22:27:26.179179+0000","last_unstale":"2024-05-16T22:27:27.157069+0000","last_undegraded":"2024-05-16T22:27:27.157069+0000","last_fullsized":"2024-05-16T22:27:27.157069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:38:13.961707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897295+0000","last_change":"2024-05-16T22:27:25.168953+0000","last_active":"2024-05-16T22:27:27.897295+0000","last_peered":"2024-05-16T22:27:27.897295+0000","last_clean":"2024-05-16T22:27:27.897295+0000","last_became_active":"2024-05-16T22:27:25.168090+0000","last_became_peered":"2024-05-16T22:27:25.168090+0000","last_unstale":"2024-05-16T22:27:27.897295+0000","last_undegraded":"2024-05-16T22:27:27.897295+0000","last_fullsized":"2024-05-16T22:27:27.897295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:28:33.593207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.898029+0000","last_change":"2024-05-16T22:27:26.175603+0000","last_active":"2024-05-16T22:27:27.898029+0000","last_peered":"2024-05-16T22:27:27.898029+0000","last_clean":"2024-05-16T22:27:27.898029+0000","last_became_active":"2024-05-16T22:27:26.175300+0000","last_became_peered":"2024-05-16T22:27:26.175300+0000","last_unstale":"2024-05-16T22:27:27.898029+0000","last_undegraded":"2024-05-16T22:27:27.898029+0000","last_fullsized":"2024-05-16T22:27:27.898029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:12:56.101802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":110,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897117+0000","last_change":"2024-05-16T22:27:15.950850+0000","last_active":"2024-05-16T22:27:27.897117+0000","last_peered":"2024-05-16T22:27:27.897117+0000","last_clean":"2024-05-16T22:27:27.897117+0000","last_became_active":"2024-05-16T22:27:15.949553+0000","last_became_peered":"2024-05-16T22:27:15.949553+0000","last_unstale":"2024-05-16T22:27:27.897117+0000","last_undegraded":"2024-05-16T22:27:27.897117+0000","last_fullsized":"2024-05-16T22:27:27.897117+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:14.702385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:14.702385+0000","last_clean_scrub_stamp":"2024-05-16T22:27:14.702385+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:46:07.495562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.156689+0000","last_change":"2024-05-16T22:27:25.168854+0000","last_active":"2024-05-16T22:27:27.156689+0000","last_peered":"2024-05-16T22:27:27.156689+0000","last_clean":"2024-05-16T22:27:27.156689+0000","last_became_active":"2024-05-16T22:27:25.168548+0000","last_became_peered":"2024-05-16T22:27:25.168548+0000","last_unstale":"2024-05-16T22:27:27.156689+0000","last_undegraded":"2024-05-16T22:27:27.156689+0000","last_fullsized":"2024-05-16T22:27:27.156689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:10:24.692416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.831072+0000","last_change":"2024-05-16T22:27:26.187669+0000","last_active":"2024-05-16T22:27:27.831072+0000","last_peered":"2024-05-16T22:27:27.831072+0000","last_clean":"2024-05-16T22:27:27.831072+0000","last_became_active":"2024-05-16T22:27:26.187358+0000","last_became_peered":"2024-05-16T22:27:26.187358+0000","last_unstale":"2024-05-16T22:27:27.831072+0000","last_undegraded":"2024-05-16T22:27:27.831072+0000","last_fullsized":"2024-05-16T22:27:27.831072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:49:00.124634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.896951+0000","last_change":"2024-05-16T22:27:25.179705+0000","last_active":"2024-05-16T22:27:27.896951+0000","last_peered":"2024-05-16T22:27:27.896951+0000","last_clean":"2024-05-16T22:27:27.896951+0000","last_became_active":"2024-05-16T22:27:25.179338+0000","last_became_peered":"2024-05-16T22:27:25.179338+0000","last_unstale":"2024-05-16T22:27:27.896951+0000","last_undegraded":"2024-05-16T22:27:27.896951+0000","last_fullsized":"2024-05-16T22:27:27.896951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:38:18.098766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.761944+0000","last_change":"2024-05-16T22:27:26.185157+0000","last_active":"2024-05-16T22:27:27.761944+0000","last_peered":"2024-05-16T22:27:27.761944+0000","last_clean":"2024-05-16T22:27:27.761944+0000","last_became_active":"2024-05-16T22:27:26.184780+0000","last_became_peered":"2024-05-16T22:27:26.184780+0000","last_unstale":"2024-05-16T22:27:27.761944+0000","last_undegraded":"2024-05-16T22:27:27.761944+0000","last_fullsized":"2024-05-16T22:27:27.761944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:56:14.312711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897243+0000","last_change":"2024-05-16T22:27:25.172921+0000","last_active":"2024-05-16T22:27:27.897243+0000","last_peered":"2024-05-16T22:27:27.897243+0000","last_clean":"2024-05-16T22:27:27.897243+0000","last_became_active":"2024-05-16T22:27:25.172582+0000","last_became_peered":"2024-05-16T22:27:25.172582+0000","last_unstale":"2024-05-16T22:27:27.897243+0000","last_undegraded":"2024-05-16T22:27:27.897243+0000","last_fullsized":"2024-05-16T22:27:27.897243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:14:19.598037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.155424+0000","last_change":"2024-05-16T22:27:26.180819+0000","last_active":"2024-05-16T22:27:27.155424+0000","last_peered":"2024-05-16T22:27:27.155424+0000","last_clean":"2024-05-16T22:27:27.155424+0000","last_became_active":"2024-05-16T22:27:26.180533+0000","last_became_peered":"2024-05-16T22:27:26.180533+0000","last_unstale":"2024-05-16T22:27:27.155424+0000","last_undegraded":"2024-05-16T22:27:27.155424+0000","last_fullsized":"2024-05-16T22:27:27.155424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:15:24.877779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.157126+0000","last_change":"2024-05-16T22:27:25.164143+0000","last_active":"2024-05-16T22:27:27.157126+0000","last_peered":"2024-05-16T22:27:27.157126+0000","last_clean":"2024-05-16T22:27:27.157126+0000","last_became_active":"2024-05-16T22:27:25.163816+0000","last_became_peered":"2024-05-16T22:27:25.163816+0000","last_unstale":"2024-05-16T22:27:27.157126+0000","last_undegraded":"2024-05-16T22:27:27.157126+0000","last_fullsized":"2024-05-16T22:27:27.157126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:18:45.799763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897611+0000","last_change":"2024-05-16T22:27:26.190255+0000","last_active":"2024-05-16T22:27:27.897611+0000","last_peered":"2024-05-16T22:27:27.897611+0000","last_clean":"2024-05-16T22:27:27.897611+0000","last_became_active":"2024-05-16T22:27:26.189958+0000","last_became_peered":"2024-05-16T22:27:26.189958+0000","last_unstale":"2024-05-16T22:27:27.897611+0000","last_undegraded":"2024-05-16T22:27:27.897611+0000","last_fullsized":"2024-05-16T22:27:27.897611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:18:46.805784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.155441+0000","last_change":"2024-05-16T22:27:25.168229+0000","last_active":"2024-05-16T22:27:27.155441+0000","last_peered":"2024-05-16T22:27:27.155441+0000","last_clean":"2024-05-16T22:27:27.155441+0000","last_became_active":"2024-05-16T22:27:25.167870+0000","last_became_peered":"2024-05-16T22:27:25.167870+0000","last_unstale":"2024-05-16T22:27:27.155441+0000","last_undegraded":"2024-05-16T22:27:27.155441+0000","last_fullsized":"2024-05-16T22:27:27.155441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:00:19.434832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.157322+0000","last_change":"2024-05-16T22:27:26.180054+0000","last_active":"2024-05-16T22:27:27.157322+0000","last_peered":"2024-05-16T22:27:27.157322+0000","last_clean":"2024-05-16T22:27:27.157322+0000","last_became_active":"2024-05-16T22:27:26.179579+0000","last_became_peered":"2024-05-16T22:27:26.179579+0000","last_unstale":"2024-05-16T22:27:27.157322+0000","last_undegraded":"2024-05-16T22:27:27.157322+0000","last_fullsized":"2024-05-16T22:27:27.157322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:23:26.496588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.898140+0000","last_change":"2024-05-16T22:27:25.179765+0000","last_active":"2024-05-16T22:27:27.898140+0000","last_peered":"2024-05-16T22:27:27.898140+0000","last_clean":"2024-05-16T22:27:27.898140+0000","last_became_active":"2024-05-16T22:27:25.179478+0000","last_became_peered":"2024-05-16T22:27:25.179478+0000","last_unstale":"2024-05-16T22:27:27.898140+0000","last_undegraded":"2024-05-16T22:27:27.898140+0000","last_fullsized":"2024-05-16T22:27:27.898140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:00:19.434832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.155474+0000","last_change":"2024-05-16T22:27:26.176594+0000","last_active":"2024-05-16T22:27:27.155474+0000","last_peered":"2024-05-16T22:27:27.155474+0000","last_clean":"2024-05-16T22:27:27.155474+0000","last_became_active":"2024-05-16T22:27:26.176164+0000","last_became_peered":"2024-05-16T22:27:26.176164+0000","last_unstale":"2024-05-16T22:27:27.155474+0000","last_undegraded":"2024-05-16T22:27:27.155474+0000","last_fullsized":"2024-05-16T22:27:27.155474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:00:54.570632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.163540+0000","last_change":"2024-05-16T22:27:25.167314+0000","last_active":"2024-05-16T22:27:27.163540+0000","last_peered":"2024-05-16T22:27:27.163540+0000","last_clean":"2024-05-16T22:27:27.163540+0000","last_became_active":"2024-05-16T22:27:25.166970+0000","last_became_peered":"2024-05-16T22:27:25.166970+0000","last_unstale":"2024-05-16T22:27:27.163540+0000","last_undegraded":"2024-05-16T22:27:27.163540+0000","last_fullsized":"2024-05-16T22:27:27.163540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:38:18.098766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.831087+0000","last_change":"2024-05-16T22:27:26.179815+0000","last_active":"2024-05-16T22:27:27.831087+0000","last_peered":"2024-05-16T22:27:27.831087+0000","last_clean":"2024-05-16T22:27:27.831087+0000","last_became_active":"2024-05-16T22:27:26.179100+0000","last_became_peered":"2024-05-16T22:27:26.179100+0000","last_unstale":"2024-05-16T22:27:27.831087+0000","last_undegraded":"2024-05-16T22:27:27.831087+0000","last_fullsized":"2024-05-16T22:27:27.831087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:15:00.704481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.164789+0000","last_change":"2024-05-16T22:27:25.175426+0000","last_active":"2024-05-16T22:27:27.164789+0000","last_peered":"2024-05-16T22:27:27.164789+0000","last_clean":"2024-05-16T22:27:27.164789+0000","last_became_active":"2024-05-16T22:27:25.175074+0000","last_became_peered":"2024-05-16T22:27:25.175074+0000","last_unstale":"2024-05-16T22:27:27.164789+0000","last_undegraded":"2024-05-16T22:27:27.164789+0000","last_fullsized":"2024-05-16T22:27:27.164789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:38:18.098766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.762368+0000","last_change":"2024-05-16T22:27:26.186566+0000","last_active":"2024-05-16T22:27:27.762368+0000","last_peered":"2024-05-16T22:27:27.762368+0000","last_clean":"2024-05-16T22:27:27.762368+0000","last_became_active":"2024-05-16T22:27:26.185741+0000","last_became_peered":"2024-05-16T22:27:26.185741+0000","last_unstale":"2024-05-16T22:27:27.762368+0000","last_undegraded":"2024-05-16T22:27:27.762368+0000","last_fullsized":"2024-05-16T22:27:27.762368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:51:58.232014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.896927+0000","last_change":"2024-05-16T22:27:25.179797+0000","last_active":"2024-05-16T22:27:27.896927+0000","last_peered":"2024-05-16T22:27:27.896927+0000","last_clean":"2024-05-16T22:27:27.896927+0000","last_became_active":"2024-05-16T22:27:25.179523+0000","last_became_peered":"2024-05-16T22:27:25.179523+0000","last_unstale":"2024-05-16T22:27:27.896927+0000","last_undegraded":"2024-05-16T22:27:27.896927+0000","last_fullsized":"2024-05-16T22:27:27.896927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:05:32.380138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897242+0000","last_change":"2024-05-16T22:27:26.176417+0000","last_active":"2024-05-16T22:27:27.897242+0000","last_peered":"2024-05-16T22:27:27.897242+0000","last_clean":"2024-05-16T22:27:27.897242+0000","last_became_active":"2024-05-16T22:27:26.176117+0000","last_became_peered":"2024-05-16T22:27:26.176117+0000","last_unstale":"2024-05-16T22:27:27.897242+0000","last_undegraded":"2024-05-16T22:27:27.897242+0000","last_fullsized":"2024-05-16T22:27:27.897242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:38:19.104787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.155475+0000","last_change":"2024-05-16T22:27:25.173786+0000","last_active":"2024-05-16T22:27:27.155475+0000","last_peered":"2024-05-16T22:27:27.155475+0000","last_clean":"2024-05-16T22:27:27.155475+0000","last_became_active":"2024-05-16T22:27:25.173340+0000","last_became_peered":"2024-05-16T22:27:25.173340+0000","last_unstale":"2024-05-16T22:27:27.155475+0000","last_undegraded":"2024-05-16T22:27:27.155475+0000","last_fullsized":"2024-05-16T22:27:27.155475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:18:45.799763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.830624+0000","last_change":"2024-05-16T22:27:26.173368+0000","last_active":"2024-05-16T22:27:27.830624+0000","last_peered":"2024-05-16T22:27:27.830624+0000","last_clean":"2024-05-16T22:27:27.830624+0000","last_became_active":"2024-05-16T22:27:26.172519+0000","last_became_peered":"2024-05-16T22:27:26.172519+0000","last_unstale":"2024-05-16T22:27:27.830624+0000","last_undegraded":"2024-05-16T22:27:27.830624+0000","last_fullsized":"2024-05-16T22:27:27.830624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:00:54.570632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.155439+0000","last_change":"2024-05-16T22:27:25.170729+0000","last_active":"2024-05-16T22:27:27.155439+0000","last_peered":"2024-05-16T22:27:27.155439+0000","last_clean":"2024-05-16T22:27:27.155439+0000","last_became_active":"2024-05-16T22:27:25.170385+0000","last_became_peered":"2024-05-16T22:27:25.170385+0000","last_unstale":"2024-05-16T22:27:27.155439+0000","last_undegraded":"2024-05-16T22:27:27.155439+0000","last_fullsized":"2024-05-16T22:27:27.155439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:14:19.598037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.830840+0000","last_change":"2024-05-16T22:27:26.193277+0000","last_active":"2024-05-16T22:27:27.830840+0000","last_peered":"2024-05-16T22:27:27.830840+0000","last_clean":"2024-05-16T22:27:27.830840+0000","last_became_active":"2024-05-16T22:27:26.192885+0000","last_became_peered":"2024-05-16T22:27:26.192885+0000","last_unstale":"2024-05-16T22:27:27.830840+0000","last_undegraded":"2024-05-16T22:27:27.830840+0000","last_fullsized":"2024-05-16T22:27:27.830840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:06:36.076585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.898275+0000","last_change":"2024-05-16T22:27:25.173350+0000","last_active":"2024-05-16T22:27:27.898275+0000","last_peered":"2024-05-16T22:27:27.898275+0000","last_clean":"2024-05-16T22:27:27.898275+0000","last_became_active":"2024-05-16T22:27:25.172986+0000","last_became_peered":"2024-05-16T22:27:25.172986+0000","last_unstale":"2024-05-16T22:27:27.898275+0000","last_undegraded":"2024-05-16T22:27:27.898275+0000","last_fullsized":"2024-05-16T22:27:27.898275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:18:45.799763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.164381+0000","last_change":"2024-05-16T22:27:26.178022+0000","last_active":"2024-05-16T22:27:27.164381+0000","last_peered":"2024-05-16T22:27:27.164381+0000","last_clean":"2024-05-16T22:27:27.164381+0000","last_became_active":"2024-05-16T22:27:26.177657+0000","last_became_peered":"2024-05-16T22:27:26.177657+0000","last_unstale":"2024-05-16T22:27:27.164381+0000","last_undegraded":"2024-05-16T22:27:27.164381+0000","last_fullsized":"2024-05-16T22:27:27.164381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:09:35.504713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.157307+0000","last_change":"2024-05-16T22:27:26.182079+0000","last_active":"2024-05-16T22:27:27.157307+0000","last_peered":"2024-05-16T22:27:27.157307+0000","last_clean":"2024-05-16T22:27:27.157307+0000","last_became_active":"2024-05-16T22:27:26.181164+0000","last_became_peered":"2024-05-16T22:27:26.181164+0000","last_unstale":"2024-05-16T22:27:27.157307+0000","last_undegraded":"2024-05-16T22:27:27.157307+0000","last_fullsized":"2024-05-16T22:27:27.157307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:18:14.496079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897381+0000","last_change":"2024-05-16T22:27:25.176553+0000","last_active":"2024-05-16T22:27:27.897381+0000","last_peered":"2024-05-16T22:27:27.897381+0000","last_clean":"2024-05-16T22:27:27.897381+0000","last_became_active":"2024-05-16T22:27:25.176195+0000","last_became_peered":"2024-05-16T22:27:25.176195+0000","last_unstale":"2024-05-16T22:27:27.897381+0000","last_undegraded":"2024-05-16T22:27:27.897381+0000","last_fullsized":"2024-05-16T22:27:27.897381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:16:38.727975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.157220+0000","last_change":"2024-05-16T22:27:26.176499+0000","last_active":"2024-05-16T22:27:27.157220+0000","last_peered":"2024-05-16T22:27:27.157220+0000","last_clean":"2024-05-16T22:27:27.157220+0000","last_became_active":"2024-05-16T22:27:26.176201+0000","last_became_peered":"2024-05-16T22:27:26.176201+0000","last_unstale":"2024-05-16T22:27:27.157220+0000","last_undegraded":"2024-05-16T22:27:27.157220+0000","last_fullsized":"2024-05-16T22:27:27.157220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:39:13.259116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.898018+0000","last_change":"2024-05-16T22:27:25.176489+0000","last_active":"2024-05-16T22:27:27.898018+0000","last_peered":"2024-05-16T22:27:27.898018+0000","last_clean":"2024-05-16T22:27:27.898018+0000","last_became_active":"2024-05-16T22:27:25.175878+0000","last_became_peered":"2024-05-16T22:27:25.175878+0000","last_unstale":"2024-05-16T22:27:27.898018+0000","last_undegraded":"2024-05-16T22:27:27.898018+0000","last_fullsized":"2024-05-16T22:27:27.898018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:14:19.598037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.762117+0000","last_change":"2024-05-16T22:27:26.188958+0000","last_active":"2024-05-16T22:27:27.762117+0000","last_peered":"2024-05-16T22:27:27.762117+0000","last_clean":"2024-05-16T22:27:27.762117+0000","last_became_active":"2024-05-16T22:27:26.188364+0000","last_became_peered":"2024-05-16T22:27:26.188364+0000","last_unstale":"2024-05-16T22:27:27.762117+0000","last_undegraded":"2024-05-16T22:27:27.762117+0000","last_fullsized":"2024-05-16T22:27:27.762117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:09:35.504713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.831034+0000","last_change":"2024-05-16T22:27:25.172230+0000","last_active":"2024-05-16T22:27:27.831034+0000","last_peered":"2024-05-16T22:27:27.831034+0000","last_clean":"2024-05-16T22:27:27.831034+0000","last_became_active":"2024-05-16T22:27:25.171609+0000","last_became_peered":"2024-05-16T22:27:25.171609+0000","last_unstale":"2024-05-16T22:27:27.831034+0000","last_undegraded":"2024-05-16T22:27:27.831034+0000","last_fullsized":"2024-05-16T22:27:27.831034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:49:34.698714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.831003+0000","last_change":"2024-05-16T22:27:26.174545+0000","last_active":"2024-05-16T22:27:27.831003+0000","last_peered":"2024-05-16T22:27:27.831003+0000","last_clean":"2024-05-16T22:27:27.831003+0000","last_became_active":"2024-05-16T22:27:26.174218+0000","last_became_peered":"2024-05-16T22:27:26.174218+0000","last_unstale":"2024-05-16T22:27:27.831003+0000","last_undegraded":"2024-05-16T22:27:27.831003+0000","last_fullsized":"2024-05-16T22:27:27.831003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:54:03.308645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.762375+0000","last_change":"2024-05-16T22:27:25.175258+0000","last_active":"2024-05-16T22:27:27.762375+0000","last_peered":"2024-05-16T22:27:27.762375+0000","last_clean":"2024-05-16T22:27:27.762375+0000","last_became_active":"2024-05-16T22:27:25.174778+0000","last_became_peered":"2024-05-16T22:27:25.174778+0000","last_unstale":"2024-05-16T22:27:27.762375+0000","last_undegraded":"2024-05-16T22:27:27.762375+0000","last_fullsized":"2024-05-16T22:27:27.762375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:12:36.673821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31980,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339860,"statfs":{"total":96636764160,"available":96604016640,"internally_reserved":0,"allocated":815104,"data_stored":666275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":229376,"data_stored":76937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":221184,"data_stored":75415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":69151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":70637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":75325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":75485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":823296,"data_stored":666331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-16T22:27:30.603 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-16T22:27:30.603 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-16T22:27:30.603 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-16T22:27:30.603 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-16T22:27:30.604 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-16T22:27:30.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.752+0000 7f5161813640 1 Processor -- start 2024-05-16T22:27:30.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.752+0000 7f5161813640 1 -- start start 2024-05-16T22:27:30.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.753+0000 7f5161813640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f515c14e530 0x7f515c0ba320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:30.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.753+0000 7f5161813640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f515c0bd440 0x7f515c0bd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:30.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.753+0000 7f5161813640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f515c0ba860 con 0x7f515c0b8d70 2024-05-16T22:27:30.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.753+0000 7f5161813640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f515c0b88e0 con 0x7f515c0bd440 2024-05-16T22:27:30.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.753+0000 7f5161813640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f515c14ece0 con 0x7f515c14e530 2024-05-16T22:27:30.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.753+0000 7f515a7fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f515c0bd440 0x7f515c0bd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:30.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.753+0000 7f515a7fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f515c0bd440 0x7f515c0bd850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57824/0 (socket says 172.21.15.44:57824) 2024-05-16T22:27:30.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.753+0000 7f515a7fc640 1 -- 172.21.15.44:0/1214362588 learned_addr learned my addr 172.21.15.44:0/1214362588 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:30.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.753+0000 7f515affd640 1 --2- 172.21.15.44:0/1214362588 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f515c14e530 0x7f515c0ba320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:30.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.754+0000 7f515a7fc640 1 -- 172.21.15.44:0/1214362588 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f515c14e530 msgr2=0x7f515c0ba320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:30.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.754+0000 7f515a7fc640 1 --2- 172.21.15.44:0/1214362588 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f515c14e530 0x7f515c0ba320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:30.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.754+0000 7f515a7fc640 1 -- 172.21.15.44:0/1214362588 >> v1:172.21.15.70:6789/0 conn(0x7f515c0b8d70 legacy=0x7f515c0b9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:30.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.754+0000 7f515a7fc640 1 -- 172.21.15.44:0/1214362588 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f515c0bdd90 con 0x7f515c0bd440 2024-05-16T22:27:30.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.754+0000 7f515a7fc640 1 --2- 172.21.15.44:0/1214362588 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f515c0bd440 0x7f515c0bd850 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5144009870 tx=0x7f514402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92ee3e22e2ac4160 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:30.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.754+0000 7f5159ffb640 1 -- 172.21.15.44:0/1214362588 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5144037070 con 0x7f515c0bd440 2024-05-16T22:27:30.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.755+0000 7f5159ffb640 1 -- 172.21.15.44:0/1214362588 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5144032440 con 0x7f515c0bd440 2024-05-16T22:27:30.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.755+0000 7f5159ffb640 1 -- 172.21.15.44:0/1214362588 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5144032810 con 0x7f515c0bd440 2024-05-16T22:27:30.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.755+0000 7f5161813640 1 -- 172.21.15.44:0/1214362588 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f515c0bd440 msgr2=0x7f515c0bd850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:30.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.755+0000 7f5161813640 1 --2- 172.21.15.44:0/1214362588 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f515c0bd440 0x7f515c0bd850 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5144009870 tx=0x7f514402a270 comp rx=0 tx=0).stop 2024-05-16T22:27:30.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.755+0000 7f5161813640 1 -- 172.21.15.44:0/1214362588 shutdown_connections 2024-05-16T22:27:30.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.755+0000 7f5161813640 1 --2- 172.21.15.44:0/1214362588 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f515c0bd440 0x7f515c0bd850 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:30.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.755+0000 7f5161813640 1 --2- 172.21.15.44:0/1214362588 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f515c14e530 0x7f515c0ba320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:30.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.755+0000 7f5161813640 1 -- 172.21.15.44:0/1214362588 >> 172.21.15.44:0/1214362588 conn(0x7f515c0c0570 msgr2=0x7f515c0c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:30.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.755+0000 7f5161813640 1 -- 172.21.15.44:0/1214362588 shutdown_connections 2024-05-16T22:27:30.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.755+0000 7f5161813640 1 -- 172.21.15.44:0/1214362588 wait complete. 2024-05-16T22:27:30.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.757+0000 7f5161813640 1 Processor -- start 2024-05-16T22:27:30.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.757+0000 7f5161813640 1 -- start start 2024-05-16T22:27:30.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.758+0000 7f5161813640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f515c0b8d70 0x7f515c0c2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:30.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.758+0000 7f5161813640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f515c0bd440 0x7f515c143e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:30.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.758+0000 7f5161813640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f515c14e530 0x7f515c144360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:30.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.758+0000 7f5161813640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f515c0bbb70 con 0x7f515c14e530 2024-05-16T22:27:30.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.758+0000 7f5161813640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f515c14f2a0 con 0x7f515c0b8d70 2024-05-16T22:27:30.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.758+0000 7f5161813640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f515c14e940 con 0x7f515c0bd440 2024-05-16T22:27:30.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.758+0000 7f515b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f515c14e530 0x7f515c144360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:30.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.758+0000 7f515b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f515c14e530 0x7f515c144360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57836/0 (socket says 172.21.15.44:57836) 2024-05-16T22:27:30.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.758+0000 7f515b7fe640 1 -- 172.21.15.44:0/120524829 learned_addr learned my addr 172.21.15.44:0/120524829 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:30.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.758+0000 7f515affd640 1 --2- 172.21.15.44:0/120524829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f515c0b8d70 0x7f515c0c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:30.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.758+0000 7f515a7fc640 1 --2- 172.21.15.44:0/120524829 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f515c0bd440 0x7f515c143e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:30.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.759+0000 7f515b7fe640 1 -- 172.21.15.44:0/120524829 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f515c0bd440 msgr2=0x7f515c143e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:30.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.759+0000 7f515b7fe640 1 --2- 172.21.15.44:0/120524829 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f515c0bd440 0x7f515c143e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:30.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.759+0000 7f515b7fe640 1 -- 172.21.15.44:0/120524829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f515c0b8d70 msgr2=0x7f515c0c2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:30.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.759+0000 7f515b7fe640 1 --2- 172.21.15.44:0/120524829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f515c0b8d70 0x7f515c0c2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:30.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.759+0000 7f515b7fe640 1 -- 172.21.15.44:0/120524829 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f515c0c2d40 con 0x7f515c14e530 2024-05-16T22:27:30.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.759+0000 7f515b7fe640 1 --2- 172.21.15.44:0/120524829 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f515c14e530 0x7f515c144360 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f514c00c6e0 tx=0x7f514c00cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:30.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.759+0000 7f5153fff640 1 -- 172.21.15.44:0/120524829 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514c003b70 con 0x7f515c14e530 2024-05-16T22:27:30.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.759+0000 7f5153fff640 1 -- 172.21.15.44:0/120524829 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f514c003d10 con 0x7f515c14e530 2024-05-16T22:27:30.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.759+0000 7f5161813640 1 -- 172.21.15.44:0/120524829 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f515c140ea0 con 0x7f515c14e530 2024-05-16T22:27:30.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.759+0000 7f5153fff640 1 -- 172.21.15.44:0/120524829 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514c0052f0 con 0x7f515c14e530 2024-05-16T22:27:30.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.759+0000 7f5161813640 1 -- 172.21.15.44:0/120524829 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f515c1e8360 con 0x7f515c14e530 2024-05-16T22:27:30.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.760+0000 7f5161813640 1 -- 172.21.15.44:0/120524829 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f515c1e7e70 con 0x7f515c14e530 2024-05-16T22:27:30.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.761+0000 7f5153fff640 1 -- 172.21.15.44:0/120524829 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f514c005490 con 0x7f515c14e530 2024-05-16T22:27:30.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.761+0000 7f5153fff640 1 --2- 172.21.15.44:0/120524829 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f513c0762d0 0x7f513c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:30.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.761+0000 7f5153fff640 1 -- 172.21.15.44:0/120524829 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f514c0972d0 con 0x7f515c14e530 2024-05-16T22:27:30.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.762+0000 7f515affd640 1 --2- 172.21.15.44:0/120524829 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f513c0762d0 0x7f513c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:30.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.762+0000 7f515affd640 1 --2- 172.21.15.44:0/120524829 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f513c0762d0 0x7f513c0787e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5154005f80 tx=0x7f5154008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:30.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:30.766+0000 7f5153fff640 1 -- 172.21.15.44:0/120524829 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f514c0605f0 con 0x7f515c14e530 2024-05-16T22:27:31.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.006+0000 7f5161813640 1 -- 172.21.15.44:0/120524829 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f515c050940 con 0x7f515c14e530 2024-05-16T22:27:31.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.009+0000 7f5153fff640 1 -- 172.21.15.44:0/120524829 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+189521 (secure 0 0 0) 0x7f514c0648f0 con 0x7f515c14e530 2024-05-16T22:27:31.011 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:27:31.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.012+0000 7f5161813640 1 -- 172.21.15.44:0/120524829 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f513c0762d0 msgr2=0x7f513c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:31.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.012+0000 7f5161813640 1 --2- 172.21.15.44:0/120524829 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f513c0762d0 0x7f513c0787e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5154005f80 tx=0x7f5154008040 comp rx=0 tx=0).stop 2024-05-16T22:27:31.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.012+0000 7f5161813640 1 -- 172.21.15.44:0/120524829 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f515c14e530 msgr2=0x7f515c144360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:31.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.012+0000 7f5161813640 1 --2- 172.21.15.44:0/120524829 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f515c14e530 0x7f515c144360 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f514c00c6e0 tx=0x7f514c00cba0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.012+0000 7f5161813640 1 -- 172.21.15.44:0/120524829 shutdown_connections 2024-05-16T22:27:31.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.012+0000 7f5161813640 1 --2- 172.21.15.44:0/120524829 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f513c0762d0 0x7f513c0787e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.012+0000 7f5161813640 1 --2- 172.21.15.44:0/120524829 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f515c0bd440 0x7f515c143e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.012+0000 7f5161813640 1 --2- 172.21.15.44:0/120524829 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f515c14e530 0x7f515c144360 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.012+0000 7f5161813640 1 --2- 172.21.15.44:0/120524829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f515c0b8d70 0x7f515c0c2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.012+0000 7f5161813640 1 -- 172.21.15.44:0/120524829 >> 172.21.15.44:0/120524829 conn(0x7f515c0c0570 msgr2=0x7f515c0bdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:31.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.012+0000 7f5161813640 1 -- 172.21.15.44:0/120524829 shutdown_connections 2024-05-16T22:27:31.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.012+0000 7f5161813640 1 -- 172.21.15.44:0/120524829 wait complete. 2024-05-16T22:27:31.022 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":5,"flags":0,"active_gid":4114,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4049588098},{"type":"v1","addr":"172.21.15.70:6833","nonce":4049588098}]},"active_addr":"172.21.15.70:6833/4049588098","active_change":"2024-05-16T22:27:06.535883+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4104,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":1425437283}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":1782478527}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":2303699343}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":2213967086}]}]} 2024-05-16T22:27:31.025 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-16T22:27:31.025 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-16T22:27:31.026 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-16T22:27:31.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.137+0000 7f4a74dd5640 1 Processor -- start 2024-05-16T22:27:31.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.137+0000 7f4a74dd5640 1 -- start start 2024-05-16T22:27:31.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.138+0000 7f4a74dd5640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4a70151fc0 0x7f4a700bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.138+0000 7f4a74dd5640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4a7006da30 0x7f4a700be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.138+0000 7f4a74dd5640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a700c36f0 con 0x7f4a7006de40 2024-05-16T22:27:31.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.138+0000 7f4a74dd5640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f4a700bdc10 con 0x7f4a7006da30 2024-05-16T22:27:31.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.138+0000 7f4a74dd5640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f4a70152530 con 0x7f4a70151fc0 2024-05-16T22:27:31.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.138+0000 7f4a6dd9b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4a7006da30 0x7f4a700be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.138+0000 7f4a6dd9b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4a7006da30 0x7f4a700be940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57852/0 (socket says 172.21.15.44:57852) 2024-05-16T22:27:31.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.138+0000 7f4a6dd9b640 1 -- 172.21.15.44:0/4138573321 learned_addr learned my addr 172.21.15.44:0/4138573321 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:31.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.138+0000 7f4a6e59c640 1 --2- 172.21.15.44:0/4138573321 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4a70151fc0 0x7f4a700bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.139 INFO:tasks.ceph.mds.c.smithi044.stderr:2024-05-16T22:27:31.138+0000 7f75e77fc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-16T22:27:31.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.139+0000 7f4a6dd9b640 1 -- 172.21.15.44:0/4138573321 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4a70151fc0 msgr2=0x7f4a700bd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:31.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.139+0000 7f4a6dd9b640 1 --2- 172.21.15.44:0/4138573321 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4a70151fc0 0x7f4a700bd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.139+0000 7f4a6dd9b640 1 -- 172.21.15.44:0/4138573321 >> v1:172.21.15.70:6789/0 conn(0x7f4a7006de40 legacy=0x7f4a7014e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:31.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.139+0000 7f4a6dd9b640 1 -- 172.21.15.44:0/4138573321 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a70152810 con 0x7f4a7006da30 2024-05-16T22:27:31.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.139+0000 7f4a6e59c640 1 --2- 172.21.15.44:0/4138573321 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4a70151fc0 0x7f4a700bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:27:31.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.139+0000 7f4a6dd9b640 1 --2- 172.21.15.44:0/4138573321 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4a7006da30 0x7f4a700be940 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4a64009870 tx=0x7f4a6402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=518c15d241ac2c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:31.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.140+0000 7f4a6d59a640 1 -- 172.21.15.44:0/4138573321 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a64037070 con 0x7f4a7006da30 2024-05-16T22:27:31.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.140+0000 7f4a6d59a640 1 -- 172.21.15.44:0/4138573321 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a64032440 con 0x7f4a7006da30 2024-05-16T22:27:31.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.140+0000 7f4a6d59a640 1 -- 172.21.15.44:0/4138573321 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a64032810 con 0x7f4a7006da30 2024-05-16T22:27:31.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.140+0000 7f4a74dd5640 1 -- 172.21.15.44:0/4138573321 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4a7006da30 msgr2=0x7f4a700be940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:31.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.140+0000 7f4a74dd5640 1 --2- 172.21.15.44:0/4138573321 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4a7006da30 0x7f4a700be940 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4a64009870 tx=0x7f4a6402a270 comp rx=0 tx=0).stop 2024-05-16T22:27:31.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.140+0000 7f4a74dd5640 1 -- 172.21.15.44:0/4138573321 shutdown_connections 2024-05-16T22:27:31.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.140+0000 7f4a74dd5640 1 --2- 172.21.15.44:0/4138573321 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4a7006da30 0x7f4a700be940 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.140+0000 7f4a74dd5640 1 --2- 172.21.15.44:0/4138573321 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4a70151fc0 0x7f4a700bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.140+0000 7f4a74dd5640 1 -- 172.21.15.44:0/4138573321 >> 172.21.15.44:0/4138573321 conn(0x7f4a700c3d20 msgr2=0x7f4a700c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:31.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.140+0000 7f4a74dd5640 1 -- 172.21.15.44:0/4138573321 shutdown_connections 2024-05-16T22:27:31.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.140+0000 7f4a74dd5640 1 -- 172.21.15.44:0/4138573321 wait complete. 2024-05-16T22:27:31.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.142+0000 7f4a74dd5640 1 Processor -- start 2024-05-16T22:27:31.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.142+0000 7f4a74dd5640 1 -- start start 2024-05-16T22:27:31.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.143+0000 7f4a74dd5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a7006da30 0x7f4a700a26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.143+0000 7f4a74dd5640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4a7006de40 0x7f4a700b88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.143+0000 7f4a74dd5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4a70151fc0 0x7f4a701e4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.143+0000 7f4a74dd5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4a700a3050 con 0x7f4a70151fc0 2024-05-16T22:27:31.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.143+0000 7f4a74dd5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4a700a2ed0 con 0x7f4a7006da30 2024-05-16T22:27:31.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.143+0000 7f4a74dd5640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f4a700bee80 con 0x7f4a7006de40 2024-05-16T22:27:31.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.143+0000 7f4a6ed9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4a70151fc0 0x7f4a701e4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.143+0000 7f4a6ed9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4a70151fc0 0x7f4a701e4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57856/0 (socket says 172.21.15.44:57856) 2024-05-16T22:27:31.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.143+0000 7f4a6ed9d640 1 -- 172.21.15.44:0/2856829991 learned_addr learned my addr 172.21.15.44:0/2856829991 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:31.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.143+0000 7f4a6dd9b640 1 --2- 172.21.15.44:0/2856829991 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4a7006de40 0x7f4a700b88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.143+0000 7f4a6e59c640 1 --2- 172.21.15.44:0/2856829991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a7006da30 0x7f4a700a26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.144+0000 7f4a6ed9d640 1 -- 172.21.15.44:0/2856829991 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4a7006de40 msgr2=0x7f4a700b88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:31.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.144+0000 7f4a6ed9d640 1 --2- 172.21.15.44:0/2856829991 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4a7006de40 0x7f4a700b88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.144+0000 7f4a6ed9d640 1 -- 172.21.15.44:0/2856829991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a7006da30 msgr2=0x7f4a700a26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:31.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.144+0000 7f4a6ed9d640 1 --2- 172.21.15.44:0/2856829991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a7006da30 0x7f4a700a26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.144+0000 7f4a6ed9d640 1 -- 172.21.15.44:0/2856829991 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a700a2c10 con 0x7f4a70151fc0 2024-05-16T22:27:31.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.144+0000 7f4a6dd9b640 1 --2- 172.21.15.44:0/2856829991 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4a7006de40 0x7f4a700b88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T22:27:31.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.144+0000 7f4a6e59c640 1 --2- 172.21.15.44:0/2856829991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a7006da30 0x7f4a700a26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T22:27:31.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.144+0000 7f4a6ed9d640 1 --2- 172.21.15.44:0/2856829991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4a70151fc0 0x7f4a701e4cb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4a6800c700 tx=0x7f4a6800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:31.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.144+0000 7f4a5effd640 1 -- 172.21.15.44:0/2856829991 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a68003b70 con 0x7f4a70151fc0 2024-05-16T22:27:31.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.144+0000 7f4a5effd640 1 -- 172.21.15.44:0/2856829991 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a68003d10 con 0x7f4a70151fc0 2024-05-16T22:27:31.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.144+0000 7f4a74dd5640 1 -- 172.21.15.44:0/2856829991 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a700b8df0 con 0x7f4a70151fc0 2024-05-16T22:27:31.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.144+0000 7f4a5effd640 1 -- 172.21.15.44:0/2856829991 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6800aa70 con 0x7f4a70151fc0 2024-05-16T22:27:31.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.144+0000 7f4a74dd5640 1 -- 172.21.15.44:0/2856829991 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a7014ee60 con 0x7f4a70151fc0 2024-05-16T22:27:31.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.145+0000 7f4a74dd5640 1 -- 172.21.15.44:0/2856829991 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a70050940 con 0x7f4a70151fc0 2024-05-16T22:27:31.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.146+0000 7f4a5effd640 1 -- 172.21.15.44:0/2856829991 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4a6800ac10 con 0x7f4a70151fc0 2024-05-16T22:27:31.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.146+0000 7f4a5effd640 1 --2- 172.21.15.44:0/2856829991 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4a500762d0 0x7f4a500787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.146+0000 7f4a5effd640 1 -- 172.21.15.44:0/2856829991 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4a680974d0 con 0x7f4a70151fc0 2024-05-16T22:27:31.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.146+0000 7f4a6e59c640 1 --2- 172.21.15.44:0/2856829991 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4a500762d0 0x7f4a500787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.147+0000 7f4a6e59c640 1 --2- 172.21.15.44:0/2856829991 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4a500762d0 0x7f4a500787e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4a60009a20 tx=0x7f4a60008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:31.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.151+0000 7f4a5effd640 1 -- 172.21.15.44:0/2856829991 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4a68060e30 con 0x7f4a70151fc0 2024-05-16T22:27:31.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.343+0000 7f4a74dd5640 1 -- 172.21.15.44:0/2856829991 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4a7006eb40 con 0x7f4a70151fc0 2024-05-16T22:27:31.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.344+0000 7f4a5effd640 1 -- 172.21.15.44:0/2856829991 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16569 (secure 0 0 0) 0x7f4a68095e20 con 0x7f4a70151fc0 2024-05-16T22:27:31.343 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:27:31.344 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":21,"fsid":"572ab7cc-b103-4548-ae8f-c6614d57f0c8","created":"2024-05-16T22:27:02.216874+0000","modified":"2024-05-16T22:27:27.151884+0000","last_up_change":"2024-05-16T22:27:13.693953+0000","last_in_change":"2024-05-16T22:27:04.455119+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-16T22:27:14.562409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-16T22:27:23.458618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-16T22:27:24.495231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a7003e89-c706-4562-9f25-670bb35ae108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6825","nonce":1074109859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6827","nonce":1074109859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6831","nonce":1074109859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6829","nonce":1074109859}]},"public_addr":"172.21.15.44:6825/1074109859","cluster_addr":"172.21.15.44:6827/1074109859","heartbeat_back_addr":"172.21.15.44:6831/1074109859","heartbeat_front_addr":"172.21.15.44:6829/1074109859","state":["exists","up"]},{"osd":1,"uuid":"a4d5169d-8327-4494-9c7c-58db21b00636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6817","nonce":2909429972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6819","nonce":2909429972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6823","nonce":2909429972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6821","nonce":2909429972}]},"public_addr":"172.21.15.44:6817/2909429972","cluster_addr":"172.21.15.44:6819/2909429972","heartbeat_back_addr":"172.21.15.44:6823/2909429972","heartbeat_front_addr":"172.21.15.44:6821/2909429972","state":["exists","up"]},{"osd":2,"uuid":"d4a834f8-83a5-400f-9814-eb0a25124df4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6801","nonce":2908194156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6803","nonce":2908194156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6807","nonce":2908194156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6805","nonce":2908194156}]},"public_addr":"172.21.15.44:6801/2908194156","cluster_addr":"172.21.15.44:6803/2908194156","heartbeat_back_addr":"172.21.15.44:6807/2908194156","heartbeat_front_addr":"172.21.15.44:6805/2908194156","state":["exists","up"]},{"osd":3,"uuid":"b9d24a56-ad43-4674-a395-5ec24d135ae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6809","nonce":2168695793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6811","nonce":2168695793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6815","nonce":2168695793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6813","nonce":2168695793}]},"public_addr":"172.21.15.44:6809/2168695793","cluster_addr":"172.21.15.44:6811/2168695793","heartbeat_back_addr":"172.21.15.44:6815/2168695793","heartbeat_front_addr":"172.21.15.44:6813/2168695793","state":["exists","up"]},{"osd":4,"uuid":"9bd94af5-3e17-4cbe-995a-8f837a66c653","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6823","nonce":1540297751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6825","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6827","nonce":1540297751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6831","nonce":1540297751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6829","nonce":1540297751}]},"public_addr":"172.21.15.70:6823/1540297751","cluster_addr":"172.21.15.70:6827/1540297751","heartbeat_back_addr":"172.21.15.70:6831/1540297751","heartbeat_front_addr":"172.21.15.70:6829/1540297751","state":["exists","up"]},{"osd":5,"uuid":"a5b0cfa5-b259-48bd-98b6-96b44f5ebabd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6804","nonce":4218901987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6808","nonce":4218901987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6815","nonce":4218901987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6812","nonce":4218901987}]},"public_addr":"172.21.15.70:6804/4218901987","cluster_addr":"172.21.15.70:6808/4218901987","heartbeat_back_addr":"172.21.15.70:6815/4218901987","heartbeat_front_addr":"172.21.15.70:6812/4218901987","state":["exists","up"]},{"osd":6,"uuid":"0b6af6df-1358-4fc6-a62c-ba57e02914ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6801","nonce":2389556489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6805","nonce":2389556489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6813","nonce":2389556489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6807","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6809","nonce":2389556489}]},"public_addr":"172.21.15.70:6801/2389556489","cluster_addr":"172.21.15.70:6805/2389556489","heartbeat_back_addr":"172.21.15.70:6813/2389556489","heartbeat_front_addr":"172.21.15.70:6809/2389556489","state":["exists","up"]},{"osd":7,"uuid":"eb1a2c5d-42cf-47d0-9e03-b9d26944a589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6817","nonce":3619691281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6819","nonce":3619691281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6826","nonce":3619691281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6822","nonce":3619691281}]},"public_addr":"172.21.15.70:6817/3619691281","cluster_addr":"172.21.15.70:6819/3619691281","heartbeat_back_addr":"172.21.15.70:6826/3619691281","heartbeat_front_addr":"172.21.15.70:6822/3619691281","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.652256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.613348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.528454+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.625204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.678845+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.680829+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.556200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.647030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T22:27:31.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.346+0000 7f4a74dd5640 1 -- 172.21.15.44:0/2856829991 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4a500762d0 msgr2=0x7f4a500787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:31.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.346+0000 7f4a74dd5640 1 --2- 172.21.15.44:0/2856829991 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4a500762d0 0x7f4a500787e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4a60009a20 tx=0x7f4a60008040 comp rx=0 tx=0).stop 2024-05-16T22:27:31.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.346+0000 7f4a74dd5640 1 -- 172.21.15.44:0/2856829991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4a70151fc0 msgr2=0x7f4a701e4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:31.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.346+0000 7f4a74dd5640 1 --2- 172.21.15.44:0/2856829991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4a70151fc0 0x7f4a701e4cb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4a6800c700 tx=0x7f4a6800cbc0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.346+0000 7f4a74dd5640 1 -- 172.21.15.44:0/2856829991 shutdown_connections 2024-05-16T22:27:31.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.346+0000 7f4a74dd5640 1 --2- 172.21.15.44:0/2856829991 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4a500762d0 0x7f4a500787e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.346+0000 7f4a74dd5640 1 --2- 172.21.15.44:0/2856829991 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4a7006de40 0x7f4a700b88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.346+0000 7f4a74dd5640 1 --2- 172.21.15.44:0/2856829991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4a70151fc0 0x7f4a701e4cb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.346+0000 7f4a74dd5640 1 --2- 172.21.15.44:0/2856829991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a7006da30 0x7f4a700a26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.346+0000 7f4a74dd5640 1 -- 172.21.15.44:0/2856829991 >> 172.21.15.44:0/2856829991 conn(0x7f4a700c3d20 msgr2=0x7f4a700c0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:31.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.347+0000 7f4a74dd5640 1 -- 172.21.15.44:0/2856829991 shutdown_connections 2024-05-16T22:27:31.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.347+0000 7f4a74dd5640 1 -- 172.21.15.44:0/2856829991 wait complete. 2024-05-16T22:27:31.357 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-16T22:27:31.357 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-16T22:27:31.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.469+0000 7fa2161f2640 1 Processor -- start 2024-05-16T22:27:31.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.469+0000 7fa2161f2640 1 -- start start 2024-05-16T22:27:31.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.470+0000 7fa2161f2640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa2100bd6d0 0x7fa2100be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.470+0000 7fa2161f2640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa21006e140 con 0x7fa2100bee80 2024-05-16T22:27:31.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.470+0000 7fa2161f2640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2100c36f0 con 0x7fa210151fc0 2024-05-16T22:27:31.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.470+0000 7fa2161f2640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fa210152530 con 0x7fa2100bd6d0 2024-05-16T22:27:31.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.470+0000 7fa20ffff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fa2100bee80 0x7fa210158e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:58940/0 (socket says 172.21.15.44:58940) 2024-05-16T22:27:31.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.470+0000 7fa20ffff640 1 -- 172.21.15.44:0/568349731 learned_addr learned my addr 172.21.15.44:0/568349731 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:27:31.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.471+0000 7fa20effd640 1 --2- 172.21.15.44:0/568349731 >> v2:172.21.15.70:3300/0 conn(0x7fa2100bd6d0 0x7fa2100be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.471+0000 7fa20e7fc640 1 -- 172.21.15.44:0/568349731 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2275214282 0 0) 0x7fa208001490 con 0x7fa2100bee80 2024-05-16T22:27:31.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.471+0000 7fa20e7fc640 1 -- 172.21.15.44:0/568349731 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1f8003520 con 0x7fa2100bee80 2024-05-16T22:27:31.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.471+0000 7fa20e7fc640 1 -- 172.21.15.44:0/568349731 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2194049436 0 0) 0x7fa1f8003520 con 0x7fa2100bee80 2024-05-16T22:27:31.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.471+0000 7fa20e7fc640 1 -- 172.21.15.44:0/568349731 >> v2:172.21.15.70:3300/0 conn(0x7fa2100bd6d0 msgr2=0x7fa2100be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:31.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.471+0000 7fa20e7fc640 1 --2- 172.21.15.44:0/568349731 >> v2:172.21.15.70:3300/0 conn(0x7fa2100bd6d0 0x7fa2100be940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.471+0000 7fa20e7fc640 1 -- 172.21.15.44:0/568349731 >> v1:172.21.15.70:6789/0 conn(0x7fa210151fc0 legacy=0x7fa21006da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:31.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.471+0000 7fa20e7fc640 1 -- 172.21.15.44:0/568349731 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa210152810 con 0x7fa2100bee80 2024-05-16T22:27:31.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.471+0000 7fa20e7fc640 1 -- 172.21.15.44:0/568349731 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 568431863 0 0) 0x7fa208001c60 con 0x7fa2100bee80 2024-05-16T22:27:31.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.471+0000 7fa20e7fc640 1 -- 172.21.15.44:0/568349731 >> v1:172.21.15.44:6789/0 conn(0x7fa2100bee80 legacy=0x7fa210158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:31.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.471+0000 7fa20e7fc640 1 --2- 172.21.15.44:0/568349731 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1f8003a50 0x7fa1f8003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.471+0000 7fa20e7fc640 1 --2- 172.21.15.44:0/568349731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1f8004800 0x7fa1f8004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.471+0000 7fa20e7fc640 1 --2- 172.21.15.44:0/568349731 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa1f8005350 0x7fa1f800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.471+0000 7fa20e7fc640 1 -- 172.21.15.44:0/568349731 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa210152530 con 0x7fa1f8004800 2024-05-16T22:27:31.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.471+0000 7fa20e7fc640 1 -- 172.21.15.44:0/568349731 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f800c280 con 0x7fa1f8003a50 2024-05-16T22:27:31.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.471+0000 7fa20e7fc640 1 -- 172.21.15.44:0/568349731 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fa1f800c480 con 0x7fa1f8005350 2024-05-16T22:27:31.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.471+0000 7fa20effd640 1 --2- 172.21.15.44:0/568349731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1f8004800 0x7fa1f8004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.471+0000 7fa20f7fe640 1 --2- 172.21.15.44:0/568349731 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1f8003a50 0x7fa1f8003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.471+0000 7fa20ffff640 1 --2- 172.21.15.44:0/568349731 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa1f8005350 0x7fa1f800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.471+0000 7fa20effd640 1 -- 172.21.15.44:0/568349731 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa1f8005350 msgr2=0x7fa1f800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:31.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.471+0000 7fa20effd640 1 --2- 172.21.15.44:0/568349731 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa1f8005350 0x7fa1f800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.471+0000 7fa20effd640 1 -- 172.21.15.44:0/568349731 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1f8003a50 msgr2=0x7fa1f8003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:31.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.471+0000 7fa20effd640 1 --2- 172.21.15.44:0/568349731 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1f8003a50 0x7fa1f8003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.471+0000 7fa20effd640 1 -- 172.21.15.44:0/568349731 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1f8003520 con 0x7fa1f8004800 2024-05-16T22:27:31.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.471+0000 7fa20ffff640 1 --2- 172.21.15.44:0/568349731 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa1f8005350 0x7fa1f800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:27:31.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.471+0000 7fa20ffff640 1 -- 172.21.15.44:0/568349731 reap_dead start 2024-05-16T22:27:31.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.472+0000 7fa20effd640 1 --2- 172.21.15.44:0/568349731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1f8004800 0x7fa1f8004c10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa21006e3d0 tx=0x7fa1f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=567e266d8e228378 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:31.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.472+0000 7fa20e7fc640 1 -- 172.21.15.44:0/568349731 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa204036070 con 0x7fa1f8004800 2024-05-16T22:27:31.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.472+0000 7fa20e7fc640 1 -- 172.21.15.44:0/568349731 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa204031400 con 0x7fa1f8004800 2024-05-16T22:27:31.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.472+0000 7fa20e7fc640 1 -- 172.21.15.44:0/568349731 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa204009690 con 0x7fa1f8004800 2024-05-16T22:27:31.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.473+0000 7fa2161f2640 1 -- 172.21.15.44:0/568349731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1f8004800 msgr2=0x7fa1f8004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:31.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.473+0000 7fa2161f2640 1 --2- 172.21.15.44:0/568349731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1f8004800 0x7fa1f8004c10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa21006e3d0 tx=0x7fa1f8005830 comp rx=0 tx=0).stop 2024-05-16T22:27:31.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.473+0000 7fa2161f2640 1 -- 172.21.15.44:0/568349731 shutdown_connections 2024-05-16T22:27:31.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.473+0000 7fa2161f2640 1 --2- 172.21.15.44:0/568349731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1f8004800 0x7fa1f8004c10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.473+0000 7fa2161f2640 1 -- 172.21.15.44:0/568349731 >> 172.21.15.44:0/568349731 conn(0x7fa2100c3d20 msgr2=0x7fa2100c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:31.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.473+0000 7fa2161f2640 1 -- 172.21.15.44:0/568349731 shutdown_connections 2024-05-16T22:27:31.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.473+0000 7fa2161f2640 1 -- 172.21.15.44:0/568349731 wait complete. 2024-05-16T22:27:31.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.474+0000 7fa2161f2640 1 Processor -- start 2024-05-16T22:27:31.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.475+0000 7fa2161f2640 1 -- start start 2024-05-16T22:27:31.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.476+0000 7fa2161f2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1f8004800 0x7fa21014d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.476+0000 7fa2161f2640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa21014ddd0 0x7fa210150980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.476+0000 7fa2161f2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2101d7800 0x7fa2101d7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.476+0000 7fa2161f2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa2100bdae0 con 0x7fa2101d7800 2024-05-16T22:27:31.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.476+0000 7fa2161f2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa2100c0070 con 0x7fa1f8004800 2024-05-16T22:27:31.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.476+0000 7fa2161f2640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fa2100a2ed0 con 0x7fa21014ddd0 2024-05-16T22:27:31.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.476+0000 7fa20ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2101d7800 0x7fa2101d7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.476+0000 7fa20ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2101d7800 0x7fa2101d7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57864/0 (socket says 172.21.15.44:57864) 2024-05-16T22:27:31.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.476+0000 7fa20f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1f8004800 0x7fa21014d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.476+0000 7fa20ffff640 1 -- 172.21.15.44:0/3937816841 learned_addr learned my addr 172.21.15.44:0/3937816841 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:31.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.476+0000 7fa20effd640 1 --2- 172.21.15.44:0/3937816841 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa21014ddd0 0x7fa210150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.476+0000 7fa20ffff640 1 -- 172.21.15.44:0/3937816841 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa21014ddd0 msgr2=0x7fa210150980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:31.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.476+0000 7fa20ffff640 1 --2- 172.21.15.44:0/3937816841 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa21014ddd0 0x7fa210150980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.476+0000 7fa20ffff640 1 -- 172.21.15.44:0/3937816841 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1f8004800 msgr2=0x7fa21014d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:31.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.476+0000 7fa20ffff640 1 --2- 172.21.15.44:0/3937816841 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1f8004800 0x7fa21014d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.476+0000 7fa20ffff640 1 -- 172.21.15.44:0/3937816841 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa210150ec0 con 0x7fa2101d7800 2024-05-16T22:27:31.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.476+0000 7fa20ffff640 1 --2- 172.21.15.44:0/3937816841 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2101d7800 0x7fa2101d7c10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa208000f80 tx=0x7fa208007b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:31.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.476+0000 7fa1f7fff640 1 -- 172.21.15.44:0/3937816841 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa20800aa60 con 0x7fa2101d7800 2024-05-16T22:27:31.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.477+0000 7fa1f7fff640 1 -- 172.21.15.44:0/3937816841 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa208018070 con 0x7fa2101d7800 2024-05-16T22:27:31.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.477+0000 7fa2161f2640 1 -- 172.21.15.44:0/3937816841 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa21014ca40 con 0x7fa2101d7800 2024-05-16T22:27:31.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.477+0000 7fa1f7fff640 1 -- 172.21.15.44:0/3937816841 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa20800ae60 con 0x7fa2101d7800 2024-05-16T22:27:31.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.477+0000 7fa2161f2640 1 -- 172.21.15.44:0/3937816841 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa21014c760 con 0x7fa2101d7800 2024-05-16T22:27:31.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.478+0000 7fa2161f2640 1 -- 172.21.15.44:0/3937816841 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa21014c290 con 0x7fa2101d7800 2024-05-16T22:27:31.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.478+0000 7fa1f7fff640 1 -- 172.21.15.44:0/3937816841 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa20801d460 con 0x7fa2101d7800 2024-05-16T22:27:31.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.479+0000 7fa1f7fff640 1 --2- 172.21.15.44:0/3937816841 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fa1fc0762d0 0x7fa1fc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.479+0000 7fa1f7fff640 1 -- 172.21.15.44:0/3937816841 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa2080979d0 con 0x7fa2101d7800 2024-05-16T22:27:31.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.479+0000 7fa20f7fe640 1 --2- 172.21.15.44:0/3937816841 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fa1fc0762d0 0x7fa1fc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.480+0000 7fa20f7fe640 1 --2- 172.21.15.44:0/3937816841 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fa1fc0762d0 0x7fa1fc0787e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa200001820 tx=0x7fa200009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:31.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.484+0000 7fa1f7fff640 1 -- 172.21.15.44:0/3937816841 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa21006e140 con 0x7fa2101d7800 2024-05-16T22:27:31.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.676+0000 7fa2161f2640 1 -- 172.21.15.44:0/3937816841 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa210050940 con 0x7fa2101d7800 2024-05-16T22:27:31.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.677+0000 7fa1f7fff640 1 -- 172.21.15.44:0/3937816841 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16569 (secure 0 0 0) 0x7fa208060bb0 con 0x7fa2101d7800 2024-05-16T22:27:31.677 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:27:31.677 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":21,"fsid":"572ab7cc-b103-4548-ae8f-c6614d57f0c8","created":"2024-05-16T22:27:02.216874+0000","modified":"2024-05-16T22:27:27.151884+0000","last_up_change":"2024-05-16T22:27:13.693953+0000","last_in_change":"2024-05-16T22:27:04.455119+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-16T22:27:14.562409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-16T22:27:23.458618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-16T22:27:24.495231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a7003e89-c706-4562-9f25-670bb35ae108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6825","nonce":1074109859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6827","nonce":1074109859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6831","nonce":1074109859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6829","nonce":1074109859}]},"public_addr":"172.21.15.44:6825/1074109859","cluster_addr":"172.21.15.44:6827/1074109859","heartbeat_back_addr":"172.21.15.44:6831/1074109859","heartbeat_front_addr":"172.21.15.44:6829/1074109859","state":["exists","up"]},{"osd":1,"uuid":"a4d5169d-8327-4494-9c7c-58db21b00636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6817","nonce":2909429972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6819","nonce":2909429972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6823","nonce":2909429972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6821","nonce":2909429972}]},"public_addr":"172.21.15.44:6817/2909429972","cluster_addr":"172.21.15.44:6819/2909429972","heartbeat_back_addr":"172.21.15.44:6823/2909429972","heartbeat_front_addr":"172.21.15.44:6821/2909429972","state":["exists","up"]},{"osd":2,"uuid":"d4a834f8-83a5-400f-9814-eb0a25124df4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6801","nonce":2908194156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6803","nonce":2908194156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6807","nonce":2908194156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6805","nonce":2908194156}]},"public_addr":"172.21.15.44:6801/2908194156","cluster_addr":"172.21.15.44:6803/2908194156","heartbeat_back_addr":"172.21.15.44:6807/2908194156","heartbeat_front_addr":"172.21.15.44:6805/2908194156","state":["exists","up"]},{"osd":3,"uuid":"b9d24a56-ad43-4674-a395-5ec24d135ae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6809","nonce":2168695793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6811","nonce":2168695793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6815","nonce":2168695793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6813","nonce":2168695793}]},"public_addr":"172.21.15.44:6809/2168695793","cluster_addr":"172.21.15.44:6811/2168695793","heartbeat_back_addr":"172.21.15.44:6815/2168695793","heartbeat_front_addr":"172.21.15.44:6813/2168695793","state":["exists","up"]},{"osd":4,"uuid":"9bd94af5-3e17-4cbe-995a-8f837a66c653","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6823","nonce":1540297751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6825","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6827","nonce":1540297751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6831","nonce":1540297751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6829","nonce":1540297751}]},"public_addr":"172.21.15.70:6823/1540297751","cluster_addr":"172.21.15.70:6827/1540297751","heartbeat_back_addr":"172.21.15.70:6831/1540297751","heartbeat_front_addr":"172.21.15.70:6829/1540297751","state":["exists","up"]},{"osd":5,"uuid":"a5b0cfa5-b259-48bd-98b6-96b44f5ebabd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6804","nonce":4218901987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6808","nonce":4218901987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6815","nonce":4218901987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6812","nonce":4218901987}]},"public_addr":"172.21.15.70:6804/4218901987","cluster_addr":"172.21.15.70:6808/4218901987","heartbeat_back_addr":"172.21.15.70:6815/4218901987","heartbeat_front_addr":"172.21.15.70:6812/4218901987","state":["exists","up"]},{"osd":6,"uuid":"0b6af6df-1358-4fc6-a62c-ba57e02914ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6801","nonce":2389556489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6805","nonce":2389556489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6813","nonce":2389556489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6807","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6809","nonce":2389556489}]},"public_addr":"172.21.15.70:6801/2389556489","cluster_addr":"172.21.15.70:6805/2389556489","heartbeat_back_addr":"172.21.15.70:6813/2389556489","heartbeat_front_addr":"172.21.15.70:6809/2389556489","state":["exists","up"]},{"osd":7,"uuid":"eb1a2c5d-42cf-47d0-9e03-b9d26944a589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6817","nonce":3619691281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6819","nonce":3619691281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6826","nonce":3619691281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6822","nonce":3619691281}]},"public_addr":"172.21.15.70:6817/3619691281","cluster_addr":"172.21.15.70:6819/3619691281","heartbeat_back_addr":"172.21.15.70:6826/3619691281","heartbeat_front_addr":"172.21.15.70:6822/3619691281","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.652256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.613348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.528454+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.625204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.678845+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.680829+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.556200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.647030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T22:27:31.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.679+0000 7fa2161f2640 1 -- 172.21.15.44:0/3937816841 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fa1fc0762d0 msgr2=0x7fa1fc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:31.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.679+0000 7fa2161f2640 1 --2- 172.21.15.44:0/3937816841 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fa1fc0762d0 0x7fa1fc0787e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa200001820 tx=0x7fa200009040 comp rx=0 tx=0).stop 2024-05-16T22:27:31.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.679+0000 7fa2161f2640 1 -- 172.21.15.44:0/3937816841 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2101d7800 msgr2=0x7fa2101d7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:31.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.679+0000 7fa2161f2640 1 --2- 172.21.15.44:0/3937816841 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2101d7800 0x7fa2101d7c10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa208000f80 tx=0x7fa208007b50 comp rx=0 tx=0).stop 2024-05-16T22:27:31.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.679+0000 7fa2161f2640 1 -- 172.21.15.44:0/3937816841 shutdown_connections 2024-05-16T22:27:31.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.679+0000 7fa2161f2640 1 --2- 172.21.15.44:0/3937816841 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fa1fc0762d0 0x7fa1fc0787e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.679+0000 7fa2161f2640 1 --2- 172.21.15.44:0/3937816841 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa21014ddd0 0x7fa210150980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.679+0000 7fa2161f2640 1 --2- 172.21.15.44:0/3937816841 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2101d7800 0x7fa2101d7c10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.679+0000 7fa2161f2640 1 --2- 172.21.15.44:0/3937816841 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1f8004800 0x7fa21014d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.679+0000 7fa2161f2640 1 -- 172.21.15.44:0/3937816841 >> 172.21.15.44:0/3937816841 conn(0x7fa2100c3d20 msgr2=0x7fa2100c2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:31.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.679+0000 7fa2161f2640 1 -- 172.21.15.44:0/3937816841 shutdown_connections 2024-05-16T22:27:31.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.679+0000 7fa2161f2640 1 -- 172.21.15.44:0/3937816841 wait complete. 2024-05-16T22:27:31.690 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-16T22:27:31.690 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-16T22:27:31.691 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-16T22:27:31.691 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-16T22:27:31.692 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-16T22:27:31.692 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-16T22:27:31.692 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-16T22:27:31.693 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-16T22:27:31.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.919+0000 7f8670f3f640 1 Processor -- start 2024-05-16T22:27:31.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.919+0000 7f8670f3f640 1 -- start start 2024-05-16T22:27:31.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.919+0000 7fbcbfcaf640 1 Processor -- start 2024-05-16T22:27:31.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.919+0000 7fd32902b640 1 Processor -- start 2024-05-16T22:27:31.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.920+0000 7f4908ebd640 1 Processor -- start 2024-05-16T22:27:31.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.920+0000 7fbcbfcaf640 1 -- start start 2024-05-16T22:27:31.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.920+0000 7fbb2589f640 1 Processor -- start 2024-05-16T22:27:31.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.920+0000 7f4908ebd640 1 -- start start 2024-05-16T22:27:31.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.920+0000 7fbb2589f640 1 -- start start 2024-05-16T22:27:31.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.920+0000 7fe8a5bff640 1 Processor -- start 2024-05-16T22:27:31.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.920+0000 7fe8a5bff640 1 -- start start 2024-05-16T22:27:31.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.920+0000 7f0aa3614640 1 Processor -- start 2024-05-16T22:27:31.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.920+0000 7fd32902b640 1 -- start start 2024-05-16T22:27:31.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.921+0000 7f0aa3614640 1 -- start start 2024-05-16T22:27:31.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.921+0000 7f8670f3f640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f866403a2e0 0x7f86640cd790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.921+0000 7fb5a4a61640 1 Processor -- start 2024-05-16T22:27:31.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.922+0000 7fb5a4a61640 1 -- start start 2024-05-16T22:27:31.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.922+0000 7f8670f3f640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8664038260 0x7f866403b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.922+0000 7f4908ebd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f490414cc20 0x7f49040b5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.922+0000 7fbb2589f640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fbb20145660 0x7fbb2009fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.922+0000 7f4908ebd640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4904073190 0x7f4904156460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.922+0000 7f4908ebd640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49040701a0 con 0x7f4904072d80 2024-05-16T22:27:31.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.922+0000 7fbcbfcaf640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbcb8072e00 0x7fbcb8144b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.922+0000 7f4908ebd640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f490414d030 con 0x7f490414cc20 2024-05-16T22:27:31.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.922+0000 7f4908ebd640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f4904153140 con 0x7f4904073190 2024-05-16T22:27:31.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.922+0000 7fbcbfcaf640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbcb8073920 0x7fbcb806d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.922+0000 7fbb1effd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fbb20145660 0x7fbb2009fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.922+0000 7fbb1effd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fbb20145660 0x7fbb2009fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.44:57184/0 (socket says 172.21.15.44:57184) 2024-05-16T22:27:31.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.922+0000 7fbb2589f640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbb2006f970 0x7fbb2014b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.922+0000 7fbb1effd640 1 -- 172.21.15.44:0/3527535058 learned_addr learned my addr 172.21.15.44:0/3527535058 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:31.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.922+0000 7f866a59c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f866403a2e0 0x7f86640cd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.922+0000 7f866a59c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f866403a2e0 0x7f86640cd790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.44:50404/0 (socket says 172.21.15.44:50404) 2024-05-16T22:27:31.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.922+0000 7f866a59c640 1 -- 172.21.15.44:0/2591974182 learned_addr learned my addr 172.21.15.44:0/2591974182 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:31.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.922+0000 7f8669d9b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8664038260 0x7f866403b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.922+0000 7fe8a5bff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe8a0145660 0x7fe8a009fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.922+0000 7fbcbda4b640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbcb8072e00 0x7fbcb8144b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.922+0000 7fbcbda4b640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbcb8072e00 0x7fbcb8144b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.44:50408/0 (socket says 172.21.15.44:50408) 2024-05-16T22:27:31.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.922+0000 7fbcbda4b640 1 -- 172.21.15.44:0/2407758902 learned_addr learned my addr 172.21.15.44:0/2407758902 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:31.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.922+0000 7fe8a5bff640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe8a014bd30 0x7fe8a0155a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.922+0000 7fbb2589f640 1 -- 172.21.15.44:0/3527535058 --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb200bf8d0 con 0x7fbb2006fd80 2024-05-16T22:27:31.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.922+0000 7fbb1e7fc640 1 --2- 172.21.15.44:0/3527535058 >> v2:172.21.15.44:3300/0 conn(0x7fbb2006f970 0x7fbb2014b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.923+0000 7fbb2589f640 1 -- 172.21.15.44:0/3527535058 --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fbb200befa0 con 0x7fbb2006f970 2024-05-16T22:27:31.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.923+0000 7fbb2589f640 1 -- 172.21.15.44:0/3527535058 --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fbb200bf280 con 0x7fbb20145660 2024-05-16T22:27:31.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.923+0000 7fe89effd640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fe8a006f970 0x7fe8a014b620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.44:45540/0 (socket says 172.21.15.44:45540) 2024-05-16T22:27:31.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.923+0000 7fe89effd640 1 -- 172.21.15.44:0/2399896518 learned_addr learned my addr 172.21.15.44:0/2399896518 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:27:31.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.923+0000 7f8670f3f640 1 --2- 172.21.15.44:0/2591974182 >> v2:172.21.15.70:3300/0 conn(0x7f866403be60 0x7f86640d0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.923+0000 7fd32902b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd32406daa0 0x7fd3240be440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.923+0000 7fd32902b640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd32414eca0 0x7fd3240bd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.923+0000 7fd32902b640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3240be980 con 0x7fd32414f0b0 2024-05-16T22:27:31.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.923+0000 7fd32902b640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fd32414e810 con 0x7fd32406daa0 2024-05-16T22:27:31.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.923+0000 7fd32902b640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fd32408d930 con 0x7fd32414eca0 2024-05-16T22:27:31.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.923+0000 7fe8a5bff640 1 -- 172.21.15.44:0/2399896518 --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8a00bf8d0 con 0x7fe8a006f970 2024-05-16T22:27:31.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.923+0000 7f8670f3f640 1 -- 172.21.15.44:0/2591974182 --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f866403c440 con 0x7f8664038260 2024-05-16T22:27:31.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.923+0000 7f866ad9d640 1 --2- 172.21.15.44:0/2591974182 >> v2:172.21.15.70:3300/0 conn(0x7f866403be60 0x7f86640d0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.922+0000 7fbcbd24a640 1 --2- 172.21.15.44:0/2407758902 >> v2:172.21.15.44:3300/0 conn(0x7fbcb8073920 0x7fbcb806d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.923+0000 7f0aa3614640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f0a9c1455f0 0x7f0a9c14ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.923+0000 7f0aa3614640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0a9c0bb060 0x7f0a9c14e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.923+0000 7f0aa3614640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0a9c0bb470 0x7f0a9c14ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.923+0000 7f0aa3614640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f0a9c14b590 con 0x7f0a9c0bb470 2024-05-16T22:27:31.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.923+0000 7f0aa3614640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f0a9c0bc710 con 0x7f0a9c1455f0 2024-05-16T22:27:31.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.923+0000 7f0aa3614640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f0a9c1519b0 con 0x7f0a9c0bb060 2024-05-16T22:27:31.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.923+0000 7f8670f3f640 1 -- 172.21.15.44:0/2591974182 --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f866403b1f0 con 0x7f866403be60 2024-05-16T22:27:31.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.923+0000 7fbcbfcaf640 1 --2- 172.21.15.44:0/2407758902 >> v2:172.21.15.70:3300/0 conn(0x7fbcb8076150 0x7fbcb814abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.923+0000 7f8670f3f640 1 -- 172.21.15.44:0/2591974182 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f866403b4d0 con 0x7f866403a2e0 2024-05-16T22:27:31.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.923+0000 7fd322d9d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd32406daa0 0x7fd3240be440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.923+0000 7fd322d9d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd32406daa0 0x7fd3240be440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57930/0 (socket says 172.21.15.44:57930) 2024-05-16T22:27:31.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.923+0000 7fd322d9d640 1 -- 172.21.15.44:0/2506587776 learned_addr learned my addr 172.21.15.44:0/2506587776 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:31.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.923+0000 7fe89ffff640 1 --2- 172.21.15.44:0/2399896518 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe8a014bd30 0x7fe8a0155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.923+0000 7fbcbfcaf640 1 -- 172.21.15.44:0/2407758902 --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fbcb8074780 con 0x7fbcb8073920 2024-05-16T22:27:31.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.923+0000 7fe8a5bff640 1 -- 172.21.15.44:0/2399896518 --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fe8a00befa0 con 0x7fe8a0145660 2024-05-16T22:27:31.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.923+0000 7fbcbfcaf640 1 -- 172.21.15.44:0/2407758902 --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fbcb8073ee0 con 0x7fbcb8076150 2024-05-16T22:27:31.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.923+0000 7f0aa1bb1640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0a9c0bb470 0x7f0a9c14ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.923+0000 7f0aa1bb1640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0a9c0bb470 0x7f0a9c14ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57934/0 (socket says 172.21.15.44:57934) 2024-05-16T22:27:31.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.923+0000 7f0aa1bb1640 1 -- 172.21.15.44:0/774124159 learned_addr learned my addr 172.21.15.44:0/774124159 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:31.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.923+0000 7fbcbfcaf640 1 -- 172.21.15.44:0/2407758902 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fbcb80741c0 con 0x7fbcb8072e00 2024-05-16T22:27:31.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.923+0000 7fe8a5bff640 1 -- 172.21.15.44:0/2399896518 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fe8a00bf280 con 0x7fe8a014bd30 2024-05-16T22:27:31.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.923+0000 7fd32259c640 1 --2- 172.21.15.44:0/2506587776 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd32414eca0 0x7fd3240bd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.923+0000 7f0aa0baf640 1 --2- 172.21.15.44:0/774124159 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0a9c0bb060 0x7f0a9c14e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.923+0000 7fbcbe24c640 1 --2- 172.21.15.44:0/2407758902 >> v2:172.21.15.70:3300/0 conn(0x7fbcb8076150 0x7fbcb814abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.923+0000 7f490259c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f490414cc20 0x7f49040b5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.923+0000 7f490259c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f490414cc20 0x7f49040b5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57918/0 (socket says 172.21.15.44:57918) 2024-05-16T22:27:31.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.923+0000 7f490259c640 1 -- 172.21.15.44:0/435015927 learned_addr learned my addr 172.21.15.44:0/435015927 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:31.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.923+0000 7f4901d9b640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f4904072d80 0x7f4904155d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:58956/0 (socket says 172.21.15.44:58956) 2024-05-16T22:27:31.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.924+0000 7f0aa13b0640 1 --2- 172.21.15.44:0/774124159 >> v2:172.21.15.70:3300/0 conn(0x7f0a9c1455f0 0x7f0a9c14ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.924+0000 7fe89e7fc640 1 -- 172.21.15.44:0/2399896518 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1461298914 0 0) 0x7fe894001110 con 0x7fe8a006f970 2024-05-16T22:27:31.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.924+0000 7f866a59c640 1 -- 172.21.15.44:0/2591974182 >> v2:172.21.15.70:3300/0 conn(0x7f866403be60 msgr2=0x7f86640d0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:31.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.924+0000 7fe89e7fc640 1 -- 172.21.15.44:0/2399896518 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe888003520 con 0x7fe8a006f970 2024-05-16T22:27:31.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.924+0000 7f866a59c640 1 --2- 172.21.15.44:0/2591974182 >> v2:172.21.15.70:3300/0 conn(0x7f866403be60 0x7f86640d0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.924+0000 7f866a59c640 1 -- 172.21.15.44:0/2591974182 >> v2:172.21.15.44:3300/0 conn(0x7f8664038260 msgr2=0x7f866403b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:31.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.924+0000 7f866a59c640 1 --2- 172.21.15.44:0/2591974182 >> v2:172.21.15.44:3300/0 conn(0x7f8664038260 0x7f866403b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.924+0000 7f866a59c640 1 -- 172.21.15.44:0/2591974182 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8664038b00 con 0x7f866403a2e0 2024-05-16T22:27:31.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.924+0000 7f4902d9d640 1 --2- 172.21.15.44:0/435015927 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4904073190 0x7f4904156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.923+0000 7fbb1dffb640 1 -- 172.21.15.44:0/3527535058 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2320247213 0 0) 0x7fbb18001490 con 0x7fbb2006fd80 2024-05-16T22:27:31.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.923+0000 7fbb1dffb640 1 -- 172.21.15.44:0/3527535058 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb08003520 con 0x7fbb2006fd80 2024-05-16T22:27:31.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.923+0000 7fbb1effd640 1 -- 172.21.15.44:0/3527535058 >> v2:172.21.15.44:3300/0 conn(0x7fbb2006f970 msgr2=0x7fbb2014b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:31.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.923+0000 7fbb1effd640 1 --2- 172.21.15.44:0/3527535058 >> v2:172.21.15.44:3300/0 conn(0x7fbb2006f970 0x7fbb2014b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.923+0000 7fbb1effd640 1 -- 172.21.15.44:0/3527535058 >> v1:172.21.15.70:6789/0 conn(0x7fbb2006fd80 legacy=0x7fbb2014e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:31.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.923+0000 7fbb1effd640 1 -- 172.21.15.44:0/3527535058 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb200bf560 con 0x7fbb20145660 2024-05-16T22:27:31.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.924+0000 7fbb1e7fc640 1 --2- 172.21.15.44:0/3527535058 >> v2:172.21.15.44:3300/0 conn(0x7fbb2006f970 0x7fbb2014b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T22:27:31.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.924+0000 7fd322d9d640 1 -- 172.21.15.44:0/2506587776 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd32414eca0 msgr2=0x7fd3240bd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:31.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.924+0000 7fb5a4a61640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb5a00bb060 0x7fb5a014e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.924+0000 7fb5a4a61640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb5a00bb470 0x7fb5a014ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.924+0000 7fd322d9d640 1 --2- 172.21.15.44:0/2506587776 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd32414eca0 0x7fd3240bd0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.924+0000 7fbcbd24a640 1 -- 172.21.15.44:0/2407758902 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbcb8072e00 msgr2=0x7fbcb8144b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:31.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.924+0000 7fbcbd24a640 1 --2- 172.21.15.44:0/2407758902 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbcb8072e00 0x7fbcb8144b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.924+0000 7fbcbd24a640 1 -- 172.21.15.44:0/2407758902 >> v2:172.21.15.70:3300/0 conn(0x7fbcb8076150 msgr2=0x7fbcb814abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:31.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.924+0000 7fbcbd24a640 1 --2- 172.21.15.44:0/2407758902 >> v2:172.21.15.70:3300/0 conn(0x7fbcb8076150 0x7fbcb814abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.924+0000 7fbcbd24a640 1 -- 172.21.15.44:0/2407758902 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcb80744a0 con 0x7fbcb8073920 2024-05-16T22:27:31.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.924+0000 7fd322d9d640 1 -- 172.21.15.44:0/2506587776 >> v1:172.21.15.70:6789/0 conn(0x7fd32414f0b0 legacy=0x7fd3241519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:31.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.924+0000 7fb59ed9d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb5a00bb470 0x7fb5a014ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.924+0000 7fb59ed9d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb5a00bb470 0x7fb5a014ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.44:57224/0 (socket says 172.21.15.44:57224) 2024-05-16T22:27:31.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.924+0000 7fb59ed9d640 1 -- 172.21.15.44:0/173372250 learned_addr learned my addr 172.21.15.44:0/173372250 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:31.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.924+0000 7fb5a4a61640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5a00bc710 con 0x7fb5a01455f0 2024-05-16T22:27:31.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.924+0000 7fb5a4a61640 1 -- 172.21.15.44:0/173372250 --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fb5a014b590 con 0x7fb5a00bb060 2024-05-16T22:27:31.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.924+0000 7fb5a4a61640 1 -- 172.21.15.44:0/173372250 --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fb5a014f1c0 con 0x7fb5a00bb470 2024-05-16T22:27:31.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.924+0000 7fe89ffff640 1 -- 172.21.15.44:0/2399896518 >> v2:172.21.15.44:3300/0 conn(0x7fe8a0145660 msgr2=0x7fe8a009fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:31.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.924+0000 7fe89ffff640 1 --2- 172.21.15.44:0/2399896518 >> v2:172.21.15.44:3300/0 conn(0x7fe8a0145660 0x7fe8a009fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.924+0000 7fe89ffff640 1 -- 172.21.15.44:0/2399896518 >> v1:172.21.15.70:6789/0 conn(0x7fe8a006f970 legacy=0x7fe8a014b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:31.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.924+0000 7fe89ffff640 1 -- 172.21.15.44:0/2399896518 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8a00bf560 con 0x7fe8a014bd30 2024-05-16T22:27:31.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.924+0000 7f490159a640 1 -- 172.21.15.44:0/435015927 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2135660786 0 0) 0x7f49040701a0 con 0x7f4904072d80 2024-05-16T22:27:31.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.924+0000 7f490159a640 1 -- 172.21.15.44:0/435015927 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48ec003520 con 0x7f4904072d80 2024-05-16T22:27:31.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.924+0000 7fd322d9d640 1 -- 172.21.15.44:0/2506587776 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3240bec20 con 0x7fd32406daa0 2024-05-16T22:27:31.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.924+0000 7fbb1effd640 1 --2- 172.21.15.44:0/3527535058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb20145660 0x7fbb2009fb90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbb200c0630 tx=0x7fbb1002a1f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6ff92034d9b1a7a server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:31.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.925+0000 7f490159a640 1 -- 172.21.15.44:0/435015927 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3218358406 0 0) 0x7f48ec003520 con 0x7f4904072d80 2024-05-16T22:27:31.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.925+0000 7f490159a640 1 -- 172.21.15.44:0/435015927 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4904073190 msgr2=0x7f4904156460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:31.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.925+0000 7f490159a640 1 --2- 172.21.15.44:0/435015927 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4904073190 0x7f4904156460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.925+0000 7fbb1dffb640 1 -- 172.21.15.44:0/3527535058 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb10037070 con 0x7fbb20145660 2024-05-16T22:27:31.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.925+0000 7f490159a640 1 -- 172.21.15.44:0/435015927 >> v2:172.21.15.44:3300/0 conn(0x7f490414cc20 msgr2=0x7f49040b5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:31.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.925+0000 7f490159a640 1 --2- 172.21.15.44:0/435015927 >> v2:172.21.15.44:3300/0 conn(0x7f490414cc20 0x7f49040b5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.925+0000 7f866ad9d640 1 --2- 172.21.15.44:0/2591974182 >> v2:172.21.15.70:3300/0 conn(0x7f866403be60 0x7f86640d0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:27:31.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.925+0000 7f490159a640 1 -- 172.21.15.44:0/435015927 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4904152af0 con 0x7f4904072d80 2024-05-16T22:27:31.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.925+0000 7fbb1dffb640 1 -- 172.21.15.44:0/3527535058 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb10032440 con 0x7fbb20145660 2024-05-16T22:27:31.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.925+0000 7fbb1dffb640 1 -- 172.21.15.44:0/3527535058 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb10032810 con 0x7fbb20145660 2024-05-16T22:27:31.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.925+0000 7f490159a640 1 -- 172.21.15.44:0/435015927 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 568431863 0 0) 0x7f48f80016f0 con 0x7f4904072d80 2024-05-16T22:27:31.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.925+0000 7fd322d9d640 1 --2- 172.21.15.44:0/2506587776 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd32406daa0 0x7fd3240be440 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd3240beb50 tx=0x7fd31802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45d740bfd65c0417 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:31.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.925+0000 7f866a59c640 1 --2- 172.21.15.44:0/2591974182 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f866403a2e0 0x7f86640cd790 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f866403c810 tx=0x7f865c02b2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0928ec5096ed641 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:31.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.925+0000 7f490259c640 1 --2- 172.21.15.44:0/435015927 >> v2:172.21.15.44:3300/0 conn(0x7f490414cc20 0x7f49040b5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:27:31.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.925+0000 7fbcbe24c640 1 --2- 172.21.15.44:0/2407758902 >> v2:172.21.15.70:3300/0 conn(0x7fbcb8076150 0x7fbcb814abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T22:27:31.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.925+0000 7f490159a640 1 -- 172.21.15.44:0/435015927 >> v1:172.21.15.44:6789/0 conn(0x7f4904072d80 legacy=0x7f4904155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:31.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.925+0000 7f0aa0baf640 1 -- 172.21.15.44:0/774124159 >> v2:172.21.15.70:3300/0 conn(0x7f0a9c1455f0 msgr2=0x7f0a9c14ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:31.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.925+0000 7f0aa0baf640 1 --2- 172.21.15.44:0/774124159 >> v2:172.21.15.70:3300/0 conn(0x7f0a9c1455f0 0x7f0a9c14ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.925+0000 7f0aa0baf640 1 -- 172.21.15.44:0/774124159 >> v2:172.21.15.44:3300/0 conn(0x7f0a9c0bb470 msgr2=0x7f0a9c14ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:31.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.925+0000 7f0aa0baf640 1 --2- 172.21.15.44:0/774124159 >> v2:172.21.15.44:3300/0 conn(0x7f0a9c0bb470 0x7f0a9c14ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.925+0000 7f0aa0baf640 1 -- 172.21.15.44:0/774124159 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a9c14f1c0 con 0x7f0a9c0bb060 2024-05-16T22:27:31.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.925+0000 7f490159a640 1 --2- 172.21.15.44:0/435015927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48ec003a50 0x7f48ec003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.925+0000 7fb59dd9b640 1 -- 172.21.15.44:0/173372250 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 474090431 0 0) 0x7fb5a00bc710 con 0x7fb5a01455f0 2024-05-16T22:27:31.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.925+0000 7fb59dd9b640 1 -- 172.21.15.44:0/173372250 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb58c005730 con 0x7fb5a01455f0 2024-05-16T22:27:31.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.925+0000 7f490159a640 1 --2- 172.21.15.44:0/435015927 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48ec004800 0x7f48ec004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.925+0000 7f490159a640 1 --2- 172.21.15.44:0/435015927 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4904073190 0x7f48ec0052d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.925+0000 7f490159a640 1 -- 172.21.15.44:0/435015927 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4904153140 con 0x7f48ec003a50 2024-05-16T22:27:31.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.925+0000 7f490159a640 1 -- 172.21.15.44:0/435015927 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f48ec00bb80 con 0x7f48ec004800 2024-05-16T22:27:31.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.925+0000 7f490159a640 1 -- 172.21.15.44:0/435015927 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f48ec00bd80 con 0x7f4904073190 2024-05-16T22:27:31.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.925+0000 7f4902d9d640 1 --2- 172.21.15.44:0/435015927 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4904073190 0x7f48ec0052d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.926+0000 7f4901d9b640 1 --2- 172.21.15.44:0/435015927 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48ec004800 0x7f48ec004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.926+0000 7fd321d9b640 1 -- 172.21.15.44:0/2506587776 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd318037070 con 0x7fd32406daa0 2024-05-16T22:27:31.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.926+0000 7fd321d9b640 1 -- 172.21.15.44:0/2506587776 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd318032440 con 0x7fd32406daa0 2024-05-16T22:27:31.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.926+0000 7fd321d9b640 1 -- 172.21.15.44:0/2506587776 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd318032810 con 0x7fd32406daa0 2024-05-16T22:27:31.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.926+0000 7f490259c640 1 --2- 172.21.15.44:0/435015927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48ec003a50 0x7f48ec003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.926+0000 7f4902d9d640 1 -- 172.21.15.44:0/435015927 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48ec004800 msgr2=0x7f48ec004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:31.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.926+0000 7fbcbd24a640 1 --2- 172.21.15.44:0/2407758902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcb8073920 0x7fbcb806d6f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbcb806f060 tx=0x7fbca802e5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfa7aa2cf28fade9 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:31.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.926+0000 7f866959a640 1 -- 172.21.15.44:0/2591974182 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f865c0089e0 con 0x7f866403a2e0 2024-05-16T22:27:31.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.926+0000 7f4902d9d640 1 --2- 172.21.15.44:0/435015927 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48ec004800 0x7f48ec004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.926+0000 7f4902d9d640 1 -- 172.21.15.44:0/435015927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48ec003a50 msgr2=0x7f48ec003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:31.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.926+0000 7f4902d9d640 1 --2- 172.21.15.44:0/435015927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48ec003a50 0x7f48ec003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.926+0000 7f4902d9d640 1 -- 172.21.15.44:0/435015927 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48ec003520 con 0x7f4904073190 2024-05-16T22:27:31.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.926+0000 7fb595d9b640 1 --2- 172.21.15.44:0/173372250 >> v2:172.21.15.44:3300/0 conn(0x7fb5a00bb060 0x7fb5a014e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.926+0000 7f866959a640 1 -- 172.21.15.44:0/2591974182 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f865c008b80 con 0x7f866403a2e0 2024-05-16T22:27:31.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.926+0000 7f866959a640 1 -- 172.21.15.44:0/2591974182 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f865c00a0d0 con 0x7f866403a2e0 2024-05-16T22:27:31.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.926+0000 7fb59dd9b640 1 -- 172.21.15.44:0/173372250 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 423377227 0 0) 0x7fb58c005730 con 0x7fb5a01455f0 2024-05-16T22:27:31.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.926+0000 7fb59dd9b640 1 -- 172.21.15.44:0/173372250 >> v2:172.21.15.70:3300/0 conn(0x7fb5a00bb470 msgr2=0x7fb5a014ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:31.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.926+0000 7fb59dd9b640 1 --2- 172.21.15.44:0/173372250 >> v2:172.21.15.70:3300/0 conn(0x7fb5a00bb470 0x7fb5a014ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.926+0000 7fb59dd9b640 1 -- 172.21.15.44:0/173372250 >> v2:172.21.15.44:3300/0 conn(0x7fb5a00bb060 msgr2=0x7fb5a014e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:31.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.926+0000 7fb59dd9b640 1 --2- 172.21.15.44:0/173372250 >> v2:172.21.15.44:3300/0 conn(0x7fb5a00bb060 0x7fb5a014e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.926+0000 7fb59dd9b640 1 -- 172.21.15.44:0/173372250 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5a014b220 con 0x7fb5a01455f0 2024-05-16T22:27:31.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.926+0000 7fe89ffff640 1 --2- 172.21.15.44:0/2399896518 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe8a014bd30 0x7fe8a0155a90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe898009d90 tx=0x7fe89802a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=976081f4246814ff server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:31.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.926+0000 7f490259c640 1 --2- 172.21.15.44:0/435015927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48ec003a50 0x7f48ec003ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T22:27:31.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.926+0000 7fb59dd9b640 1 -- 172.21.15.44:0/173372250 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 568431863 0 0) 0x7fb5880016d0 con 0x7fb5a01455f0 2024-05-16T22:27:31.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.926+0000 7fb59dd9b640 1 -- 172.21.15.44:0/173372250 >> v1:172.21.15.44:6789/0 conn(0x7fb5a01455f0 legacy=0x7fb5a014ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:31.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.926+0000 7fb59dd9b640 1 --2- 172.21.15.44:0/173372250 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb58c005c80 0x7fb58c006110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.926+0000 7fb59dd9b640 1 --2- 172.21.15.44:0/173372250 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb58c006a10 0x7fb58c006e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.926+0000 7fb59dd9b640 1 --2- 172.21.15.44:0/173372250 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb58c007440 0x7fb58c00dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.926+0000 7fb59dd9b640 1 -- 172.21.15.44:0/173372250 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a014b590 con 0x7fb58c005c80 2024-05-16T22:27:31.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.926+0000 7fb59dd9b640 1 -- 172.21.15.44:0/173372250 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a014f1c0 con 0x7fb58c006a10 2024-05-16T22:27:31.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.926+0000 7fb59dd9b640 1 -- 172.21.15.44:0/173372250 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fb58c00e410 con 0x7fb58c007440 2024-05-16T22:27:31.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.926+0000 7fe89e7fc640 1 -- 172.21.15.44:0/2399896518 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe898007740 con 0x7fe8a014bd30 2024-05-16T22:27:31.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.926+0000 7fe89e7fc640 1 -- 172.21.15.44:0/2399896518 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8980078e0 con 0x7fe8a014bd30 2024-05-16T22:27:31.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.926+0000 7fbb2589f640 1 -- 172.21.15.44:0/3527535058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb20145660 msgr2=0x7fbb2009fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:31.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.927+0000 7fbb2589f640 1 --2- 172.21.15.44:0/3527535058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb20145660 0x7fbb2009fb90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbb200c0630 tx=0x7fbb1002a1f0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.927+0000 7fe89e7fc640 1 -- 172.21.15.44:0/2399896518 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe898007cf0 con 0x7fe8a014bd30 2024-05-16T22:27:31.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.927+0000 7fb59ed9d640 1 --2- 172.21.15.44:0/173372250 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb58c007440 0x7fb58c00dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.927+0000 7fb59e59c640 1 --2- 172.21.15.44:0/173372250 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb58c005c80 0x7fb58c006110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.927+0000 7fbb2589f640 1 -- 172.21.15.44:0/3527535058 shutdown_connections 2024-05-16T22:27:31.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.927+0000 7fbb2589f640 1 --2- 172.21.15.44:0/3527535058 >> v2:172.21.15.44:3300/0 conn(0x7fbb2006f970 0x7fbb2014b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.927+0000 7fbb2589f640 1 --2- 172.21.15.44:0/3527535058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb20145660 0x7fbb2009fb90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.927+0000 7fbb2589f640 1 -- 172.21.15.44:0/3527535058 >> 172.21.15.44:0/3527535058 conn(0x7fbb200bd1d0 msgr2=0x7fbb200bd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:31.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.927+0000 7fbcbca49640 1 -- 172.21.15.44:0/2407758902 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca803a070 con 0x7fbcb8073920 2024-05-16T22:27:31.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.927+0000 7fbcbca49640 1 -- 172.21.15.44:0/2407758902 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbca8033710 con 0x7fbcb8073920 2024-05-16T22:27:31.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.927+0000 7f0aa0baf640 1 --2- 172.21.15.44:0/774124159 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0a9c0bb060 0x7f0a9c14e680 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c06e830 tx=0x7f0a9402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec89a906d14f016 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:31.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.927+0000 7fd32902b640 1 -- 172.21.15.44:0/2506587776 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd32406daa0 msgr2=0x7fd3240be440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:31.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.927+0000 7fd32902b640 1 --2- 172.21.15.44:0/2506587776 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd32406daa0 0x7fd3240be440 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd3240beb50 tx=0x7fd31802a1a0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.927+0000 7f0a93fff640 1 -- 172.21.15.44:0/774124159 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a94007740 con 0x7f0a9c0bb060 2024-05-16T22:27:31.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.927+0000 7f0a93fff640 1 -- 172.21.15.44:0/774124159 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a940078e0 con 0x7f0a9c0bb060 2024-05-16T22:27:31.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.927+0000 7f0a93fff640 1 -- 172.21.15.44:0/774124159 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a94007740 con 0x7f0a9c0bb060 2024-05-16T22:27:31.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.927+0000 7fd32902b640 1 -- 172.21.15.44:0/2506587776 shutdown_connections 2024-05-16T22:27:31.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.927+0000 7fd32902b640 1 --2- 172.21.15.44:0/2506587776 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd32414eca0 0x7fd3240bd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.927+0000 7fd32902b640 1 --2- 172.21.15.44:0/2506587776 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd32406daa0 0x7fd3240be440 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.927+0000 7fd32902b640 1 -- 172.21.15.44:0/2506587776 >> 172.21.15.44:0/2506587776 conn(0x7fd3240c3b40 msgr2=0x7fd3240c3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:31.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.927+0000 7fb595d9b640 1 --2- 172.21.15.44:0/173372250 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb58c006a10 0x7fb58c006e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.927+0000 7fb59e59c640 1 -- 172.21.15.44:0/173372250 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb58c007440 msgr2=0x7fb58c00dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:31.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.927+0000 7fb59e59c640 1 --2- 172.21.15.44:0/173372250 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb58c007440 0x7fb58c00dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.927+0000 7fb59e59c640 1 -- 172.21.15.44:0/173372250 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb58c006a10 msgr2=0x7fb58c006e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:31.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.927+0000 7fb59e59c640 1 --2- 172.21.15.44:0/173372250 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb58c006a10 0x7fb58c006e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.927+0000 7fd32902b640 1 -- 172.21.15.44:0/2506587776 shutdown_connections 2024-05-16T22:27:31.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.927+0000 7fb59e59c640 1 -- 172.21.15.44:0/173372250 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5a014b220 con 0x7fb58c005c80 2024-05-16T22:27:31.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.927+0000 7fb59ed9d640 1 --2- 172.21.15.44:0/173372250 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb58c007440 0x7fb58c00dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:27:31.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.927+0000 7fb59ed9d640 1 -- 172.21.15.44:0/173372250 reap_dead start 2024-05-16T22:27:31.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.927+0000 7fb595d9b640 1 --2- 172.21.15.44:0/173372250 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb58c006a10 0x7fb58c006e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T22:27:31.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.927+0000 7fd32902b640 1 -- 172.21.15.44:0/2506587776 wait complete. 2024-05-16T22:27:31.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.927+0000 7fbb2589f640 1 -- 172.21.15.44:0/3527535058 shutdown_connections 2024-05-16T22:27:31.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.928+0000 7fe8a5bff640 1 -- 172.21.15.44:0/2399896518 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe8a014bd30 msgr2=0x7fe8a0155a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:31.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.928+0000 7fe8a5bff640 1 --2- 172.21.15.44:0/2399896518 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe8a014bd30 0x7fe8a0155a90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe898009d90 tx=0x7fe89802a680 comp rx=0 tx=0).stop 2024-05-16T22:27:31.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.928+0000 7f8670f3f640 1 -- 172.21.15.44:0/2591974182 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f866403a2e0 msgr2=0x7f86640cd790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:31.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.928+0000 7f8670f3f640 1 --2- 172.21.15.44:0/2591974182 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f866403a2e0 0x7f86640cd790 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f866403c810 tx=0x7f865c02b2a0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.927+0000 7fbcbca49640 1 -- 172.21.15.44:0/2407758902 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca8033ae0 con 0x7fbcb8073920 2024-05-16T22:27:31.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.928+0000 7fbb2589f640 1 -- 172.21.15.44:0/3527535058 wait complete. 2024-05-16T22:27:31.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.928+0000 7fe8a5bff640 1 -- 172.21.15.44:0/2399896518 shutdown_connections 2024-05-16T22:27:31.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.928+0000 7fe8a5bff640 1 --2- 172.21.15.44:0/2399896518 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe8a014bd30 0x7fe8a0155a90 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.928+0000 7fe8a5bff640 1 --2- 172.21.15.44:0/2399896518 >> v2:172.21.15.44:3300/0 conn(0x7fe8a0145660 0x7fe8a009fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.928+0000 7fe8a5bff640 1 -- 172.21.15.44:0/2399896518 >> 172.21.15.44:0/2399896518 conn(0x7fe8a00bd1d0 msgr2=0x7fe8a00bd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:31.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.928+0000 7f4902d9d640 1 --2- 172.21.15.44:0/435015927 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4904073190 0x7f48ec0052d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f490406ec20 tx=0x7f48ec005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11e28ca519756ab1 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:31.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.928+0000 7fbcbfcaf640 1 -- 172.21.15.44:0/2407758902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcb8073920 msgr2=0x7fbcb806d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:31.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.928+0000 7fbcbfcaf640 1 --2- 172.21.15.44:0/2407758902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcb8073920 0x7fbcb806d6f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbcb806f060 tx=0x7fbca802e5b0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.928+0000 7fe8a5bff640 1 -- 172.21.15.44:0/2399896518 shutdown_connections 2024-05-16T22:27:31.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.928+0000 7fe8a5bff640 1 -- 172.21.15.44:0/2399896518 wait complete. 2024-05-16T22:27:31.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.928+0000 7f490159a640 1 -- 172.21.15.44:0/435015927 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48fc036070 con 0x7f4904073190 2024-05-16T22:27:31.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.928+0000 7fbcbfcaf640 1 -- 172.21.15.44:0/2407758902 shutdown_connections 2024-05-16T22:27:31.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.928+0000 7f490159a640 1 -- 172.21.15.44:0/435015927 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48fc031400 con 0x7f4904073190 2024-05-16T22:27:31.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.928+0000 7f490159a640 1 -- 172.21.15.44:0/435015927 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48fc009690 con 0x7f4904073190 2024-05-16T22:27:31.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.928+0000 7fbcbfcaf640 1 --2- 172.21.15.44:0/2407758902 >> v2:172.21.15.70:3300/0 conn(0x7fbcb8076150 0x7fbcb814abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.928+0000 7fb59e59c640 1 --2- 172.21.15.44:0/173372250 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb58c005c80 0x7fb58c006110 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb588001900 tx=0x7fb58c007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92c5cfba267c9bdc server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:31.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.928+0000 7fbcbfcaf640 1 --2- 172.21.15.44:0/2407758902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcb8073920 0x7fbcb806d6f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.928+0000 7fbcbfcaf640 1 --2- 172.21.15.44:0/2407758902 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbcb8072e00 0x7fbcb8144b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.928+0000 7fbcbfcaf640 1 -- 172.21.15.44:0/2407758902 >> 172.21.15.44:0/2407758902 conn(0x7fbcb806f390 msgr2=0x7fbcb806f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:31.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.929+0000 7fb59dd9b640 1 -- 172.21.15.44:0/173372250 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb588007c40 con 0x7fb58c005c80 2024-05-16T22:27:31.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.929+0000 7f0aa3614640 1 -- 172.21.15.44:0/774124159 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0a9c0bb060 msgr2=0x7f0a9c14e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:31.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.929+0000 7f0aa3614640 1 --2- 172.21.15.44:0/774124159 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0a9c0bb060 0x7f0a9c14e680 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c06e830 tx=0x7f0a9402a660 comp rx=0 tx=0).stop 2024-05-16T22:27:31.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.929+0000 7fb59dd9b640 1 -- 172.21.15.44:0/173372250 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb588005270 con 0x7fb58c005c80 2024-05-16T22:27:31.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.929+0000 7fb59dd9b640 1 -- 172.21.15.44:0/173372250 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb588007c40 con 0x7fb58c005c80 2024-05-16T22:27:31.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.929+0000 7f0aa3614640 1 -- 172.21.15.44:0/774124159 shutdown_connections 2024-05-16T22:27:31.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.929+0000 7f0aa3614640 1 --2- 172.21.15.44:0/774124159 >> v2:172.21.15.44:3300/0 conn(0x7f0a9c0bb470 0x7f0a9c14ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.929+0000 7f0aa3614640 1 --2- 172.21.15.44:0/774124159 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0a9c0bb060 0x7f0a9c14e680 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.929+0000 7fbcbfcaf640 1 -- 172.21.15.44:0/2407758902 shutdown_connections 2024-05-16T22:27:31.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.929+0000 7f0aa3614640 1 --2- 172.21.15.44:0/774124159 >> v2:172.21.15.70:3300/0 conn(0x7f0a9c1455f0 0x7f0a9c14ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.929+0000 7f0aa3614640 1 -- 172.21.15.44:0/774124159 >> 172.21.15.44:0/774124159 conn(0x7f0a9c0bd160 msgr2=0x7f0a9c0bd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:31.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.929+0000 7fbcbfcaf640 1 -- 172.21.15.44:0/2407758902 wait complete. 2024-05-16T22:27:31.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.930+0000 7f4908ebd640 1 -- 172.21.15.44:0/435015927 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4904073190 msgr2=0x7f48ec0052d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:31.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.930+0000 7f4908ebd640 1 --2- 172.21.15.44:0/435015927 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4904073190 0x7f48ec0052d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f490406ec20 tx=0x7f48ec005830 comp rx=0 tx=0).stop 2024-05-16T22:27:31.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.930+0000 7f4902d9d640 1 -- 172.21.15.44:0/435015927 reap_dead start 2024-05-16T22:27:31.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.930+0000 7f4908ebd640 1 -- 172.21.15.44:0/435015927 shutdown_connections 2024-05-16T22:27:31.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.930+0000 7f4908ebd640 1 -- 172.21.15.44:0/435015927 >> 172.21.15.44:0/435015927 conn(0x7f49040bc4f0 msgr2=0x7f49040bc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:31.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.930+0000 7f8670f3f640 1 -- 172.21.15.44:0/2591974182 shutdown_connections 2024-05-16T22:27:31.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.930+0000 7f8670f3f640 1 --2- 172.21.15.44:0/2591974182 >> v2:172.21.15.70:3300/0 conn(0x7f866403be60 0x7f86640d0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.930+0000 7f8670f3f640 1 --2- 172.21.15.44:0/2591974182 >> v2:172.21.15.44:3300/0 conn(0x7f8664038260 0x7f866403b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.930+0000 7f8670f3f640 1 --2- 172.21.15.44:0/2591974182 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f866403a2e0 0x7f86640cd790 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.930+0000 7f8670f3f640 1 -- 172.21.15.44:0/2591974182 >> 172.21.15.44:0/2591974182 conn(0x7f866403f6b0 msgr2=0x7f8664006110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:31.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.930+0000 7f4908ebd640 1 -- 172.21.15.44:0/435015927 shutdown_connections 2024-05-16T22:27:31.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.930+0000 7f4908ebd640 1 -- 172.21.15.44:0/435015927 wait complete. 2024-05-16T22:27:31.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.930+0000 7fb5a4a61640 1 -- 172.21.15.44:0/173372250 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb58c005c80 msgr2=0x7fb58c006110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:31.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.930+0000 7fb5a4a61640 1 --2- 172.21.15.44:0/173372250 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb58c005c80 0x7fb58c006110 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb588001900 tx=0x7fb58c007a40 comp rx=0 tx=0).stop 2024-05-16T22:27:31.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.930+0000 7fb5a4a61640 1 -- 172.21.15.44:0/173372250 shutdown_connections 2024-05-16T22:27:31.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.930+0000 7fb5a4a61640 1 --2- 172.21.15.44:0/173372250 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb58c005c80 0x7fb58c006110 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.930+0000 7fb5a4a61640 1 -- 172.21.15.44:0/173372250 >> 172.21.15.44:0/173372250 conn(0x7fb5a00bd160 msgr2=0x7fb5a00bd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:31.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.930+0000 7fb5a4a61640 1 -- 172.21.15.44:0/173372250 shutdown_connections 2024-05-16T22:27:31.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.930+0000 7f0aa3614640 1 -- 172.21.15.44:0/774124159 shutdown_connections 2024-05-16T22:27:31.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.930+0000 7fb5a4a61640 1 -- 172.21.15.44:0/173372250 wait complete. 2024-05-16T22:27:31.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.931+0000 7fbb2589f640 1 Processor -- start 2024-05-16T22:27:31.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.931+0000 7fe8a5bff640 1 Processor -- start 2024-05-16T22:27:31.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.930+0000 7f0aa3614640 1 -- 172.21.15.44:0/774124159 wait complete. 2024-05-16T22:27:31.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.931+0000 7fd32902b640 1 Processor -- start 2024-05-16T22:27:31.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.931+0000 7fbb2589f640 1 -- start start 2024-05-16T22:27:31.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.931+0000 7fe8a5bff640 1 -- start start 2024-05-16T22:27:31.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.931+0000 7f8670f3f640 1 -- 172.21.15.44:0/2591974182 shutdown_connections 2024-05-16T22:27:31.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.931+0000 7f8670f3f640 1 -- 172.21.15.44:0/2591974182 wait complete. 2024-05-16T22:27:31.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.931+0000 7fd32902b640 1 -- start start 2024-05-16T22:27:31.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.931+0000 7fbcbfcaf640 1 Processor -- start 2024-05-16T22:27:31.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.932+0000 7fbcbfcaf640 1 -- start start 2024-05-16T22:27:31.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.932+0000 7f4908ebd640 1 Processor -- start 2024-05-16T22:27:31.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.933+0000 7f4908ebd640 1 -- start start 2024-05-16T22:27:31.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.933+0000 7fe8a5bff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8a006f970 0x7fe8a014dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.933+0000 7fd32902b640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd32406daa0 0x7fd32413e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.933+0000 7fd32902b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd32414eca0 0x7fd32414c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.933+0000 7fd32902b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd32414f0b0 0x7fd32414c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.933+0000 7fd32902b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd32414e470 con 0x7fd32414f0b0 2024-05-16T22:27:31.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.933+0000 7fd32902b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd32406deb0 con 0x7fd32414eca0 2024-05-16T22:27:31.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.933+0000 7fd32902b640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fd3240c3490 con 0x7fd32406daa0 2024-05-16T22:27:31.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.933+0000 7fbb2589f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb2006f970 0x7fbb200b95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.933+0000 7fbb2589f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb2006fd80 0x7fbb20145b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.933+0000 7fbb2589f640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbb20145660 0x7fbb201460a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.933+0000 7fbb2589f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbb200bed40 con 0x7fbb2006fd80 2024-05-16T22:27:31.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.933+0000 7fbb2589f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbb200bebc0 con 0x7fbb2006f970 2024-05-16T22:27:31.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.933+0000 7fbb2589f640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fbb2014bb60 con 0x7fbb20145660 2024-05-16T22:27:31.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.933+0000 7fd32359e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd32414f0b0 0x7fd32414c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.933+0000 7fd32359e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd32414f0b0 0x7fd32414c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57972/0 (socket says 172.21.15.44:57972) 2024-05-16T22:27:31.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.933+0000 7fd32359e640 1 -- 172.21.15.44:0/1630207845 learned_addr learned my addr 172.21.15.44:0/1630207845 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:31.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.934+0000 7fbb1e7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb2006fd80 0x7fbb20145b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.934+0000 7fbb1e7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb2006fd80 0x7fbb20145b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57986/0 (socket says 172.21.15.44:57986) 2024-05-16T22:27:31.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.934+0000 7fbb1e7fc640 1 -- 172.21.15.44:0/3694284757 learned_addr learned my addr 172.21.15.44:0/3694284757 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:31.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.934+0000 7fe8a5bff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8a0145660 0x7fe8a014c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.934+0000 7fe8a5bff640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe8a014bd30 0x7fe8a014c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.934+0000 7fe8a5bff640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a00bed40 con 0x7fe8a006f970 2024-05-16T22:27:31.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.934+0000 7fb5a4a61640 1 Processor -- start 2024-05-16T22:27:31.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.934+0000 7fbb1f7fe640 1 --2- 172.21.15.44:0/3694284757 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbb20145660 0x7fbb201460a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.934+0000 7fb5a4a61640 1 -- start start 2024-05-16T22:27:31.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.934+0000 7fbb1effd640 1 --2- 172.21.15.44:0/3694284757 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb2006f970 0x7fbb200b95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.934+0000 7f8670f3f640 1 Processor -- start 2024-05-16T22:27:31.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.934+0000 7fd32259c640 1 --2- 172.21.15.44:0/1630207845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd32414eca0 0x7fd32414c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.934+0000 7f8670f3f640 1 -- start start 2024-05-16T22:27:31.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.934+0000 7fd32359e640 1 -- 172.21.15.44:0/1630207845 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd32406daa0 msgr2=0x7fd32413e700 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-16T22:27:31.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.934+0000 7fd32359e640 1 --2- 172.21.15.44:0/1630207845 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd32406daa0 0x7fd32413e700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.934+0000 7fd32359e640 1 -- 172.21.15.44:0/1630207845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd32414eca0 msgr2=0x7fd32414c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:31.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.934+0000 7fbb1f7fe640 1 -- 172.21.15.44:0/3694284757 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb2006f970 msgr2=0x7fbb200b95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:31.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.934+0000 7fbb1f7fe640 1 --2- 172.21.15.44:0/3694284757 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb2006f970 0x7fbb200b95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.934+0000 7fbb1f7fe640 1 -- 172.21.15.44:0/3694284757 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb2006fd80 msgr2=0x7fbb20145b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:31.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.934+0000 7fbb1f7fe640 1 --2- 172.21.15.44:0/3694284757 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb2006fd80 0x7fbb20145b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.934+0000 7fbb1f7fe640 1 -- 172.21.15.44:0/3694284757 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb200b9b30 con 0x7fbb20145660 2024-05-16T22:27:31.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.934+0000 7fd32359e640 1 --2- 172.21.15.44:0/1630207845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd32414eca0 0x7fd32414c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.934+0000 7fd32359e640 1 -- 172.21.15.44:0/1630207845 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd32413ec40 con 0x7fd32414f0b0 2024-05-16T22:27:31.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.934+0000 7fbcbfcaf640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbcb8072e00 0x7fbcb80bde80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.934+0000 7fe89f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8a006f970 0x7fe8a014dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.934+0000 7fe89f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8a006f970 0x7fe8a014dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57966/0 (socket says 172.21.15.44:57966) 2024-05-16T22:27:31.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.934+0000 7fe89f7fe640 1 -- 172.21.15.44:0/798096268 learned_addr learned my addr 172.21.15.44:0/798096268 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:31.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.934+0000 7fe8a5bff640 1 -- 172.21.15.44:0/798096268 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a00bebc0 con 0x7fe8a0145660 2024-05-16T22:27:31.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.934+0000 7fe8a5bff640 1 -- 172.21.15.44:0/798096268 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fe8a006fd80 con 0x7fe8a014bd30 2024-05-16T22:27:31.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.935+0000 7fe89ffff640 1 --2- 172.21.15.44:0/798096268 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe8a014bd30 0x7fe8a014c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.935+0000 7fbb1f7fe640 1 --2- 172.21.15.44:0/3694284757 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbb20145660 0x7fbb201460a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbb180021c0 tx=0x7fbb180021f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:31.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.935+0000 7fd32359e640 1 --2- 172.21.15.44:0/1630207845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd32414f0b0 0x7fd32414c800 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd31c00ba10 tx=0x7fd31c00bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:31.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.935+0000 7fbcbfcaf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbcb8073920 0x7fbcb8149820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.935+0000 7fd32259c640 1 --2- 172.21.15.44:0/1630207845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd32414eca0 0x7fd32414c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:27:31.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.935+0000 7fe89effd640 1 --2- 172.21.15.44:0/798096268 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8a0145660 0x7fe8a014c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.935+0000 7fbcbfcaf640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcb8076150 0x7fbcb8148a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.935+0000 7fbcbda4b640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbcb8072e00 0x7fbcb80bde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.935+0000 7f4908ebd640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4904073190 0x7f49041479a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.935+0000 7f4908ebd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49040be910 0x7f49040bb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.935+0000 7f4908ebd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49040bbb20 0x7f4904141f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.935+0000 7f4908ebd640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f49041535d0 con 0x7f49040be910 2024-05-16T22:27:31.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.935+0000 7f4908ebd640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4904152800 con 0x7f49040bbb20 2024-05-16T22:27:31.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.935+0000 7f4908ebd640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f49040bf320 con 0x7f4904073190 2024-05-16T22:27:31.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.935+0000 7fbcbda4b640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbcb8072e00 0x7fbcb80bde80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.44:50506/0 (socket says 172.21.15.44:50506) 2024-05-16T22:27:31.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.933+0000 7f0aa3614640 1 Processor -- start 2024-05-16T22:27:31.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.933+0000 7f0aa3614640 1 -- start start 2024-05-16T22:27:31.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.935+0000 7f0aa3614640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0a9c0bb060 0x7f0a9c146660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.935+0000 7f0aa3614640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a9c0bb470 0x7f0a9c147470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.935+0000 7f0aa3614640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a9c1455f0 0x7f0a9c14f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:31.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.935+0000 7fd30b7fe640 1 -- 172.21.15.44:0/1630207845 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31c019070 con 0x7fd32414f0b0 2024-05-16T22:27:31.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.935+0000 7fbcbd24a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbcb8073920 0x7fbcb8149820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.935+0000 7f0aa13b0640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0a9c0bb060 0x7f0a9c146660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.935+0000 7fbcbd24a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbcb8073920 0x7fbcb8149820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.44:57262/0 (socket says 172.21.15.44:57262) 2024-05-16T22:27:31.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.935+0000 7fd30b7fe640 1 -- 172.21.15.44:0/1630207845 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd31c00cb40 con 0x7fd32414f0b0 2024-05-16T22:27:31.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.935+0000 7f490259c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4904073190 0x7f49041479a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.935+0000 7fd30b7fe640 1 -- 172.21.15.44:0/1630207845 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31c014440 con 0x7fd32414f0b0 2024-05-16T22:27:31.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.935+0000 7fbcbe24c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcb8076150 0x7fbcb8148a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.935+0000 7fbb07fff640 1 -- 172.21.15.44:0/3694284757 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb18003b70 con 0x7fbb20145660 2024-05-16T22:27:31.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.935+0000 7fbb07fff640 1 -- 172.21.15.44:0/3694284757 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb18003d10 con 0x7fbb20145660 2024-05-16T22:27:31.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.935+0000 7fbb07fff640 1 -- 172.21.15.44:0/3694284757 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb18005310 con 0x7fbb20145660 2024-05-16T22:27:31.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.935+0000 7f0aa13b0640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0a9c0bb060 0x7f0a9c146660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.44:50516/0 (socket says 172.21.15.44:50516) 2024-05-16T22:27:31.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.935+0000 7f0aa0baf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a9c0bb470 0x7f0a9c147470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.935+0000 7f4902d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49040bbb20 0x7f4904141f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.935+0000 7f0aa13b0640 1 -- 172.21.15.44:0/2247389309 learned_addr learned my addr 172.21.15.44:0/2247389309 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:31.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.935+0000 7f0aa3614640 1 -- 172.21.15.44:0/2247389309 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0a9c14f4a0 con 0x7f0a9c1455f0 2024-05-16T22:27:31.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.935+0000 7f0aa3614640 1 -- 172.21.15.44:0/2247389309 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0a9c14bf60 con 0x7f0a9c0bb470 2024-05-16T22:27:31.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.935+0000 7f0aa3614640 1 -- 172.21.15.44:0/2247389309 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f0a9c073120 con 0x7f0a9c0bb060 2024-05-16T22:27:31.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.935+0000 7f4901d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49040be910 0x7f49040bb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:31.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.935+0000 7fbb2589f640 1 -- 172.21.15.44:0/3694284757 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb20148790 con 0x7fbb20145660 2024-05-16T22:27:31.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.935+0000 7f490259c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4904073190 0x7f49041479a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.44:50528/0 (socket says 172.21.15.44:50528) 2024-05-16T22:27:31.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.935+0000 7f490259c640 1 -- 172.21.15.44:0/1986853453 learned_addr learned my addr 172.21.15.44:0/1986853453 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:31.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.936+0000 7fbcbe24c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcb8076150 0x7fbcb8148a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57998/0 (socket says 172.21.15.44:57998) 2024-05-16T22:27:31.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.936+0000 7fe89ffff640 1 -- 172.21.15.44:0/798096268 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8a0145660 msgr2=0x7fe8a014c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:31.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.936+0000 7fe89ffff640 1 --2- 172.21.15.44:0/798096268 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8a0145660 0x7fe8a014c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.936+0000 7fe89ffff640 1 -- 172.21.15.44:0/798096268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8a006f970 msgr2=0x7fe8a014dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:31.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.936+0000 7fe89ffff640 1 --2- 172.21.15.44:0/798096268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8a006f970 0x7fe8a014dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.936+0000 7fe89ffff640 1 -- 172.21.15.44:0/798096268 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8a014e320 con 0x7fe8a014bd30 2024-05-16T22:27:31.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.936+0000 7fbb2589f640 1 -- 172.21.15.44:0/3694284757 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb200a4c90 con 0x7fbb20145660 2024-05-16T22:27:31.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.936+0000 7fbcbda4b640 1 -- 172.21.15.44:0/1530421987 learned_addr learned my addr 172.21.15.44:0/1530421987 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:31.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.936+0000 7fbcbfcaf640 1 -- 172.21.15.44:0/1530421987 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb80bc670 con 0x7fbcb8076150 2024-05-16T22:27:31.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.936+0000 7fbcbfcaf640 1 -- 172.21.15.44:0/1530421987 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb806de40 con 0x7fbcb8073920 2024-05-16T22:27:31.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.936+0000 7fbcbfcaf640 1 -- 172.21.15.44:0/1530421987 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fbcb80bc7f0 con 0x7fbcb8072e00 2024-05-16T22:27:31.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.936+0000 7f490259c640 1 -- 172.21.15.44:0/1986853453 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49040bbb20 msgr2=0x7f4904141f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:31.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.936+0000 7f490259c640 1 --2- 172.21.15.44:0/1986853453 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49040bbb20 0x7f4904141f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.936+0000 7f490259c640 1 -- 172.21.15.44:0/1986853453 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49040be910 msgr2=0x7f49040bb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:31.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.936+0000 7f490259c640 1 --2- 172.21.15.44:0/1986853453 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49040be910 0x7f49040bb5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.936+0000 7f490259c640 1 -- 172.21.15.44:0/1986853453 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4904147ee0 con 0x7f4904073190 2024-05-16T22:27:31.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.936+0000 7f0aa0baf640 1 -- 172.21.15.44:0/2247389309 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0a9c0bb060 msgr2=0x7f0a9c146660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:31.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.936+0000 7f0aa0baf640 1 --2- 172.21.15.44:0/2247389309 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0a9c0bb060 0x7f0a9c146660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.936+0000 7f0aa0baf640 1 -- 172.21.15.44:0/2247389309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a9c1455f0 msgr2=0x7f0a9c14f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:31.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.936+0000 7f0aa0baf640 1 --2- 172.21.15.44:0/2247389309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a9c1455f0 0x7f0a9c14f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:31.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.936+0000 7f0aa0baf640 1 -- 172.21.15.44:0/2247389309 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a9c0a4df0 con 0x7f0a9c0bb470 2024-05-16T22:27:32.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.936+0000 7fe89ffff640 1 --2- 172.21.15.44:0/798096268 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe8a014bd30 0x7fe8a014c890 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe898031000 tx=0x7fe898004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:32.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.936+0000 7f490259c640 1 --2- 172.21.15.44:0/1986853453 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4904073190 0x7f49041479a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f48f4007e00 tx=0x7f48f400e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:32.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.936+0000 7f8670f3f640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8664038260 0x7f86640cca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.936+0000 7f0aa0baf640 1 --2- 172.21.15.44:0/2247389309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a9c0bb470 0x7f0a9c147470 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0a94031000 tx=0x7f0a94004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:32.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.936+0000 7fe887fff640 1 -- 172.21.15.44:0/798096268 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe89803e9b0 con 0x7fe8a014bd30 2024-05-16T22:27:32.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.937+0000 7fe887fff640 1 -- 172.21.15.44:0/798096268 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe89803eb50 con 0x7fe8a014bd30 2024-05-16T22:27:32.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.937+0000 7fe887fff640 1 -- 172.21.15.44:0/798096268 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe898031630 con 0x7fe8a014bd30 2024-05-16T22:27:32.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.937+0000 7f8670f3f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f866403a2e0 0x7f86640ca990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.937+0000 7f48f2ffd640 1 -- 172.21.15.44:0/1986853453 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f4007e30 con 0x7f4904073190 2024-05-16T22:27:32.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.937+0000 7f4908ebd640 1 -- 172.21.15.44:0/1986853453 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49041e8df0 con 0x7f4904073190 2024-05-16T22:27:32.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.937+0000 7f4908ebd640 1 -- 172.21.15.44:0/1986853453 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f49041e93b0 con 0x7f4904073190 2024-05-16T22:27:32.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.937+0000 7fe8a5bff640 1 -- 172.21.15.44:0/798096268 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8a00a6640 con 0x7fe8a014bd30 2024-05-16T22:27:32.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.937+0000 7fbcbd24a640 1 -- 172.21.15.44:0/1530421987 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbcb8072e00 msgr2=0x7fbcb80bde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.937+0000 7fbcbd24a640 1 --2- 172.21.15.44:0/1530421987 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbcb8072e00 0x7fbcb80bde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.937+0000 7fbcbd24a640 1 -- 172.21.15.44:0/1530421987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcb8076150 msgr2=0x7fbcb8148a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.937+0000 7f866a59c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8664038260 0x7f86640cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.937+0000 7fe8a5bff640 1 -- 172.21.15.44:0/798096268 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8a014f240 con 0x7fe8a014bd30 2024-05-16T22:27:32.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.937+0000 7fbcbd24a640 1 --2- 172.21.15.44:0/1530421987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcb8076150 0x7fbcb8148a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.937+0000 7fbcbd24a640 1 -- 172.21.15.44:0/1530421987 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcb8148fc0 con 0x7fbcb8073920 2024-05-16T22:27:32.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.937+0000 7fbcbe24c640 1 --2- 172.21.15.44:0/1530421987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcb8076150 0x7fbcb8148a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:27:32.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.937+0000 7f866a59c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8664038260 0x7f86640cca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.44:50534/0 (socket says 172.21.15.44:50534) 2024-05-16T22:27:32.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.937+0000 7fb5a4a61640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb58c005c80 0x7fb5a0071250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.937+0000 7fb5a4a61640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb5a0147210 0x7fb5a01e06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.937+0000 7fb59e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb58c005c80 0x7fb5a0071250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.937+0000 7fb59e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb58c005c80 0x7fb5a0071250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.44:57298/0 (socket says 172.21.15.44:57298) 2024-05-16T22:27:32.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.938+0000 7fb59e59c640 1 -- 172.21.15.44:0/2143314663 learned_addr learned my addr 172.21.15.44:0/2143314663 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:32.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.938+0000 7fb595d9b640 1 --2- 172.21.15.44:0/2143314663 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb5a0147210 0x7fb5a01e06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.938+0000 7fb5a4a61640 1 --2- 172.21.15.44:0/2143314663 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5a01e0be0 0x7fb5a00a3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.938+0000 7fb5a4a61640 1 -- 172.21.15.44:0/2143314663 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a0073120 con 0x7fb5a01e0be0 2024-05-16T22:27:32.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.938+0000 7fb5a4a61640 1 -- 172.21.15.44:0/2143314663 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a014ba20 con 0x7fb58c005c80 2024-05-16T22:27:32.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.938+0000 7fb59ed9d640 1 --2- 172.21.15.44:0/2143314663 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5a01e0be0 0x7fb5a00a3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.938+0000 7fb5a4a61640 1 -- 172.21.15.44:0/2143314663 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fb5a009f970 con 0x7fb5a0147210 2024-05-16T22:27:32.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.937+0000 7f8669d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f866403a2e0 0x7f86640ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.937+0000 7f8669d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f866403a2e0 0x7f86640ca990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58028/0 (socket says 172.21.15.44:58028) 2024-05-16T22:27:32.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.937+0000 7f866a59c640 1 -- 172.21.15.44:0/2862258949 learned_addr learned my addr 172.21.15.44:0/2862258949 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:32.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.937+0000 7f8670f3f640 1 --2- 172.21.15.44:0/2862258949 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86640cb990 0x7f8664027e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.938+0000 7f8670f3f640 1 -- 172.21.15.44:0/2862258949 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8664039300 con 0x7f866403a2e0 2024-05-16T22:27:32.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.938+0000 7f8670f3f640 1 -- 172.21.15.44:0/2862258949 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f86640cdcd0 con 0x7f86640cb990 2024-05-16T22:27:32.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.938+0000 7f8670f3f640 1 -- 172.21.15.44:0/2862258949 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f8664039480 con 0x7f8664038260 2024-05-16T22:27:32.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.938+0000 7f866ad9d640 1 --2- 172.21.15.44:0/2862258949 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86640cb990 0x7f8664027e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.937+0000 7f0a91ffb640 1 -- 172.21.15.44:0/2247389309 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9403f070 con 0x7f0a9c0bb470 2024-05-16T22:27:32.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.937+0000 7f0a91ffb640 1 -- 172.21.15.44:0/2247389309 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a94031d40 con 0x7f0a9c0bb470 2024-05-16T22:27:32.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.937+0000 7f0a91ffb640 1 -- 172.21.15.44:0/2247389309 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a94007740 con 0x7f0a9c0bb470 2024-05-16T22:27:32.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.937+0000 7f0aa3614640 1 -- 172.21.15.44:0/2247389309 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a9c1479b0 con 0x7f0a9c0bb470 2024-05-16T22:27:32.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.937+0000 7f0aa3614640 1 -- 172.21.15.44:0/2247389309 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a9c145c20 con 0x7f0a9c0bb470 2024-05-16T22:27:32.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.937+0000 7f48f2ffd640 1 -- 172.21.15.44:0/1986853453 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48f4019070 con 0x7f4904073190 2024-05-16T22:27:32.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.938+0000 7f866ad9d640 1 -- 172.21.15.44:0/2862258949 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8664038260 msgr2=0x7f86640cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.938+0000 7f866ad9d640 1 --2- 172.21.15.44:0/2862258949 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8664038260 0x7f86640cca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.938+0000 7f866ad9d640 1 -- 172.21.15.44:0/2862258949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f866403a2e0 msgr2=0x7f86640ca990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.938+0000 7f866ad9d640 1 --2- 172.21.15.44:0/2862258949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f866403a2e0 0x7f86640ca990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.938+0000 7fbcbd24a640 1 --2- 172.21.15.44:0/1530421987 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbcb8073920 0x7fbcb8149820 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbcb806e170 tx=0x7fbca80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:32.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.939+0000 7f866ad9d640 1 -- 172.21.15.44:0/2862258949 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86640caed0 con 0x7f86640cb990 2024-05-16T22:27:32.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.939+0000 7f8669d9b640 1 --2- 172.21.15.44:0/2862258949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f866403a2e0 0x7f86640ca990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:27:32.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.939+0000 7f48f2ffd640 1 -- 172.21.15.44:0/1986853453 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f4007e30 con 0x7f4904073190 2024-05-16T22:27:32.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.938+0000 7fd32902b640 1 -- 172.21.15.44:0/1630207845 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd32414dc90 con 0x7fd32414f0b0 2024-05-16T22:27:32.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.939+0000 7fd32902b640 1 -- 172.21.15.44:0/1630207845 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3240a6670 con 0x7fd32414f0b0 2024-05-16T22:27:32.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.938+0000 7fe8a5bff640 1 -- 172.21.15.44:0/798096268 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe8a014eb00 con 0x7fe8a014bd30 2024-05-16T22:27:32.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.939+0000 7fbcae7fc640 1 -- 172.21.15.44:0/1530421987 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca8043020 con 0x7fbcb8073920 2024-05-16T22:27:32.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.939+0000 7f4908ebd640 1 -- 172.21.15.44:0/1986853453 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f48e8001030 con 0x7f4904073190 2024-05-16T22:27:32.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.939+0000 7fbcae7fc640 1 -- 172.21.15.44:0/1530421987 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbca80359b0 con 0x7fbcb8073920 2024-05-16T22:27:32.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.939+0000 7fbcae7fc640 1 -- 172.21.15.44:0/1530421987 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca803a040 con 0x7fbcb8073920 2024-05-16T22:27:32.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.939+0000 7fbb2589f640 1 -- 172.21.15.44:0/3694284757 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbb20148990 con 0x7fbb20145660 2024-05-16T22:27:32.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.939+0000 7fbcbfcaf640 1 -- 172.21.15.44:0/1530421987 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcb814a4c0 con 0x7fbcb8073920 2024-05-16T22:27:32.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.939+0000 7fb59e59c640 1 -- 172.21.15.44:0/2143314663 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb5a0147210 msgr2=0x7fb5a01e06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.939+0000 7fb59e59c640 1 --2- 172.21.15.44:0/2143314663 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb5a0147210 0x7fb5a01e06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.939+0000 7fb59e59c640 1 -- 172.21.15.44:0/2143314663 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5a01e0be0 msgr2=0x7fb5a00a3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.939+0000 7fb59e59c640 1 --2- 172.21.15.44:0/2143314663 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5a01e0be0 0x7fb5a00a3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.939+0000 7fb59e59c640 1 -- 172.21.15.44:0/2143314663 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5a0071790 con 0x7fb58c005c80 2024-05-16T22:27:32.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.940+0000 7fbcbfcaf640 1 -- 172.21.15.44:0/1530421987 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcb81e0a20 con 0x7fbcb8073920 2024-05-16T22:27:32.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.940+0000 7f866ad9d640 1 --2- 172.21.15.44:0/2862258949 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86640cb990 0x7f8664027e80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f866c06c450 tx=0x7f866c06ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:32.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.940+0000 7fb59e59c640 1 --2- 172.21.15.44:0/2143314663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb58c005c80 0x7fb5a0071250 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb58802abf0 tx=0x7fb588001870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:32.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.940+0000 7f0aa3614640 1 -- 172.21.15.44:0/2247389309 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0a9c069b50 con 0x7f0a9c0bb470 2024-05-16T22:27:32.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.940+0000 7fbb07fff640 1 -- 172.21.15.44:0/3694284757 <== mon.2 v2:172.21.15.70:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbb180054b0 con 0x7fbb20145660 2024-05-16T22:27:32.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.940+0000 7fd32902b640 1 -- 172.21.15.44:0/1630207845 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd3240a8ef0 con 0x7fd32414f0b0 2024-05-16T22:27:32.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.940+0000 7fb5977fe640 1 -- 172.21.15.44:0/2143314663 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5880014d0 con 0x7fb58c005c80 2024-05-16T22:27:32.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.940+0000 7fb5977fe640 1 -- 172.21.15.44:0/2143314663 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb588001690 con 0x7fb58c005c80 2024-05-16T22:27:32.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.941+0000 7fb5a4a61640 1 -- 172.21.15.44:0/2143314663 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5a009f680 con 0x7fb58c005c80 2024-05-16T22:27:32.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.941+0000 7f48f2ffd640 1 -- 172.21.15.44:0/1986853453 <== mon.2 v2:172.21.15.70:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f48f4014420 con 0x7f4904073190 2024-05-16T22:27:32.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.941+0000 7f0a91ffb640 1 -- 172.21.15.44:0/2247389309 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0a940446a0 con 0x7f0a9c0bb470 2024-05-16T22:27:32.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.941+0000 7fb5a4a61640 1 -- 172.21.15.44:0/2143314663 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5a0146220 con 0x7fb58c005c80 2024-05-16T22:27:32.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.941+0000 7fb5977fe640 1 -- 172.21.15.44:0/2143314663 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb58803c8a0 con 0x7fb58c005c80 2024-05-16T22:27:32.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.940+0000 7fe887fff640 1 -- 172.21.15.44:0/798096268 <== mon.2 v2:172.21.15.70:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe8980317d0 con 0x7fe8a014bd30 2024-05-16T22:27:32.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.941+0000 7f865affd640 1 -- 172.21.15.44:0/2862258949 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f866c076680 con 0x7f86640cb990 2024-05-16T22:27:32.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.941+0000 7f865affd640 1 -- 172.21.15.44:0/2862258949 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f866c076860 con 0x7f86640cb990 2024-05-16T22:27:32.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.941+0000 7f865affd640 1 -- 172.21.15.44:0/2862258949 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f866c096660 con 0x7f86640cb990 2024-05-16T22:27:32.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.941+0000 7f8670f3f640 1 -- 172.21.15.44:0/2862258949 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86640071c0 con 0x7f86640cb990 2024-05-16T22:27:32.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.941+0000 7fbb07fff640 1 --2- 172.21.15.44:0/3694284757 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fbb0c0763d0 0x7fbb0c0788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.941+0000 7fbb07fff640 1 -- 172.21.15.44:0/3694284757 <== mon.2 v2:172.21.15.70:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fbb1809b0e0 con 0x7fbb20145660 2024-05-16T22:27:32.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.941+0000 7fbb07fff640 1 --2- 172.21.15.44:0/3694284757 >> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] conn(0x7fbb0c07e5c0 0x7fbb0c080a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.941+0000 7fbb07fff640 1 -- 172.21.15.44:0/3694284757 --> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbb0c0810e0 con 0x7fbb0c07e5c0 2024-05-16T22:27:32.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.941+0000 7fbb07fff640 1 -- 172.21.15.44:0/3694284757 <== mon.2 v2:172.21.15.70:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fbb180a2050 con 0x7fbb20145660 2024-05-16T22:27:32.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.942+0000 7fbb1e7fc640 1 --2- 172.21.15.44:0/3694284757 >> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] conn(0x7fbb0c07e5c0 0x7fbb0c080a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.942+0000 7fd30b7fe640 1 -- 172.21.15.44:0/1630207845 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd31c01c070 con 0x7fd32414f0b0 2024-05-16T22:27:32.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.942+0000 7fbb1effd640 1 --2- 172.21.15.44:0/3694284757 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fbb0c0763d0 0x7fbb0c0788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.942+0000 7fe887fff640 1 --2- 172.21.15.44:0/798096268 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fe88c0762d0 0x7fe88c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.942+0000 7fe887fff640 1 -- 172.21.15.44:0/798096268 <== mon.2 v2:172.21.15.70:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe8980bd7b0 con 0x7fe8a014bd30 2024-05-16T22:27:32.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.942+0000 7f0a91ffb640 1 --2- 172.21.15.44:0/2247389309 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0a800763a0 0x7f0a800788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.942+0000 7fbb1e7fc640 1 --2- 172.21.15.44:0/3694284757 >> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] conn(0x7fbb0c07e5c0 0x7fbb0c080a10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:32.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.942+0000 7fd30b7fe640 1 --2- 172.21.15.44:0/1630207845 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd3100763d0 0x7fd3100788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.942+0000 7fe887fff640 1 --2- 172.21.15.44:0/798096268 >> [v2:172.21.15.44:6816/2909429972,v1:172.21.15.44:6817/2909429972] conn(0x7fe88c07e5a0 0x7fe88c0809f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.942+0000 7fe887fff640 1 -- 172.21.15.44:0/798096268 --> [v2:172.21.15.44:6816/2909429972,v1:172.21.15.44:6817/2909429972] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe8980078e0 con 0x7fe88c07e5a0 2024-05-16T22:27:32.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.942+0000 7fe887fff640 1 -- 172.21.15.44:0/798096268 <== mon.2 v2:172.21.15.70:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe8980bdba0 con 0x7fe8a014bd30 2024-05-16T22:27:32.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.943+0000 7fe89f7fe640 1 --2- 172.21.15.44:0/798096268 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fe88c0762d0 0x7fe88c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.943+0000 7fe89effd640 1 --2- 172.21.15.44:0/798096268 >> [v2:172.21.15.44:6816/2909429972,v1:172.21.15.44:6817/2909429972] conn(0x7fe88c07e5a0 0x7fe88c0809f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.943+0000 7f8670f3f640 1 -- 172.21.15.44:0/2862258949 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86640cbee0 con 0x7f86640cb990 2024-05-16T22:27:32.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.941+0000 7f48f2ffd640 1 --2- 172.21.15.44:0/1986853453 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f48e4076700 0x7f48e4078c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.942+0000 7f48f2ffd640 1 -- 172.21.15.44:0/1986853453 <== mon.2 v2:172.21.15.70:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f48f400edd0 con 0x7f4904073190 2024-05-16T22:27:32.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.942+0000 7f48f2ffd640 1 --2- 172.21.15.44:0/1986853453 >> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] conn(0x7f48e407e8f0 0x7f48e4080d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.942+0000 7f48f2ffd640 1 -- 172.21.15.44:0/1986853453 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f48f400be50 con 0x7f48e407e8f0 2024-05-16T22:27:32.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.942+0000 7f4901d9b640 1 --2- 172.21.15.44:0/1986853453 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f48e4076700 0x7f48e4078c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.943+0000 7f4902d9d640 1 --2- 172.21.15.44:0/1986853453 >> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] conn(0x7f48e407e8f0 0x7f48e4080d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.943+0000 7f48f2ffd640 1 -- 172.21.15.44:0/1986853453 <== mon.2 v2:172.21.15.70:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f48f409e050 con 0x7f4904073190 2024-05-16T22:27:32.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.942+0000 7f0a91ffb640 1 -- 172.21.15.44:0/2247389309 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0a940b8d10 con 0x7f0a9c0bb470 2024-05-16T22:27:32.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.943+0000 7f0a91ffb640 1 --2- 172.21.15.44:0/2247389309 >> [v2:172.21.15.70:6821/1540297751,v1:172.21.15.70:6823/1540297751] conn(0x7f0a8007e670 0x7f0a80080ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.943+0000 7f0a91ffb640 1 -- 172.21.15.44:0/2247389309 --> [v2:172.21.15.70:6821/1540297751,v1:172.21.15.70:6823/1540297751] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0a94033e50 con 0x7f0a8007e670 2024-05-16T22:27:32.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.943+0000 7f0a91ffb640 1 -- 172.21.15.44:0/2247389309 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f0a940bb370 con 0x7f0a9c0bb470 2024-05-16T22:27:32.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.943+0000 7f0aa13b0640 1 --2- 172.21.15.44:0/2247389309 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0a800763a0 0x7f0a800788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.941+0000 7fbcbfcaf640 1 -- 172.21.15.44:0/1530421987 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbca0001030 con 0x7fbcb8073920 2024-05-16T22:27:32.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.942+0000 7fbcae7fc640 1 -- 172.21.15.44:0/1530421987 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbca8046020 con 0x7fbcb8073920 2024-05-16T22:27:32.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.943+0000 7fd30b7fe640 1 -- 172.21.15.44:0/1630207845 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd31c0978e0 con 0x7fd32414f0b0 2024-05-16T22:27:32.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.943+0000 7fd322d9d640 1 --2- 172.21.15.44:0/1630207845 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd3100763d0 0x7fd3100788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.943+0000 7fbcae7fc640 1 --2- 172.21.15.44:0/1530421987 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fbc9c0763d0 0x7fbc9c0788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.943+0000 7f4902d9d640 1 --2- 172.21.15.44:0/1986853453 >> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] conn(0x7f48e407e8f0 0x7f48e4080d40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:32.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.943+0000 7fbb1effd640 1 --2- 172.21.15.44:0/3694284757 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fbb0c0763d0 0x7fbb0c0788e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbb10034000 tx=0x7fbb1002e000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:32.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.943+0000 7fbcae7fc640 1 -- 172.21.15.44:0/1530421987 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fbca80bb940 con 0x7fbcb8073920 2024-05-16T22:27:32.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.944+0000 7fb5977fe640 1 -- 172.21.15.44:0/2143314663 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb58803ca40 con 0x7fb58c005c80 2024-05-16T22:27:32.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.944+0000 7fb5a4a61640 1 -- 172.21.15.44:0/2143314663 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb584001030 con 0x7fb58c005c80 2024-05-16T22:27:32.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.943+0000 7fd30b7fe640 1 --2- 172.21.15.44:0/1630207845 >> [v2:172.21.15.70:6800/2389556489,v1:172.21.15.70:6801/2389556489] conn(0x7fd31007e6a0 0x7fd310080af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.943+0000 7fd30b7fe640 1 -- 172.21.15.44:0/1630207845 --> [v2:172.21.15.70:6800/2389556489,v1:172.21.15.70:6801/2389556489] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd31c012e50 con 0x7fd31007e6a0 2024-05-16T22:27:32.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.943+0000 7fd30b7fe640 1 -- 172.21.15.44:0/1630207845 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fd31c097cd0 con 0x7fd32414f0b0 2024-05-16T22:27:32.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.943+0000 7fd32259c640 1 --2- 172.21.15.44:0/1630207845 >> [v2:172.21.15.70:6800/2389556489,v1:172.21.15.70:6801/2389556489] conn(0x7fd31007e6a0 0x7fd310080af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.944+0000 7fbb07fff640 1 -- 172.21.15.44:0/3694284757 <== osd.7 v2:172.21.15.70:6816/3619691281 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbb0c0810e0 con 0x7fbb0c07e5c0 2024-05-16T22:27:32.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.943+0000 7f0aa1bb1640 1 --2- 172.21.15.44:0/2247389309 >> [v2:172.21.15.70:6821/1540297751,v1:172.21.15.70:6823/1540297751] conn(0x7f0a8007e670 0x7f0a80080ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.944+0000 7fbcae7fc640 1 --2- 172.21.15.44:0/1530421987 >> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] conn(0x7fbc9c07e620 0x7fbc9c080a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.944+0000 7fbcae7fc640 1 -- 172.21.15.44:0/1530421987 --> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbca8047e70 con 0x7fbc9c07e620 2024-05-16T22:27:32.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.944+0000 7fe89effd640 1 --2- 172.21.15.44:0/798096268 >> [v2:172.21.15.44:6816/2909429972,v1:172.21.15.44:6817/2909429972] conn(0x7fe88c07e5a0 0x7fe88c0809f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:32.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.944+0000 7fbcae7fc640 1 -- 172.21.15.44:0/1530421987 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fbca80812c0 con 0x7fbcb8073920 2024-05-16T22:27:32.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.944+0000 7fbcbda4b640 1 --2- 172.21.15.44:0/1530421987 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fbc9c0763d0 0x7fbc9c0788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.944+0000 7fbcbe24c640 1 --2- 172.21.15.44:0/1530421987 >> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] conn(0x7fbc9c07e620 0x7fbc9c080a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.944+0000 7f0aa1bb1640 1 --2- 172.21.15.44:0/2247389309 >> [v2:172.21.15.70:6821/1540297751,v1:172.21.15.70:6823/1540297751] conn(0x7f0a8007e670 0x7f0a80080ac0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:32.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.944+0000 7f8670f3f640 1 -- 172.21.15.44:0/2862258949 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f866415a510 con 0x7f86640cb990 2024-05-16T22:27:32.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.944+0000 7fb5977fe640 1 --2- 172.21.15.44:0/2143314663 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fb5800763d0 0x7fb5800788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.944+0000 7fd322d9d640 1 --2- 172.21.15.44:0/1630207845 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd3100763d0 0x7fd3100788e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd318034000 tx=0x7fd31802e000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:32.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.944+0000 7f4901d9b640 1 --2- 172.21.15.44:0/1986853453 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f48e4076700 0x7f48e4078c10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f49041e66b0 tx=0x7f48f8001e50 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:32.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.944+0000 7f0aa13b0640 1 --2- 172.21.15.44:0/2247389309 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0a800763a0 0x7f0a800788b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0a98007a60 tx=0x7f0a98008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:32.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.944+0000 7fd32259c640 1 --2- 172.21.15.44:0/1630207845 >> [v2:172.21.15.70:6800/2389556489,v1:172.21.15.70:6801/2389556489] conn(0x7fd31007e6a0 0x7fd310080af0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:32.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.945+0000 7fb5977fe640 1 -- 172.21.15.44:0/2143314663 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb5880bb050 con 0x7fb58c005c80 2024-05-16T22:27:32.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.945+0000 7fb595d9b640 1 --2- 172.21.15.44:0/2143314663 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fb5800763d0 0x7fb5800788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.945+0000 7fb5977fe640 1 --2- 172.21.15.44:0/2143314663 >> [v2:172.21.15.44:6824/1074109859,v1:172.21.15.44:6825/1074109859] conn(0x7fb58007e6a0 0x7fb580080af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.945+0000 7fb5977fe640 1 -- 172.21.15.44:0/2143314663 --> [v2:172.21.15.44:6824/1074109859,v1:172.21.15.44:6825/1074109859] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb588007610 con 0x7fb58007e6a0 2024-05-16T22:27:32.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.945+0000 7fb5977fe640 1 -- 172.21.15.44:0/2143314663 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb5880be5e0 con 0x7fb58c005c80 2024-05-16T22:27:32.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.945+0000 7f48f2ffd640 1 -- 172.21.15.44:0/1986853453 <== osd.3 v2:172.21.15.44:6808/2168695793 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f48f400be50 con 0x7f48e407e8f0 2024-05-16T22:27:32.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.945+0000 7fbcbda4b640 1 --2- 172.21.15.44:0/1530421987 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fbc9c0763d0 0x7fbc9c0788e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbcb000afd0 tx=0x7fbcb000a920 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:32.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.945+0000 7fe89f7fe640 1 --2- 172.21.15.44:0/798096268 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fe88c0762d0 0x7fe88c0787e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe8900098b0 tx=0x7fe890008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:32.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.945+0000 7fb59ed9d640 1 --2- 172.21.15.44:0/2143314663 >> [v2:172.21.15.44:6824/1074109859,v1:172.21.15.44:6825/1074109859] conn(0x7fb58007e6a0 0x7fb580080af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.945+0000 7fe887fff640 1 -- 172.21.15.44:0/798096268 <== osd.1 v2:172.21.15.44:6816/2909429972 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe8980078e0 con 0x7fe88c07e5a0 2024-05-16T22:27:32.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.945+0000 7f0a91ffb640 1 -- 172.21.15.44:0/2247389309 <== osd.4 v2:172.21.15.70:6821/1540297751 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0a94033e50 con 0x7f0a8007e670 2024-05-16T22:27:32.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.945+0000 7fbcbe24c640 1 --2- 172.21.15.44:0/1530421987 >> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] conn(0x7fbc9c07e620 0x7fbc9c080a70 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:32.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.945+0000 7fb595d9b640 1 --2- 172.21.15.44:0/2143314663 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fb5800763d0 0x7fb5800788e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0071bb0 tx=0x7fb590008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:32.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.945+0000 7fd30b7fe640 1 -- 172.21.15.44:0/1630207845 <== osd.6 v2:172.21.15.70:6800/2389556489 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd31c012e50 con 0x7fd31007e6a0 2024-05-16T22:27:32.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.946+0000 7fb59ed9d640 1 --2- 172.21.15.44:0/2143314663 >> [v2:172.21.15.44:6824/1074109859,v1:172.21.15.44:6825/1074109859] conn(0x7fb58007e6a0 0x7fb580080af0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:32.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.946+0000 7f865affd640 1 -- 172.21.15.44:0/2862258949 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f866c096800 con 0x7f86640cb990 2024-05-16T22:27:32.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.947+0000 7f865affd640 1 --2- 172.21.15.44:0/2862258949 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f864c0763a0 0x7f864c0788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.947+0000 7fb5977fe640 1 -- 172.21.15.44:0/2143314663 <== osd.0 v2:172.21.15.44:6824/1074109859 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb588007610 con 0x7fb58007e6a0 2024-05-16T22:27:32.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.946+0000 7fbcae7fc640 1 -- 172.21.15.44:0/1530421987 <== osd.5 v2:172.21.15.70:6802/4218901987 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbca8047e70 con 0x7fbc9c07e620 2024-05-16T22:27:32.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.947+0000 7f865affd640 1 -- 172.21.15.44:0/2862258949 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f866c113e80 con 0x7f86640cb990 2024-05-16T22:27:32.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.947+0000 7f866a59c640 1 --2- 172.21.15.44:0/2862258949 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f864c0763a0 0x7f864c0788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.948+0000 7f865affd640 1 --2- 172.21.15.44:0/2862258949 >> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] conn(0x7f864c07e670 0x7f864c080ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.948+0000 7f866a59c640 1 --2- 172.21.15.44:0/2862258949 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f864c0763a0 0x7f864c0788b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f865c0071a0 tx=0x7f865c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:32.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.948+0000 7f865affd640 1 -- 172.21.15.44:0/2862258949 --> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f864c081190 con 0x7f864c07e670 2024-05-16T22:27:32.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.948+0000 7f865affd640 1 -- 172.21.15.44:0/2862258949 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f866c1164e0 con 0x7f86640cb990 2024-05-16T22:27:32.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.948+0000 7f8669d9b640 1 --2- 172.21.15.44:0/2862258949 >> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] conn(0x7f864c07e670 0x7f864c080ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.949+0000 7f8669d9b640 1 --2- 172.21.15.44:0/2862258949 >> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] conn(0x7f864c07e670 0x7f864c080ac0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:32.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.950+0000 7f865affd640 1 -- 172.21.15.44:0/2862258949 <== osd.2 v2:172.21.15.44:6800/2908194156 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f864c081190 con 0x7f864c07e670 2024-05-16T22:27:32.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.977+0000 7fbb2589f640 1 -- 172.21.15.44:0/3694284757 --> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbb20148c70 con 0x7fbb0c07e5c0 2024-05-16T22:27:32.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.977+0000 7fbcbfcaf640 1 -- 172.21.15.44:0/1530421987 --> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbca0002dd0 con 0x7fbc9c07e620 2024-05-16T22:27:32.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.977+0000 7fe8a5bff640 1 -- 172.21.15.44:0/798096268 --> [v2:172.21.15.44:6816/2909429972,v1:172.21.15.44:6817/2909429972] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe8a009fd00 con 0x7fe88c07e5a0 2024-05-16T22:27:32.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.978+0000 7fe887fff640 1 -- 172.21.15.44:0/798096268 <== osd.1 v2:172.21.15.44:6816/2909429972 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe8a009fd00 con 0x7fe88c07e5a0 2024-05-16T22:27:32.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.978+0000 7fbcae7fc640 1 -- 172.21.15.44:0/1530421987 <== osd.5 v2:172.21.15.70:6802/4218901987 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbca0002dd0 con 0x7fbc9c07e620 2024-05-16T22:27:32.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.978+0000 7fbb07fff640 1 -- 172.21.15.44:0/3694284757 <== osd.7 v2:172.21.15.70:6816/3619691281 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbb20148c70 con 0x7fbb0c07e5c0 2024-05-16T22:27:32.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.979+0000 7fe8a5bff640 1 -- 172.21.15.44:0/798096268 >> [v2:172.21.15.44:6816/2909429972,v1:172.21.15.44:6817/2909429972] conn(0x7fe88c07e5a0 msgr2=0x7fe88c0809f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.979+0000 7fe8a5bff640 1 --2- 172.21.15.44:0/798096268 >> [v2:172.21.15.44:6816/2909429972,v1:172.21.15.44:6817/2909429972] conn(0x7fe88c07e5a0 0x7fe88c0809f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.979+0000 7fe8a5bff640 1 -- 172.21.15.44:0/798096268 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fe88c0762d0 msgr2=0x7fe88c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.979+0000 7fe8a5bff640 1 --2- 172.21.15.44:0/798096268 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fe88c0762d0 0x7fe88c0787e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe8900098b0 tx=0x7fe890008040 comp rx=0 tx=0).stop 2024-05-16T22:27:32.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.979+0000 7fbc9bfff640 1 -- 172.21.15.44:0/1530421987 >> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] conn(0x7fbc9c07e620 msgr2=0x7fbc9c080a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.979+0000 7fbc9bfff640 1 --2- 172.21.15.44:0/1530421987 >> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] conn(0x7fbc9c07e620 0x7fbc9c080a70 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.979+0000 7fe8a5bff640 1 -- 172.21.15.44:0/798096268 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe8a014bd30 msgr2=0x7fe8a014c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.979+0000 7fe8a5bff640 1 --2- 172.21.15.44:0/798096268 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe8a014bd30 0x7fe8a014c890 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe898031000 tx=0x7fe898004a40 comp rx=0 tx=0).stop 2024-05-16T22:27:32.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.979+0000 7fe89ffff640 1 -- 172.21.15.44:0/798096268 reap_dead start 2024-05-16T22:27:32.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.979+0000 7fbc9bfff640 1 -- 172.21.15.44:0/1530421987 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fbc9c0763d0 msgr2=0x7fbc9c0788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.979+0000 7fbc9bfff640 1 --2- 172.21.15.44:0/1530421987 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fbc9c0763d0 0x7fbc9c0788e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbcb000afd0 tx=0x7fbcb000a920 comp rx=0 tx=0).stop 2024-05-16T22:27:32.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.979+0000 7f0aa3614640 1 -- 172.21.15.44:0/2247389309 --> [v2:172.21.15.70:6821/1540297751,v1:172.21.15.70:6823/1540297751] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0a9c050940 con 0x7f0a8007e670 2024-05-16T22:27:32.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.979+0000 7fbc9bfff640 1 -- 172.21.15.44:0/1530421987 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbcb8073920 msgr2=0x7fbcb8149820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.979+0000 7fbb2589f640 1 -- 172.21.15.44:0/3694284757 >> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] conn(0x7fbb0c07e5c0 msgr2=0x7fbb0c080a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.979+0000 7fbb2589f640 1 --2- 172.21.15.44:0/3694284757 >> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] conn(0x7fbb0c07e5c0 0x7fbb0c080a10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.979+0000 7fbc9bfff640 1 --2- 172.21.15.44:0/1530421987 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbcb8073920 0x7fbcb8149820 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbcb806e170 tx=0x7fbca80046c0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.979+0000 7f4908ebd640 1 -- 172.21.15.44:0/1986853453 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f48e8002dd0 con 0x7f48e407e8f0 2024-05-16T22:27:32.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.979+0000 7f48f2ffd640 1 -- 172.21.15.44:0/1986853453 <== osd.3 v2:172.21.15.44:6808/2168695793 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f48e8002dd0 con 0x7f48e407e8f0 2024-05-16T22:27:32.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.979+0000 7fbcbe24c640 1 -- 172.21.15.44:0/1530421987 reap_dead start 2024-05-16T22:27:32.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.979+0000 7fe8a5bff640 1 -- 172.21.15.44:0/798096268 shutdown_connections 2024-05-16T22:27:32.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.979+0000 7fe8a5bff640 1 -- 172.21.15.44:0/798096268 >> 172.21.15.44:0/798096268 conn(0x7fe8a00bd1d0 msgr2=0x7fe8a0074880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:32.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.979+0000 7fbc9bfff640 1 -- 172.21.15.44:0/1530421987 shutdown_connections 2024-05-16T22:27:32.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.979+0000 7fbb2589f640 1 -- 172.21.15.44:0/3694284757 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fbb0c0763d0 msgr2=0x7fbb0c0788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.979+0000 7fbb2589f640 1 --2- 172.21.15.44:0/3694284757 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fbb0c0763d0 0x7fbb0c0788e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbb10034000 tx=0x7fbb1002e000 comp rx=0 tx=0).stop 2024-05-16T22:27:32.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.979+0000 7fbb2589f640 1 -- 172.21.15.44:0/3694284757 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbb20145660 msgr2=0x7fbb201460a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.979+0000 7fbb2589f640 1 --2- 172.21.15.44:0/3694284757 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbb20145660 0x7fbb201460a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbb180021c0 tx=0x7fbb180021f0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.979+0000 7fbc9bfff640 1 -- 172.21.15.44:0/1530421987 >> 172.21.15.44:0/1530421987 conn(0x7fbcb806f390 msgr2=0x7fbcb80ba3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:32.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.979+0000 7fbb1f7fe640 1 -- 172.21.15.44:0/3694284757 reap_dead start 2024-05-16T22:27:32.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.979+0000 7fbb2589f640 1 -- 172.21.15.44:0/3694284757 shutdown_connections 2024-05-16T22:27:32.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.980+0000 7fbb2589f640 1 -- 172.21.15.44:0/3694284757 >> 172.21.15.44:0/3694284757 conn(0x7fbb200bd1d0 msgr2=0x7fbb20068d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:32.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.980+0000 7f0a91ffb640 1 -- 172.21.15.44:0/2247389309 <== osd.4 v2:172.21.15.70:6821/1540297751 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0a9c050940 con 0x7f0a8007e670 2024-05-16T22:27:32.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.980+0000 7fe8a5bff640 1 -- 172.21.15.44:0/798096268 shutdown_connections 2024-05-16T22:27:32.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.980+0000 7fe8a5bff640 1 -- 172.21.15.44:0/798096268 wait complete. 2024-05-16T22:27:32.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.980+0000 7f4908ebd640 1 -- 172.21.15.44:0/1986853453 >> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] conn(0x7f48e407e8f0 msgr2=0x7f48e4080d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.980+0000 7f4908ebd640 1 --2- 172.21.15.44:0/1986853453 >> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] conn(0x7f48e407e8f0 0x7f48e4080d40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.980+0000 7fbc9bfff640 1 -- 172.21.15.44:0/1530421987 shutdown_connections 2024-05-16T22:27:32.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.980+0000 7fbc9bfff640 1 -- 172.21.15.44:0/1530421987 wait complete. 2024-05-16T22:27:32.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.980+0000 7f4908ebd640 1 -- 172.21.15.44:0/1986853453 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f48e4076700 msgr2=0x7f48e4078c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.980+0000 7f4908ebd640 1 --2- 172.21.15.44:0/1986853453 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f48e4076700 0x7f48e4078c10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f49041e66b0 tx=0x7f48f8001e50 comp rx=0 tx=0).stop 2024-05-16T22:27:32.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.980+0000 7f4908ebd640 1 -- 172.21.15.44:0/1986853453 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4904073190 msgr2=0x7f49041479a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.980+0000 7f4908ebd640 1 --2- 172.21.15.44:0/1986853453 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4904073190 0x7f49041479a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f48f4007e00 tx=0x7f48f400e4b0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.980+0000 7fbb2589f640 1 -- 172.21.15.44:0/3694284757 shutdown_connections 2024-05-16T22:27:32.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.980+0000 7fbb2589f640 1 -- 172.21.15.44:0/3694284757 wait complete. 2024-05-16T22:27:32.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.980+0000 7f0aa3614640 1 -- 172.21.15.44:0/2247389309 >> [v2:172.21.15.70:6821/1540297751,v1:172.21.15.70:6823/1540297751] conn(0x7f0a8007e670 msgr2=0x7f0a80080ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.980+0000 7f0aa3614640 1 --2- 172.21.15.44:0/2247389309 >> [v2:172.21.15.70:6821/1540297751,v1:172.21.15.70:6823/1540297751] conn(0x7f0a8007e670 0x7f0a80080ac0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.980+0000 7fd32902b640 1 -- 172.21.15.44:0/1630207845 --> [v2:172.21.15.70:6800/2389556489,v1:172.21.15.70:6801/2389556489] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd32413f390 con 0x7fd31007e6a0 2024-05-16T22:27:32.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.980+0000 7f4902d9d640 1 -- 172.21.15.44:0/1986853453 reap_dead start 2024-05-16T22:27:32.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.980+0000 7f4908ebd640 1 -- 172.21.15.44:0/1986853453 shutdown_connections 2024-05-16T22:27:32.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.980+0000 7f4908ebd640 1 -- 172.21.15.44:0/1986853453 >> 172.21.15.44:0/1986853453 conn(0x7f49040bc4f0 msgr2=0x7f49040bcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:32.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.981+0000 7f4908ebd640 1 -- 172.21.15.44:0/1986853453 shutdown_connections 2024-05-16T22:27:32.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.981+0000 7f0aa3614640 1 -- 172.21.15.44:0/2247389309 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0a800763a0 msgr2=0x7f0a800788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.981+0000 7fd30b7fe640 1 -- 172.21.15.44:0/1630207845 <== osd.6 v2:172.21.15.70:6800/2389556489 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd32413f390 con 0x7fd31007e6a0 2024-05-16T22:27:32.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.981+0000 7f0aa3614640 1 --2- 172.21.15.44:0/2247389309 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0a800763a0 0x7f0a800788b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0a98007a60 tx=0x7f0a98008040 comp rx=0 tx=0).stop 2024-05-16T22:27:32.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.981+0000 7f0aa3614640 1 -- 172.21.15.44:0/2247389309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a9c0bb470 msgr2=0x7f0a9c147470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.981+0000 7f0aa3614640 1 --2- 172.21.15.44:0/2247389309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a9c0bb470 0x7f0a9c147470 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0a94031000 tx=0x7f0a94004a40 comp rx=0 tx=0).stop 2024-05-16T22:27:32.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.981+0000 7f0aa1bb1640 1 -- 172.21.15.44:0/2247389309 reap_dead start 2024-05-16T22:27:32.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.981+0000 7f0aa3614640 1 -- 172.21.15.44:0/2247389309 shutdown_connections 2024-05-16T22:27:32.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.981+0000 7f0aa3614640 1 -- 172.21.15.44:0/2247389309 >> 172.21.15.44:0/2247389309 conn(0x7f0a9c0bd160 msgr2=0x7f0a9c14aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:32.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.981+0000 7f4908ebd640 1 -- 172.21.15.44:0/1986853453 wait complete. 2024-05-16T22:27:32.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.981+0000 7f0aa3614640 1 -- 172.21.15.44:0/2247389309 shutdown_connections 2024-05-16T22:27:32.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.981+0000 7f0aa3614640 1 -- 172.21.15.44:0/2247389309 wait complete. 2024-05-16T22:27:32.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.981+0000 7fb5a4a61640 1 -- 172.21.15.44:0/2143314663 --> [v2:172.21.15.44:6824/1074109859,v1:172.21.15.44:6825/1074109859] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb584002d50 con 0x7fb58007e6a0 2024-05-16T22:27:32.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.981+0000 7fd32902b640 1 -- 172.21.15.44:0/1630207845 >> [v2:172.21.15.70:6800/2389556489,v1:172.21.15.70:6801/2389556489] conn(0x7fd31007e6a0 msgr2=0x7fd310080af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.981+0000 7fd32902b640 1 --2- 172.21.15.44:0/1630207845 >> [v2:172.21.15.70:6800/2389556489,v1:172.21.15.70:6801/2389556489] conn(0x7fd31007e6a0 0x7fd310080af0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.982+0000 7fd32902b640 1 -- 172.21.15.44:0/1630207845 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd3100763d0 msgr2=0x7fd3100788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.982+0000 7fd32902b640 1 --2- 172.21.15.44:0/1630207845 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd3100763d0 0x7fd3100788e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd318034000 tx=0x7fd31802e000 comp rx=0 tx=0).stop 2024-05-16T22:27:32.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.982+0000 7fd32902b640 1 -- 172.21.15.44:0/1630207845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd32414f0b0 msgr2=0x7fd32414c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.982+0000 7fd32902b640 1 --2- 172.21.15.44:0/1630207845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd32414f0b0 0x7fd32414c800 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd31c00ba10 tx=0x7fd31c00bed0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.982+0000 7fd32359e640 1 -- 172.21.15.44:0/1630207845 reap_dead start 2024-05-16T22:27:32.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.982+0000 7fb5977fe640 1 -- 172.21.15.44:0/2143314663 <== osd.0 v2:172.21.15.44:6824/1074109859 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb584002d50 con 0x7fb58007e6a0 2024-05-16T22:27:32.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.982+0000 7fd32902b640 1 -- 172.21.15.44:0/1630207845 shutdown_connections 2024-05-16T22:27:32.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.982+0000 7fd32902b640 1 -- 172.21.15.44:0/1630207845 >> 172.21.15.44:0/1630207845 conn(0x7fd3240c3b40 msgr2=0x7fd3240bb460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:32.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.983+0000 7fb5a4a61640 1 -- 172.21.15.44:0/2143314663 >> [v2:172.21.15.44:6824/1074109859,v1:172.21.15.44:6825/1074109859] conn(0x7fb58007e6a0 msgr2=0x7fb580080af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.983+0000 7fb5a4a61640 1 --2- 172.21.15.44:0/2143314663 >> [v2:172.21.15.44:6824/1074109859,v1:172.21.15.44:6825/1074109859] conn(0x7fb58007e6a0 0x7fb580080af0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.983+0000 7fb5a4a61640 1 -- 172.21.15.44:0/2143314663 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fb5800763d0 msgr2=0x7fb5800788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.983+0000 7fb5a4a61640 1 --2- 172.21.15.44:0/2143314663 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fb5800763d0 0x7fb5800788e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0071bb0 tx=0x7fb590008040 comp rx=0 tx=0).stop 2024-05-16T22:27:32.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.983+0000 7fb5a4a61640 1 -- 172.21.15.44:0/2143314663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb58c005c80 msgr2=0x7fb5a0071250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.983+0000 7fb5a4a61640 1 --2- 172.21.15.44:0/2143314663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb58c005c80 0x7fb5a0071250 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb58802abf0 tx=0x7fb588001870 comp rx=0 tx=0).stop 2024-05-16T22:27:32.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.983+0000 7f8670f3f640 1 -- 172.21.15.44:0/2862258949 --> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f86640054d0 con 0x7f864c07e670 2024-05-16T22:27:32.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.983+0000 7fd32902b640 1 -- 172.21.15.44:0/1630207845 shutdown_connections 2024-05-16T22:27:32.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.983+0000 7fd32902b640 1 -- 172.21.15.44:0/1630207845 wait complete. 2024-05-16T22:27:32.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.983+0000 7fb59ed9d640 1 -- 172.21.15.44:0/2143314663 reap_dead start 2024-05-16T22:27:32.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.983+0000 7fb5a4a61640 1 -- 172.21.15.44:0/2143314663 shutdown_connections 2024-05-16T22:27:32.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.983+0000 7f865affd640 1 -- 172.21.15.44:0/2862258949 <== osd.2 v2:172.21.15.44:6800/2908194156 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f86640054d0 con 0x7f864c07e670 2024-05-16T22:27:32.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.983+0000 7fb5a4a61640 1 -- 172.21.15.44:0/2143314663 >> 172.21.15.44:0/2143314663 conn(0x7fb5a00bd160 msgr2=0x7fb5a0144c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:32.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.984+0000 7fb5a4a61640 1 -- 172.21.15.44:0/2143314663 shutdown_connections 2024-05-16T22:27:32.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.984+0000 7fb5a4a61640 1 -- 172.21.15.44:0/2143314663 wait complete. 2024-05-16T22:27:32.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.984+0000 7f8670f3f640 1 -- 172.21.15.44:0/2862258949 >> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] conn(0x7f864c07e670 msgr2=0x7f864c080ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.984+0000 7f8670f3f640 1 --2- 172.21.15.44:0/2862258949 >> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] conn(0x7f864c07e670 0x7f864c080ac0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.984+0000 7f8670f3f640 1 -- 172.21.15.44:0/2862258949 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f864c0763a0 msgr2=0x7f864c0788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.984+0000 7f8670f3f640 1 --2- 172.21.15.44:0/2862258949 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f864c0763a0 0x7f864c0788b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f865c0071a0 tx=0x7f865c009040 comp rx=0 tx=0).stop 2024-05-16T22:27:32.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.984+0000 7f8670f3f640 1 -- 172.21.15.44:0/2862258949 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86640cb990 msgr2=0x7f8664027e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.984+0000 7f8670f3f640 1 --2- 172.21.15.44:0/2862258949 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86640cb990 0x7f8664027e80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f866c06c450 tx=0x7f866c06ec40 comp rx=0 tx=0).stop 2024-05-16T22:27:32.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.985+0000 7f866ad9d640 1 -- 172.21.15.44:0/2862258949 reap_dead start 2024-05-16T22:27:32.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.985+0000 7f8670f3f640 1 -- 172.21.15.44:0/2862258949 shutdown_connections 2024-05-16T22:27:32.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.985+0000 7f8670f3f640 1 -- 172.21.15.44:0/2862258949 >> 172.21.15.44:0/2862258949 conn(0x7f866403f6b0 msgr2=0x7f86640c7710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:32.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.985+0000 7f8670f3f640 1 -- 172.21.15.44:0/2862258949 shutdown_connections 2024-05-16T22:27:32.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:31.985+0000 7f8670f3f640 1 -- 172.21.15.44:0/2862258949 wait complete. 2024-05-16T22:27:32.052 INFO:teuthology.orchestra.run.smithi044.stdout:55834574854 2024-05-16T22:27:32.052 INFO:teuthology.orchestra.run.smithi044.stdout:60129542151 2024-05-16T22:27:32.053 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-16T22:27:32.053 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-16T22:27:32.054 INFO:teuthology.orchestra.run.smithi044.stdout:55834574854 2024-05-16T22:27:32.054 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-16T22:27:32.055 INFO:teuthology.orchestra.run.smithi044.stdout:55834574854 2024-05-16T22:27:32.055 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-16T22:27:32.056 INFO:teuthology.orchestra.run.smithi044.stdout:55834574853 2024-05-16T22:27:32.056 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-16T22:27:32.057 INFO:teuthology.orchestra.run.smithi044.stdout:55834574854 2024-05-16T22:27:32.057 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-16T22:27:32.058 INFO:teuthology.orchestra.run.smithi044.stdout:55834574854 2024-05-16T22:27:32.058 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-16T22:27:32.059 INFO:teuthology.orchestra.run.smithi044.stdout:55834574854 2024-05-16T22:27:32.059 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-16T22:27:32.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.314+0000 7f5f81413640 1 Processor -- start 2024-05-16T22:27:32.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.314+0000 7f5f81413640 1 -- start start 2024-05-16T22:27:32.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.316+0000 7f5f81413640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5f7c144650 0x7f5f7c0b5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.316+0000 7f5f81413640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5f7c0a1dd0 0x7f5f7c0b5690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.316+0000 7f5f81413640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f7c14e500 con 0x7f5f7c14d780 2024-05-16T22:27:32.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.316+0000 7f5f81413640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f5f7c14e2a0 con 0x7f5f7c0a1dd0 2024-05-16T22:27:32.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.316+0000 7f5f81413640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f5f7c0b4950 con 0x7f5f7c144650 2024-05-16T22:27:32.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.317+0000 7f5f7a7fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5f7c0a1dd0 0x7f5f7c0b5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.317+0000 7f5f7a7fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5f7c0a1dd0 0x7f5f7c0b5690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58060/0 (socket says 172.21.15.44:58060) 2024-05-16T22:27:32.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.317+0000 7f5f7a7fc640 1 -- 172.21.15.44:0/867170936 learned_addr learned my addr 172.21.15.44:0/867170936 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:32.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.317+0000 7f5f7affd640 1 --2- 172.21.15.44:0/867170936 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5f7c144650 0x7f5f7c0b5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.317+0000 7f5f7a7fc640 1 -- 172.21.15.44:0/867170936 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5f7c144650 msgr2=0x7f5f7c0b5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:32.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.317+0000 7f5f7a7fc640 1 --2- 172.21.15.44:0/867170936 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5f7c144650 0x7f5f7c0b5150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.317+0000 7f5f7a7fc640 1 -- 172.21.15.44:0/867170936 >> v1:172.21.15.70:6789/0 conn(0x7f5f7c14d780 legacy=0x7f5f7c14db90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-16T22:27:32.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.317+0000 7f5f7a7fc640 1 -- 172.21.15.44:0/867170936 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f7c0b4c30 con 0x7f5f7c0a1dd0 2024-05-16T22:27:32.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.317+0000 7f0d660f9640 1 Processor -- start 2024-05-16T22:27:32.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.317+0000 7f0d660f9640 1 -- start start 2024-05-16T22:27:32.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.319+0000 7f5f7a7fc640 1 --2- 172.21.15.44:0/867170936 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5f7c0a1dd0 0x7f5f7c0b5690 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c008870 tx=0x7f5f6c02c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d88991117d035229 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:32.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.319+0000 7f5f79ffb640 1 -- 172.21.15.44:0/867170936 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c03a070 con 0x7f5f7c0a1dd0 2024-05-16T22:27:32.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.319+0000 7f5f79ffb640 1 -- 172.21.15.44:0/867170936 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f6c032480 con 0x7f5f7c0a1dd0 2024-05-16T22:27:32.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.319+0000 7f0d660f9640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f0d580ef2f0 0x7f0d5803b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.319+0000 7f0d660f9640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0d580ef700 0x7f0d58038c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.319+0000 7f0d660f9640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d580f2b20 con 0x7f0d580391c0 2024-05-16T22:27:32.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.319+0000 7f0d660f9640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f0d580f2e00 con 0x7f0d580ef2f0 2024-05-16T22:27:32.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.319+0000 7f0d660f9640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f0d580f30e0 con 0x7f0d580ef700 2024-05-16T22:27:32.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.319+0000 7f0d5f7fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f0d580ef2f0 0x7f0d5803b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.319+0000 7f0d5ffff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f0d580391c0 0x7f0d58006c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.44:45564/0 (socket says 172.21.15.44:45564) 2024-05-16T22:27:32.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.319+0000 7f0d5ffff640 1 -- 172.21.15.44:0/3747880670 learned_addr learned my addr 172.21.15.44:0/3747880670 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:27:32.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.320+0000 7f0d5f7fe640 1 -- 172.21.15.44:0/3747880670 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0d580ef700 msgr2=0x7f0d58038c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-16T22:27:32.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.320+0000 7f0d5f7fe640 1 --2- 172.21.15.44:0/3747880670 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0d580ef700 0x7f0d58038c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.320+0000 7f0d5f7fe640 1 -- 172.21.15.44:0/3747880670 >> v1:172.21.15.70:6789/0 conn(0x7f0d580391c0 legacy=0x7f0d58006c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.320+0000 7f0d5e7fc640 1 -- 172.21.15.44:0/3747880670 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2564895924 0 0) 0x7f0d580f2b20 con 0x7f0d580391c0 2024-05-16T22:27:32.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.320+0000 7f0d5f7fe640 1 -- 172.21.15.44:0/3747880670 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d580f3600 con 0x7f0d580ef2f0 2024-05-16T22:27:32.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.320+0000 7fa8449fa640 1 Processor -- start 2024-05-16T22:27:32.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.320+0000 7f5f81413640 1 -- 172.21.15.44:0/867170936 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5f7c0a1dd0 msgr2=0x7f5f7c0b5690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.320+0000 7f5f81413640 1 --2- 172.21.15.44:0/867170936 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5f7c0a1dd0 0x7f5f7c0b5690 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c008870 tx=0x7f5f6c02c740 comp rx=0 tx=0).stop 2024-05-16T22:27:32.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.320+0000 7fa8449fa640 1 -- start start 2024-05-16T22:27:32.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.321+0000 7ff4ec854640 1 Processor -- start 2024-05-16T22:27:32.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.321+0000 7f5f81413640 1 -- 172.21.15.44:0/867170936 shutdown_connections 2024-05-16T22:27:32.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.321+0000 7f5f81413640 1 --2- 172.21.15.44:0/867170936 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5f7c0a1dd0 0x7f5f7c0b5690 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.321+0000 7f5f81413640 1 --2- 172.21.15.44:0/867170936 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5f7c144650 0x7f5f7c0b5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.321+0000 7f5f81413640 1 -- 172.21.15.44:0/867170936 >> 172.21.15.44:0/867170936 conn(0x7f5f7c0c0060 msgr2=0x7f5f7c0bbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:32.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.321+0000 7ff4ec854640 1 -- start start 2024-05-16T22:27:32.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.321+0000 7f5f81413640 1 -- 172.21.15.44:0/867170936 shutdown_connections 2024-05-16T22:27:32.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.321+0000 7f0d5f7fe640 1 --2- 172.21.15.44:0/3747880670 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0d580ef2f0 0x7f0d5803b5f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0d540097a0 tx=0x7f0d5402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed09ef871a75174d server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:32.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.321+0000 7f0d5e7fc640 1 -- 172.21.15.44:0/3747880670 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d54037070 con 0x7f0d580ef2f0 2024-05-16T22:27:32.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.321+0000 7f5f81413640 1 -- 172.21.15.44:0/867170936 wait complete. 2024-05-16T22:27:32.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.322+0000 7fa8449fa640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa8400bbf30 0x7fa8400bf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.322+0000 7fa8449fa640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa8400bfd50 0x7fa8400be650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.322+0000 7fa8449fa640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8400bc780 con 0x7fa8400beb90 2024-05-16T22:27:32.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.322+0000 7fa8449fa640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fa8400bcdd0 con 0x7fa8400bfd50 2024-05-16T22:27:32.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.322+0000 7fa8449fa640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fa8400bca60 con 0x7fa8400bbf30 2024-05-16T22:27:32.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.323+0000 7ff4ec854640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff4e00427a0 0x7ff4e00cb940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.323+0000 7ff4ec854640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff4e003f660 0x7ff4e003fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.323+0000 7fa83dd9b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa8400bfd50 0x7fa8400be650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.323+0000 7ff4ec854640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4e003ffb0 con 0x7ff4e0040b70 2024-05-16T22:27:32.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.323+0000 7ff4ec854640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7ff4e003d8c0 con 0x7ff4e00427a0 2024-05-16T22:27:32.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.323+0000 7ff4ec854640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7ff4e003e520 con 0x7ff4e003f660 2024-05-16T22:27:32.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.322+0000 7f0d5e7fc640 1 -- 172.21.15.44:0/3747880670 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d54032440 con 0x7f0d580ef2f0 2024-05-16T22:27:32.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.323+0000 7f0d660f9640 1 -- 172.21.15.44:0/3747880670 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0d580ef2f0 msgr2=0x7f0d5803b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.323+0000 7f0d660f9640 1 --2- 172.21.15.44:0/3747880670 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0d580ef2f0 0x7f0d5803b5f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0d540097a0 tx=0x7f0d5402a270 comp rx=0 tx=0).stop 2024-05-16T22:27:32.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.323+0000 7fa83dd9b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa8400bfd50 0x7fa8400be650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58070/0 (socket says 172.21.15.44:58070) 2024-05-16T22:27:32.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.323+0000 7fa83dd9b640 1 -- 172.21.15.44:0/202793357 learned_addr learned my addr 172.21.15.44:0/202793357 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:32.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.323+0000 7f0d660f9640 1 -- 172.21.15.44:0/3747880670 shutdown_connections 2024-05-16T22:27:32.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.323+0000 7f0d660f9640 1 --2- 172.21.15.44:0/3747880670 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0d580ef700 0x7f0d58038c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.323+0000 7f0d660f9640 1 --2- 172.21.15.44:0/3747880670 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0d580ef2f0 0x7f0d5803b5f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.323+0000 7f0d660f9640 1 -- 172.21.15.44:0/3747880670 >> 172.21.15.44:0/3747880670 conn(0x7f0d58006110 msgr2=0x7f0d58006520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:32.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.322+0000 7f1b598c8640 1 Processor -- start 2024-05-16T22:27:32.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.322+0000 7f1b598c8640 1 -- start start 2024-05-16T22:27:32.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.323+0000 7fa83e59c640 1 --2- 172.21.15.44:0/202793357 >> v2:172.21.15.70:3300/0 conn(0x7fa8400bbf30 0x7fa8400bf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.323+0000 7ff4e7fff640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff4e003f660 0x7ff4e003fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.323+0000 7fa83dd9b640 1 -- 172.21.15.44:0/202793357 >> v2:172.21.15.70:3300/0 conn(0x7fa8400bbf30 msgr2=0x7fa8400bf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:32.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.323+0000 7fa83dd9b640 1 --2- 172.21.15.44:0/202793357 >> v2:172.21.15.70:3300/0 conn(0x7fa8400bbf30 0x7fa8400bf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.323+0000 7fa83dd9b640 1 -- 172.21.15.44:0/202793357 >> v1:172.21.15.70:6789/0 conn(0x7fa8400beb90 legacy=0x7fa8400b5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:32.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.323+0000 7f84eedd5640 1 Processor -- start 2024-05-16T22:27:32.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.323+0000 7f84eedd5640 1 -- start start 2024-05-16T22:27:32.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.323+0000 7ff4e77fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff4e00427a0 0x7ff4e00cb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.323+0000 7ff4e77fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff4e00427a0 0x7ff4e00cb940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.44:57332/0 (socket says 172.21.15.44:57332) 2024-05-16T22:27:32.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.323+0000 7ff4e77fe640 1 -- 172.21.15.44:0/1503617707 learned_addr learned my addr 172.21.15.44:0/1503617707 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:32.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.323+0000 7fa83dd9b640 1 -- 172.21.15.44:0/202793357 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8400a2cf0 con 0x7fa8400bfd50 2024-05-16T22:27:32.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.323+0000 7fa83e59c640 1 --2- 172.21.15.44:0/202793357 >> v2:172.21.15.70:3300/0 conn(0x7fa8400bbf30 0x7fa8400bf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:27:32.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.324+0000 7f5f81413640 1 Processor -- start 2024-05-16T22:27:32.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.324+0000 7f5f81413640 1 -- start start 2024-05-16T22:27:32.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.324+0000 7ff4e77fe640 1 -- 172.21.15.44:0/1503617707 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff4e003f660 msgr2=0x7ff4e003fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:32.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.324+0000 7ff4e77fe640 1 --2- 172.21.15.44:0/1503617707 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff4e003f660 0x7ff4e003fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.324+0000 7ff4e77fe640 1 -- 172.21.15.44:0/1503617707 >> v1:172.21.15.70:6789/0 conn(0x7ff4e0040b70 legacy=0x7ff4e0006f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:32.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.324+0000 7ff4e77fe640 1 -- 172.21.15.44:0/1503617707 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4e0007610 con 0x7ff4e00427a0 2024-05-16T22:27:32.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.325+0000 7ff4e77fe640 1 --2- 172.21.15.44:0/1503617707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4e00427a0 0x7ff4e00cb940 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc009870 tx=0x7ff4dc02a150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6ef9b5b7dc68a61 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:32.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.325+0000 7ff4e67fc640 1 -- 172.21.15.44:0/1503617707 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc037070 con 0x7ff4e00427a0 2024-05-16T22:27:32.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.325+0000 7ff4e67fc640 1 -- 172.21.15.44:0/1503617707 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4dc032440 con 0x7ff4e00427a0 2024-05-16T22:27:32.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.325+0000 7ff4e67fc640 1 -- 172.21.15.44:0/1503617707 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc0327f0 con 0x7ff4e00427a0 2024-05-16T22:27:32.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.325+0000 7f84eedd5640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f84e8072940 0x7f84e814caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.325+0000 7f84eedd5640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f84e81528c0 0x7f84e8152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.325+0000 7f84eedd5640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84e806de00 con 0x7f84e80bbc10 2024-05-16T22:27:32.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.325+0000 7f84eedd5640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f84e8073b50 con 0x7f84e81528c0 2024-05-16T22:27:32.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.325+0000 7f84eedd5640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f84e80bc1c0 con 0x7f84e8072940 2024-05-16T22:27:32.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.325+0000 7f84e7fff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f84e80bbc10 0x7f84e806d6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:58980/0 (socket says 172.21.15.44:58980) 2024-05-16T22:27:32.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.325+0000 7f84e7fff640 1 -- 172.21.15.44:0/435566890 learned_addr learned my addr 172.21.15.44:0/435566890 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:27:32.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.325+0000 7f84ed372640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f84e81528c0 0x7f84e8152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.325+0000 7f84ecb71640 1 --2- 172.21.15.44:0/435566890 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f84e8072940 0x7f84e814caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.324+0000 7f0d660f9640 1 -- 172.21.15.44:0/3747880670 shutdown_connections 2024-05-16T22:27:32.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.324+0000 7f0d660f9640 1 -- 172.21.15.44:0/3747880670 wait complete. 2024-05-16T22:27:32.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.324+0000 7f1b598c8640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1b5414f2e0 0x7f1b540bd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.324+0000 7f1b598c8640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b540bea40 con 0x7f1b540bd510 2024-05-16T22:27:32.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.324+0000 7f1b598c8640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b540becb0 con 0x7f1b540be230 2024-05-16T22:27:32.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.324+0000 7f1b598c8640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f1b5414c230 con 0x7f1b5414f2e0 2024-05-16T22:27:32.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.325+0000 7f1b52ffd640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f1b540be230 0x7f1b5406dbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.44:45584/0 (socket says 172.21.15.44:45584) 2024-05-16T22:27:32.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.325+0000 7f1b52ffd640 1 -- 172.21.15.44:0/3894657829 learned_addr learned my addr 172.21.15.44:0/3894657829 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:27:32.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.325+0000 7f1b537fe640 1 --2- 172.21.15.44:0/3894657829 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1b5414f2e0 0x7f1b540bd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.325+0000 7f1b537fe640 1 -- 172.21.15.44:0/3894657829 >> v1:172.21.15.70:6789/0 conn(0x7f1b540be230 legacy=0x7f1b5406dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.324+0000 7fa617534640 1 Processor -- start 2024-05-16T22:27:32.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.324+0000 7fa617534640 1 -- start start 2024-05-16T22:27:32.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.326+0000 7f5f81413640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5f7c0a1dd0 0x7f5f7c0b76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.326+0000 7fa83dd9b640 1 --2- 172.21.15.44:0/202793357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8400bfd50 0x7fa8400be650 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa8400a52f0 tx=0x7fa83802a870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22fc1a359e499b26 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:32.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.326+0000 7f23cf59e640 1 Processor -- start 2024-05-16T22:27:32.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.326+0000 7fa617534640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa608008500 0x7fa608008c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.326+0000 7fa617534640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa6080d5b40 0x7fa6080419f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.326+0000 7fa617534640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa6080cf8b0 0x7fa6080cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.326+0000 7f5f81413640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5f7c144650 0x7f5f7c1e8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.326+0000 7fa617534640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fa608009bb0 con 0x7fa608008500 2024-05-16T22:27:32.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.326+0000 7fa617534640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fa6080d0200 con 0x7fa6080d5b40 2024-05-16T22:27:32.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.326+0000 7fa617534640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fa6080095f0 con 0x7fa6080cf8b0 2024-05-16T22:27:32.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.326+0000 7f5f81413640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f7c14d780 0x7f5f7c1e5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.326+0000 7f0d660f9640 1 Processor -- start 2024-05-16T22:27:32.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.326+0000 7f84ed372640 1 -- 172.21.15.44:0/435566890 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f84e8072940 msgr2=0x7f84e814caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:32.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.326+0000 7f84ed372640 1 --2- 172.21.15.44:0/435566890 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f84e8072940 0x7f84e814caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.326+0000 7f84ed372640 1 -- 172.21.15.44:0/435566890 >> v1:172.21.15.44:6789/0 conn(0x7f84e80bbc10 legacy=0x7f84e806d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.326+0000 7f84ed372640 1 -- 172.21.15.44:0/435566890 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e8073500 con 0x7f84e81528c0 2024-05-16T22:27:32.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.326+0000 7f84ecb71640 1 --2- 172.21.15.44:0/435566890 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f84e8072940 0x7f84e814caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:27:32.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.326+0000 7fa616d33640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa6080cf8b0 0x7fa6080cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.326+0000 7fa616d33640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa6080cf8b0 0x7fa6080cfcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.44:50610/0 (socket says 172.21.15.44:50610) 2024-05-16T22:27:32.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.326+0000 7fa615d31640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa6080d5b40 0x7fa6080419f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.326+0000 7f5f7a7fc640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5f7c144650 0x7f5f7c1e8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.326+0000 7fa615d31640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa6080d5b40 0x7fa6080419f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.44:57340/0 (socket says 172.21.15.44:57340) 2024-05-16T22:27:32.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.326+0000 7fa616d33640 1 -- 172.21.15.44:0/2554473714 learned_addr learned my addr 172.21.15.44:0/2554473714 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:32.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.326+0000 7f5f7a7fc640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5f7c144650 0x7f5f7c1e8de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.44:50600/0 (socket says 172.21.15.44:50600) 2024-05-16T22:27:32.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.327+0000 7fa616532640 1 --2- 172.21.15.44:0/2554473714 >> v2:172.21.15.44:3300/0 conn(0x7fa608008500 0x7fa608008c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.325+0000 7f1b537fe640 1 -- 172.21.15.44:0/3894657829 >> v1:172.21.15.44:6789/0 conn(0x7f1b540bd510 legacy=0x7f1b5414ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.325+0000 7f1b537fe640 1 -- 172.21.15.44:0/3894657829 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b540bef90 con 0x7f1b5414f2e0 2024-05-16T22:27:32.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.327+0000 7f5f7a7fc640 1 -- 172.21.15.44:0/2588171531 learned_addr learned my addr 172.21.15.44:0/2588171531 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:32.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.327+0000 7ff4ec854640 1 -- 172.21.15.44:0/1503617707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4e00427a0 msgr2=0x7ff4e00cb940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.327+0000 7ff4ec854640 1 --2- 172.21.15.44:0/1503617707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4e00427a0 0x7ff4e00cb940 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc009870 tx=0x7ff4dc02a150 comp rx=0 tx=0).stop 2024-05-16T22:27:32.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.326+0000 7f0d660f9640 1 -- start start 2024-05-16T22:27:32.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.327+0000 7f5f7affd640 1 --2- 172.21.15.44:0/2588171531 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5f7c0a1dd0 0x7f5f7c0b76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.327+0000 7f5f81413640 1 -- 172.21.15.44:0/2588171531 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5f7c06f790 con 0x7f5f7c0a1dd0 2024-05-16T22:27:32.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.327+0000 7ff4ec854640 1 -- 172.21.15.44:0/1503617707 shutdown_connections 2024-05-16T22:27:32.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.327+0000 7ff4ec854640 1 --2- 172.21.15.44:0/1503617707 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff4e003f660 0x7ff4e003fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.327+0000 7ff4ec854640 1 --2- 172.21.15.44:0/1503617707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4e00427a0 0x7ff4e00cb940 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.327+0000 7ff4ec854640 1 -- 172.21.15.44:0/1503617707 >> 172.21.15.44:0/1503617707 conn(0x7ff4e00063e0 msgr2=0x7ff4e00067f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:32.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.327+0000 7f1b537fe640 1 --2- 172.21.15.44:0/3894657829 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1b5414f2e0 0x7f1b540bd920 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c009dc0 tx=0x7f1b4c02a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfbc483ac565e3eb server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:32.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.327+0000 7f5f81413640 1 -- 172.21.15.44:0/2588171531 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5f7c0bc870 con 0x7f5f7c14d780 2024-05-16T22:27:32.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.327+0000 7f5f81413640 1 -- 172.21.15.44:0/2588171531 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f5f7c06f910 con 0x7f5f7c144650 2024-05-16T22:27:32.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.327+0000 7ff4ec854640 1 -- 172.21.15.44:0/1503617707 shutdown_connections 2024-05-16T22:27:32.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.327+0000 7fa616532640 1 -- 172.21.15.44:0/2554473714 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa6080cf8b0 msgr2=0x7fa6080cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:32.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.327+0000 7fa616532640 1 --2- 172.21.15.44:0/2554473714 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa6080cf8b0 0x7fa6080cfcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.327+0000 7fa616532640 1 -- 172.21.15.44:0/2554473714 >> v2:172.21.15.70:3300/0 conn(0x7fa6080d5b40 msgr2=0x7fa6080419f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:32.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.327+0000 7fa616532640 1 --2- 172.21.15.44:0/2554473714 >> v2:172.21.15.70:3300/0 conn(0x7fa6080d5b40 0x7fa6080419f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.327+0000 7fa616532640 1 -- 172.21.15.44:0/2554473714 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6080098d0 con 0x7fa608008500 2024-05-16T22:27:32.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.327+0000 7fa83d59a640 1 -- 172.21.15.44:0/202793357 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa838037070 con 0x7fa8400bfd50 2024-05-16T22:27:32.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.327+0000 7fa83d59a640 1 -- 172.21.15.44:0/202793357 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa838032460 con 0x7fa8400bfd50 2024-05-16T22:27:32.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.327+0000 7fa83d59a640 1 -- 172.21.15.44:0/202793357 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa838037070 con 0x7fa8400bfd50 2024-05-16T22:27:32.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.327+0000 7ff4ec854640 1 -- 172.21.15.44:0/1503617707 wait complete. 2024-05-16T22:27:32.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.326+0000 7f23cf59e640 1 -- start start 2024-05-16T22:27:32.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.327+0000 7f5f7b7fe640 1 --2- 172.21.15.44:0/2588171531 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f7c14d780 0x7f5f7c1e5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.328+0000 7f84ed372640 1 --2- 172.21.15.44:0/435566890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84e81528c0 0x7f84e8152cd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f84e0009d90 tx=0x7f84e002a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=610d4441d7c4eb3a server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:32.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.327+0000 7f1b51ffb640 1 -- 172.21.15.44:0/3894657829 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c007740 con 0x7f1b5414f2e0 2024-05-16T22:27:32.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.327+0000 7f1b51ffb640 1 -- 172.21.15.44:0/3894657829 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b4c0078e0 con 0x7f1b5414f2e0 2024-05-16T22:27:32.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.328+0000 7f5f7a7fc640 1 -- 172.21.15.44:0/2588171531 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f7c14d780 msgr2=0x7f5f7c1e5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.328+0000 7f5f7a7fc640 1 --2- 172.21.15.44:0/2588171531 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f7c14d780 0x7f5f7c1e5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.328+0000 7f5f7a7fc640 1 -- 172.21.15.44:0/2588171531 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5f7c0a1dd0 msgr2=0x7f5f7c0b76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.328+0000 7f5f7a7fc640 1 --2- 172.21.15.44:0/2588171531 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5f7c0a1dd0 0x7f5f7c0b76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.328+0000 7f5f7a7fc640 1 -- 172.21.15.44:0/2588171531 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f7c0b7e70 con 0x7f5f7c144650 2024-05-16T22:27:32.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.328+0000 7f5f7b7fe640 1 --2- 172.21.15.44:0/2588171531 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f7c14d780 0x7f5f7c1e5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T22:27:32.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.328+0000 7f5f7a7fc640 1 --2- 172.21.15.44:0/2588171531 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5f7c144650 0x7f5f7c1e8de0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c02cd30 tx=0x7f5f6c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:32.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.328+0000 7f84e77fe640 1 -- 172.21.15.44:0/435566890 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e0007740 con 0x7f84e81528c0 2024-05-16T22:27:32.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.328+0000 7f84e77fe640 1 -- 172.21.15.44:0/435566890 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84e00078e0 con 0x7f84e81528c0 2024-05-16T22:27:32.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.328+0000 7f84e77fe640 1 -- 172.21.15.44:0/435566890 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e0007cb0 con 0x7f84e81528c0 2024-05-16T22:27:32.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.328+0000 7fa616532640 1 --2- 172.21.15.44:0/2554473714 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa608008500 0x7fa608008c10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa608007720 tx=0x7fa60002a0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f36f80126ccd69b server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:32.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.328+0000 7f23cf59e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f23d00b62c0 0x7f23d0144520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.328+0000 7f23cf59e640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23d006fda0 con 0x7f23d014a350 2024-05-16T22:27:32.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.328+0000 7f23cf59e640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23d014dbb0 con 0x7f23d006d200 2024-05-16T22:27:32.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.328+0000 7f23cf59e640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f23d014e4e0 con 0x7f23d00b62c0 2024-05-16T22:27:32.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.328+0000 7f5f637fe640 1 -- 172.21.15.44:0/2588171531 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c03a070 con 0x7f5f7c144650 2024-05-16T22:27:32.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.328+0000 7f5f637fe640 1 -- 172.21.15.44:0/2588171531 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f6c00b4c0 con 0x7f5f7c144650 2024-05-16T22:27:32.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.328+0000 7f0d660f9640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0d580391c0 0x7f0d58028170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.328+0000 7f0d660f9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d580ef2f0 0x7f0d5803cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.328+0000 7f0d660f9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0d580ef700 0x7f0d58024c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.329+0000 7f0d660f9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0d58007340 con 0x7f0d580ef2f0 2024-05-16T22:27:32.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.329+0000 7f0d5ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0d580ef700 0x7f0d58024c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.329+0000 7f0d5ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0d580ef700 0x7f0d58024c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.44:57358/0 (socket says 172.21.15.44:57358) 2024-05-16T22:27:32.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.329+0000 7f0d5ffff640 1 -- 172.21.15.44:0/3105407098 learned_addr learned my addr 172.21.15.44:0/3105407098 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:32.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.329+0000 7f0d660f9640 1 -- 172.21.15.44:0/3105407098 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0d5803bd40 con 0x7f0d580ef700 2024-05-16T22:27:32.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.329+0000 7f1b598c8640 1 -- 172.21.15.44:0/3894657829 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1b5414f2e0 msgr2=0x7f1b540bd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.329+0000 7f1b598c8640 1 --2- 172.21.15.44:0/3894657829 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1b5414f2e0 0x7f1b540bd920 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c009dc0 tx=0x7f1b4c02a5f0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.329+0000 7f0d660f9640 1 -- 172.21.15.44:0/3105407098 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f0d580074c0 con 0x7f0d580391c0 2024-05-16T22:27:32.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.329+0000 7fa615530640 1 -- 172.21.15.44:0/2554473714 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa600037070 con 0x7fa608008500 2024-05-16T22:27:32.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.329+0000 7f5f637fe640 1 -- 172.21.15.44:0/2588171531 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c00b870 con 0x7f5f7c144650 2024-05-16T22:27:32.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.329+0000 7f0d5f7fe640 1 --2- 172.21.15.44:0/3105407098 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0d580391c0 0x7f0d58028170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.329+0000 7f84eedd5640 1 -- 172.21.15.44:0/435566890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84e81528c0 msgr2=0x7f84e8152cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.329+0000 7f84eedd5640 1 --2- 172.21.15.44:0/435566890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84e81528c0 0x7f84e8152cd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f84e0009d90 tx=0x7f84e002a6f0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.329+0000 7f5f81413640 1 -- 172.21.15.44:0/2588171531 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f7c0b7c00 con 0x7f5f7c144650 2024-05-16T22:27:32.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.329+0000 7f0d5ffff640 1 -- 172.21.15.44:0/3105407098 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0d580391c0 msgr2=0x7f0d58028170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.329+0000 7f0d5effd640 1 --2- 172.21.15.44:0/3105407098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d580ef2f0 0x7f0d5803cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.329+0000 7f0d5ffff640 1 --2- 172.21.15.44:0/3105407098 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0d580391c0 0x7f0d58028170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.329+0000 7f0d5ffff640 1 -- 172.21.15.44:0/3105407098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d580ef2f0 msgr2=0x7f0d5803cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.329+0000 7fa615530640 1 -- 172.21.15.44:0/2554473714 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa60002ade0 con 0x7fa608008500 2024-05-16T22:27:32.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.329+0000 7fa615530640 1 -- 172.21.15.44:0/2554473714 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa600032640 con 0x7fa608008500 2024-05-16T22:27:32.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.329+0000 7f0d5ffff640 1 --2- 172.21.15.44:0/3105407098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d580ef2f0 0x7f0d5803cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.329+0000 7f0d5ffff640 1 -- 172.21.15.44:0/3105407098 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d580286b0 con 0x7f0d580ef700 2024-05-16T22:27:32.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.329+0000 7f0d5effd640 1 --2- 172.21.15.44:0/3105407098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d580ef2f0 0x7f0d5803cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T22:27:32.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.329+0000 7f23ce59c640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f23d006d200 0x7f23d006f690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.44:45598/0 (socket says 172.21.15.44:45598) 2024-05-16T22:27:32.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.329+0000 7f5f81413640 1 -- 172.21.15.44:0/2588171531 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f7c0b7070 con 0x7f5f7c144650 2024-05-16T22:27:32.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.330+0000 7f84eedd5640 1 -- 172.21.15.44:0/435566890 shutdown_connections 2024-05-16T22:27:32.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.330+0000 7f84eedd5640 1 --2- 172.21.15.44:0/435566890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84e81528c0 0x7f84e8152cd0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.330+0000 7f0d5ffff640 1 --2- 172.21.15.44:0/3105407098 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0d580ef700 0x7f0d58024c50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0d60052210 tx=0x7f0d6006ead0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:32.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.329+0000 7f23ce59c640 1 -- 172.21.15.44:0/3979802533 learned_addr learned my addr 172.21.15.44:0/3979802533 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:27:32.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.330+0000 7f84eedd5640 1 --2- 172.21.15.44:0/435566890 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f84e8072940 0x7f84e814caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.330+0000 7f84eedd5640 1 -- 172.21.15.44:0/435566890 >> 172.21.15.44:0/435566890 conn(0x7f84e806f390 msgr2=0x7f84e806f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:32.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.329+0000 7f23cdd9b640 1 --2- 172.21.15.44:0/3979802533 >> v2:172.21.15.44:3300/0 conn(0x7f23d00b62c0 0x7f23d0144520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.329+0000 7f23cd59a640 1 -- 172.21.15.44:0/3979802533 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3090389960 0 0) 0x7f23d014dbb0 con 0x7f23d006d200 2024-05-16T22:27:32.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.329+0000 7f23cd59a640 1 -- 172.21.15.44:0/3979802533 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23bc003520 con 0x7f23d006d200 2024-05-16T22:27:32.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.329+0000 7ff4ec854640 1 Processor -- start 2024-05-16T22:27:32.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.330+0000 7ff4ec854640 1 -- start start 2024-05-16T22:27:32.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.330+0000 7f23cd59a640 1 -- 172.21.15.44:0/3979802533 <== mon.1 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3051159941 0 0) 0x7f23bc003520 con 0x7f23d006d200 2024-05-16T22:27:32.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.330+0000 7f23cd59a640 1 -- 172.21.15.44:0/3979802533 >> v2:172.21.15.44:3300/0 conn(0x7f23d00b62c0 msgr2=0x7f23d0144520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:32.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.330+0000 7f23cd59a640 1 --2- 172.21.15.44:0/3979802533 >> v2:172.21.15.44:3300/0 conn(0x7f23d00b62c0 0x7f23d0144520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.330+0000 7f23cd59a640 1 -- 172.21.15.44:0/3979802533 >> v1:172.21.15.44:6789/0 conn(0x7f23d014a350 legacy=0x7f23d014a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:32.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.330+0000 7f23cd59a640 1 -- 172.21.15.44:0/3979802533 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23d014de90 con 0x7f23d006d200 2024-05-16T22:27:32.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.330+0000 7f23cd59a640 1 -- 172.21.15.44:0/3979802533 <== mon.1 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 568431863 0 0) 0x7f23b80016f0 con 0x7f23d006d200 2024-05-16T22:27:32.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.330+0000 7f23cd59a640 1 -- 172.21.15.44:0/3979802533 >> v1:172.21.15.70:6789/0 conn(0x7f23d006d200 legacy=0x7f23d006f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.330+0000 7f23cd59a640 1 --2- 172.21.15.44:0/3979802533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23bc003a00 0x7f23bc003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.330+0000 7f23cd59a640 1 --2- 172.21.15.44:0/3979802533 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23bc004800 0x7f23bc004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.330+0000 7f23cd59a640 1 --2- 172.21.15.44:0/3979802533 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f23bc0051a0 0x7f23bc0141d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.330+0000 7f23cd59a640 1 -- 172.21.15.44:0/3979802533 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f23d014e4e0 con 0x7f23bc003a00 2024-05-16T22:27:32.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.330+0000 7f23cd59a640 1 -- 172.21.15.44:0/3979802533 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f23bc014950 con 0x7f23bc004800 2024-05-16T22:27:32.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.330+0000 7f23cd59a640 1 -- 172.21.15.44:0/3979802533 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f23bc014b50 con 0x7f23bc0051a0 2024-05-16T22:27:32.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.330+0000 7f23ced9d640 1 --2- 172.21.15.44:0/3979802533 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f23bc0051a0 0x7f23bc0141d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.330+0000 7f23ce59c640 1 --2- 172.21.15.44:0/3979802533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23bc003a00 0x7f23bc003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.330+0000 7f23cdd9b640 1 --2- 172.21.15.44:0/3979802533 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23bc004800 0x7f23bc004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.330+0000 7f0d4bfff640 1 -- 172.21.15.44:0/3105407098 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d6006c6e0 con 0x7f0d580ef700 2024-05-16T22:27:32.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.330+0000 7f0d4bfff640 1 -- 172.21.15.44:0/3105407098 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d6006c880 con 0x7f0d580ef700 2024-05-16T22:27:32.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.330+0000 7f0d4bfff640 1 -- 172.21.15.44:0/3105407098 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d6006cc70 con 0x7f0d580ef700 2024-05-16T22:27:32.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.331+0000 7f0d660f9640 1 -- 172.21.15.44:0/3105407098 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d580416d0 con 0x7f0d580ef700 2024-05-16T22:27:32.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.331+0000 7f0d660f9640 1 -- 172.21.15.44:0/3105407098 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d5803e780 con 0x7f0d580ef700 2024-05-16T22:27:32.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.330+0000 7f84eedd5640 1 -- 172.21.15.44:0/435566890 shutdown_connections 2024-05-16T22:27:32.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.330+0000 7f84eedd5640 1 -- 172.21.15.44:0/435566890 wait complete. 2024-05-16T22:27:32.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.331+0000 7fa617534640 1 -- 172.21.15.44:0/2554473714 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa608008500 msgr2=0x7fa608008c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.331+0000 7fa617534640 1 --2- 172.21.15.44:0/2554473714 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa608008500 0x7fa608008c10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa608007720 tx=0x7fa60002a0d0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.331+0000 7f5f81413640 1 -- 172.21.15.44:0/2588171531 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f7c0b8c30 con 0x7f5f7c144650 2024-05-16T22:27:32.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.330+0000 7fa8449fa640 1 -- 172.21.15.44:0/202793357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8400bfd50 msgr2=0x7fa8400be650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.330+0000 7fa8449fa640 1 --2- 172.21.15.44:0/202793357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8400bfd50 0x7fa8400be650 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa8400a52f0 tx=0x7fa83802a870 comp rx=0 tx=0).stop 2024-05-16T22:27:32.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.331+0000 7fa8449fa640 1 -- 172.21.15.44:0/202793357 shutdown_connections 2024-05-16T22:27:32.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.331+0000 7fa8449fa640 1 --2- 172.21.15.44:0/202793357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8400bfd50 0x7fa8400be650 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.331+0000 7fa617534640 1 -- 172.21.15.44:0/2554473714 shutdown_connections 2024-05-16T22:27:32.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.331+0000 7fa617534640 1 --2- 172.21.15.44:0/2554473714 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa6080cf8b0 0x7fa6080cfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.331+0000 7fa617534640 1 --2- 172.21.15.44:0/2554473714 >> v2:172.21.15.70:3300/0 conn(0x7fa6080d5b40 0x7fa6080419f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.331+0000 7fa617534640 1 --2- 172.21.15.44:0/2554473714 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa608008500 0x7fa608008c10 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.331+0000 7fa617534640 1 -- 172.21.15.44:0/2554473714 >> 172.21.15.44:0/2554473714 conn(0x7fa6080450e0 msgr2=0x7fa6080412e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:32.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.331+0000 7fa8449fa640 1 --2- 172.21.15.44:0/202793357 >> v2:172.21.15.70:3300/0 conn(0x7fa8400bbf30 0x7fa8400bf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.331+0000 7f23ce59c640 1 -- 172.21.15.44:0/3979802533 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f23bc0051a0 msgr2=0x7f23bc0141d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:32.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.331+0000 7f23ce59c640 1 --2- 172.21.15.44:0/3979802533 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f23bc0051a0 0x7f23bc0141d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.331+0000 7f23ce59c640 1 -- 172.21.15.44:0/3979802533 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23bc004800 msgr2=0x7f23bc004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:32.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.331+0000 7f23ce59c640 1 --2- 172.21.15.44:0/3979802533 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23bc004800 0x7f23bc004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.331+0000 7f23ce59c640 1 -- 172.21.15.44:0/3979802533 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23d014de90 con 0x7f23bc003a00 2024-05-16T22:27:32.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.331+0000 7f23ced9d640 1 -- 172.21.15.44:0/3979802533 reap_dead start 2024-05-16T22:27:32.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.331+0000 7fa8449fa640 1 -- 172.21.15.44:0/202793357 >> 172.21.15.44:0/202793357 conn(0x7fa8400a3750 msgr2=0x7fa8400a3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:32.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.332+0000 7fa617534640 1 -- 172.21.15.44:0/2554473714 shutdown_connections 2024-05-16T22:27:32.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.332+0000 7f1b598c8640 1 -- 172.21.15.44:0/3894657829 shutdown_connections 2024-05-16T22:27:32.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.332+0000 7f1b598c8640 1 --2- 172.21.15.44:0/3894657829 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1b5414f2e0 0x7f1b540bd920 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.332+0000 7f1b598c8640 1 -- 172.21.15.44:0/3894657829 >> 172.21.15.44:0/3894657829 conn(0x7f1b540c3cd0 msgr2=0x7f1b540c40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:32.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.332+0000 7ff4ec854640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4e003f660 0x7ff4e00d1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.332+0000 7ff4ec854640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff4e0040b70 0x7ff4e00c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.331+0000 7fa8449fa640 1 -- 172.21.15.44:0/202793357 shutdown_connections 2024-05-16T22:27:32.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.332+0000 7ff4ec854640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4e00427a0 0x7ff4e00c7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.331+0000 7fa8449fa640 1 -- 172.21.15.44:0/202793357 wait complete. 2024-05-16T22:27:32.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.332+0000 7ff4e6ffd640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff4e0040b70 0x7ff4e00c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.332+0000 7ff4ec854640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e003d3a0 con 0x7ff4e003f660 2024-05-16T22:27:32.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.332+0000 7f0d660f9640 1 -- 172.21.15.44:0/3105407098 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d580054d0 con 0x7f0d580ef700 2024-05-16T22:27:32.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.332+0000 7f23ce59c640 1 --2- 172.21.15.44:0/3979802533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23bc003a00 0x7f23bc003e50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f23bc0057e0 tx=0x7f23bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71391d4874804cd7 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:32.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.332+0000 7ff4ec854640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e003e240 con 0x7ff4e00427a0 2024-05-16T22:27:32.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.332+0000 7ff4ec854640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7ff4e0042e50 con 0x7ff4e0040b70 2024-05-16T22:27:32.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.332+0000 7ff4e6ffd640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff4e0040b70 0x7ff4e00c83f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.44:50630/0 (socket says 172.21.15.44:50630) 2024-05-16T22:27:32.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.332+0000 7ff4e6ffd640 1 -- 172.21.15.44:0/954946087 learned_addr learned my addr 172.21.15.44:0/954946087 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:32.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.332+0000 7ff4e7fff640 1 --2- 172.21.15.44:0/954946087 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4e00427a0 0x7ff4e00c7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.332+0000 7ff4e77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4e003f660 0x7ff4e00d1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.332+0000 7f84eedd5640 1 Processor -- start 2024-05-16T22:27:32.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.332+0000 7f1b598c8640 1 -- 172.21.15.44:0/3894657829 shutdown_connections 2024-05-16T22:27:32.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.332+0000 7f1b598c8640 1 -- 172.21.15.44:0/3894657829 wait complete. 2024-05-16T22:27:32.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.332+0000 7fa617534640 1 -- 172.21.15.44:0/2554473714 wait complete. 2024-05-16T22:27:32.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.333+0000 7ff4e77fe640 1 -- 172.21.15.44:0/954946087 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff4e0040b70 msgr2=0x7ff4e00c83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.333+0000 7f5f637fe640 1 -- 172.21.15.44:0/2588171531 <== mon.2 v2:172.21.15.70:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5f6c03e070 con 0x7f5f7c144650 2024-05-16T22:27:32.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.333+0000 7ff4e77fe640 1 --2- 172.21.15.44:0/954946087 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff4e0040b70 0x7ff4e00c83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.333+0000 7ff4e77fe640 1 -- 172.21.15.44:0/954946087 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4e00427a0 msgr2=0x7ff4e00c7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.333+0000 7ff4e77fe640 1 --2- 172.21.15.44:0/954946087 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4e00427a0 0x7ff4e00c7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.333+0000 7ff4e77fe640 1 -- 172.21.15.44:0/954946087 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4e016f5f0 con 0x7ff4e003f660 2024-05-16T22:27:32.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.332+0000 7f84eedd5640 1 -- start start 2024-05-16T22:27:32.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.333+0000 7ff4e77fe640 1 --2- 172.21.15.44:0/954946087 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4e003f660 0x7ff4e00d1990 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc031000 tx=0x7ff4dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:32.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.334+0000 7ff4d3fff640 1 -- 172.21.15.44:0/954946087 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc037050 con 0x7ff4e003f660 2024-05-16T22:27:32.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.333+0000 7f23cd59a640 1 -- 172.21.15.44:0/3979802533 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b8007d90 con 0x7f23bc003a00 2024-05-16T22:27:32.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.333+0000 7f23cd59a640 1 -- 172.21.15.44:0/3979802533 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23b8005ad0 con 0x7f23bc003a00 2024-05-16T22:27:32.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.333+0000 7f23cd59a640 1 -- 172.21.15.44:0/3979802533 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b8007070 con 0x7f23bc003a00 2024-05-16T22:27:32.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.334+0000 7f23cf59e640 1 -- 172.21.15.44:0/3979802533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23bc003a00 msgr2=0x7f23bc003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.334+0000 7f23cf59e640 1 --2- 172.21.15.44:0/3979802533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23bc003a00 0x7f23bc003e50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f23bc0057e0 tx=0x7f23bc005830 comp rx=0 tx=0).stop 2024-05-16T22:27:32.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.334+0000 7f23cf59e640 1 -- 172.21.15.44:0/3979802533 shutdown_connections 2024-05-16T22:27:32.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.334+0000 7ff4d3fff640 1 -- 172.21.15.44:0/954946087 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4dc043070 con 0x7ff4e003f660 2024-05-16T22:27:32.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.334+0000 7f5f637fe640 1 --2- 172.21.15.44:0/2588171531 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f5f680763a0 0x7f5f680788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.334+0000 7f23cf59e640 1 --2- 172.21.15.44:0/3979802533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23bc003a00 0x7f23bc003e50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.334+0000 7f23cf59e640 1 -- 172.21.15.44:0/3979802533 >> 172.21.15.44:0/3979802533 conn(0x7f23d006c6e0 msgr2=0x7f23d006caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:32.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.334+0000 7fa617534640 1 Processor -- start 2024-05-16T22:27:32.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.334+0000 7f84eedd5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84e8072940 0x7f84e80b8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.334+0000 7f23cf59e640 1 -- 172.21.15.44:0/3979802533 shutdown_connections 2024-05-16T22:27:32.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.335+0000 7ff4ec854640 1 -- 172.21.15.44:0/954946087 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4e00c8930 con 0x7ff4e003f660 2024-05-16T22:27:32.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.334+0000 7fa617534640 1 -- start start 2024-05-16T22:27:32.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.335+0000 7ff4ec854640 1 -- 172.21.15.44:0/954946087 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4e00c7660 con 0x7ff4e003f660 2024-05-16T22:27:32.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.335+0000 7fa8449fa640 1 Processor -- start 2024-05-16T22:27:32.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.335+0000 7f84eedd5640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f84e80bbc10 0x7f84e80b8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.334+0000 7f0d4bfff640 1 -- 172.21.15.44:0/3105407098 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0d60076150 con 0x7f0d580ef700 2024-05-16T22:27:32.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.335+0000 7f84ecb71640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84e8072940 0x7f84e80b8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.335+0000 7f84ecb71640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84e8072940 0x7f84e80b8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.44:57384/0 (socket says 172.21.15.44:57384) 2024-05-16T22:27:32.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.335+0000 7f84ecb71640 1 -- 172.21.15.44:0/1502992402 learned_addr learned my addr 172.21.15.44:0/1502992402 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:32.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.335+0000 7f1b598c8640 1 Processor -- start 2024-05-16T22:27:32.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.335+0000 7f1b598c8640 1 -- start start 2024-05-16T22:27:32.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.335+0000 7f84eedd5640 1 --2- 172.21.15.44:0/1502992402 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84e81528c0 0x7f84e80a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.335+0000 7f0d4bfff640 1 --2- 172.21.15.44:0/3105407098 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0d440763d0 0x7f0d440788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.335+0000 7f84eedd5640 1 -- 172.21.15.44:0/1502992402 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f84e8076230 con 0x7f84e81528c0 2024-05-16T22:27:32.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.335+0000 7f84eedd5640 1 -- 172.21.15.44:0/1502992402 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f84e8153210 con 0x7f84e8072940 2024-05-16T22:27:32.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.335+0000 7f84eedd5640 1 -- 172.21.15.44:0/1502992402 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f84e80763b0 con 0x7f84e80bbc10 2024-05-16T22:27:32.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.335+0000 7f84e7fff640 1 --2- 172.21.15.44:0/1502992402 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f84e80bbc10 0x7f84e80b8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.335+0000 7f0d4bfff640 1 -- 172.21.15.44:0/3105407098 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0d60102c30 con 0x7f0d580ef700 2024-05-16T22:27:32.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.335+0000 7f84ed372640 1 --2- 172.21.15.44:0/1502992402 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84e81528c0 0x7f84e80a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.335+0000 7f0d5f7fe640 1 --2- 172.21.15.44:0/3105407098 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0d440763d0 0x7f0d440788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.335+0000 7f5f637fe640 1 -- 172.21.15.44:0/2588171531 <== mon.2 v2:172.21.15.70:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5f6c0b7720 con 0x7f5f7c144650 2024-05-16T22:27:32.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.335+0000 7f5f7affd640 1 --2- 172.21.15.44:0/2588171531 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f5f680763a0 0x7f5f680788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.335+0000 7f23cf59e640 1 -- 172.21.15.44:0/3979802533 wait complete. 2024-05-16T22:27:32.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.335+0000 7ff4d3fff640 1 -- 172.21.15.44:0/954946087 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc0329f0 con 0x7ff4e003f660 2024-05-16T22:27:32.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.336+0000 7f84e7fff640 1 -- 172.21.15.44:0/1502992402 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84e8072940 msgr2=0x7f84e80b8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.336+0000 7f84e7fff640 1 --2- 172.21.15.44:0/1502992402 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84e8072940 0x7f84e80b8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.336+0000 7f84e7fff640 1 -- 172.21.15.44:0/1502992402 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84e81528c0 msgr2=0x7f84e80a5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.336+0000 7f84e7fff640 1 --2- 172.21.15.44:0/1502992402 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84e81528c0 0x7f84e80a5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.336+0000 7f84e7fff640 1 -- 172.21.15.44:0/1502992402 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e80a6000 con 0x7f84e80bbc10 2024-05-16T22:27:32.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.336+0000 7f84ed372640 1 --2- 172.21.15.44:0/1502992402 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84e81528c0 0x7f84e80a5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:27:32.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.336+0000 7fa8449fa640 1 -- start start 2024-05-16T22:27:32.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.336+0000 7f84e7fff640 1 --2- 172.21.15.44:0/1502992402 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f84e80bbc10 0x7f84e80b8e10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f84dc00c310 tx=0x7f84dc00c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:32.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.336+0000 7f5f7affd640 1 --2- 172.21.15.44:0/2588171531 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f5f680763a0 0x7f5f680788b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5f7400f360 tx=0x7f5f74007710 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:32.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.336+0000 7fa617534640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa608008500 0x7fa6080d6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.336+0000 7f0d5f7fe640 1 --2- 172.21.15.44:0/3105407098 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0d440763d0 0x7f0d440788e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0d54034000 tx=0x7f0d5402e000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:32.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.337+0000 7fa617534640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6080cf8b0 0x7fa6080c6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.337+0000 7f1b598c8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b540bd510 0x7f1b541e34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.337+0000 7fa617534640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa6080d5b40 0x7fa6080c6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.337+0000 7fa617534640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa6080093d0 con 0x7fa608008500 2024-05-16T22:27:32.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.337+0000 7fa617534640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa608009250 con 0x7fa6080cf8b0 2024-05-16T22:27:32.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.337+0000 7fa616532640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa608008500 0x7fa6080d6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.337+0000 7fa616532640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa608008500 0x7fa6080d6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58136/0 (socket says 172.21.15.44:58136) 2024-05-16T22:27:32.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.337+0000 7fa616532640 1 -- 172.21.15.44:0/1254665567 learned_addr learned my addr 172.21.15.44:0/1254665567 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:32.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.337+0000 7fa617534640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fa6080d5f50 con 0x7fa6080d5b40 2024-05-16T22:27:32.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.337+0000 7fa615d31640 1 --2- 172.21.15.44:0/1254665567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6080cf8b0 0x7fa6080c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.337+0000 7fa616d33640 1 --2- 172.21.15.44:0/1254665567 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa6080d5b40 0x7fa6080c6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.337+0000 7f23cf59e640 1 Processor -- start 2024-05-16T22:27:32.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.337+0000 7f1b52ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b540bd510 0x7f1b541e34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.337+0000 7f1b52ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b540bd510 0x7f1b541e34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58144/0 (socket says 172.21.15.44:58144) 2024-05-16T22:27:32.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.337+0000 7f1b52ffd640 1 -- 172.21.15.44:0/776459104 learned_addr learned my addr 172.21.15.44:0/776459104 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:32.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.337+0000 7f1b598c8640 1 --2- 172.21.15.44:0/776459104 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1b540be230 0x7f1b541518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.337+0000 7ff4ec854640 1 -- 172.21.15.44:0/954946087 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4e016f7c0 con 0x7ff4e003f660 2024-05-16T22:27:32.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.337+0000 7f23cf59e640 1 -- start start 2024-05-16T22:27:32.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.337+0000 7fa616532640 1 -- 172.21.15.44:0/1254665567 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa6080d5b40 msgr2=0x7fa6080c6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.337+0000 7fa616532640 1 --2- 172.21.15.44:0/1254665567 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa6080d5b40 0x7fa6080c6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.337+0000 7fa616532640 1 -- 172.21.15.44:0/1254665567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6080cf8b0 msgr2=0x7fa6080c6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.337+0000 7fa616532640 1 --2- 172.21.15.44:0/1254665567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6080cf8b0 0x7fa6080c6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.337+0000 7f1b598c8640 1 --2- 172.21.15.44:0/776459104 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b5414f2e0 0x7f1b5414b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.337+0000 7fa616532640 1 -- 172.21.15.44:0/1254665567 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6080d7410 con 0x7fa608008500 2024-05-16T22:27:32.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.338+0000 7fa616532640 1 --2- 172.21.15.44:0/1254665567 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa608008500 0x7fa6080d6ed0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa600000c00 tx=0x7fa600004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:32.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.338+0000 7fa8449fa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8400bbf30 0x7fa8400a7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.338+0000 7fa8449fa640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa8400beb90 0x7fa8401f5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.338+0000 7fa8449fa640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8400bfd50 0x7fa8400cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.338+0000 7fa8449fa640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa84008d4e0 con 0x7fa8400bfd50 2024-05-16T22:27:32.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.338+0000 7fa8449fa640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa84008d360 con 0x7fa8400bbf30 2024-05-16T22:27:32.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.338+0000 7fa8449fa640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fa8400bc340 con 0x7fa8400beb90 2024-05-16T22:27:32.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.338+0000 7fa606ffd640 1 -- 172.21.15.44:0/1254665567 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa600037040 con 0x7fa608008500 2024-05-16T22:27:32.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.338+0000 7fa606ffd640 1 -- 172.21.15.44:0/1254665567 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa600042070 con 0x7fa608008500 2024-05-16T22:27:32.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.338+0000 7fa606ffd640 1 -- 172.21.15.44:0/1254665567 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa600006dd0 con 0x7fa608008500 2024-05-16T22:27:32.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.338+0000 7fa83ed9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8400bfd50 0x7fa8400cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.338+0000 7fa83ed9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8400bfd50 0x7fa8400cbeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58154/0 (socket says 172.21.15.44:58154) 2024-05-16T22:27:32.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.338+0000 7fa83ed9d640 1 -- 172.21.15.44:0/117144155 learned_addr learned my addr 172.21.15.44:0/117144155 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:32.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.338+0000 7f1b527fc640 1 --2- 172.21.15.44:0/776459104 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1b540be230 0x7f1b541518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.338+0000 7f1b537fe640 1 --2- 172.21.15.44:0/776459104 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b5414f2e0 0x7f1b5414b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.338+0000 7f1b598c8640 1 -- 172.21.15.44:0/776459104 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1b5408d850 con 0x7f1b540bd510 2024-05-16T22:27:32.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.338+0000 7f1b598c8640 1 -- 172.21.15.44:0/776459104 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1b540be640 con 0x7f1b5414f2e0 2024-05-16T22:27:32.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.338+0000 7f1b598c8640 1 -- 172.21.15.44:0/776459104 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f1b5408d9d0 con 0x7f1b540be230 2024-05-16T22:27:32.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.338+0000 7fa617534640 1 -- 172.21.15.44:0/1254665567 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa60816bc60 con 0x7fa608008500 2024-05-16T22:27:32.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.338+0000 7fa83e59c640 1 --2- 172.21.15.44:0/117144155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8400bbf30 0x7fa8400a7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.338+0000 7fa83dd9b640 1 --2- 172.21.15.44:0/117144155 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa8400beb90 0x7fa8401f5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.338+0000 7fa617534640 1 -- 172.21.15.44:0/1254665567 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa60816bf40 con 0x7fa608008500 2024-05-16T22:27:32.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.338+0000 7f1b537fe640 1 -- 172.21.15.44:0/776459104 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1b540be230 msgr2=0x7f1b541518f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.338+0000 7f1b537fe640 1 --2- 172.21.15.44:0/776459104 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1b540be230 0x7f1b541518f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.338+0000 7f1b537fe640 1 -- 172.21.15.44:0/776459104 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b540bd510 msgr2=0x7f1b541e34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.338+0000 7f1b537fe640 1 --2- 172.21.15.44:0/776459104 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b540bd510 0x7f1b541e34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.338+0000 7f1b537fe640 1 -- 172.21.15.44:0/776459104 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b541e39e0 con 0x7f1b5414f2e0 2024-05-16T22:27:32.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.339+0000 7fa83e59c640 1 -- 172.21.15.44:0/117144155 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa8400beb90 msgr2=0x7fa8401f5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.339+0000 7fa83e59c640 1 --2- 172.21.15.44:0/117144155 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa8400beb90 0x7fa8401f5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.339+0000 7fa83e59c640 1 -- 172.21.15.44:0/117144155 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8400bfd50 msgr2=0x7fa8400cbeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.339+0000 7fa83e59c640 1 --2- 172.21.15.44:0/117144155 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8400bfd50 0x7fa8400cbeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.339+0000 7fa83e59c640 1 -- 172.21.15.44:0/117144155 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8400b85e0 con 0x7fa8400bbf30 2024-05-16T22:27:32.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.339+0000 7ff4d3fff640 1 -- 172.21.15.44:0/954946087 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff4dc032b90 con 0x7ff4e003f660 2024-05-16T22:27:32.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.339+0000 7fa83e59c640 1 --2- 172.21.15.44:0/117144155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8400bbf30 0x7fa8400a7fe0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa83000d5c0 tx=0x7fa83000da80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:32.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.339+0000 7f1b537fe640 1 --2- 172.21.15.44:0/776459104 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b5414f2e0 0x7f1b5414b550 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1b5408d100 tx=0x7f1b4c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:32.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.339+0000 7ff4d3fff640 1 --2- 172.21.15.44:0/954946087 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7ff4cc0763a0 0x7ff4cc0788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.339+0000 7f23cf59e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23bc003a00 0x7f23d0140300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.340+0000 7f23ce59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23bc003a00 0x7f23d0140300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.340+0000 7ff4e6ffd640 1 --2- 172.21.15.44:0/954946087 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7ff4cc0763a0 0x7ff4cc0788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.340+0000 7ff4d3fff640 1 -- 172.21.15.44:0/954946087 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff4dc0b8190 con 0x7ff4e003f660 2024-05-16T22:27:32.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.340+0000 7f23ce59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23bc003a00 0x7f23d0140300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58156/0 (socket says 172.21.15.44:58156) 2024-05-16T22:27:32.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.340+0000 7f23ce59c640 1 -- 172.21.15.44:0/1474123882 learned_addr learned my addr 172.21.15.44:0/1474123882 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:32.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.340+0000 7f23cf59e640 1 --2- 172.21.15.44:0/1474123882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23d014cc80 0x7f23d013e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.340+0000 7f23cf59e640 1 --2- 172.21.15.44:0/1474123882 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f23d013ed90 0x7f23d01e33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.340+0000 7f23cf59e640 1 -- 172.21.15.44:0/1474123882 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f23d014d8e0 con 0x7f23bc003a00 2024-05-16T22:27:32.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.340+0000 7f23cf59e640 1 -- 172.21.15.44:0/1474123882 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f23d014d760 con 0x7f23d014cc80 2024-05-16T22:27:32.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.340+0000 7f23cf59e640 1 -- 172.21.15.44:0/1474123882 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f23d00b5a20 con 0x7f23d013ed90 2024-05-16T22:27:32.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.340+0000 7fa617534640 1 -- 172.21.15.44:0/1254665567 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa608000ee0 con 0x7fa608008500 2024-05-16T22:27:32.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.340+0000 7f23cdd9b640 1 --2- 172.21.15.44:0/1474123882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23d014cc80 0x7f23d013e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.340+0000 7f23ced9d640 1 --2- 172.21.15.44:0/1474123882 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f23d013ed90 0x7f23d01e33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.340+0000 7f23ce59c640 1 -- 172.21.15.44:0/1474123882 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f23d013ed90 msgr2=0x7f23d01e33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.340+0000 7f23ce59c640 1 --2- 172.21.15.44:0/1474123882 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f23d013ed90 0x7f23d01e33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.340+0000 7ff4e6ffd640 1 --2- 172.21.15.44:0/954946087 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7ff4cc0763a0 0x7ff4cc0788b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff4e806c000 tx=0x7ff4e80696f0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:32.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.340+0000 7f23ce59c640 1 -- 172.21.15.44:0/1474123882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23d014cc80 msgr2=0x7f23d013e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.340+0000 7f23ce59c640 1 --2- 172.21.15.44:0/1474123882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23d014cc80 0x7f23d013e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.340+0000 7fa606ffd640 1 -- 172.21.15.44:0/1254665567 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa600047460 con 0x7fa608008500 2024-05-16T22:27:32.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.340+0000 7f23ce59c640 1 -- 172.21.15.44:0/1474123882 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23d0140840 con 0x7f23bc003a00 2024-05-16T22:27:32.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.340+0000 7f23ced9d640 1 --2- 172.21.15.44:0/1474123882 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f23d013ed90 0x7f23d01e33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:27:32.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.341+0000 7f23ce59c640 1 --2- 172.21.15.44:0/1474123882 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23bc003a00 0x7f23d0140300 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f23b800c3e0 tx=0x7f23b8001890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:32.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.341+0000 7fa606ffd640 1 --2- 172.21.15.44:0/1254665567 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fa5f40762d0 0x7fa5f40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.341+0000 7f84e57fa640 1 -- 172.21.15.44:0/1502992402 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84dc017070 con 0x7f84e80bbc10 2024-05-16T22:27:32.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.341+0000 7f84e57fa640 1 -- 172.21.15.44:0/1502992402 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84dc005ce0 con 0x7f84e80bbc10 2024-05-16T22:27:32.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.341+0000 7fa615d31640 1 --2- 172.21.15.44:0/1254665567 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fa5f40762d0 0x7fa5f40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.341+0000 7f5f637fe640 1 -- 172.21.15.44:0/2588171531 <== mon.2 v2:172.21.15.70:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5f7c0b8c30 con 0x7f5f7c144650 2024-05-16T22:27:32.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.341+0000 7f84e57fa640 1 -- 172.21.15.44:0/1502992402 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84dc007310 con 0x7f84e80bbc10 2024-05-16T22:27:32.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.341+0000 7f84eedd5640 1 -- 172.21.15.44:0/1502992402 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84e80b9cd0 con 0x7f84e80bbc10 2024-05-16T22:27:32.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.341+0000 7f84eedd5640 1 -- 172.21.15.44:0/1502992402 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f84e80b9560 con 0x7f84e80bbc10 2024-05-16T22:27:32.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.342+0000 7fa615d31640 1 --2- 172.21.15.44:0/1254665567 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fa5f40762d0 0x7fa5f40787e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa6080d7fc0 tx=0x7fa60c008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:32.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.342+0000 7f84eedd5640 1 -- 172.21.15.44:0/1502992402 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84e80b6350 con 0x7f84e80bbc10 2024-05-16T22:27:32.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.344+0000 7f84e57fa640 1 -- 172.21.15.44:0/1502992402 <== mon.2 v2:172.21.15.70:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f84dc01a070 con 0x7f84e80bbc10 2024-05-16T22:27:32.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.344+0000 7f84e57fa640 1 --2- 172.21.15.44:0/1502992402 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f84d4076320 0x7f84d4078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.344+0000 7fa82effd640 1 -- 172.21.15.44:0/117144155 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa830004030 con 0x7fa8400bbf30 2024-05-16T22:27:32.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.344+0000 7f84e57fa640 1 -- 172.21.15.44:0/1502992402 <== mon.2 v2:172.21.15.70:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f84dc096ce0 con 0x7f84e80bbc10 2024-05-16T22:27:32.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.344+0000 7f84ecb71640 1 --2- 172.21.15.44:0/1502992402 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f84d4076320 0x7f84d4078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.344+0000 7fa82effd640 1 -- 172.21.15.44:0/117144155 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8300041d0 con 0x7fa8400bbf30 2024-05-16T22:27:32.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.344+0000 7fa82effd640 1 -- 172.21.15.44:0/117144155 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa830014620 con 0x7fa8400bbf30 2024-05-16T22:27:32.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.344+0000 7fa8449fa640 1 -- 172.21.15.44:0/117144155 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8400a8520 con 0x7fa8400bbf30 2024-05-16T22:27:32.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.344+0000 7fa8449fa640 1 -- 172.21.15.44:0/117144155 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8401e54b0 con 0x7fa8400bbf30 2024-05-16T22:27:32.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.344+0000 7f0d4bfff640 1 -- 172.21.15.44:0/3105407098 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0d600cc580 con 0x7f0d580ef700 2024-05-16T22:27:32.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.345+0000 7f1b3bfff640 1 -- 172.21.15.44:0/776459104 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c03b610 con 0x7f1b5414f2e0 2024-05-16T22:27:32.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.345+0000 7f1b3bfff640 1 -- 172.21.15.44:0/776459104 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b4c03b7b0 con 0x7f1b5414f2e0 2024-05-16T22:27:32.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.345+0000 7f1b3bfff640 1 -- 172.21.15.44:0/776459104 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c03bb60 con 0x7f1b5414f2e0 2024-05-16T22:27:32.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.346+0000 7fa8449fa640 1 -- 172.21.15.44:0/117144155 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8400a6520 con 0x7fa8400bbf30 2024-05-16T22:27:32.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.346+0000 7f1b598c8640 1 -- 172.21.15.44:0/776459104 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b54150d40 con 0x7f1b5414f2e0 2024-05-16T22:27:32.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.346+0000 7f1b598c8640 1 -- 172.21.15.44:0/776459104 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b540ba100 con 0x7f1b5414f2e0 2024-05-16T22:27:32.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.346+0000 7f84ecb71640 1 --2- 172.21.15.44:0/1502992402 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f84d4076320 0x7f84d4078830 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f84d8006d40 tx=0x7f84d8008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:32.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.347+0000 7f23c6ffd640 1 -- 172.21.15.44:0/1474123882 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b80014f0 con 0x7f23bc003a00 2024-05-16T22:27:32.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.347+0000 7fa606ffd640 1 -- 172.21.15.44:0/1254665567 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa6000b6000 con 0x7fa608008500 2024-05-16T22:27:32.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.347+0000 7f23cf59e640 1 -- 172.21.15.44:0/1474123882 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23d009c030 con 0x7f23bc003a00 2024-05-16T22:27:32.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.347+0000 7f23cf59e640 1 -- 172.21.15.44:0/1474123882 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23d009c2d0 con 0x7f23bc003a00 2024-05-16T22:27:32.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.347+0000 7f1b598c8640 1 -- 172.21.15.44:0/776459104 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b540c3610 con 0x7f1b5414f2e0 2024-05-16T22:27:32.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.347+0000 7ff4d3fff640 1 -- 172.21.15.44:0/954946087 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff4e0007610 con 0x7ff4e003f660 2024-05-16T22:27:32.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.348+0000 7f23c4ff9640 1 -- 172.21.15.44:0/1474123882 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23b4005290 con 0x7f23bc003a00 2024-05-16T22:27:32.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.349+0000 7fa82effd640 1 -- 172.21.15.44:0/117144155 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa8300147c0 con 0x7fa8400bbf30 2024-05-16T22:27:32.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.349+0000 7f1b3bfff640 1 -- 172.21.15.44:0/776459104 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1b4c03bd00 con 0x7f1b5414f2e0 2024-05-16T22:27:32.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.349+0000 7f1b3bfff640 1 --2- 172.21.15.44:0/776459104 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f1b40076320 0x7f1b40078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.350+0000 7f1b52ffd640 1 --2- 172.21.15.44:0/776459104 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f1b40076320 0x7f1b40078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.350+0000 7fa82effd640 1 --2- 172.21.15.44:0/117144155 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fa820076300 0x7fa820078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.350+0000 7fa82effd640 1 -- 172.21.15.44:0/117144155 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa830097ef0 con 0x7fa8400bbf30 2024-05-16T22:27:32.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.350+0000 7fa83dd9b640 1 --2- 172.21.15.44:0/117144155 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fa820076300 0x7fa820078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.350+0000 7f1b52ffd640 1 --2- 172.21.15.44:0/776459104 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f1b40076320 0x7f1b40078830 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1b440184b0 tx=0x7f1b440017f0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:32.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.350+0000 7fa83dd9b640 1 --2- 172.21.15.44:0/117144155 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fa820076300 0x7fa820078810 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa838034000 tx=0x7fa838009000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:32.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.351+0000 7f84e57fa640 1 -- 172.21.15.44:0/1502992402 <== mon.2 v2:172.21.15.70:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f84e80b6350 con 0x7f84e80bbc10 2024-05-16T22:27:32.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.353+0000 7f23c6ffd640 1 -- 172.21.15.44:0/1474123882 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23b8041070 con 0x7f23bc003a00 2024-05-16T22:27:32.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.355+0000 7f23c6ffd640 1 -- 172.21.15.44:0/1474123882 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b80014f0 con 0x7f23bc003a00 2024-05-16T22:27:32.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.355+0000 7f1b3bfff640 1 -- 172.21.15.44:0/776459104 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1b4c07e4d0 con 0x7f1b5414f2e0 2024-05-16T22:27:32.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.354+0000 7fa606ffd640 1 -- 172.21.15.44:0/1254665567 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa600080cd0 con 0x7fa608008500 2024-05-16T22:27:32.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.355+0000 7fa82effd640 1 -- 172.21.15.44:0/117144155 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa8400a6520 con 0x7fa8400bbf30 2024-05-16T22:27:32.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.356+0000 7f23c6ffd640 1 -- 172.21.15.44:0/1474123882 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f23b803a070 con 0x7f23bc003a00 2024-05-16T22:27:32.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.357+0000 7f23c6ffd640 1 --2- 172.21.15.44:0/1474123882 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f23b0076700 0x7f23b0078c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:32.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.357+0000 7f23c6ffd640 1 -- 172.21.15.44:0/1474123882 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f23b8037050 con 0x7f23bc003a00 2024-05-16T22:27:32.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.359+0000 7f23cdd9b640 1 --2- 172.21.15.44:0/1474123882 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f23b0076700 0x7f23b0078c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:32.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.359+0000 7f1b3bfff640 1 -- 172.21.15.44:0/776459104 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1b4c03f030 con 0x7f1b5414f2e0 2024-05-16T22:27:32.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.363+0000 7f23cdd9b640 1 --2- 172.21.15.44:0/1474123882 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f23b0076700 0x7f23b0078c10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f23d009d600 tx=0x7f23c000b040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:32.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.363+0000 7f23c6ffd640 1 -- 172.21.15.44:0/1474123882 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f23b8080a20 con 0x7f23bc003a00 2024-05-16T22:27:32.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.795+0000 7f5f81413640 1 -- 172.21.15.44:0/2588171531 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f5f7c0b8ea0 con 0x7f5f7c144650 2024-05-16T22:27:32.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.795+0000 7f0d660f9640 1 -- 172.21.15.44:0/3105407098 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f0d580069e0 con 0x7f0d580ef700 2024-05-16T22:27:32.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.795+0000 7ff4ec854640 1 -- 172.21.15.44:0/954946087 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7ff4e00058e0 con 0x7ff4e003f660 2024-05-16T22:27:32.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.796+0000 7ff4d3fff640 1 -- 172.21.15.44:0/954946087 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff4dc081480 con 0x7ff4e003f660 2024-05-16T22:27:32.796 INFO:teuthology.orchestra.run.smithi044.stdout:55834574853 2024-05-16T22:27:32.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.796+0000 7f5f637fe640 1 -- 172.21.15.44:0/2588171531 <== mon.2 v2:172.21.15.70:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5f6c080980 con 0x7f5f7c144650 2024-05-16T22:27:32.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.796+0000 7f0d4bfff640 1 -- 172.21.15.44:0/3105407098 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0d60069e30 con 0x7f0d580ef700 2024-05-16T22:27:32.797 INFO:teuthology.orchestra.run.smithi044.stdout:55834574853 2024-05-16T22:27:32.797 INFO:teuthology.orchestra.run.smithi044.stdout:55834574853 2024-05-16T22:27:32.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.800+0000 7f5f617fa640 1 -- 172.21.15.44:0/2588171531 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f5f680763a0 msgr2=0x7f5f680788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.800+0000 7ff4d1ffb640 1 -- 172.21.15.44:0/954946087 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7ff4cc0763a0 msgr2=0x7ff4cc0788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.800+0000 7ff4d1ffb640 1 --2- 172.21.15.44:0/954946087 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7ff4cc0763a0 0x7ff4cc0788b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff4e806c000 tx=0x7ff4e80696f0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.800+0000 7ff4d1ffb640 1 -- 172.21.15.44:0/954946087 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4e003f660 msgr2=0x7ff4e00d1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.800+0000 7ff4d1ffb640 1 --2- 172.21.15.44:0/954946087 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4e003f660 0x7ff4e00d1990 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc031000 tx=0x7ff4dc0046c0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.800+0000 7f0d49ffb640 1 -- 172.21.15.44:0/3105407098 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0d440763d0 msgr2=0x7f0d440788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.800+0000 7f0d49ffb640 1 --2- 172.21.15.44:0/3105407098 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0d440763d0 0x7f0d440788e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0d54034000 tx=0x7f0d5402e000 comp rx=0 tx=0).stop 2024-05-16T22:27:32.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.800+0000 7ff4d1ffb640 1 -- 172.21.15.44:0/954946087 shutdown_connections 2024-05-16T22:27:32.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.800+0000 7ff4d1ffb640 1 --2- 172.21.15.44:0/954946087 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7ff4cc0763a0 0x7ff4cc0788b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.800+0000 7ff4d1ffb640 1 --2- 172.21.15.44:0/954946087 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff4e0040b70 0x7ff4e00c83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.800+0000 7ff4d1ffb640 1 --2- 172.21.15.44:0/954946087 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4e00427a0 0x7ff4e00c7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.800+0000 7ff4d1ffb640 1 --2- 172.21.15.44:0/954946087 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4e003f660 0x7ff4e00d1990 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.800+0000 7f0d49ffb640 1 -- 172.21.15.44:0/3105407098 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0d580ef700 msgr2=0x7f0d58024c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.800+0000 7ff4d1ffb640 1 -- 172.21.15.44:0/954946087 >> 172.21.15.44:0/954946087 conn(0x7ff4e00063e0 msgr2=0x7ff4e0005af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:32.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.800+0000 7f0d49ffb640 1 --2- 172.21.15.44:0/3105407098 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0d580ef700 0x7f0d58024c50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0d60052210 tx=0x7f0d6006ead0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.800+0000 7f0d49ffb640 1 -- 172.21.15.44:0/3105407098 shutdown_connections 2024-05-16T22:27:32.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.800+0000 7f0d49ffb640 1 --2- 172.21.15.44:0/3105407098 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0d440763d0 0x7f0d440788e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.800+0000 7f0d49ffb640 1 --2- 172.21.15.44:0/3105407098 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0d580ef700 0x7f0d58024c50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.800+0000 7f0d49ffb640 1 --2- 172.21.15.44:0/3105407098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d580ef2f0 0x7f0d5803cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.800+0000 7f0d49ffb640 1 --2- 172.21.15.44:0/3105407098 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0d580391c0 0x7f0d58028170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.800+0000 7ff4d1ffb640 1 -- 172.21.15.44:0/954946087 shutdown_connections 2024-05-16T22:27:32.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.800+0000 7f0d49ffb640 1 -- 172.21.15.44:0/3105407098 >> 172.21.15.44:0/3105407098 conn(0x7f0d58006110 msgr2=0x7f0d5803b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:32.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.800+0000 7f5f617fa640 1 --2- 172.21.15.44:0/2588171531 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f5f680763a0 0x7f5f680788b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5f7400f360 tx=0x7f5f74007710 comp rx=0 tx=0).stop 2024-05-16T22:27:32.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.800+0000 7ff4d1ffb640 1 -- 172.21.15.44:0/954946087 wait complete. 2024-05-16T22:27:32.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.801+0000 7f0d49ffb640 1 -- 172.21.15.44:0/3105407098 shutdown_connections 2024-05-16T22:27:32.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.801+0000 7f0d49ffb640 1 -- 172.21.15.44:0/3105407098 wait complete. 2024-05-16T22:27:32.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.801+0000 7f5f617fa640 1 -- 172.21.15.44:0/2588171531 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5f7c144650 msgr2=0x7f5f7c1e8de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.801+0000 7f5f617fa640 1 --2- 172.21.15.44:0/2588171531 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5f7c144650 0x7f5f7c1e8de0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c02cd30 tx=0x7f5f6c0046c0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.801+0000 7f5f617fa640 1 -- 172.21.15.44:0/2588171531 shutdown_connections 2024-05-16T22:27:32.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.801+0000 7f5f617fa640 1 --2- 172.21.15.44:0/2588171531 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f5f680763a0 0x7f5f680788b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.801+0000 7f5f617fa640 1 --2- 172.21.15.44:0/2588171531 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5f7c144650 0x7f5f7c1e8de0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.801+0000 7f5f617fa640 1 --2- 172.21.15.44:0/2588171531 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f7c14d780 0x7f5f7c1e5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.801+0000 7f5f617fa640 1 --2- 172.21.15.44:0/2588171531 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5f7c0a1dd0 0x7f5f7c0b76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.801+0000 7f5f617fa640 1 -- 172.21.15.44:0/2588171531 >> 172.21.15.44:0/2588171531 conn(0x7f5f7c0c0060 msgr2=0x7f5f7c14db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:32.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.801+0000 7f5f617fa640 1 -- 172.21.15.44:0/2588171531 shutdown_connections 2024-05-16T22:27:32.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.801+0000 7f5f617fa640 1 -- 172.21.15.44:0/2588171531 wait complete. 2024-05-16T22:27:32.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.805+0000 7fa8449fa640 1 -- 172.21.15.44:0/117144155 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fa8400c3040 con 0x7fa8400bbf30 2024-05-16T22:27:32.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.805+0000 7f84eedd5640 1 -- 172.21.15.44:0/1502992402 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f84e8069b50 con 0x7f84e80bbc10 2024-05-16T22:27:32.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.805+0000 7fa82effd640 1 -- 172.21.15.44:0/117144155 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa8300045c0 con 0x7fa8400bbf30 2024-05-16T22:27:32.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.805+0000 7f84e57fa640 1 -- 172.21.15.44:0/1502992402 <== mon.2 v2:172.21.15.70:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f84dc021020 con 0x7f84e80bbc10 2024-05-16T22:27:32.807 INFO:teuthology.orchestra.run.smithi044.stdout:55834574852 2024-05-16T22:27:32.807 INFO:teuthology.orchestra.run.smithi044.stdout:60129542150 2024-05-16T22:27:32.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.809+0000 7fa8449fa640 1 -- 172.21.15.44:0/117144155 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fa820076300 msgr2=0x7fa820078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.809+0000 7f84ceffd640 1 -- 172.21.15.44:0/1502992402 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f84d4076320 msgr2=0x7f84d4078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.809+0000 7f84ceffd640 1 --2- 172.21.15.44:0/1502992402 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f84d4076320 0x7f84d4078830 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f84d8006d40 tx=0x7f84d8008040 comp rx=0 tx=0).stop 2024-05-16T22:27:32.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.809+0000 7f84ceffd640 1 -- 172.21.15.44:0/1502992402 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f84e80bbc10 msgr2=0x7f84e80b8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.809+0000 7f84ceffd640 1 --2- 172.21.15.44:0/1502992402 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f84e80bbc10 0x7f84e80b8e10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f84dc00c310 tx=0x7f84dc00c7d0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.809+0000 7fa8449fa640 1 --2- 172.21.15.44:0/117144155 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fa820076300 0x7fa820078810 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa838034000 tx=0x7fa838009000 comp rx=0 tx=0).stop 2024-05-16T22:27:32.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.809+0000 7fa8449fa640 1 -- 172.21.15.44:0/117144155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8400bbf30 msgr2=0x7fa8400a7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.809+0000 7f84ceffd640 1 -- 172.21.15.44:0/1502992402 shutdown_connections 2024-05-16T22:27:32.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.809+0000 7f84ceffd640 1 --2- 172.21.15.44:0/1502992402 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f84d4076320 0x7f84d4078830 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.809+0000 7f84ceffd640 1 --2- 172.21.15.44:0/1502992402 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f84e80bbc10 0x7f84e80b8e10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.809+0000 7f84ceffd640 1 --2- 172.21.15.44:0/1502992402 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84e81528c0 0x7f84e80a5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.809+0000 7f84ceffd640 1 --2- 172.21.15.44:0/1502992402 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84e8072940 0x7f84e80b8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.809+0000 7f84ceffd640 1 -- 172.21.15.44:0/1502992402 >> 172.21.15.44:0/1502992402 conn(0x7f84e806f390 msgr2=0x7f84e80b5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:32.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.809+0000 7fa8449fa640 1 --2- 172.21.15.44:0/117144155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8400bbf30 0x7fa8400a7fe0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa83000d5c0 tx=0x7fa83000da80 comp rx=0 tx=0).stop 2024-05-16T22:27:32.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.809+0000 7f84ceffd640 1 -- 172.21.15.44:0/1502992402 shutdown_connections 2024-05-16T22:27:32.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.810+0000 7f84ceffd640 1 -- 172.21.15.44:0/1502992402 wait complete. 2024-05-16T22:27:32.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.809+0000 7fa617534640 1 -- 172.21.15.44:0/1254665567 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fa6080a1c30 con 0x7fa608008500 2024-05-16T22:27:32.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.809+0000 7fa8449fa640 1 -- 172.21.15.44:0/117144155 shutdown_connections 2024-05-16T22:27:32.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.809+0000 7fa8449fa640 1 --2- 172.21.15.44:0/117144155 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fa820076300 0x7fa820078810 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.809+0000 7fa8449fa640 1 --2- 172.21.15.44:0/117144155 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa8400beb90 0x7fa8401f5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.809+0000 7fa8449fa640 1 --2- 172.21.15.44:0/117144155 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8400bfd50 0x7fa8400cbeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.809+0000 7fa8449fa640 1 --2- 172.21.15.44:0/117144155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8400bbf30 0x7fa8400a7fe0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.809+0000 7fa8449fa640 1 -- 172.21.15.44:0/117144155 >> 172.21.15.44:0/117144155 conn(0x7fa8400a3750 msgr2=0x7fa8401e2840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:32.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.809+0000 7fa8449fa640 1 -- 172.21.15.44:0/117144155 shutdown_connections 2024-05-16T22:27:32.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.810+0000 7fa8449fa640 1 -- 172.21.15.44:0/117144155 wait complete. 2024-05-16T22:27:32.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.810+0000 7fa606ffd640 1 -- 172.21.15.44:0/1254665567 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa600084fd0 con 0x7fa608008500 2024-05-16T22:27:32.814 INFO:teuthology.orchestra.run.smithi044.stdout:55834574853 2024-05-16T22:27:32.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.812+0000 7f1b598c8640 1 -- 172.21.15.44:0/776459104 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f1b54050940 con 0x7f1b5414f2e0 2024-05-16T22:27:32.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.813+0000 7f1b3bfff640 1 -- 172.21.15.44:0/776459104 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1b4c082240 con 0x7f1b5414f2e0 2024-05-16T22:27:32.814 INFO:teuthology.orchestra.run.smithi044.stdout:55834574853 2024-05-16T22:27:32.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.814+0000 7fa617534640 1 -- 172.21.15.44:0/1254665567 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fa5f40762d0 msgr2=0x7fa5f40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.814+0000 7fa617534640 1 --2- 172.21.15.44:0/1254665567 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fa5f40762d0 0x7fa5f40787e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa6080d7fc0 tx=0x7fa60c008040 comp rx=0 tx=0).stop 2024-05-16T22:27:32.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.814+0000 7fa617534640 1 -- 172.21.15.44:0/1254665567 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa608008500 msgr2=0x7fa6080d6ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.814+0000 7fa617534640 1 --2- 172.21.15.44:0/1254665567 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa608008500 0x7fa6080d6ed0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa600000c00 tx=0x7fa600004730 comp rx=0 tx=0).stop 2024-05-16T22:27:32.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.814+0000 7fa617534640 1 -- 172.21.15.44:0/1254665567 shutdown_connections 2024-05-16T22:27:32.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.814+0000 7fa617534640 1 --2- 172.21.15.44:0/1254665567 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fa5f40762d0 0x7fa5f40787e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.814+0000 7fa617534640 1 --2- 172.21.15.44:0/1254665567 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa6080d5b40 0x7fa6080c6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.814+0000 7fa617534640 1 --2- 172.21.15.44:0/1254665567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6080cf8b0 0x7fa6080c6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.814+0000 7fa617534640 1 --2- 172.21.15.44:0/1254665567 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa608008500 0x7fa6080d6ed0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.814+0000 7fa617534640 1 -- 172.21.15.44:0/1254665567 >> 172.21.15.44:0/1254665567 conn(0x7fa6080450e0 msgr2=0x7fa6080d4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:32.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.814+0000 7fa617534640 1 -- 172.21.15.44:0/1254665567 shutdown_connections 2024-05-16T22:27:32.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.814+0000 7fa617534640 1 -- 172.21.15.44:0/1254665567 wait complete. 2024-05-16T22:27:32.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.816+0000 7f23c4ff9640 1 -- 172.21.15.44:0/1474123882 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f23b4005850 con 0x7f23bc003a00 2024-05-16T22:27:32.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.817+0000 7f1b598c8640 1 -- 172.21.15.44:0/776459104 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f1b40076320 msgr2=0x7f1b40078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.817+0000 7f1b598c8640 1 --2- 172.21.15.44:0/776459104 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f1b40076320 0x7f1b40078830 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1b440184b0 tx=0x7f1b440017f0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.817+0000 7f23c6ffd640 1 -- 172.21.15.44:0/1474123882 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f23b8080320 con 0x7f23bc003a00 2024-05-16T22:27:32.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.817+0000 7f1b598c8640 1 -- 172.21.15.44:0/776459104 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b5414f2e0 msgr2=0x7f1b5414b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.817+0000 7f1b598c8640 1 --2- 172.21.15.44:0/776459104 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b5414f2e0 0x7f1b5414b550 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1b5408d100 tx=0x7f1b4c004a40 comp rx=0 tx=0).stop 2024-05-16T22:27:32.818 INFO:teuthology.orchestra.run.smithi044.stdout:55834574853 2024-05-16T22:27:32.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.817+0000 7f1b598c8640 1 -- 172.21.15.44:0/776459104 shutdown_connections 2024-05-16T22:27:32.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.818+0000 7f1b598c8640 1 --2- 172.21.15.44:0/776459104 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f1b40076320 0x7f1b40078830 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.818+0000 7f1b598c8640 1 --2- 172.21.15.44:0/776459104 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1b540be230 0x7f1b541518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.818+0000 7f1b598c8640 1 --2- 172.21.15.44:0/776459104 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b5414f2e0 0x7f1b5414b550 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.818+0000 7f1b598c8640 1 --2- 172.21.15.44:0/776459104 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b540bd510 0x7f1b541e34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.818+0000 7f1b598c8640 1 -- 172.21.15.44:0/776459104 >> 172.21.15.44:0/776459104 conn(0x7f1b540c3cd0 msgr2=0x7f1b54068970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:32.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.818+0000 7f1b598c8640 1 -- 172.21.15.44:0/776459104 shutdown_connections 2024-05-16T22:27:32.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.818+0000 7f1b598c8640 1 -- 172.21.15.44:0/776459104 wait complete. 2024-05-16T22:27:32.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.821+0000 7f23c4ff9640 1 -- 172.21.15.44:0/1474123882 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f23b0076700 msgr2=0x7f23b0078c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.821+0000 7f23c4ff9640 1 --2- 172.21.15.44:0/1474123882 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f23b0076700 0x7f23b0078c10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f23d009d600 tx=0x7f23c000b040 comp rx=0 tx=0).stop 2024-05-16T22:27:32.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.821+0000 7f23c4ff9640 1 -- 172.21.15.44:0/1474123882 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23bc003a00 msgr2=0x7f23d0140300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:32.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.821+0000 7f23c4ff9640 1 --2- 172.21.15.44:0/1474123882 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23bc003a00 0x7f23d0140300 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f23b800c3e0 tx=0x7f23b8001890 comp rx=0 tx=0).stop 2024-05-16T22:27:32.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.822+0000 7f23c4ff9640 1 -- 172.21.15.44:0/1474123882 shutdown_connections 2024-05-16T22:27:32.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.822+0000 7f23c4ff9640 1 --2- 172.21.15.44:0/1474123882 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f23b0076700 0x7f23b0078c10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.822+0000 7f23c4ff9640 1 --2- 172.21.15.44:0/1474123882 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f23d013ed90 0x7f23d01e33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.822+0000 7f23c4ff9640 1 --2- 172.21.15.44:0/1474123882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23d014cc80 0x7f23d013e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.822+0000 7f23c4ff9640 1 --2- 172.21.15.44:0/1474123882 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23bc003a00 0x7f23d0140300 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:32.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.822+0000 7f23c4ff9640 1 -- 172.21.15.44:0/1474123882 >> 172.21.15.44:0/1474123882 conn(0x7f23d006c6e0 msgr2=0x7f23d006caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:32.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.822+0000 7f23c4ff9640 1 -- 172.21.15.44:0/1474123882 shutdown_connections 2024-05-16T22:27:32.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:32.822+0000 7f23c4ff9640 1 -- 172.21.15.44:0/1474123882 wait complete. 2024-05-16T22:27:32.823 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2024-05-16T22:27:32.824 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2024-05-16T22:27:32.827 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2024-05-16T22:27:32.831 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.1 2024-05-16T22:27:32.837 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2024-05-16T22:27:32.837 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.7 2024-05-16T22:27:32.838 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2024-05-16T22:27:32.839 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2024-05-16T22:27:33.824 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-16T22:27:33.825 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-16T22:27:33.828 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-16T22:27:33.831 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-16T22:27:33.838 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-16T22:27:33.838 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-16T22:27:33.839 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-16T22:27:33.839 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-16T22:27:34.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.019+0000 7f38dc9f3640 1 Processor -- start 2024-05-16T22:27:34.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.019+0000 7f424f5ff640 1 Processor -- start 2024-05-16T22:27:34.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.020+0000 7f38dc9f3640 1 -- start start 2024-05-16T22:27:34.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.022+0000 7f38dc9f3640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f38d003b8d0 0x7f38d00381d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.022+0000 7f38dc9f3640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f38d00d1450 0x7f38d0007080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.023+0000 7f38dc9f3640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38d003bce0 con 0x7f38d00d1860 2024-05-16T22:27:34.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.020+0000 7f424f5ff640 1 -- start start 2024-05-16T22:27:34.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.023+0000 7f38dc9f3640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f38d00c7e00 con 0x7f38d00d1450 2024-05-16T22:27:34.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.023+0000 7f38dc9f3640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f38d00d0ce0 con 0x7f38d003b8d0 2024-05-16T22:27:34.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.023+0000 7f38d6d9d640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f38d00d1860 0x7f38d003df90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:58992/0 (socket says 172.21.15.44:58992) 2024-05-16T22:27:34.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.023+0000 7f38d6d9d640 1 -- 172.21.15.44:0/421405467 learned_addr learned my addr 172.21.15.44:0/421405467 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:27:34.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.023+0000 7f38d5d9b640 1 --2- 172.21.15.44:0/421405467 >> v2:172.21.15.70:3300/0 conn(0x7f38d00d1450 0x7f38d0007080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.023+0000 7f38d659c640 1 --2- 172.21.15.44:0/421405467 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f38d003b8d0 0x7f38d00381d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.024+0000 7f38d559a640 1 -- 172.21.15.44:0/421405467 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1745866204 0 0) 0x7f38d003bce0 con 0x7f38d00d1860 2024-05-16T22:27:34.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.024+0000 7f38d659c640 1 -- 172.21.15.44:0/421405467 >> v2:172.21.15.70:3300/0 conn(0x7f38d00d1450 msgr2=0x7f38d0007080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:34.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.024+0000 7f38d659c640 1 --2- 172.21.15.44:0/421405467 >> v2:172.21.15.70:3300/0 conn(0x7f38d00d1450 0x7f38d0007080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.025+0000 7f38d659c640 1 -- 172.21.15.44:0/421405467 >> v1:172.21.15.44:6789/0 conn(0x7f38d00d1860 legacy=0x7f38d003df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.025+0000 7f38d659c640 1 -- 172.21.15.44:0/421405467 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38d003bf90 con 0x7f38d003b8d0 2024-05-16T22:27:34.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.022+0000 7f424f5ff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f42480c0ac0 0x7f42480c1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.023+0000 7f424f5ff640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4248156b50 0x7f424815d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.023+0000 7f424f5ff640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42480c14f0 con 0x7f42480c24d0 2024-05-16T22:27:34.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.023+0000 7f424f5ff640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f42480a2cd0 con 0x7f42480c0ac0 2024-05-16T22:27:34.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.023+0000 7f424f5ff640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f42480c1790 con 0x7f4248156b50 2024-05-16T22:27:34.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.023+0000 7f424db9c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4248156b50 0x7f424815d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.023+0000 7f424db9c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4248156b50 0x7f424815d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.44:50686/0 (socket says 172.21.15.44:50686) 2024-05-16T22:27:34.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.023+0000 7f424db9c640 1 -- 172.21.15.44:0/320269488 learned_addr learned my addr 172.21.15.44:0/320269488 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:34.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.024+0000 7f424db9c640 1 -- 172.21.15.44:0/320269488 >> v2:172.21.15.70:3300/0 conn(0x7f42480c0ac0 msgr2=0x7f42480c1f90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-16T22:27:34.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.024+0000 7f424db9c640 1 --2- 172.21.15.44:0/320269488 >> v2:172.21.15.70:3300/0 conn(0x7f42480c0ac0 0x7f42480c1f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.024+0000 7f424db9c640 1 -- 172.21.15.44:0/320269488 >> v1:172.21.15.44:6789/0 conn(0x7f42480c24d0 legacy=0x7f4248156440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-16T22:27:34.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.024+0000 7f424db9c640 1 -- 172.21.15.44:0/320269488 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42480c1a70 con 0x7f4248156b50 2024-05-16T22:27:34.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.025+0000 7f424db9c640 1 --2- 172.21.15.44:0/320269488 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4248156b50 0x7f424815d220 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4238009870 tx=0x7f423802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2671ca19d750229a server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:34.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.026+0000 7f423ffff640 1 -- 172.21.15.44:0/320269488 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4238037070 con 0x7f4248156b50 2024-05-16T22:27:34.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.026+0000 7f423ffff640 1 -- 172.21.15.44:0/320269488 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4238032440 con 0x7f4248156b50 2024-05-16T22:27:34.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.026+0000 7f423ffff640 1 -- 172.21.15.44:0/320269488 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4238032810 con 0x7f4248156b50 2024-05-16T22:27:34.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.026+0000 7f38d659c640 1 --2- 172.21.15.44:0/421405467 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f38d003b8d0 0x7f38d00381d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f38cc0097a0 tx=0x7f38cc02a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f759e08c7de69df8 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:34.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.027+0000 7f38d559a640 1 -- 172.21.15.44:0/421405467 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38cc037070 con 0x7f38d003b8d0 2024-05-16T22:27:34.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.027+0000 7f38d559a640 1 -- 172.21.15.44:0/421405467 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38cc032440 con 0x7f38d003b8d0 2024-05-16T22:27:34.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.028+0000 7f38dc9f3640 1 -- 172.21.15.44:0/421405467 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f38d003b8d0 msgr2=0x7f38d00381d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.028+0000 7f38dc9f3640 1 --2- 172.21.15.44:0/421405467 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f38d003b8d0 0x7f38d00381d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f38cc0097a0 tx=0x7f38cc02a250 comp rx=0 tx=0).stop 2024-05-16T22:27:34.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.029+0000 7f38dc9f3640 1 -- 172.21.15.44:0/421405467 shutdown_connections 2024-05-16T22:27:34.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.029+0000 7f38dc9f3640 1 --2- 172.21.15.44:0/421405467 >> v2:172.21.15.70:3300/0 conn(0x7f38d00d1450 0x7f38d0007080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.029+0000 7f38dc9f3640 1 --2- 172.21.15.44:0/421405467 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f38d003b8d0 0x7f38d00381d0 secure :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f38cc0097a0 tx=0x7f38cc02a250 comp rx=0 tx=0).stop 2024-05-16T22:27:34.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.029+0000 7f38dc9f3640 1 -- 172.21.15.44:0/421405467 >> 172.21.15.44:0/421405467 conn(0x7f38d0006110 msgr2=0x7f38d0006520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:34.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.027+0000 7f424f5ff640 1 -- 172.21.15.44:0/320269488 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4248156b50 msgr2=0x7f424815d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.027+0000 7f424f5ff640 1 --2- 172.21.15.44:0/320269488 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4248156b50 0x7f424815d220 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4238009870 tx=0x7f423802a270 comp rx=0 tx=0).stop 2024-05-16T22:27:34.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.027+0000 7f424f5ff640 1 -- 172.21.15.44:0/320269488 shutdown_connections 2024-05-16T22:27:34.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.027+0000 7f424f5ff640 1 --2- 172.21.15.44:0/320269488 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4248156b50 0x7f424815d220 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.027+0000 7f424f5ff640 1 --2- 172.21.15.44:0/320269488 >> v2:172.21.15.70:3300/0 conn(0x7f42480c0ac0 0x7f42480c1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.027+0000 7f424f5ff640 1 -- 172.21.15.44:0/320269488 >> 172.21.15.44:0/320269488 conn(0x7f42480c3d20 msgr2=0x7f42480c0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:34.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.028+0000 7f424f5ff640 1 -- 172.21.15.44:0/320269488 shutdown_connections 2024-05-16T22:27:34.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.028+0000 7f424f5ff640 1 -- 172.21.15.44:0/320269488 wait complete. 2024-05-16T22:27:34.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.029+0000 7f38dc9f3640 1 -- 172.21.15.44:0/421405467 shutdown_connections 2024-05-16T22:27:34.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.030+0000 7f424f5ff640 1 Processor -- start 2024-05-16T22:27:34.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.031+0000 7f424f5ff640 1 -- start start 2024-05-16T22:27:34.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.030+0000 7f38dc9f3640 1 -- 172.21.15.44:0/421405467 wait complete. 2024-05-16T22:27:34.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.032+0000 7f38dc9f3640 1 Processor -- start 2024-05-16T22:27:34.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.033+0000 7f424f5ff640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f42480c0ac0 0x7f42481472c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.033+0000 7f424f5ff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42480c24d0 0x7f4248147800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.033+0000 7f424d39b640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f42480c0ac0 0x7f42481472c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.034+0000 7f424d39b640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f42480c0ac0 0x7f42481472c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.44:50696/0 (socket says 172.21.15.44:50696) 2024-05-16T22:27:34.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.034+0000 7f424d39b640 1 -- 172.21.15.44:0/195429211 learned_addr learned my addr 172.21.15.44:0/195429211 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:34.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.034+0000 7f424cb9a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42480c24d0 0x7f4248147800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.034+0000 7f424f5ff640 1 --2- 172.21.15.44:0/195429211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4248156b50 0x7f4248147d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.034+0000 7f424f5ff640 1 -- 172.21.15.44:0/195429211 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f424808d3a0 con 0x7f42480c24d0 2024-05-16T22:27:34.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.033+0000 7f38dc9f3640 1 -- start start 2024-05-16T22:27:34.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.034+0000 7f38dc9f3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f38d00d1450 0x7f38d00c6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.034+0000 7f38dc9f3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38d00d1860 0x7f38d00cd910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.035+0000 7f38dc9f3640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f38d00c5c70 0x7f38d0034c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.035+0000 7f38d659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f38d00d1450 0x7f38d00c6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.035+0000 7f38d659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f38d00d1450 0x7f38d00c6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58186/0 (socket says 172.21.15.44:58186) 2024-05-16T22:27:34.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.035+0000 7f424db9c640 1 --2- 172.21.15.44:0/195429211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4248156b50 0x7f4248147d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.035+0000 7f424f5ff640 1 -- 172.21.15.44:0/195429211 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f42480c0ed0 con 0x7f4248156b50 2024-05-16T22:27:34.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.035+0000 7f424f5ff640 1 -- 172.21.15.44:0/195429211 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f42480badd0 con 0x7f42480c0ac0 2024-05-16T22:27:34.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.035+0000 7f38dc9f3640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f38d003c960 con 0x7f38d00d1450 2024-05-16T22:27:34.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.035+0000 7f38dc9f3640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f38d00d0f30 con 0x7f38d00d1860 2024-05-16T22:27:34.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.035+0000 7f38d6d9d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f38d00c5c70 0x7f38d0034c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.035+0000 7f38d659c640 1 -- 172.21.15.44:0/494948216 learned_addr learned my addr 172.21.15.44:0/494948216 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:34.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.035+0000 7f38dc9f3640 1 -- 172.21.15.44:0/494948216 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f38d00392f0 con 0x7f38d00c5c70 2024-05-16T22:27:34.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.036+0000 7f38d5d9b640 1 --2- 172.21.15.44:0/494948216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38d00d1860 0x7f38d00cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.036+0000 7f38d659c640 1 -- 172.21.15.44:0/494948216 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f38d00c5c70 msgr2=0x7f38d0034c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.036+0000 7f38d659c640 1 --2- 172.21.15.44:0/494948216 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f38d00c5c70 0x7f38d0034c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.036+0000 7f38d659c640 1 -- 172.21.15.44:0/494948216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38d00d1860 msgr2=0x7f38d00cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.036+0000 7f38d659c640 1 --2- 172.21.15.44:0/494948216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38d00d1860 0x7f38d00cd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.036+0000 7f38d659c640 1 -- 172.21.15.44:0/494948216 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38d00cde50 con 0x7f38d00d1450 2024-05-16T22:27:34.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.036+0000 7f38d5d9b640 1 --2- 172.21.15.44:0/494948216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38d00d1860 0x7f38d00cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T22:27:34.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.036+0000 7f424db9c640 1 -- 172.21.15.44:0/195429211 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f42480c0ac0 msgr2=0x7f42481472c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.036+0000 7f424db9c640 1 --2- 172.21.15.44:0/195429211 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f42480c0ac0 0x7f42481472c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.036+0000 7f424db9c640 1 -- 172.21.15.44:0/195429211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42480c24d0 msgr2=0x7f4248147800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.036+0000 7f424db9c640 1 --2- 172.21.15.44:0/195429211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42480c24d0 0x7f4248147800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.036+0000 7f424db9c640 1 -- 172.21.15.44:0/195429211 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4248072810 con 0x7f4248156b50 2024-05-16T22:27:34.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.037+0000 7f38d659c640 1 --2- 172.21.15.44:0/494948216 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f38d00d1450 0x7f38d00c6650 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f38cc0098c0 tx=0x7f38cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:34.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.037+0000 7f424db9c640 1 --2- 172.21.15.44:0/195429211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4248156b50 0x7f4248147d40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f42480694e0 tx=0x7f42380046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:34.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.037+0000 7f423dffb640 1 -- 172.21.15.44:0/195429211 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4238041070 con 0x7f4248156b50 2024-05-16T22:27:34.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.037+0000 7f38c6ffd640 1 -- 172.21.15.44:0/494948216 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38cc037050 con 0x7f38d00d1450 2024-05-16T22:27:34.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.037+0000 7f424f5ff640 1 -- 172.21.15.44:0/195429211 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42480a3240 con 0x7f4248156b50 2024-05-16T22:27:34.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.038+0000 7f424f5ff640 1 -- 172.21.15.44:0/195429211 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42480a2790 con 0x7f4248156b50 2024-05-16T22:27:34.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.038+0000 7f38dc9f3640 1 -- 172.21.15.44:0/494948216 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38d00c50c0 con 0x7f38d00d1450 2024-05-16T22:27:34.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.038+0000 7f38dc9f3640 1 -- 172.21.15.44:0/494948216 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38d0031b70 con 0x7f38d00d1450 2024-05-16T22:27:34.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.038+0000 7f38c6ffd640 1 -- 172.21.15.44:0/494948216 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38cc043070 con 0x7f38d00d1450 2024-05-16T22:27:34.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.038+0000 7f38c6ffd640 1 -- 172.21.15.44:0/494948216 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38cc03e690 con 0x7f38d00d1450 2024-05-16T22:27:34.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.039+0000 7f423dffb640 1 -- 172.21.15.44:0/195429211 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4238032440 con 0x7f4248156b50 2024-05-16T22:27:34.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.042+0000 7f38dc9f3640 1 -- 172.21.15.44:0/494948216 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38bc005290 con 0x7f38d00d1450 2024-05-16T22:27:34.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.042+0000 7f38c6ffd640 1 -- 172.21.15.44:0/494948216 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f38cc032440 con 0x7f38d00d1450 2024-05-16T22:27:34.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.043+0000 7f38c6ffd640 1 --2- 172.21.15.44:0/494948216 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f38b80763d0 0x7f38b80788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.043+0000 7f38c6ffd640 1 -- 172.21.15.44:0/494948216 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f38cc0b8000 con 0x7f38d00d1450 2024-05-16T22:27:34.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.047+0000 7f38d5d9b640 1 --2- 172.21.15.44:0/494948216 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f38b80763d0 0x7f38b80788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.047+0000 7f38d5d9b640 1 --2- 172.21.15.44:0/494948216 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f38b80763d0 0x7f38b80788e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f38d003f050 tx=0x7f38c8008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:34.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.040+0000 7f423dffb640 1 -- 172.21.15.44:0/195429211 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4238037040 con 0x7f4248156b50 2024-05-16T22:27:34.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.042+0000 7f424f5ff640 1 -- 172.21.15.44:0/195429211 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4228005290 con 0x7f4248156b50 2024-05-16T22:27:34.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.045+0000 7f423dffb640 1 -- 172.21.15.44:0/195429211 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4238044070 con 0x7f4248156b50 2024-05-16T22:27:34.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.046+0000 7f423dffb640 1 --2- 172.21.15.44:0/195429211 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4234076420 0x7f4234078930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.046+0000 7f423dffb640 1 -- 172.21.15.44:0/195429211 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f42380b7cc0 con 0x7f4248156b50 2024-05-16T22:27:34.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.046+0000 7f424d39b640 1 --2- 172.21.15.44:0/195429211 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4234076420 0x7f4234078930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.047+0000 7f424d39b640 1 --2- 172.21.15.44:0/195429211 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4234076420 0x7f4234078930 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4240000b60 tx=0x7f424000b040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:34.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.051+0000 7f423dffb640 1 -- 172.21.15.44:0/195429211 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f423804b070 con 0x7f4248156b50 2024-05-16T22:27:34.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.053+0000 7f38c6ffd640 1 -- 172.21.15.44:0/494948216 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f38cc030e20 con 0x7f38d00d1450 2024-05-16T22:27:34.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.082+0000 7f2ec85e3640 1 Processor -- start 2024-05-16T22:27:34.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.082+0000 7f2ec85e3640 1 -- start start 2024-05-16T22:27:34.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.082+0000 7f3b2c134640 1 Processor -- start 2024-05-16T22:27:34.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.082+0000 7f3b2c134640 1 -- start start 2024-05-16T22:27:34.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.083+0000 7f77996a7640 1 Processor -- start 2024-05-16T22:27:34.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.083+0000 7f77996a7640 1 -- start start 2024-05-16T22:27:34.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.084+0000 7fad98bee640 1 Processor -- start 2024-05-16T22:27:34.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.084+0000 7f3b2c134640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3b1c03cf80 0x7f3b1c0d6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.084+0000 7f3b2c134640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b1c0d0210 con 0x7f3b1c039c20 2024-05-16T22:27:34.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.084+0000 7f3b2c134640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b1c0d5ab0 con 0x7f3b1c03c1c0 2024-05-16T22:27:34.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.084+0000 7f3b2c134640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f3b1c0d60c0 con 0x7f3b1c03cf80 2024-05-16T22:27:34.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.084+0000 7fad98bee640 1 -- start start 2024-05-16T22:27:34.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.085+0000 7f3b296cf640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f3b1c039c20 0x7f3b1c03b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59000/0 (socket says 172.21.15.44:59000) 2024-05-16T22:27:34.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.085+0000 7f2ec85e3640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2ec014bd30 0x7f2ec0156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.085+0000 7f77996a7640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7794070300 0x7f7794147c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.085+0000 7f2ec637f640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f2ec0145660 0x7f2ec006f970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.44:45612/0 (socket says 172.21.15.44:45612) 2024-05-16T22:27:34.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.085+0000 7f2ec637f640 1 -- 172.21.15.44:0/2794231456 learned_addr learned my addr 172.21.15.44:0/2794231456 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:27:34.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.085+0000 7f2ec6b80640 1 --2- 172.21.15.44:0/2794231456 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2ec014bd30 0x7f2ec0156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.086+0000 7f2ec85e3640 1 -- 172.21.15.44:0/2794231456 --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ec00bf8d0 con 0x7f2ec009fb90 2024-05-16T22:27:34.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.086+0000 7f2ec85e3640 1 -- 172.21.15.44:0/2794231456 --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ec0070080 con 0x7f2ec0145660 2024-05-16T22:27:34.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.086+0000 7f2ec85e3640 1 -- 172.21.15.44:0/2794231456 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f2ec00befa0 con 0x7f2ec014bd30 2024-05-16T22:27:34.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.085+0000 7f3b296cf640 1 -- 172.21.15.44:0/3341395147 learned_addr learned my addr 172.21.15.44:0/3341395147 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:27:34.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.085+0000 7f3b2a6d1640 1 --2- 172.21.15.44:0/3341395147 >> v2:172.21.15.44:3300/0 conn(0x7f3b1c03cf80 0x7f3b1c0d6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.086+0000 7f2ec537d640 1 -- 172.21.15.44:0/2794231456 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1146675034 0 0) 0x7f2eb4001110 con 0x7f2ec0145660 2024-05-16T22:27:34.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.085+0000 7f77996a7640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f77940bb6f0 0x7f77940bc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.085+0000 7f77996a7640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77940b5c60 con 0x7f77940a0dc0 2024-05-16T22:27:34.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.085+0000 7f77996a7640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f77940b6010 con 0x7f77940bb6f0 2024-05-16T22:27:34.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.085+0000 7f77996a7640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f77940b62b0 con 0x7f7794070300 2024-05-16T22:27:34.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.085+0000 7f7792ffd640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7794070300 0x7f7794147c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.085+0000 7f7792ffd640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7794070300 0x7f7794147c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.44:50712/0 (socket says 172.21.15.44:50712) 2024-05-16T22:27:34.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.085+0000 7f7792ffd640 1 -- 172.21.15.44:0/3489213172 learned_addr learned my addr 172.21.15.44:0/3489213172 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:34.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.086+0000 7f7792ffd640 1 -- 172.21.15.44:0/3489213172 >> v2:172.21.15.70:3300/0 conn(0x7f77940bb6f0 msgr2=0x7f77940bc6f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-16T22:27:34.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.086+0000 7f7792ffd640 1 --2- 172.21.15.44:0/3489213172 >> v2:172.21.15.70:3300/0 conn(0x7f77940bb6f0 0x7f77940bc6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.086+0000 7f7792ffd640 1 -- 172.21.15.44:0/3489213172 >> v1:172.21.15.70:6789/0 conn(0x7f77940a0dc0 legacy=0x7f779406e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:34.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.086+0000 7f7792ffd640 1 -- 172.21.15.44:0/3489213172 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77940b45a0 con 0x7f7794070300 2024-05-16T22:27:34.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.087+0000 7f7792ffd640 1 --2- 172.21.15.44:0/3489213172 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7794070300 0x7f7794147c20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7784014a00 tx=0x7f77840331d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca300e8089535287 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:34.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.086+0000 7fad98bee640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fad940bd510 0x7fad940bd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.086+0000 7fad98bee640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fad9414ebd0 0x7fad9414efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.086+0000 7fad98bee640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad940bea40 con 0x7fad940be230 2024-05-16T22:27:34.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.086+0000 7fad98bee640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fad9414c230 con 0x7fad940bd510 2024-05-16T22:27:34.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.086+0000 7fad98bee640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fad940becb0 con 0x7fad9414ebd0 2024-05-16T22:27:34.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.086+0000 7fad9259c640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fad940be230 0x7fad9406dbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59020/0 (socket says 172.21.15.44:59020) 2024-05-16T22:27:34.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.086+0000 7fad9259c640 1 -- 172.21.15.44:0/1536086115 learned_addr learned my addr 172.21.15.44:0/1536086115 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:27:34.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.086+0000 7f3b2a6d1640 1 -- 172.21.15.44:0/3341395147 >> v1:172.21.15.70:6789/0 conn(0x7f3b1c03c1c0 legacy=0x7f3b1c0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.086+0000 7f3b2a6d1640 1 -- 172.21.15.44:0/3341395147 >> v1:172.21.15.44:6789/0 conn(0x7f3b1c039c20 legacy=0x7f3b1c03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.086+0000 7f3b2a6d1640 1 -- 172.21.15.44:0/3341395147 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b1c03b970 con 0x7f3b1c03cf80 2024-05-16T22:27:34.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.087+0000 7fad92d9d640 1 --2- 172.21.15.44:0/1536086115 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fad9414ebd0 0x7fad9414efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.087+0000 7f77927fc640 1 -- 172.21.15.44:0/3489213172 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77840110d0 con 0x7f7794070300 2024-05-16T22:27:34.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.087+0000 7f77927fc640 1 -- 172.21.15.44:0/3489213172 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7784011270 con 0x7f7794070300 2024-05-16T22:27:34.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.087+0000 7f77927fc640 1 -- 172.21.15.44:0/3489213172 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7784011640 con 0x7f7794070300 2024-05-16T22:27:34.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.088+0000 7f3b2a6d1640 1 --2- 172.21.15.44:0/3341395147 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b1c03cf80 0x7f3b1c0d6550 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3b140097a0 tx=0x7f3b1402a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df4b3ff18d7cc77d server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:34.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.089+0000 7f77996a7640 1 -- 172.21.15.44:0/3489213172 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7794070300 msgr2=0x7f7794147c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.089+0000 7f77996a7640 1 --2- 172.21.15.44:0/3489213172 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7794070300 0x7f7794147c20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7784014a00 tx=0x7f77840331d0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.089+0000 7f3b28ece640 1 -- 172.21.15.44:0/3341395147 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b14037070 con 0x7f3b1c03cf80 2024-05-16T22:27:34.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.089+0000 7f3b28ece640 1 -- 172.21.15.44:0/3341395147 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b14032440 con 0x7f3b1c03cf80 2024-05-16T22:27:34.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.089+0000 7f2ec537d640 1 -- 172.21.15.44:0/2794231456 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2eac003520 con 0x7f2ec0145660 2024-05-16T22:27:34.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.089+0000 7f2ec537d640 1 -- 172.21.15.44:0/2794231456 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 658020076 0 0) 0x7f2ebc001110 con 0x7f2ec009fb90 2024-05-16T22:27:34.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.089+0000 7f2ec537d640 1 -- 172.21.15.44:0/2794231456 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2eb4001110 con 0x7f2ec009fb90 2024-05-16T22:27:34.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.087+0000 7fad9159a640 1 -- 172.21.15.44:0/1536086115 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2318020628 0 0) 0x7fad940bea40 con 0x7fad940be230 2024-05-16T22:27:34.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.087+0000 7fad9159a640 1 -- 172.21.15.44:0/1536086115 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad7c003520 con 0x7fad940be230 2024-05-16T22:27:34.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.087+0000 7fad9159a640 1 -- 172.21.15.44:0/1536086115 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 560837795 0 0) 0x7fad7c003520 con 0x7fad940be230 2024-05-16T22:27:34.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.087+0000 7fad9159a640 1 -- 172.21.15.44:0/1536086115 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fad9414ebd0 msgr2=0x7fad9414efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:34.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.087+0000 7fad9159a640 1 --2- 172.21.15.44:0/1536086115 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fad9414ebd0 0x7fad9414efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.087+0000 7fad9159a640 1 -- 172.21.15.44:0/1536086115 >> v2:172.21.15.70:3300/0 conn(0x7fad940bd510 msgr2=0x7fad940bd920 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-16T22:27:34.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.087+0000 7fad9159a640 1 --2- 172.21.15.44:0/1536086115 >> v2:172.21.15.70:3300/0 conn(0x7fad940bd510 0x7fad940bd920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.087+0000 7fad9159a640 1 -- 172.21.15.44:0/1536086115 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad940bef90 con 0x7fad940be230 2024-05-16T22:27:34.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.088+0000 7fad9159a640 1 -- 172.21.15.44:0/1536086115 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 568431863 0 0) 0x7fad8c001a70 con 0x7fad940be230 2024-05-16T22:27:34.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.088+0000 7fad9159a640 1 -- 172.21.15.44:0/1536086115 >> v1:172.21.15.44:6789/0 conn(0x7fad940be230 legacy=0x7fad9406dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.088+0000 7fad9159a640 1 --2- 172.21.15.44:0/1536086115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad7c003ad0 0x7fad7c003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.088+0000 7fad9259c640 1 --2- 172.21.15.44:0/1536086115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad7c003ad0 0x7fad7c003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.088+0000 7fad9159a640 1 --2- 172.21.15.44:0/1536086115 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fad7c004800 0x7fad7c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.088+0000 7fad9159a640 1 --2- 172.21.15.44:0/1536086115 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad7c005350 0x7fad7c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.088+0000 7fad9159a640 1 -- 172.21.15.44:0/1536086115 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fad9414c230 con 0x7fad7c003ad0 2024-05-16T22:27:34.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.088+0000 7fad9159a640 1 -- 172.21.15.44:0/1536086115 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fad940becb0 con 0x7fad7c005350 2024-05-16T22:27:34.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.088+0000 7fad9159a640 1 -- 172.21.15.44:0/1536086115 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fad7c00c2d0 con 0x7fad7c004800 2024-05-16T22:27:34.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.089+0000 7fad9259c640 1 -- 172.21.15.44:0/1536086115 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fad7c004800 msgr2=0x7fad7c004c10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-16T22:27:34.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.089+0000 7fad9259c640 1 --2- 172.21.15.44:0/1536086115 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fad7c004800 0x7fad7c004c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.089+0000 7fad9259c640 1 -- 172.21.15.44:0/1536086115 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad7c005350 msgr2=0x7fad7c00b9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-16T22:27:34.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.089+0000 7fad9259c640 1 --2- 172.21.15.44:0/1536086115 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad7c005350 0x7fad7c00b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.089+0000 7fad9259c640 1 -- 172.21.15.44:0/1536086115 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad7c003520 con 0x7fad7c003ad0 2024-05-16T22:27:34.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.087+0000 7fb34e297640 1 Processor -- start 2024-05-16T22:27:34.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.087+0000 7fb34e297640 1 -- start start 2024-05-16T22:27:34.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.089+0000 7fb34e297640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb3480be770 0x7fb3480736e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.089+0000 7fb347fff640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb3480be770 0x7fb3480736e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.089+0000 7fb347fff640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb3480be770 0x7fb3480736e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.44:50748/0 (socket says 172.21.15.44:50748) 2024-05-16T22:27:34.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.089+0000 7fb347fff640 1 -- 172.21.15.44:0/2267423711 learned_addr learned my addr 172.21.15.44:0/2267423711 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:34.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.089+0000 7f3b28ece640 1 -- 172.21.15.44:0/3341395147 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b14037070 con 0x7f3b1c03cf80 2024-05-16T22:27:34.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.089+0000 7f2ec537d640 1 -- 172.21.15.44:0/2794231456 <== mon.1 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2625495485 0 0) 0x7f2eac003520 con 0x7f2ec0145660 2024-05-16T22:27:34.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.090+0000 7f2ec537d640 1 -- 172.21.15.44:0/2794231456 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2ec014bd30 msgr2=0x7f2ec0156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:34.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.090+0000 7f2ec537d640 1 --2- 172.21.15.44:0/2794231456 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2ec014bd30 0x7f2ec0156aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.090+0000 7f2ec537d640 1 -- 172.21.15.44:0/2794231456 >> v1:172.21.15.44:6789/0 conn(0x7f2ec009fb90 legacy=0x7f2ec014b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.090+0000 7f2ec537d640 1 -- 172.21.15.44:0/2794231456 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ec00bf280 con 0x7f2ec0145660 2024-05-16T22:27:34.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.090+0000 7f2ec537d640 1 -- 172.21.15.44:0/2794231456 <== mon.1 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 568431863 0 0) 0x7f2eb40018c0 con 0x7f2ec0145660 2024-05-16T22:27:34.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.090+0000 7f2ec537d640 1 -- 172.21.15.44:0/2794231456 >> v1:172.21.15.70:6789/0 conn(0x7f2ec0145660 legacy=0x7f2ec006f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.090+0000 7f2ec537d640 1 --2- 172.21.15.44:0/2794231456 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2ec014bd30 0x7f2eac003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.090+0000 7f2ec537d640 1 --2- 172.21.15.44:0/2794231456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2eac004120 0x7f2eac004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.090+0000 7f2ec537d640 1 --2- 172.21.15.44:0/2794231456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2eac004d40 0x7f2eac005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.090+0000 7f2ec537d640 1 -- 172.21.15.44:0/2794231456 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec00befa0 con 0x7f2eac004d40 2024-05-16T22:27:34.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.090+0000 7f2ec537d640 1 -- 172.21.15.44:0/2794231456 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2eac00bb80 con 0x7f2eac004120 2024-05-16T22:27:34.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.090+0000 7f77996a7640 1 -- 172.21.15.44:0/3489213172 shutdown_connections 2024-05-16T22:27:34.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.090+0000 7f77996a7640 1 --2- 172.21.15.44:0/3489213172 >> v2:172.21.15.70:3300/0 conn(0x7f77940bb6f0 0x7f77940bc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.090+0000 7f77996a7640 1 --2- 172.21.15.44:0/3489213172 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7794070300 0x7f7794147c20 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.090+0000 7f77996a7640 1 -- 172.21.15.44:0/3489213172 >> 172.21.15.44:0/3489213172 conn(0x7f77940a1ac0 msgr2=0x7f77940bbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:34.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.089+0000 7fb34e297640 1 -- 172.21.15.44:0/2267423711 --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb348074d60 con 0x7fb3480bc0c0 2024-05-16T22:27:34.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.089+0000 7fb34e297640 1 -- 172.21.15.44:0/2267423711 --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb34806d130 con 0x7fb3481537f0 2024-05-16T22:27:34.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.089+0000 7fb34e297640 1 -- 172.21.15.44:0/2267423711 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fb3480bc4d0 con 0x7fb3480be770 2024-05-16T22:27:34.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.090+0000 7fb346ffd640 1 -- 172.21.15.44:0/2267423711 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3812888719 0 0) 0x7fb34806d130 con 0x7fb3481537f0 2024-05-16T22:27:34.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.090+0000 7fb347fff640 1 -- 172.21.15.44:0/2267423711 >> v1:172.21.15.70:6789/0 conn(0x7fb3481537f0 legacy=0x7fb3480bb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.090+0000 7fb347fff640 1 -- 172.21.15.44:0/2267423711 >> v1:172.21.15.44:6789/0 conn(0x7fb3480bc0c0 legacy=0x7fb34815d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:34.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.090+0000 7fcf0c71f640 1 Processor -- start 2024-05-16T22:27:34.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.090+0000 7fcf0c71f640 1 -- start start 2024-05-16T22:27:34.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.090+0000 7f3b2c134640 1 -- 172.21.15.44:0/3341395147 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b1c03cf80 msgr2=0x7f3b1c0d6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.090+0000 7f3b2c134640 1 --2- 172.21.15.44:0/3341395147 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b1c03cf80 0x7f3b1c0d6550 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3b140097a0 tx=0x7f3b1402a130 comp rx=0 tx=0).stop 2024-05-16T22:27:34.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.090+0000 7f3b2c134640 1 -- 172.21.15.44:0/3341395147 shutdown_connections 2024-05-16T22:27:34.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.090+0000 7f3b2c134640 1 --2- 172.21.15.44:0/3341395147 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b1c03cf80 0x7f3b1c0d6550 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.090+0000 7f3b2c134640 1 -- 172.21.15.44:0/3341395147 >> 172.21.15.44:0/3341395147 conn(0x7f3b1c03f6b0 msgr2=0x7f3b1c006110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:34.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.090+0000 7f2ec537d640 1 -- 172.21.15.44:0/2794231456 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f2eac00bd80 con 0x7f2ec014bd30 2024-05-16T22:27:34.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.090+0000 7f77996a7640 1 -- 172.21.15.44:0/3489213172 shutdown_connections 2024-05-16T22:27:34.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.090+0000 7fb347fff640 1 -- 172.21.15.44:0/2267423711 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb34806cb70 con 0x7fb3480be770 2024-05-16T22:27:34.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.090+0000 7f77996a7640 1 -- 172.21.15.44:0/3489213172 wait complete. 2024-05-16T22:27:34.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.091+0000 7f2ec637f640 1 --2- 172.21.15.44:0/2794231456 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2ec014bd30 0x7f2eac003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.091+0000 7f2ec6b80640 1 --2- 172.21.15.44:0/2794231456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2eac004d40 0x7f2eac005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.091+0000 7f3b2c134640 1 -- 172.21.15.44:0/3341395147 shutdown_connections 2024-05-16T22:27:34.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.091+0000 7f2ec5b7e640 1 --2- 172.21.15.44:0/2794231456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2eac004120 0x7f2eac004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.091+0000 7f2ec637f640 1 -- 172.21.15.44:0/2794231456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2eac004120 msgr2=0x7f2eac004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:34.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.091+0000 7f2ec637f640 1 --2- 172.21.15.44:0/2794231456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2eac004120 0x7f2eac004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.091+0000 7f2ec637f640 1 -- 172.21.15.44:0/2794231456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2eac004d40 msgr2=0x7f2eac005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:34.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.091+0000 7f2ec637f640 1 --2- 172.21.15.44:0/2794231456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2eac004d40 0x7f2eac005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.091+0000 7f2ec637f640 1 -- 172.21.15.44:0/2794231456 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ec00bf280 con 0x7f2ec014bd30 2024-05-16T22:27:34.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.091+0000 7fb347fff640 1 --2- 172.21.15.44:0/2267423711 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb3480be770 0x7fb3480736e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb3380098a0 tx=0x7fb33802a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba9059bf4ba9bc6a server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:34.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.091+0000 7fb346ffd640 1 -- 172.21.15.44:0/2267423711 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb338037070 con 0x7fb3480be770 2024-05-16T22:27:34.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.091+0000 7fb346ffd640 1 -- 172.21.15.44:0/2267423711 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb338032440 con 0x7fb3480be770 2024-05-16T22:27:34.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.091+0000 7fb346ffd640 1 -- 172.21.15.44:0/2267423711 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb338032810 con 0x7fb3480be770 2024-05-16T22:27:34.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.091+0000 7f3b2c134640 1 -- 172.21.15.44:0/3341395147 wait complete. 2024-05-16T22:27:34.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.091+0000 7fad9259c640 1 --2- 172.21.15.44:0/1536086115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad7c003ad0 0x7fad7c003f00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fad8c00d110 tx=0x7fad7c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8177f3314e20af82 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:34.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.091+0000 7fad9159a640 1 -- 172.21.15.44:0/1536086115 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad8c005630 con 0x7fad7c003ad0 2024-05-16T22:27:34.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.092+0000 7fad9159a640 1 -- 172.21.15.44:0/1536086115 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad8c0082d0 con 0x7fad7c003ad0 2024-05-16T22:27:34.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.092+0000 7fcf0c71f640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf04073df0 0x7fcf040bb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.092+0000 7fcf0c71f640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fcf041537f0 0x7fcf040bbef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.092+0000 7fcf0a4bb640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fcf040be770 0x7fcf040736e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59038/0 (socket says 172.21.15.44:59038) 2024-05-16T22:27:34.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.092+0000 7fcf09cba640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf04073df0 0x7fcf040bb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.092+0000 7f2ec5b7e640 1 --2- 172.21.15.44:0/2794231456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2eac004120 0x7f2eac004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:27:34.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.092+0000 7fcf09cba640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf04073df0 0x7fcf040bb9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.44:50768/0 (socket says 172.21.15.44:50768) 2024-05-16T22:27:34.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.092+0000 7fcf0a4bb640 1 -- 172.21.15.44:0/2958771242 learned_addr learned my addr 172.21.15.44:0/2958771242 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:27:34.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.092+0000 7fad9159a640 1 -- 172.21.15.44:0/1536086115 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad8c008740 con 0x7fad7c003ad0 2024-05-16T22:27:34.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.092+0000 7f2ec637f640 1 --2- 172.21.15.44:0/2794231456 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2ec014bd30 0x7f2eac003bc0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2eb400c4c0 tx=0x7f2eac005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7918ade0a258e40 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:34.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.092+0000 7fcf0acbc640 1 --2- 172.21.15.44:0/2958771242 >> v2:172.21.15.44:3300/0 conn(0x7fcf041537f0 0x7fcf040bbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.093+0000 7f2ec537d640 1 -- 172.21.15.44:0/2794231456 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb400c0e0 con 0x7f2ec014bd30 2024-05-16T22:27:34.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.093+0000 7f2ec537d640 1 -- 172.21.15.44:0/2794231456 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eb4034070 con 0x7f2ec014bd30 2024-05-16T22:27:34.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.093+0000 7f2ec537d640 1 -- 172.21.15.44:0/2794231456 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb4005d90 con 0x7f2ec014bd30 2024-05-16T22:27:34.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.093+0000 7fcf0c71f640 1 -- 172.21.15.44:0/2958771242 --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf04074d60 con 0x7fcf040be770 2024-05-16T22:27:34.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.093+0000 7fcf0c71f640 1 -- 172.21.15.44:0/2958771242 --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fcf0406d130 con 0x7fcf041537f0 2024-05-16T22:27:34.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.093+0000 7fcf0c71f640 1 -- 172.21.15.44:0/2958771242 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fcf040bc430 con 0x7fcf04073df0 2024-05-16T22:27:34.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.093+0000 7f77996a7640 1 Processor -- start 2024-05-16T22:27:34.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.093+0000 7f77996a7640 1 -- start start 2024-05-16T22:27:34.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.093+0000 7f3b2c134640 1 Processor -- start 2024-05-16T22:27:34.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.093+0000 7f3b2c134640 1 -- start start 2024-05-16T22:27:34.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.094+0000 7fad98bee640 1 -- 172.21.15.44:0/1536086115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad7c003ad0 msgr2=0x7fad7c003f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.094+0000 7fad98bee640 1 --2- 172.21.15.44:0/1536086115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad7c003ad0 0x7fad7c003f00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fad8c00d110 tx=0x7fad7c005830 comp rx=0 tx=0).stop 2024-05-16T22:27:34.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.093+0000 7fcf094b9640 1 -- 172.21.15.44:0/2958771242 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4272543829 0 0) 0x7fcf04074d60 con 0x7fcf040be770 2024-05-16T22:27:34.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.093+0000 7fcf09cba640 1 -- 172.21.15.44:0/2958771242 >> v2:172.21.15.44:3300/0 conn(0x7fcf041537f0 msgr2=0x7fcf040bbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:34.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.093+0000 7fcf09cba640 1 --2- 172.21.15.44:0/2958771242 >> v2:172.21.15.44:3300/0 conn(0x7fcf041537f0 0x7fcf040bbef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.094+0000 7fb34e297640 1 -- 172.21.15.44:0/2267423711 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb3480be770 msgr2=0x7fb3480736e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.094+0000 7fb34e297640 1 --2- 172.21.15.44:0/2267423711 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb3480be770 0x7fb3480736e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb3380098a0 tx=0x7fb33802a250 comp rx=0 tx=0).stop 2024-05-16T22:27:34.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.093+0000 7fcf09cba640 1 -- 172.21.15.44:0/2958771242 >> v1:172.21.15.44:6789/0 conn(0x7fcf040be770 legacy=0x7fcf040736e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.094+0000 7fad92d9d640 1 -- 172.21.15.44:0/1536086115 reap_dead start 2024-05-16T22:27:34.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.094+0000 7f2ec85e3640 1 -- 172.21.15.44:0/2794231456 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2ec014bd30 msgr2=0x7f2eac003bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.094+0000 7fad98bee640 1 -- 172.21.15.44:0/1536086115 shutdown_connections 2024-05-16T22:27:34.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.094+0000 7fad98bee640 1 -- 172.21.15.44:0/1536086115 >> 172.21.15.44:0/1536086115 conn(0x7fad940c3cd0 msgr2=0x7fad940c40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:34.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.094+0000 7f2ec85e3640 1 --2- 172.21.15.44:0/2794231456 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2ec014bd30 0x7f2eac003bc0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2eb400c4c0 tx=0x7f2eac005830 comp rx=0 tx=0).stop 2024-05-16T22:27:34.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.094+0000 7f2ec6b80640 1 -- 172.21.15.44:0/2794231456 reap_dead start 2024-05-16T22:27:34.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.093+0000 7fcf09cba640 1 -- 172.21.15.44:0/2958771242 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf0406cb70 con 0x7fcf04073df0 2024-05-16T22:27:34.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.094+0000 7fcf0acbc640 1 --2- 172.21.15.44:0/2958771242 >> v2:172.21.15.44:3300/0 conn(0x7fcf041537f0 0x7fcf040bbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:27:34.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.094+0000 7fcf09cba640 1 --2- 172.21.15.44:0/2958771242 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf04073df0 0x7fcf040bb9b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fcf000097a0 tx=0x7fcf0002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a104d19202c1b53 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:34.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.095+0000 7f2ec85e3640 1 -- 172.21.15.44:0/2794231456 shutdown_connections 2024-05-16T22:27:34.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.095+0000 7f2ec85e3640 1 -- 172.21.15.44:0/2794231456 >> 172.21.15.44:0/2794231456 conn(0x7f2ec00bd1d0 msgr2=0x7f2ec00bd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:34.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.095+0000 7fb34e297640 1 -- 172.21.15.44:0/2267423711 shutdown_connections 2024-05-16T22:27:34.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.095+0000 7fb34e297640 1 --2- 172.21.15.44:0/2267423711 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb3480be770 0x7fb3480736e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.095+0000 7fb34e297640 1 -- 172.21.15.44:0/2267423711 >> 172.21.15.44:0/2267423711 conn(0x7fb3480bd160 msgr2=0x7fb3480bd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:34.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.095+0000 7f2ec85e3640 1 -- 172.21.15.44:0/2794231456 shutdown_connections 2024-05-16T22:27:34.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.095+0000 7f2ec85e3640 1 -- 172.21.15.44:0/2794231456 wait complete. 2024-05-16T22:27:34.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.095+0000 7fad98bee640 1 -- 172.21.15.44:0/1536086115 shutdown_connections 2024-05-16T22:27:34.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.095+0000 7fad98bee640 1 -- 172.21.15.44:0/1536086115 wait complete. 2024-05-16T22:27:34.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.095+0000 7fb34e297640 1 -- 172.21.15.44:0/2267423711 shutdown_connections 2024-05-16T22:27:34.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.095+0000 7f77996a7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7794070300 0x7f779413f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.095+0000 7f3b2c134640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b1c039c20 0x7f3b1c0d2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.096+0000 7f3b2c134640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3b1c03c1c0 0x7f3b1c16fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.096+0000 7f3b2c134640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b1c03cf80 0x7f3b1c0c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.096+0000 7f77996a7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f77940a0dc0 0x7f77941e43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.096+0000 7f3b2c134640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1c0e1360 con 0x7f3b1c03cf80 2024-05-16T22:27:34.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.096+0000 7f3b2c134640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1c0d5d50 con 0x7f3b1c039c20 2024-05-16T22:27:34.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.096+0000 7f3b2c134640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f3b1c0e14e0 con 0x7f3b1c03c1c0 2024-05-16T22:27:34.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.096+0000 7f7792ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7794070300 0x7f779413f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.096+0000 7f77996a7640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f77940bb6f0 0x7f77940a3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.096+0000 7f7792ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7794070300 0x7f779413f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.44:57502/0 (socket says 172.21.15.44:57502) 2024-05-16T22:27:34.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.096+0000 7f77996a7640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f77940b4da0 con 0x7f77940a0dc0 2024-05-16T22:27:34.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.096+0000 7f77996a7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f77940b6590 con 0x7f7794070300 2024-05-16T22:27:34.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.096+0000 7f77996a7640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f77940b4f20 con 0x7f77940bb6f0 2024-05-16T22:27:34.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.096+0000 7f7792ffd640 1 -- 172.21.15.44:0/3703454406 learned_addr learned my addr 172.21.15.44:0/3703454406 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:34.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.096+0000 7f77937fe640 1 --2- 172.21.15.44:0/3703454406 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f77940bb6f0 0x7f77940a3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.096+0000 7f3b29ed0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b1c039c20 0x7f3b1c0d2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.096+0000 7f778bfff640 1 --2- 172.21.15.44:0/3703454406 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f77940a0dc0 0x7f77941e43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.096+0000 7f3b29ed0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b1c039c20 0x7f3b1c0d2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.44:57494/0 (socket says 172.21.15.44:57494) 2024-05-16T22:27:34.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.096+0000 7f3b29ed0640 1 -- 172.21.15.44:0/2878955582 learned_addr learned my addr 172.21.15.44:0/2878955582 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:34.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.096+0000 7f3b2a6d1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b1c03cf80 0x7f3b1c0c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.097+0000 7f3b29ed0640 1 -- 172.21.15.44:0/2878955582 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3b1c03c1c0 msgr2=0x7f3b1c16fe20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-16T22:27:34.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.097+0000 7f3b29ed0640 1 --2- 172.21.15.44:0/2878955582 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3b1c03c1c0 0x7f3b1c16fe20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.097+0000 7f3b29ed0640 1 -- 172.21.15.44:0/2878955582 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b1c03cf80 msgr2=0x7f3b1c0c8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.097+0000 7f3b29ed0640 1 --2- 172.21.15.44:0/2878955582 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b1c03cf80 0x7f3b1c0c8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.097+0000 7f3b29ed0640 1 -- 172.21.15.44:0/2878955582 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b1c0d8320 con 0x7f3b1c039c20 2024-05-16T22:27:34.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.097+0000 7f77937fe640 1 -- 172.21.15.44:0/3703454406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7794070300 msgr2=0x7f779413f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.097+0000 7f77937fe640 1 --2- 172.21.15.44:0/3703454406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7794070300 0x7f779413f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.097+0000 7f77937fe640 1 -- 172.21.15.44:0/3703454406 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f77940a0dc0 msgr2=0x7f77941e43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.097+0000 7f77937fe640 1 --2- 172.21.15.44:0/3703454406 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f77940a0dc0 0x7f77941e43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.097+0000 7f77937fe640 1 -- 172.21.15.44:0/3703454406 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77941411f0 con 0x7f77940bb6f0 2024-05-16T22:27:34.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.097+0000 7f3b29ed0640 1 --2- 172.21.15.44:0/2878955582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b1c039c20 0x7f3b1c0d2b70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3b2000c3c0 tx=0x7f3b2000c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:34.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.097+0000 7f2ec85e3640 1 Processor -- start 2024-05-16T22:27:34.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.097+0000 7f7792ffd640 1 --2- 172.21.15.44:0/3703454406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7794070300 0x7f779413f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:27:34.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.098+0000 7f3b1a7fc640 1 -- 172.21.15.44:0/2878955582 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b20017070 con 0x7f3b1c039c20 2024-05-16T22:27:34.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.098+0000 7f2ec85e3640 1 -- start start 2024-05-16T22:27:34.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.098+0000 7f77937fe640 1 --2- 172.21.15.44:0/3703454406 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f77940bb6f0 0x7f77940a3b20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f778c00b440 tx=0x7f778c00b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:34.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.095+0000 7fb34e297640 1 -- 172.21.15.44:0/2267423711 wait complete. 2024-05-16T22:27:34.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.098+0000 7f3b1a7fc640 1 -- 172.21.15.44:0/2878955582 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b200052f0 con 0x7f3b1c039c20 2024-05-16T22:27:34.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.098+0000 7f3b1a7fc640 1 -- 172.21.15.44:0/2878955582 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b20003850 con 0x7f3b1c039c20 2024-05-16T22:27:34.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.098+0000 7f3b2c134640 1 -- 172.21.15.44:0/2878955582 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b1c0d30b0 con 0x7f3b1c039c20 2024-05-16T22:27:34.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.098+0000 7fb34e297640 1 Processor -- start 2024-05-16T22:27:34.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.098+0000 7f3b2c134640 1 -- 172.21.15.44:0/2878955582 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b1c0d9350 con 0x7f3b1c039c20 2024-05-16T22:27:34.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.098+0000 7f778b7fe640 1 -- 172.21.15.44:0/3703454406 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778c015020 con 0x7f77940bb6f0 2024-05-16T22:27:34.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.098+0000 7f778b7fe640 1 -- 172.21.15.44:0/3703454406 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f778c011830 con 0x7f77940bb6f0 2024-05-16T22:27:34.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.098+0000 7f77996a7640 1 -- 172.21.15.44:0/3703454406 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77940a4060 con 0x7f77940bb6f0 2024-05-16T22:27:34.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.098+0000 7f77996a7640 1 -- 172.21.15.44:0/3703454406 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f779413ff60 con 0x7f77940bb6f0 2024-05-16T22:27:34.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.098+0000 7fad98bee640 1 Processor -- start 2024-05-16T22:27:34.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.098+0000 7fad98bee640 1 -- start start 2024-05-16T22:27:34.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.095+0000 7fcf094b9640 1 -- 172.21.15.44:0/2958771242 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf00037070 con 0x7fcf04073df0 2024-05-16T22:27:34.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.095+0000 7fcf094b9640 1 -- 172.21.15.44:0/2958771242 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf00032440 con 0x7fcf04073df0 2024-05-16T22:27:34.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.095+0000 7fcf094b9640 1 -- 172.21.15.44:0/2958771242 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf00032810 con 0x7fcf04073df0 2024-05-16T22:27:34.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.097+0000 7fcf0c71f640 1 -- 172.21.15.44:0/2958771242 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf04073df0 msgr2=0x7fcf040bb9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.097+0000 7fcf0c71f640 1 --2- 172.21.15.44:0/2958771242 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf04073df0 0x7fcf040bb9b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fcf000097a0 tx=0x7fcf0002a180 comp rx=0 tx=0).stop 2024-05-16T22:27:34.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.100+0000 7f2ec85e3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ec014bd30 0x7f2ec00a4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.098+0000 7fcf0c71f640 1 -- 172.21.15.44:0/2958771242 shutdown_connections 2024-05-16T22:27:34.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.100+0000 7fad98bee640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad941d9020 0x7fad940a6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.098+0000 7fcf0c71f640 1 --2- 172.21.15.44:0/2958771242 >> v2:172.21.15.44:3300/0 conn(0x7fcf041537f0 0x7fcf040bbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.098+0000 7fcf0c71f640 1 --2- 172.21.15.44:0/2958771242 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf04073df0 0x7fcf040bb9b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.100+0000 7f2ec85e3640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2ec014ad30 0x7f2ec0073440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.098+0000 7fb34e297640 1 -- start start 2024-05-16T22:27:34.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.100+0000 7fb34e297640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb3480bc0c0 0x7fb3480b68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.100+0000 7f2ec85e3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ec013e760 0x7f2ec013eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.100+0000 7f2ec637f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ec014bd30 0x7f2ec00a4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.098+0000 7fcf0c71f640 1 -- 172.21.15.44:0/2958771242 >> 172.21.15.44:0/2958771242 conn(0x7fcf040bd160 msgr2=0x7fcf040bd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:34.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.100+0000 7fcf0c71f640 1 -- 172.21.15.44:0/2958771242 shutdown_connections 2024-05-16T22:27:34.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.100+0000 7f778b7fe640 1 -- 172.21.15.44:0/3703454406 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778c011c20 con 0x7f77940bb6f0 2024-05-16T22:27:34.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.100+0000 7fad9259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad941d9020 0x7fad940a6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.100+0000 7f2ec5b7e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2ec014ad30 0x7f2ec0073440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.100+0000 7fb347fff640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb3480bc0c0 0x7fb3480b68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.100+0000 7fb347fff640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb3480bc0c0 0x7fb3480b68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.44:50800/0 (socket says 172.21.15.44:50800) 2024-05-16T22:27:34.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.100+0000 7f2ec637f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ec014bd30 0x7f2ec00a4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.44:57506/0 (socket says 172.21.15.44:57506) 2024-05-16T22:27:34.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.100+0000 7f2ec5b7e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2ec014ad30 0x7f2ec0073440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.44:50790/0 (socket says 172.21.15.44:50790) 2024-05-16T22:27:34.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.100+0000 7fb34e297640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3480be770 0x7fb348152520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.100+0000 7fb347fff640 1 -- 172.21.15.44:0/267014671 learned_addr learned my addr 172.21.15.44:0/267014671 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:34.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.100+0000 7f77996a7640 1 -- 172.21.15.44:0/3703454406 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7770005290 con 0x7f77940bb6f0 2024-05-16T22:27:34.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.100+0000 7fb34e297640 1 --2- 172.21.15.44:0/267014671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3481537f0 0x7fb34814b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.100+0000 7fad98bee640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad940bb3f0 0x7fad940bb800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.100+0000 7fad98bee640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fad941ec0d0 0x7fad941ec4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.100+0000 7fad98bee640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fad9408d850 con 0x7fad941d9020 2024-05-16T22:27:34.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.100+0000 7fb34e297640 1 -- 172.21.15.44:0/267014671 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb34806c6e0 con 0x7fb3480be770 2024-05-16T22:27:34.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.100+0000 7fb3477fe640 1 --2- 172.21.15.44:0/267014671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3480be770 0x7fb348152520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.100+0000 7fb34c834640 1 --2- 172.21.15.44:0/267014671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3481537f0 0x7fb34814b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.101+0000 7fb34e297640 1 -- 172.21.15.44:0/267014671 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb3480731c0 con 0x7fb3481537f0 2024-05-16T22:27:34.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.101+0000 7fb34e297640 1 -- 172.21.15.44:0/267014671 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fb34806c860 con 0x7fb3480bc0c0 2024-05-16T22:27:34.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.100+0000 7fad9259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad941d9020 0x7fad940a6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58238/0 (socket says 172.21.15.44:58238) 2024-05-16T22:27:34.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.100+0000 7fad9259c640 1 -- 172.21.15.44:0/189593911 learned_addr learned my addr 172.21.15.44:0/189593911 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:34.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.100+0000 7fad98bee640 1 -- 172.21.15.44:0/189593911 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fad940be640 con 0x7fad940bb3f0 2024-05-16T22:27:34.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.100+0000 7fad98bee640 1 -- 172.21.15.44:0/189593911 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fad9408d9d0 con 0x7fad941ec0d0 2024-05-16T22:27:34.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.101+0000 7fad92d9d640 1 --2- 172.21.15.44:0/189593911 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fad941ec0d0 0x7fad941ec4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.100+0000 7fcf0c71f640 1 -- 172.21.15.44:0/2958771242 wait complete. 2024-05-16T22:27:34.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.101+0000 7f2ec85e3640 1 -- 172.21.15.44:0/2859505139 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec00be6f0 con 0x7f2ec013e760 2024-05-16T22:27:34.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.101+0000 7f2ec5b7e640 1 -- 172.21.15.44:0/2859505139 learned_addr learned my addr 172.21.15.44:0/2859505139 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:34.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.101+0000 7fad91d9b640 1 --2- 172.21.15.44:0/189593911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad940bb3f0 0x7fad940bb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.100+0000 7f3b07fff640 1 -- 172.21.15.44:0/2878955582 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b00005290 con 0x7f3b1c039c20 2024-05-16T22:27:34.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.101+0000 7f3b1a7fc640 1 -- 172.21.15.44:0/2878955582 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3b2001a070 con 0x7f3b1c039c20 2024-05-16T22:27:34.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.101+0000 7fad92d9d640 1 -- 172.21.15.44:0/189593911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad940bb3f0 msgr2=0x7fad940bb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.101+0000 7fad92d9d640 1 --2- 172.21.15.44:0/189593911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad940bb3f0 0x7fad940bb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.101+0000 7fad92d9d640 1 -- 172.21.15.44:0/189593911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad941d9020 msgr2=0x7fad940a6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.101+0000 7fad92d9d640 1 --2- 172.21.15.44:0/189593911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad941d9020 0x7fad940a6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.101+0000 7fad92d9d640 1 -- 172.21.15.44:0/189593911 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad940a7300 con 0x7fad941ec0d0 2024-05-16T22:27:34.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.101+0000 7f2ec6b80640 1 --2- 172.21.15.44:0/2859505139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ec013e760 0x7f2ec013eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.101+0000 7f2ec85e3640 1 -- 172.21.15.44:0/2859505139 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec009ffa0 con 0x7f2ec014bd30 2024-05-16T22:27:34.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.101+0000 7f2ec85e3640 1 -- 172.21.15.44:0/2859505139 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f2ec00bebc0 con 0x7f2ec014ad30 2024-05-16T22:27:34.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.101+0000 7fb347fff640 1 -- 172.21.15.44:0/267014671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3481537f0 msgr2=0x7fb34814b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.101+0000 7fb347fff640 1 --2- 172.21.15.44:0/267014671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3481537f0 0x7fb34814b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.101+0000 7fb347fff640 1 -- 172.21.15.44:0/267014671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3480be770 msgr2=0x7fb348152520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.101+0000 7fb347fff640 1 --2- 172.21.15.44:0/267014671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3480be770 0x7fb348152520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.101+0000 7fb347fff640 1 -- 172.21.15.44:0/267014671 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3480b6df0 con 0x7fb3480bc0c0 2024-05-16T22:27:34.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.102+0000 7f3b1a7fc640 1 --2- 172.21.15.44:0/2878955582 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f3b080763d0 0x7f3b080788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.102+0000 7fad92d9d640 1 --2- 172.21.15.44:0/189593911 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fad941ec0d0 0x7fad941ec4e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fad940b73b0 tx=0x7fad8800d7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:34.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.102+0000 7f2ec637f640 1 -- 172.21.15.44:0/2859505139 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2ec014ad30 msgr2=0x7f2ec0073440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.102+0000 7f2ec637f640 1 --2- 172.21.15.44:0/2859505139 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2ec014ad30 0x7f2ec0073440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.102+0000 7f2ec637f640 1 -- 172.21.15.44:0/2859505139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ec013e760 msgr2=0x7f2ec013eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.102+0000 7f2ec637f640 1 --2- 172.21.15.44:0/2859505139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ec013e760 0x7f2ec013eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.102+0000 7f2ec637f640 1 -- 172.21.15.44:0/2859505139 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ec00a63a0 con 0x7f2ec014bd30 2024-05-16T22:27:34.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.102+0000 7f2ec6b80640 1 --2- 172.21.15.44:0/2859505139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ec013e760 0x7f2ec013eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:27:34.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.102+0000 7fb347fff640 1 --2- 172.21.15.44:0/267014671 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb3480bc0c0 0x7fb3480b68b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb3380098a0 tx=0x7fb3380046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:34.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.102+0000 7f3b296cf640 1 --2- 172.21.15.44:0/2878955582 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f3b080763d0 0x7f3b080788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.102+0000 7f778b7fe640 1 -- 172.21.15.44:0/3703454406 <== mon.2 v2:172.21.15.70:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f778c018020 con 0x7f77940bb6f0 2024-05-16T22:27:34.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.102+0000 7f3b1a7fc640 1 -- 172.21.15.44:0/2878955582 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3b200968c0 con 0x7f3b1c039c20 2024-05-16T22:27:34.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.103+0000 7fcf0c71f640 1 Processor -- start 2024-05-16T22:27:34.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.103+0000 7f2ec637f640 1 --2- 172.21.15.44:0/2859505139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ec014bd30 0x7f2ec00a4660 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2eac00bf50 tx=0x7f2eb4001a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:34.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.103+0000 7fcf0c71f640 1 -- start start 2024-05-16T22:27:34.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.103+0000 7f3b296cf640 1 --2- 172.21.15.44:0/2878955582 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f3b080763d0 0x7f3b080788e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3b24051610 tx=0x7f3b240696f0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:34.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.103+0000 7f778b7fe640 1 --2- 172.21.15.44:0/3703454406 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f777c076320 0x7f777c078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.103+0000 7f7792ffd640 1 --2- 172.21.15.44:0/3703454406 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f777c076320 0x7f777c078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.103+0000 7f778b7fe640 1 -- 172.21.15.44:0/3703454406 <== mon.2 v2:172.21.15.70:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f778c0977f0 con 0x7f77940bb6f0 2024-05-16T22:27:34.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.104+0000 7f7792ffd640 1 --2- 172.21.15.44:0/3703454406 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f777c076320 0x7f777c078830 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7784000f80 tx=0x7f7784037000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:34.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.104+0000 7fcf0c71f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf04073df0 0x7fcf040b6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.104+0000 7fcf0c71f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf040be770 0x7fcf041e9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.104+0000 7fcf0a4bb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf04073df0 0x7fcf040b6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.105+0000 7fcf0a4bb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf04073df0 0x7fcf040b6b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58262/0 (socket says 172.21.15.44:58262) 2024-05-16T22:27:34.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.105+0000 7fcf0c71f640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf041537f0 0x7fcf04070d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.105+0000 7fcf09cba640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf040be770 0x7fcf041e9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.105+0000 7fcf09cba640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf040be770 0x7fcf041e9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.44:57526/0 (socket says 172.21.15.44:57526) 2024-05-16T22:27:34.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.105+0000 7fcf0a4bb640 1 -- 172.21.15.44:0/170030670 learned_addr learned my addr 172.21.15.44:0/170030670 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:34.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.105+0000 7fcf0c71f640 1 -- 172.21.15.44:0/170030670 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcf0406c6e0 con 0x7fcf04073df0 2024-05-16T22:27:34.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.105+0000 7fcf0c71f640 1 -- 172.21.15.44:0/170030670 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcf040731c0 con 0x7fcf040be770 2024-05-16T22:27:34.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.105+0000 7fcf0c71f640 1 -- 172.21.15.44:0/170030670 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fcf0406c860 con 0x7fcf041537f0 2024-05-16T22:27:34.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.105+0000 7fcf0acbc640 1 --2- 172.21.15.44:0/170030670 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf041537f0 0x7fcf04070d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.105+0000 7fcf09cba640 1 -- 172.21.15.44:0/170030670 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf041537f0 msgr2=0x7fcf04070d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.105+0000 7fcf09cba640 1 --2- 172.21.15.44:0/170030670 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf041537f0 0x7fcf04070d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.105+0000 7fcf09cba640 1 -- 172.21.15.44:0/170030670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf04073df0 msgr2=0x7fcf040b6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.105+0000 7fcf09cba640 1 --2- 172.21.15.44:0/170030670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf04073df0 0x7fcf040b6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.105+0000 7fcf09cba640 1 -- 172.21.15.44:0/170030670 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf040b7050 con 0x7fcf040be770 2024-05-16T22:27:34.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.105+0000 7fcf0a4bb640 1 --2- 172.21.15.44:0/170030670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf04073df0 0x7fcf040b6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:27:34.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.105+0000 7fcf0acbc640 1 --2- 172.21.15.44:0/170030670 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf041537f0 0x7fcf04070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:27:34.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.105+0000 7fcf09cba640 1 --2- 172.21.15.44:0/170030670 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf040be770 0x7fcf041e9130 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcf00031000 tx=0x7fcf000046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:34.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.112+0000 7fb344ff9640 1 -- 172.21.15.44:0/267014671 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb338037040 con 0x7fb3480bc0c0 2024-05-16T22:27:34.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.112+0000 7fad82ffd640 1 -- 172.21.15.44:0/189593911 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad880125f0 con 0x7fad941ec0d0 2024-05-16T22:27:34.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.112+0000 7fb34e297640 1 -- 172.21.15.44:0/267014671 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb348152a60 con 0x7fb3480bc0c0 2024-05-16T22:27:34.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.112+0000 7fb344ff9640 1 -- 172.21.15.44:0/267014671 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb338042070 con 0x7fb3480bc0c0 2024-05-16T22:27:34.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.112+0000 7fcef6ffd640 1 -- 172.21.15.44:0/170030670 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf00037050 con 0x7fcf040be770 2024-05-16T22:27:34.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.112+0000 7fb344ff9640 1 -- 172.21.15.44:0/267014671 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb338030bd0 con 0x7fb3480bc0c0 2024-05-16T22:27:34.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.112+0000 7fb34e297640 1 -- 172.21.15.44:0/267014671 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb348070110 con 0x7fb3480bc0c0 2024-05-16T22:27:34.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.112+0000 7f778b7fe640 1 -- 172.21.15.44:0/3703454406 <== mon.2 v2:172.21.15.70:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f778c01f020 con 0x7f77940bb6f0 2024-05-16T22:27:34.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.112+0000 7fcef6ffd640 1 -- 172.21.15.44:0/170030670 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf00038040 con 0x7fcf040be770 2024-05-16T22:27:34.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.112+0000 7fcf0c71f640 1 -- 172.21.15.44:0/170030670 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf041e8990 con 0x7fcf040be770 2024-05-16T22:27:34.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.112+0000 7fad98bee640 1 -- 172.21.15.44:0/189593911 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad940bc6b0 con 0x7fad941ec0d0 2024-05-16T22:27:34.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.112+0000 7fad98bee640 1 -- 172.21.15.44:0/189593911 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fad941d9430 con 0x7fad941ec0d0 2024-05-16T22:27:34.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.113+0000 7fad82ffd640 1 -- 172.21.15.44:0/189593911 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad88018070 con 0x7fad941ec0d0 2024-05-16T22:27:34.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.112+0000 7f2eb2ffd640 1 -- 172.21.15.44:0/2859505139 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb4007270 con 0x7f2ec014bd30 2024-05-16T22:27:34.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.112+0000 7f2eb2ffd640 1 -- 172.21.15.44:0/2859505139 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eb4007410 con 0x7f2ec014bd30 2024-05-16T22:27:34.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.112+0000 7f2eb2ffd640 1 -- 172.21.15.44:0/2859505139 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb40077c0 con 0x7f2ec014bd30 2024-05-16T22:27:34.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.113+0000 7f2ec85e3640 1 -- 172.21.15.44:0/2859505139 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ec0073980 con 0x7f2ec014bd30 2024-05-16T22:27:34.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.114+0000 7f2ec85e3640 1 -- 172.21.15.44:0/2859505139 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ec00a5330 con 0x7f2ec014bd30 2024-05-16T22:27:34.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.114+0000 7fcef6ffd640 1 -- 172.21.15.44:0/170030670 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf00030970 con 0x7fcf040be770 2024-05-16T22:27:34.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.114+0000 7fcf0c71f640 1 -- 172.21.15.44:0/170030670 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf041e9880 con 0x7fcf040be770 2024-05-16T22:27:34.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.115+0000 7fcf0c71f640 1 -- 172.21.15.44:0/170030670 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf04069b50 con 0x7fcf040be770 2024-05-16T22:27:34.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.114+0000 7f3b1a7fc640 1 -- 172.21.15.44:0/2878955582 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3b2005fb20 con 0x7f3b1c039c20 2024-05-16T22:27:34.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.115+0000 7fad82ffd640 1 -- 172.21.15.44:0/189593911 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad880129f0 con 0x7fad941ec0d0 2024-05-16T22:27:34.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.115+0000 7fad80ff9640 1 -- 172.21.15.44:0/189593911 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad78005290 con 0x7fad941ec0d0 2024-05-16T22:27:34.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.114+0000 7fb32e7fc640 1 -- 172.21.15.44:0/267014671 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb348070bb0 con 0x7fb3480bc0c0 2024-05-16T22:27:34.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.116+0000 7f2ec85e3640 1 -- 172.21.15.44:0/2859505139 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ec0069b50 con 0x7f2ec014bd30 2024-05-16T22:27:34.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.116+0000 7f2eb2ffd640 1 -- 172.21.15.44:0/2859505139 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2eb4039480 con 0x7f2ec014bd30 2024-05-16T22:27:34.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.116+0000 7fcef6ffd640 1 -- 172.21.15.44:0/170030670 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcf00045020 con 0x7fcf040be770 2024-05-16T22:27:34.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.116+0000 7fcef6ffd640 1 --2- 172.21.15.44:0/170030670 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fcee8076320 0x7fcee8078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.117+0000 7fcf0a4bb640 1 --2- 172.21.15.44:0/170030670 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fcee8076320 0x7fcee8078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.117+0000 7fad82ffd640 1 -- 172.21.15.44:0/189593911 <== mon.2 v2:172.21.15.70:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fad88012b90 con 0x7fad941ec0d0 2024-05-16T22:27:34.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.117+0000 7fb344ff9640 1 -- 172.21.15.44:0/267014671 <== mon.2 v2:172.21.15.70:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb338047460 con 0x7fb3480bc0c0 2024-05-16T22:27:34.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.117+0000 7fcef6ffd640 1 -- 172.21.15.44:0/170030670 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fcf0007ceb0 con 0x7fcf040be770 2024-05-16T22:27:34.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.118+0000 7f2eb2ffd640 1 --2- 172.21.15.44:0/2859505139 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f2ea4076570 0x7f2ea4078a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.118+0000 7f2eb2ffd640 1 -- 172.21.15.44:0/2859505139 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2eb40b7f80 con 0x7f2ec014bd30 2024-05-16T22:27:34.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.118+0000 7fad82ffd640 1 --2- 172.21.15.44:0/189593911 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fad740762d0 0x7fad740787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.118+0000 7fb344ff9640 1 --2- 172.21.15.44:0/267014671 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fb3340762d0 0x7fb3340787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.118+0000 7fb344ff9640 1 -- 172.21.15.44:0/267014671 <== mon.2 v2:172.21.15.70:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb3380b81a0 con 0x7fb3480bc0c0 2024-05-16T22:27:34.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.118+0000 7fcf0a4bb640 1 --2- 172.21.15.44:0/170030670 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fcee8076320 0x7fcee8078830 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcef8007fd0 tx=0x7fcef8000f10 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:34.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.118+0000 7f2ec5b7e640 1 --2- 172.21.15.44:0/2859505139 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f2ea4076570 0x7f2ea4078a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.118+0000 7fad9259c640 1 --2- 172.21.15.44:0/189593911 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fad740762d0 0x7fad740787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.118+0000 7fad82ffd640 1 -- 172.21.15.44:0/189593911 <== mon.2 v2:172.21.15.70:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fad88097ca0 con 0x7fad941ec0d0 2024-05-16T22:27:34.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.118+0000 7fb3477fe640 1 --2- 172.21.15.44:0/267014671 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fb3340762d0 0x7fb3340787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.119+0000 7fad9259c640 1 --2- 172.21.15.44:0/189593911 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fad740762d0 0x7fad740787e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fad8c005050 tx=0x7fad8c00a000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:34.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.119+0000 7f2ec5b7e640 1 --2- 172.21.15.44:0/2859505139 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f2ea4076570 0x7f2ea4078a80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2ec014b7e0 tx=0x7f2ebc009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:34.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.119+0000 7fb3477fe640 1 --2- 172.21.15.44:0/267014671 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fb3340762d0 0x7fb3340787e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb3480bfdf0 tx=0x7fb33c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:34.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.126+0000 7fad82ffd640 1 -- 172.21.15.44:0/189593911 <== mon.2 v2:172.21.15.70:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fad88060f90 con 0x7fad941ec0d0 2024-05-16T22:27:34.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.129+0000 7fcef6ffd640 1 -- 172.21.15.44:0/170030670 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fcf00065060 con 0x7fcf040be770 2024-05-16T22:27:34.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.135+0000 7f2eb2ffd640 1 -- 172.21.15.44:0/2859505139 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2ec0070080 con 0x7f2ec014bd30 2024-05-16T22:27:34.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.135+0000 7fb344ff9640 1 -- 172.21.15.44:0/267014671 <== mon.2 v2:172.21.15.70:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb348070bb0 con 0x7fb3480bc0c0 2024-05-16T22:27:34.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.464+0000 7f38dc9f3640 1 -- 172.21.15.44:0/494948216 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f38bc005580 con 0x7f38d00d1450 2024-05-16T22:27:34.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.464+0000 7f424f5ff640 1 -- 172.21.15.44:0/195429211 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f4228005580 con 0x7f4248156b50 2024-05-16T22:27:34.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.465+0000 7f423dffb640 1 -- 172.21.15.44:0/195429211 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4238080ea0 con 0x7f4248156b50 2024-05-16T22:27:34.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.465+0000 7f38c6ffd640 1 -- 172.21.15.44:0/494948216 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f38cc081940 con 0x7f38d00d1450 2024-05-16T22:27:34.465 INFO:teuthology.orchestra.run.smithi044.stdout:55834574854 2024-05-16T22:27:34.465 INFO:teuthology.orchestra.run.smithi044.stdout:55834574854 2024-05-16T22:27:34.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.468+0000 7f38c4ff9640 1 -- 172.21.15.44:0/494948216 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f38b80763d0 msgr2=0x7f38b80788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.469+0000 7f38c4ff9640 1 --2- 172.21.15.44:0/494948216 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f38b80763d0 0x7f38b80788e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f38d003f050 tx=0x7f38c8008040 comp rx=0 tx=0).stop 2024-05-16T22:27:34.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.469+0000 7f42337fe640 1 -- 172.21.15.44:0/195429211 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4234076420 msgr2=0x7f4234078930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.469+0000 7f38c4ff9640 1 -- 172.21.15.44:0/494948216 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f38d00d1450 msgr2=0x7f38d00c6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.469+0000 7f38c4ff9640 1 --2- 172.21.15.44:0/494948216 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f38d00d1450 0x7f38d00c6650 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f38cc0098c0 tx=0x7f38cc0046c0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.469+0000 7f42337fe640 1 --2- 172.21.15.44:0/195429211 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4234076420 0x7f4234078930 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4240000b60 tx=0x7f424000b040 comp rx=0 tx=0).stop 2024-05-16T22:27:34.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.469+0000 7f42337fe640 1 -- 172.21.15.44:0/195429211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4248156b50 msgr2=0x7f4248147d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.469+0000 7f38c4ff9640 1 -- 172.21.15.44:0/494948216 shutdown_connections 2024-05-16T22:27:34.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.469+0000 7f42337fe640 1 --2- 172.21.15.44:0/195429211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4248156b50 0x7f4248147d40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f42480694e0 tx=0x7f42380046c0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.469+0000 7f38c4ff9640 1 --2- 172.21.15.44:0/494948216 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f38b80763d0 0x7f38b80788e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.469+0000 7f42337fe640 1 -- 172.21.15.44:0/195429211 shutdown_connections 2024-05-16T22:27:34.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.469+0000 7f42337fe640 1 --2- 172.21.15.44:0/195429211 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4234076420 0x7f4234078930 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.469+0000 7f42337fe640 1 --2- 172.21.15.44:0/195429211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4248156b50 0x7f4248147d40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.469+0000 7f42337fe640 1 --2- 172.21.15.44:0/195429211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42480c24d0 0x7f4248147800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.469+0000 7f42337fe640 1 --2- 172.21.15.44:0/195429211 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f42480c0ac0 0x7f42481472c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.469+0000 7f42337fe640 1 -- 172.21.15.44:0/195429211 >> 172.21.15.44:0/195429211 conn(0x7f42480c3d20 msgr2=0x7f4248068600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:34.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.469+0000 7f38c4ff9640 1 --2- 172.21.15.44:0/494948216 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f38d00c5c70 0x7f38d0034c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.469+0000 7f38c4ff9640 1 --2- 172.21.15.44:0/494948216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38d00d1860 0x7f38d00cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.469+0000 7f42337fe640 1 -- 172.21.15.44:0/195429211 shutdown_connections 2024-05-16T22:27:34.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.470+0000 7f38c4ff9640 1 --2- 172.21.15.44:0/494948216 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f38d00d1450 0x7f38d00c6650 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.470+0000 7f42337fe640 1 -- 172.21.15.44:0/195429211 wait complete. 2024-05-16T22:27:34.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.470+0000 7f38c4ff9640 1 -- 172.21.15.44:0/494948216 >> 172.21.15.44:0/494948216 conn(0x7f38d0006110 msgr2=0x7f38d0041ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:34.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.470+0000 7f38c4ff9640 1 -- 172.21.15.44:0/494948216 shutdown_connections 2024-05-16T22:27:34.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.470+0000 7f38c4ff9640 1 -- 172.21.15.44:0/494948216 wait complete. 2024-05-16T22:27:34.488 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2024-05-16T22:27:34.488 DEBUG:teuthology.parallel:result is None 2024-05-16T22:27:34.489 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2024-05-16T22:27:34.489 DEBUG:teuthology.parallel:result is None 2024-05-16T22:27:34.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.522+0000 7f2ec85e3640 1 -- 172.21.15.44:0/2859505139 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f2ec00be4d0 con 0x7f2ec014bd30 2024-05-16T22:27:34.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.522+0000 7fcf0c71f640 1 -- 172.21.15.44:0/170030670 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fcf040b7730 con 0x7fcf040be770 2024-05-16T22:27:34.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.523+0000 7fcef6ffd640 1 -- 172.21.15.44:0/170030670 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcf041e8990 con 0x7fcf040be770 2024-05-16T22:27:34.522 INFO:teuthology.orchestra.run.smithi044.stdout:55834574854 2024-05-16T22:27:34.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.523+0000 7f2eb2ffd640 1 -- 172.21.15.44:0/2859505139 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2eb40811e0 con 0x7f2ec014bd30 2024-05-16T22:27:34.523 INFO:teuthology.orchestra.run.smithi044.stdout:55834574854 2024-05-16T22:27:34.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.525+0000 7fcf0c71f640 1 -- 172.21.15.44:0/170030670 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fcee8076320 msgr2=0x7fcee8078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.525+0000 7fcf0c71f640 1 --2- 172.21.15.44:0/170030670 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fcee8076320 0x7fcee8078830 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcef8007fd0 tx=0x7fcef8000f10 comp rx=0 tx=0).stop 2024-05-16T22:27:34.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.525+0000 7fcf0c71f640 1 -- 172.21.15.44:0/170030670 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf040be770 msgr2=0x7fcf041e9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.525+0000 7fcf0c71f640 1 --2- 172.21.15.44:0/170030670 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf040be770 0x7fcf041e9130 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcf00031000 tx=0x7fcf000046c0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.525+0000 7f2ec85e3640 1 -- 172.21.15.44:0/2859505139 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f2ea4076570 msgr2=0x7f2ea4078a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.525+0000 7fcf0c71f640 1 -- 172.21.15.44:0/170030670 shutdown_connections 2024-05-16T22:27:34.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.525+0000 7fcf0c71f640 1 --2- 172.21.15.44:0/170030670 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fcee8076320 0x7fcee8078830 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.525+0000 7fcf0c71f640 1 --2- 172.21.15.44:0/170030670 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf041537f0 0x7fcf04070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.525+0000 7fcf0c71f640 1 --2- 172.21.15.44:0/170030670 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf040be770 0x7fcf041e9130 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.525+0000 7fcf0c71f640 1 --2- 172.21.15.44:0/170030670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf04073df0 0x7fcf040b6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.525+0000 7f2ec85e3640 1 --2- 172.21.15.44:0/2859505139 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f2ea4076570 0x7f2ea4078a80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2ec014b7e0 tx=0x7f2ebc009040 comp rx=0 tx=0).stop 2024-05-16T22:27:34.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.525+0000 7fcf0c71f640 1 -- 172.21.15.44:0/170030670 >> 172.21.15.44:0/170030670 conn(0x7fcf040bd160 msgr2=0x7fcf040736e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:34.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.525+0000 7f2ec85e3640 1 -- 172.21.15.44:0/2859505139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ec014bd30 msgr2=0x7f2ec00a4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.525+0000 7f2ec85e3640 1 --2- 172.21.15.44:0/2859505139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ec014bd30 0x7f2ec00a4660 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2eac00bf50 tx=0x7f2eb4001a60 comp rx=0 tx=0).stop 2024-05-16T22:27:34.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.525+0000 7f2ec85e3640 1 -- 172.21.15.44:0/2859505139 shutdown_connections 2024-05-16T22:27:34.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.525+0000 7fcf0c71f640 1 -- 172.21.15.44:0/170030670 shutdown_connections 2024-05-16T22:27:34.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.525+0000 7f2ec85e3640 1 --2- 172.21.15.44:0/2859505139 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f2ea4076570 0x7f2ea4078a80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.525+0000 7f2ec85e3640 1 --2- 172.21.15.44:0/2859505139 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2ec014ad30 0x7f2ec0073440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.525+0000 7f2ec85e3640 1 --2- 172.21.15.44:0/2859505139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ec013e760 0x7f2ec013eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.525+0000 7f2ec85e3640 1 --2- 172.21.15.44:0/2859505139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ec014bd30 0x7f2ec00a4660 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.525+0000 7f2ec85e3640 1 -- 172.21.15.44:0/2859505139 >> 172.21.15.44:0/2859505139 conn(0x7f2ec00bd1d0 msgr2=0x7f2ec00a0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:34.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.525+0000 7fcf0c71f640 1 -- 172.21.15.44:0/170030670 wait complete. 2024-05-16T22:27:34.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.525+0000 7f2ec85e3640 1 -- 172.21.15.44:0/2859505139 shutdown_connections 2024-05-16T22:27:34.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.525+0000 7f2ec85e3640 1 -- 172.21.15.44:0/2859505139 wait complete. 2024-05-16T22:27:34.541 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2024-05-16T22:27:34.541 DEBUG:teuthology.parallel:result is None 2024-05-16T22:27:34.542 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2024-05-16T22:27:34.542 DEBUG:teuthology.parallel:result is None 2024-05-16T22:27:34.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.553+0000 7f77996a7640 1 -- 172.21.15.44:0/3703454406 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f7770005850 con 0x7f77940bb6f0 2024-05-16T22:27:34.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.554+0000 7f778b7fe640 1 -- 172.21.15.44:0/3703454406 <== mon.2 v2:172.21.15.70:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f778c060b50 con 0x7f77940bb6f0 2024-05-16T22:27:34.553 INFO:teuthology.orchestra.run.smithi044.stdout:55834574853 2024-05-16T22:27:34.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.557+0000 7f77996a7640 1 -- 172.21.15.44:0/3703454406 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f777c076320 msgr2=0x7f777c078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.557+0000 7f77996a7640 1 --2- 172.21.15.44:0/3703454406 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f777c076320 0x7f777c078830 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7784000f80 tx=0x7f7784037000 comp rx=0 tx=0).stop 2024-05-16T22:27:34.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.557+0000 7f77996a7640 1 -- 172.21.15.44:0/3703454406 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f77940bb6f0 msgr2=0x7f77940a3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.557+0000 7f77996a7640 1 --2- 172.21.15.44:0/3703454406 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f77940bb6f0 0x7f77940a3b20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f778c00b440 tx=0x7f778c00b900 comp rx=0 tx=0).stop 2024-05-16T22:27:34.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.557+0000 7f77996a7640 1 -- 172.21.15.44:0/3703454406 shutdown_connections 2024-05-16T22:27:34.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.557+0000 7f77996a7640 1 --2- 172.21.15.44:0/3703454406 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f777c076320 0x7f777c078830 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.557+0000 7f77996a7640 1 --2- 172.21.15.44:0/3703454406 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f77940bb6f0 0x7f77940a3b20 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.557+0000 7f77996a7640 1 --2- 172.21.15.44:0/3703454406 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f77940a0dc0 0x7f77941e43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.557+0000 7f77996a7640 1 --2- 172.21.15.44:0/3703454406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7794070300 0x7f779413f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.557+0000 7f77996a7640 1 -- 172.21.15.44:0/3703454406 >> 172.21.15.44:0/3703454406 conn(0x7f77940a1ac0 msgr2=0x7f77940b9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:34.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.557+0000 7f77996a7640 1 -- 172.21.15.44:0/3703454406 shutdown_connections 2024-05-16T22:27:34.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.557+0000 7f77996a7640 1 -- 172.21.15.44:0/3703454406 wait complete. 2024-05-16T22:27:34.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.566+0000 7f3b07fff640 1 -- 172.21.15.44:0/2878955582 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f3b00005580 con 0x7f3b1c039c20 2024-05-16T22:27:34.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.566+0000 7f3b1a7fc640 1 -- 172.21.15.44:0/2878955582 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3b200681f0 con 0x7f3b1c039c20 2024-05-16T22:27:34.566 INFO:teuthology.orchestra.run.smithi044.stdout:55834574854 2024-05-16T22:27:34.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.568+0000 7f3b07fff640 1 -- 172.21.15.44:0/2878955582 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f3b080763d0 msgr2=0x7f3b080788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.568+0000 7f3b07fff640 1 --2- 172.21.15.44:0/2878955582 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f3b080763d0 0x7f3b080788e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3b24051610 tx=0x7f3b240696f0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.568+0000 7f3b07fff640 1 -- 172.21.15.44:0/2878955582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b1c039c20 msgr2=0x7f3b1c0d2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.568+0000 7f3b07fff640 1 --2- 172.21.15.44:0/2878955582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b1c039c20 0x7f3b1c0d2b70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3b2000c3c0 tx=0x7f3b2000c880 comp rx=0 tx=0).stop 2024-05-16T22:27:34.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.568+0000 7f3b07fff640 1 -- 172.21.15.44:0/2878955582 shutdown_connections 2024-05-16T22:27:34.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.568+0000 7f3b07fff640 1 --2- 172.21.15.44:0/2878955582 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f3b080763d0 0x7f3b080788e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.568+0000 7f3b07fff640 1 --2- 172.21.15.44:0/2878955582 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3b1c03c1c0 0x7f3b1c16fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.568+0000 7f3b07fff640 1 --2- 172.21.15.44:0/2878955582 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b1c03cf80 0x7f3b1c0c8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.568+0000 7f3b07fff640 1 --2- 172.21.15.44:0/2878955582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b1c039c20 0x7f3b1c0d2b70 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.568+0000 7f3b07fff640 1 -- 172.21.15.44:0/2878955582 >> 172.21.15.44:0/2878955582 conn(0x7f3b1c03f6b0 msgr2=0x7f3b1c0056e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:34.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.568+0000 7f3b07fff640 1 -- 172.21.15.44:0/2878955582 shutdown_connections 2024-05-16T22:27:34.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.569+0000 7f3b07fff640 1 -- 172.21.15.44:0/2878955582 wait complete. 2024-05-16T22:27:34.572 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2024-05-16T22:27:34.572 DEBUG:teuthology.parallel:result is None 2024-05-16T22:27:34.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.575+0000 7fad80ff9640 1 -- 172.21.15.44:0/189593911 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fad78005850 con 0x7fad941ec0d0 2024-05-16T22:27:34.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.575+0000 7fad82ffd640 1 -- 172.21.15.44:0/189593911 <== mon.2 v2:172.21.15.70:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fad88065290 con 0x7fad941ec0d0 2024-05-16T22:27:34.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.575+0000 7fb32e7fc640 1 -- 172.21.15.44:0/267014671 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fb348069b50 con 0x7fb3480bc0c0 2024-05-16T22:27:34.575 INFO:teuthology.orchestra.run.smithi044.stdout:60129542151 2024-05-16T22:27:34.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.576+0000 7fb344ff9640 1 -- 172.21.15.44:0/267014671 <== mon.2 v2:172.21.15.70:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb338081420 con 0x7fb3480bc0c0 2024-05-16T22:27:34.575 INFO:teuthology.orchestra.run.smithi044.stdout:55834574854 2024-05-16T22:27:34.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.577+0000 7fad80ff9640 1 -- 172.21.15.44:0/189593911 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fad740762d0 msgr2=0x7fad740787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.577+0000 7fad80ff9640 1 --2- 172.21.15.44:0/189593911 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fad740762d0 0x7fad740787e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fad8c005050 tx=0x7fad8c00a000 comp rx=0 tx=0).stop 2024-05-16T22:27:34.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.577+0000 7fad80ff9640 1 -- 172.21.15.44:0/189593911 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fad941ec0d0 msgr2=0x7fad941ec4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.577+0000 7fad80ff9640 1 --2- 172.21.15.44:0/189593911 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fad941ec0d0 0x7fad941ec4e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fad940b73b0 tx=0x7fad8800d7e0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.578+0000 7fad80ff9640 1 -- 172.21.15.44:0/189593911 shutdown_connections 2024-05-16T22:27:34.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.578+0000 7fad80ff9640 1 --2- 172.21.15.44:0/189593911 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fad740762d0 0x7fad740787e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.578+0000 7fad80ff9640 1 --2- 172.21.15.44:0/189593911 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fad941ec0d0 0x7fad941ec4e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.578+0000 7fad80ff9640 1 --2- 172.21.15.44:0/189593911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad940bb3f0 0x7fad940bb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.578+0000 7fad80ff9640 1 --2- 172.21.15.44:0/189593911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad941d9020 0x7fad940a6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.578+0000 7fad80ff9640 1 -- 172.21.15.44:0/189593911 >> 172.21.15.44:0/189593911 conn(0x7fad940c3cd0 msgr2=0x7fad9414cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:34.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.578+0000 7fad80ff9640 1 -- 172.21.15.44:0/189593911 shutdown_connections 2024-05-16T22:27:34.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.578+0000 7fad80ff9640 1 -- 172.21.15.44:0/189593911 wait complete. 2024-05-16T22:27:34.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.578+0000 7fb32e7fc640 1 -- 172.21.15.44:0/267014671 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fb3340762d0 msgr2=0x7fb3340787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.578+0000 7fb32e7fc640 1 --2- 172.21.15.44:0/267014671 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fb3340762d0 0x7fb3340787e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb3480bfdf0 tx=0x7fb33c009040 comp rx=0 tx=0).stop 2024-05-16T22:27:34.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.578+0000 7fb32e7fc640 1 -- 172.21.15.44:0/267014671 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb3480bc0c0 msgr2=0x7fb3480b68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.578+0000 7fb32e7fc640 1 --2- 172.21.15.44:0/267014671 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb3480bc0c0 0x7fb3480b68b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb3380098a0 tx=0x7fb3380046c0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.578+0000 7fb32e7fc640 1 -- 172.21.15.44:0/267014671 shutdown_connections 2024-05-16T22:27:34.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.578+0000 7fb32e7fc640 1 --2- 172.21.15.44:0/267014671 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fb3340762d0 0x7fb3340787e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.578+0000 7fb32e7fc640 1 --2- 172.21.15.44:0/267014671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3481537f0 0x7fb34814b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.578+0000 7fb32e7fc640 1 --2- 172.21.15.44:0/267014671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3480be770 0x7fb348152520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.578+0000 7fb32e7fc640 1 --2- 172.21.15.44:0/267014671 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb3480bc0c0 0x7fb3480b68b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.578+0000 7fb32e7fc640 1 -- 172.21.15.44:0/267014671 >> 172.21.15.44:0/267014671 conn(0x7fb3480bd160 msgr2=0x7fb34814fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:34.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.578+0000 7fb32e7fc640 1 -- 172.21.15.44:0/267014671 shutdown_connections 2024-05-16T22:27:34.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.578+0000 7fb32e7fc640 1 -- 172.21.15.44:0/267014671 wait complete. 2024-05-16T22:27:34.581 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2024-05-16T22:27:34.581 DEBUG:teuthology.parallel:result is None 2024-05-16T22:27:34.590 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2024-05-16T22:27:34.590 DEBUG:teuthology.parallel:result is None 2024-05-16T22:27:34.590 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.7 2024-05-16T22:27:34.590 DEBUG:teuthology.parallel:result is None 2024-05-16T22:27:34.591 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-16T22:27:34.591 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-16T22:27:34.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.742+0000 7fbdeaf3f640 1 Processor -- start 2024-05-16T22:27:34.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.742+0000 7fbdeaf3f640 1 -- start start 2024-05-16T22:27:34.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.743+0000 7fbdeaf3f640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbde40bd6d0 0x7fbde40be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.743+0000 7fbdeaf3f640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbde40bee80 0x7fbde4158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.743+0000 7fbdeaf3f640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbde406e140 con 0x7fbde4151fc0 2024-05-16T22:27:34.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.743+0000 7fbdeaf3f640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fbde40c36f0 con 0x7fbde40bd6d0 2024-05-16T22:27:34.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.743+0000 7fbdeaf3f640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fbde4152530 con 0x7fbde40bee80 2024-05-16T22:27:34.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.743+0000 7fbde3fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbde40bd6d0 0x7fbde40be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.743+0000 7fbde3fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbde40bd6d0 0x7fbde40be940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58278/0 (socket says 172.21.15.44:58278) 2024-05-16T22:27:34.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.743+0000 7fbde3fff640 1 -- 172.21.15.44:0/2080646016 learned_addr learned my addr 172.21.15.44:0/2080646016 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:34.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.743+0000 7fbde94dc640 1 --2- 172.21.15.44:0/2080646016 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbde40bee80 0x7fbde4158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.743+0000 7fbde3fff640 1 -- 172.21.15.44:0/2080646016 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbde40bee80 msgr2=0x7fbde4158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:34.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.743+0000 7fbde3fff640 1 --2- 172.21.15.44:0/2080646016 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbde40bee80 0x7fbde4158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.743+0000 7fbde3fff640 1 -- 172.21.15.44:0/2080646016 >> v1:172.21.15.70:6789/0 conn(0x7fbde4151fc0 legacy=0x7fbde406da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.743+0000 7fbde3fff640 1 -- 172.21.15.44:0/2080646016 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbde4152810 con 0x7fbde40bd6d0 2024-05-16T22:27:34.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.743+0000 7fbde94dc640 1 --2- 172.21.15.44:0/2080646016 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbde40bee80 0x7fbde4158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:27:34.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.744+0000 7fbde3fff640 1 --2- 172.21.15.44:0/2080646016 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbde40bd6d0 0x7fbde40be940 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0009870 tx=0x7fbdd002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e646110c6b074cd server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:34.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.744+0000 7fbde37fe640 1 -- 172.21.15.44:0/2080646016 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd0037070 con 0x7fbde40bd6d0 2024-05-16T22:27:34.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.744+0000 7fbde37fe640 1 -- 172.21.15.44:0/2080646016 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdd0032440 con 0x7fbde40bd6d0 2024-05-16T22:27:34.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.744+0000 7fbde37fe640 1 -- 172.21.15.44:0/2080646016 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd0032810 con 0x7fbde40bd6d0 2024-05-16T22:27:34.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.745+0000 7fbdeaf3f640 1 -- 172.21.15.44:0/2080646016 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbde40bd6d0 msgr2=0x7fbde40be940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.745+0000 7fbdeaf3f640 1 --2- 172.21.15.44:0/2080646016 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbde40bd6d0 0x7fbde40be940 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0009870 tx=0x7fbdd002a270 comp rx=0 tx=0).stop 2024-05-16T22:27:34.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.745+0000 7fbdeaf3f640 1 -- 172.21.15.44:0/2080646016 shutdown_connections 2024-05-16T22:27:34.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.745+0000 7fbdeaf3f640 1 --2- 172.21.15.44:0/2080646016 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbde40bee80 0x7fbde4158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.745+0000 7fbdeaf3f640 1 --2- 172.21.15.44:0/2080646016 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbde40bd6d0 0x7fbde40be940 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.745+0000 7fbdeaf3f640 1 -- 172.21.15.44:0/2080646016 >> 172.21.15.44:0/2080646016 conn(0x7fbde40c3d20 msgr2=0x7fbde40c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:34.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.745+0000 7fbdeaf3f640 1 -- 172.21.15.44:0/2080646016 shutdown_connections 2024-05-16T22:27:34.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.745+0000 7fbdeaf3f640 1 -- 172.21.15.44:0/2080646016 wait complete. 2024-05-16T22:27:34.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.747+0000 7fbdeaf3f640 1 Processor -- start 2024-05-16T22:27:34.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.747+0000 7fbdeaf3f640 1 -- start start 2024-05-16T22:27:34.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.748+0000 7fbdeaf3f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbde40bd6d0 0x7fbde40b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.748+0000 7fbdeaf3f640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbde40bee80 0x7fbde40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.748+0000 7fbdeaf3f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbde4151fc0 0x7fbde40b9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.748+0000 7fbdeaf3f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbde40bdae0 con 0x7fbde4151fc0 2024-05-16T22:27:34.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.748+0000 7fbdeaf3f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbde40c0070 con 0x7fbde40bd6d0 2024-05-16T22:27:34.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.748+0000 7fbdeaf3f640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fbde40a2ed0 con 0x7fbde40bee80 2024-05-16T22:27:34.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.748+0000 7fbde94dc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbde4151fc0 0x7fbde40b9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.748+0000 7fbde94dc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbde4151fc0 0x7fbde40b9960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58288/0 (socket says 172.21.15.44:58288) 2024-05-16T22:27:34.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.748+0000 7fbde94dc640 1 -- 172.21.15.44:0/2204770552 learned_addr learned my addr 172.21.15.44:0/2204770552 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:34.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.748+0000 7fbde8cdb640 1 --2- 172.21.15.44:0/2204770552 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbde40bd6d0 0x7fbde40b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.748+0000 7fbde3fff640 1 --2- 172.21.15.44:0/2204770552 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbde40bee80 0x7fbde40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.748+0000 7fbde94dc640 1 -- 172.21.15.44:0/2204770552 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbde40bee80 msgr2=0x7fbde40b8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.748+0000 7fbde94dc640 1 --2- 172.21.15.44:0/2204770552 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbde40bee80 0x7fbde40b8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.748+0000 7fbde94dc640 1 -- 172.21.15.44:0/2204770552 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbde40bd6d0 msgr2=0x7fbde40b7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.748+0000 7fbde94dc640 1 --2- 172.21.15.44:0/2204770552 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbde40bd6d0 0x7fbde40b7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.748+0000 7fbde94dc640 1 -- 172.21.15.44:0/2204770552 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbde40b7d70 con 0x7fbde4151fc0 2024-05-16T22:27:34.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.748+0000 7fbde94dc640 1 --2- 172.21.15.44:0/2204770552 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbde4151fc0 0x7fbde40b9960 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbddc007df0 tx=0x7fbddc00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:34.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.748+0000 7fbde17fa640 1 -- 172.21.15.44:0/2204770552 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbddc01a070 con 0x7fbde4151fc0 2024-05-16T22:27:34.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.749+0000 7fbde17fa640 1 -- 172.21.15.44:0/2204770552 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbddc003990 con 0x7fbde4151fc0 2024-05-16T22:27:34.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.749+0000 7fbdeaf3f640 1 -- 172.21.15.44:0/2204770552 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbde40b90d0 con 0x7fbde4151fc0 2024-05-16T22:27:34.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.749+0000 7fbde17fa640 1 -- 172.21.15.44:0/2204770552 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbddc003d80 con 0x7fbde4151fc0 2024-05-16T22:27:34.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.749+0000 7fbdeaf3f640 1 -- 172.21.15.44:0/2204770552 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbde414e530 con 0x7fbde4151fc0 2024-05-16T22:27:34.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.750+0000 7fbdeaf3f640 1 -- 172.21.15.44:0/2204770552 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbde40b9ea0 con 0x7fbde4151fc0 2024-05-16T22:27:34.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.750+0000 7fbde17fa640 1 -- 172.21.15.44:0/2204770552 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbddc01d070 con 0x7fbde4151fc0 2024-05-16T22:27:34.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.751+0000 7fbde17fa640 1 --2- 172.21.15.44:0/2204770552 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fbdc80762d0 0x7fbdc80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:34.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.751+0000 7fbde17fa640 1 -- 172.21.15.44:0/2204770552 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fbddc097770 con 0x7fbde4151fc0 2024-05-16T22:27:34.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.751+0000 7fbde8cdb640 1 --2- 172.21.15.44:0/2204770552 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fbdc80762d0 0x7fbdc80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:34.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.752+0000 7fbde8cdb640 1 --2- 172.21.15.44:0/2204770552 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fbdc80762d0 0x7fbdc80787e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8000f60 tx=0x7fbdd8009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:34.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.756+0000 7fbde17fa640 1 -- 172.21.15.44:0/2204770552 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbddc010070 con 0x7fbde4151fc0 2024-05-16T22:27:34.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.942+0000 7fbdeaf3f640 1 -- 172.21.15.44:0/2204770552 --> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbde4050940 con 0x7fbdc80762d0 2024-05-16T22:27:34.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.948+0000 7fbde17fa640 1 -- 172.21.15.44:0/2204770552 <== mgr.4114 v2:172.21.15.70:6832/4049588098 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251825 (secure 0 0 0) 0x7fbde4050940 con 0x7fbdc80762d0 2024-05-16T22:27:34.950 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:27:34.951 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-05-16T22:27:34.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.951+0000 7fbdeaf3f640 1 -- 172.21.15.44:0/2204770552 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fbdc80762d0 msgr2=0x7fbdc80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.951+0000 7fbdeaf3f640 1 --2- 172.21.15.44:0/2204770552 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fbdc80762d0 0x7fbdc80787e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8000f60 tx=0x7fbdd8009040 comp rx=0 tx=0).stop 2024-05-16T22:27:34.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.952+0000 7fbdeaf3f640 1 -- 172.21.15.44:0/2204770552 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbde4151fc0 msgr2=0x7fbde40b9960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:34.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.952+0000 7fbdeaf3f640 1 --2- 172.21.15.44:0/2204770552 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbde4151fc0 0x7fbde40b9960 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbddc007df0 tx=0x7fbddc00d4a0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.952+0000 7fbdeaf3f640 1 -- 172.21.15.44:0/2204770552 shutdown_connections 2024-05-16T22:27:34.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.952+0000 7fbdeaf3f640 1 --2- 172.21.15.44:0/2204770552 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fbdc80762d0 0x7fbdc80787e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.952+0000 7fbdeaf3f640 1 --2- 172.21.15.44:0/2204770552 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbde40bee80 0x7fbde40b8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.952+0000 7fbdeaf3f640 1 --2- 172.21.15.44:0/2204770552 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbde4151fc0 0x7fbde40b9960 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.952+0000 7fbdeaf3f640 1 --2- 172.21.15.44:0/2204770552 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbde40bd6d0 0x7fbde40b7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:34.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.952+0000 7fbdeaf3f640 1 -- 172.21.15.44:0/2204770552 >> 172.21.15.44:0/2204770552 conn(0x7fbde40c3d20 msgr2=0x7fbde40c17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:34.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.952+0000 7fbdeaf3f640 1 -- 172.21.15.44:0/2204770552 shutdown_connections 2024-05-16T22:27:34.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:34.952+0000 7fbdeaf3f640 1 -- 172.21.15.44:0/2204770552 wait complete. 2024-05-16T22:27:34.962 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-05-16T22:27:34.546851+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231568,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754743152,"statfs":{"total":773094113280,"available":772856987648,"internally_reserved":0,"allocated":2990080,"data_stored":1788156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":234016305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.393481"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.898292+0000","last_change":"2024-05-16T22:27:26.169639+0000","last_active":"2024-05-16T22:27:27.898292+0000","last_peered":"2024-05-16T22:27:27.898292+0000","last_clean":"2024-05-16T22:27:27.898292+0000","last_became_active":"2024-05-16T22:27:26.168686+0000","last_became_peered":"2024-05-16T22:27:26.168686+0000","last_unstale":"2024-05-16T22:27:27.898292+0000","last_undegraded":"2024-05-16T22:27:27.898292+0000","last_fullsized":"2024-05-16T22:27:27.898292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:39:13.259116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.155697+0000","last_change":"2024-05-16T22:27:26.188439+0000","last_active":"2024-05-16T22:27:27.155697+0000","last_peered":"2024-05-16T22:27:27.155697+0000","last_clean":"2024-05-16T22:27:27.155697+0000","last_became_active":"2024-05-16T22:27:26.188099+0000","last_became_peered":"2024-05-16T22:27:26.188099+0000","last_unstale":"2024-05-16T22:27:27.155697+0000","last_undegraded":"2024-05-16T22:27:27.155697+0000","last_fullsized":"2024-05-16T22:27:27.155697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:53:35.410252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.762271+0000","last_change":"2024-05-16T22:27:26.187026+0000","last_active":"2024-05-16T22:27:27.762271+0000","last_peered":"2024-05-16T22:27:27.762271+0000","last_clean":"2024-05-16T22:27:27.762271+0000","last_became_active":"2024-05-16T22:27:26.186037+0000","last_became_peered":"2024-05-16T22:27:26.186037+0000","last_unstale":"2024-05-16T22:27:27.762271+0000","last_undegraded":"2024-05-16T22:27:27.762271+0000","last_fullsized":"2024-05-16T22:27:27.762271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:00:54.570632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.156701+0000","last_change":"2024-05-16T22:27:26.179800+0000","last_active":"2024-05-16T22:27:27.156701+0000","last_peered":"2024-05-16T22:27:27.156701+0000","last_clean":"2024-05-16T22:27:27.156701+0000","last_became_active":"2024-05-16T22:27:26.178823+0000","last_became_peered":"2024-05-16T22:27:26.178823+0000","last_unstale":"2024-05-16T22:27:27.156701+0000","last_undegraded":"2024-05-16T22:27:27.156701+0000","last_fullsized":"2024-05-16T22:27:27.156701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:54:03.308645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897854+0000","last_change":"2024-05-16T22:27:26.180782+0000","last_active":"2024-05-16T22:27:27.897854+0000","last_peered":"2024-05-16T22:27:27.897854+0000","last_clean":"2024-05-16T22:27:27.897854+0000","last_became_active":"2024-05-16T22:27:26.180495+0000","last_became_peered":"2024-05-16T22:27:26.180495+0000","last_unstale":"2024-05-16T22:27:27.897854+0000","last_undegraded":"2024-05-16T22:27:27.897854+0000","last_fullsized":"2024-05-16T22:27:27.897854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:49:00.124634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.156432+0000","last_change":"2024-05-16T22:27:26.188526+0000","last_active":"2024-05-16T22:27:27.156432+0000","last_peered":"2024-05-16T22:27:27.156432+0000","last_clean":"2024-05-16T22:27:27.156432+0000","last_became_active":"2024-05-16T22:27:26.187884+0000","last_became_peered":"2024-05-16T22:27:26.187884+0000","last_unstale":"2024-05-16T22:27:27.156432+0000","last_undegraded":"2024-05-16T22:27:27.156432+0000","last_fullsized":"2024-05-16T22:27:27.156432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:51:58.232014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897445+0000","last_change":"2024-05-16T22:27:26.192943+0000","last_active":"2024-05-16T22:27:27.897445+0000","last_peered":"2024-05-16T22:27:27.897445+0000","last_clean":"2024-05-16T22:27:27.897445+0000","last_became_active":"2024-05-16T22:27:26.192498+0000","last_became_peered":"2024-05-16T22:27:26.192498+0000","last_unstale":"2024-05-16T22:27:27.897445+0000","last_undegraded":"2024-05-16T22:27:27.897445+0000","last_fullsized":"2024-05-16T22:27:27.897445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:51:58.232014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.830431+0000","last_change":"2024-05-16T22:27:26.186897+0000","last_active":"2024-05-16T22:27:27.830431+0000","last_peered":"2024-05-16T22:27:27.830431+0000","last_clean":"2024-05-16T22:27:27.830431+0000","last_became_active":"2024-05-16T22:27:26.186571+0000","last_became_peered":"2024-05-16T22:27:26.186571+0000","last_unstale":"2024-05-16T22:27:27.830431+0000","last_undegraded":"2024-05-16T22:27:27.830431+0000","last_fullsized":"2024-05-16T22:27:27.830431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:56:00.004438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.898457+0000","last_change":"2024-05-16T22:27:26.170959+0000","last_active":"2024-05-16T22:27:27.898457+0000","last_peered":"2024-05-16T22:27:27.898457+0000","last_clean":"2024-05-16T22:27:27.898457+0000","last_became_active":"2024-05-16T22:27:26.170095+0000","last_became_peered":"2024-05-16T22:27:26.170095+0000","last_unstale":"2024-05-16T22:27:27.898457+0000","last_undegraded":"2024-05-16T22:27:27.898457+0000","last_fullsized":"2024-05-16T22:27:27.898457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:23:26.496588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.164762+0000","last_change":"2024-05-16T22:27:26.177170+0000","last_active":"2024-05-16T22:27:27.164762+0000","last_peered":"2024-05-16T22:27:27.164762+0000","last_clean":"2024-05-16T22:27:27.164762+0000","last_became_active":"2024-05-16T22:27:26.176840+0000","last_became_peered":"2024-05-16T22:27:26.176840+0000","last_unstale":"2024-05-16T22:27:27.164762+0000","last_undegraded":"2024-05-16T22:27:27.164762+0000","last_fullsized":"2024-05-16T22:27:27.164762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:06:36.076585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.164865+0000","last_change":"2024-05-16T22:27:26.185020+0000","last_active":"2024-05-16T22:27:27.164865+0000","last_peered":"2024-05-16T22:27:27.164865+0000","last_clean":"2024-05-16T22:27:27.164865+0000","last_became_active":"2024-05-16T22:27:26.184695+0000","last_became_peered":"2024-05-16T22:27:26.184695+0000","last_unstale":"2024-05-16T22:27:27.164865+0000","last_undegraded":"2024-05-16T22:27:27.164865+0000","last_fullsized":"2024-05-16T22:27:27.164865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:53:35.410252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897534+0000","last_change":"2024-05-16T22:27:26.171746+0000","last_active":"2024-05-16T22:27:27.897534+0000","last_peered":"2024-05-16T22:27:27.897534+0000","last_clean":"2024-05-16T22:27:27.897534+0000","last_became_active":"2024-05-16T22:27:26.171394+0000","last_became_peered":"2024-05-16T22:27:26.171394+0000","last_unstale":"2024-05-16T22:27:27.897534+0000","last_undegraded":"2024-05-16T22:27:27.897534+0000","last_fullsized":"2024-05-16T22:27:27.897534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:00:20.440853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.830873+0000","last_change":"2024-05-16T22:27:26.173414+0000","last_active":"2024-05-16T22:27:27.830873+0000","last_peered":"2024-05-16T22:27:27.830873+0000","last_clean":"2024-05-16T22:27:27.830873+0000","last_became_active":"2024-05-16T22:27:26.173089+0000","last_became_peered":"2024-05-16T22:27:26.173089+0000","last_unstale":"2024-05-16T22:27:27.830873+0000","last_undegraded":"2024-05-16T22:27:27.830873+0000","last_fullsized":"2024-05-16T22:27:27.830873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:53:35.410252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.761942+0000","last_change":"2024-05-16T22:27:26.187223+0000","last_active":"2024-05-16T22:27:27.761942+0000","last_peered":"2024-05-16T22:27:27.761942+0000","last_clean":"2024-05-16T22:27:27.761942+0000","last_became_active":"2024-05-16T22:27:26.186573+0000","last_became_peered":"2024-05-16T22:27:26.186573+0000","last_unstale":"2024-05-16T22:27:27.761942+0000","last_undegraded":"2024-05-16T22:27:27.761942+0000","last_fullsized":"2024-05-16T22:27:27.761942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:00:57.160863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.155581+0000","last_change":"2024-05-16T22:27:26.159254+0000","last_active":"2024-05-16T22:27:27.155581+0000","last_peered":"2024-05-16T22:27:27.155581+0000","last_clean":"2024-05-16T22:27:27.155581+0000","last_became_active":"2024-05-16T22:27:26.158883+0000","last_became_peered":"2024-05-16T22:27:26.158883+0000","last_unstale":"2024-05-16T22:27:27.155581+0000","last_undegraded":"2024-05-16T22:27:27.155581+0000","last_fullsized":"2024-05-16T22:27:27.155581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:06:36.076585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.156375+0000","last_change":"2024-05-16T22:27:26.188285+0000","last_active":"2024-05-16T22:27:27.156375+0000","last_peered":"2024-05-16T22:27:27.156375+0000","last_clean":"2024-05-16T22:27:27.156375+0000","last_became_active":"2024-05-16T22:27:26.187895+0000","last_became_peered":"2024-05-16T22:27:26.187895+0000","last_unstale":"2024-05-16T22:27:27.156375+0000","last_undegraded":"2024-05-16T22:27:27.156375+0000","last_fullsized":"2024-05-16T22:27:27.156375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:53:35.410252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.157378+0000","last_change":"2024-05-16T22:27:26.170197+0000","last_active":"2024-05-16T22:27:27.157378+0000","last_peered":"2024-05-16T22:27:27.157378+0000","last_clean":"2024-05-16T22:27:27.157378+0000","last_became_active":"2024-05-16T22:27:26.169877+0000","last_became_peered":"2024-05-16T22:27:26.169877+0000","last_unstale":"2024-05-16T22:27:27.157378+0000","last_undegraded":"2024-05-16T22:27:27.157378+0000","last_fullsized":"2024-05-16T22:27:27.157378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:07:55.802033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897382+0000","last_change":"2024-05-16T22:27:26.168473+0000","last_active":"2024-05-16T22:27:27.897382+0000","last_peered":"2024-05-16T22:27:27.897382+0000","last_clean":"2024-05-16T22:27:27.897382+0000","last_became_active":"2024-05-16T22:27:26.168104+0000","last_became_peered":"2024-05-16T22:27:26.168104+0000","last_unstale":"2024-05-16T22:27:27.897382+0000","last_undegraded":"2024-05-16T22:27:27.897382+0000","last_fullsized":"2024-05-16T22:27:27.897382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:05:33.386159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.898203+0000","last_change":"2024-05-16T22:27:26.178885+0000","last_active":"2024-05-16T22:27:27.898203+0000","last_peered":"2024-05-16T22:27:27.898203+0000","last_clean":"2024-05-16T22:27:27.898203+0000","last_became_active":"2024-05-16T22:27:26.178192+0000","last_became_peered":"2024-05-16T22:27:26.178192+0000","last_unstale":"2024-05-16T22:27:27.898203+0000","last_undegraded":"2024-05-16T22:27:27.898203+0000","last_fullsized":"2024-05-16T22:27:27.898203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:38:13.961707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.164660+0000","last_change":"2024-05-16T22:27:26.178104+0000","last_active":"2024-05-16T22:27:27.164660+0000","last_peered":"2024-05-16T22:27:27.164660+0000","last_clean":"2024-05-16T22:27:27.164660+0000","last_became_active":"2024-05-16T22:27:26.177764+0000","last_became_peered":"2024-05-16T22:27:26.177764+0000","last_unstale":"2024-05-16T22:27:27.164660+0000","last_undegraded":"2024-05-16T22:27:27.164660+0000","last_fullsized":"2024-05-16T22:27:27.164660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:15:24.877779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.762260+0000","last_change":"2024-05-16T22:27:26.190476+0000","last_active":"2024-05-16T22:27:27.762260+0000","last_peered":"2024-05-16T22:27:27.762260+0000","last_clean":"2024-05-16T22:27:27.762260+0000","last_became_active":"2024-05-16T22:27:26.190058+0000","last_became_peered":"2024-05-16T22:27:26.190058+0000","last_unstale":"2024-05-16T22:27:27.762260+0000","last_undegraded":"2024-05-16T22:27:27.762260+0000","last_fullsized":"2024-05-16T22:27:27.762260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:15:24.877779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.156703+0000","last_change":"2024-05-16T22:27:26.177470+0000","last_active":"2024-05-16T22:27:27.156703+0000","last_peered":"2024-05-16T22:27:27.156703+0000","last_clean":"2024-05-16T22:27:27.156703+0000","last_became_active":"2024-05-16T22:27:26.170806+0000","last_became_peered":"2024-05-16T22:27:26.170806+0000","last_unstale":"2024-05-16T22:27:27.156703+0000","last_undegraded":"2024-05-16T22:27:27.156703+0000","last_fullsized":"2024-05-16T22:27:27.156703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:49:00.124634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.830542+0000","last_change":"2024-05-16T22:27:26.171962+0000","last_active":"2024-05-16T22:27:27.830542+0000","last_peered":"2024-05-16T22:27:27.830542+0000","last_clean":"2024-05-16T22:27:27.830542+0000","last_became_active":"2024-05-16T22:27:26.171144+0000","last_became_peered":"2024-05-16T22:27:26.171144+0000","last_unstale":"2024-05-16T22:27:27.830542+0000","last_undegraded":"2024-05-16T22:27:27.830542+0000","last_fullsized":"2024-05-16T22:27:27.830542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:09:35.504713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.156462+0000","last_change":"2024-05-16T22:27:26.179980+0000","last_active":"2024-05-16T22:27:27.156462+0000","last_peered":"2024-05-16T22:27:27.156462+0000","last_clean":"2024-05-16T22:27:27.156462+0000","last_became_active":"2024-05-16T22:27:26.179609+0000","last_became_peered":"2024-05-16T22:27:26.179609+0000","last_unstale":"2024-05-16T22:27:27.156462+0000","last_undegraded":"2024-05-16T22:27:27.156462+0000","last_fullsized":"2024-05-16T22:27:27.156462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:35:53.031312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.830937+0000","last_change":"2024-05-16T22:27:26.180257+0000","last_active":"2024-05-16T22:27:27.830937+0000","last_peered":"2024-05-16T22:27:27.830937+0000","last_clean":"2024-05-16T22:27:27.830937+0000","last_became_active":"2024-05-16T22:27:26.179478+0000","last_became_peered":"2024-05-16T22:27:26.179478+0000","last_unstale":"2024-05-16T22:27:27.830937+0000","last_undegraded":"2024-05-16T22:27:27.830937+0000","last_fullsized":"2024-05-16T22:27:27.830937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:35:53.031312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.164694+0000","last_change":"2024-05-16T22:27:26.176451+0000","last_active":"2024-05-16T22:27:27.164694+0000","last_peered":"2024-05-16T22:27:27.164694+0000","last_clean":"2024-05-16T22:27:27.164694+0000","last_became_active":"2024-05-16T22:27:26.176119+0000","last_became_peered":"2024-05-16T22:27:26.176119+0000","last_unstale":"2024-05-16T22:27:27.164694+0000","last_undegraded":"2024-05-16T22:27:27.164694+0000","last_fullsized":"2024-05-16T22:27:27.164694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:00:54.570632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.155780+0000","last_change":"2024-05-16T22:27:26.179933+0000","last_active":"2024-05-16T22:27:27.155780+0000","last_peered":"2024-05-16T22:27:27.155780+0000","last_clean":"2024-05-16T22:27:27.155780+0000","last_became_active":"2024-05-16T22:27:26.174184+0000","last_became_peered":"2024-05-16T22:27:26.174184+0000","last_unstale":"2024-05-16T22:27:27.155780+0000","last_undegraded":"2024-05-16T22:27:27.155780+0000","last_fullsized":"2024-05-16T22:27:27.155780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:51:58.232014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.830881+0000","last_change":"2024-05-16T22:27:26.176821+0000","last_active":"2024-05-16T22:27:27.830881+0000","last_peered":"2024-05-16T22:27:27.830881+0000","last_clean":"2024-05-16T22:27:27.830881+0000","last_became_active":"2024-05-16T22:27:26.176467+0000","last_became_peered":"2024-05-16T22:27:26.176467+0000","last_unstale":"2024-05-16T22:27:27.830881+0000","last_undegraded":"2024-05-16T22:27:27.830881+0000","last_fullsized":"2024-05-16T22:27:27.830881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:51:58.232014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.762287+0000","last_change":"2024-05-16T22:27:26.189691+0000","last_active":"2024-05-16T22:27:27.762287+0000","last_peered":"2024-05-16T22:27:27.762287+0000","last_clean":"2024-05-16T22:27:27.762287+0000","last_became_active":"2024-05-16T22:27:26.188674+0000","last_became_peered":"2024-05-16T22:27:26.188674+0000","last_unstale":"2024-05-16T22:27:27.762287+0000","last_undegraded":"2024-05-16T22:27:27.762287+0000","last_fullsized":"2024-05-16T22:27:27.762287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:06:36.076585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.157021+0000","last_change":"2024-05-16T22:27:26.181862+0000","last_active":"2024-05-16T22:27:27.157021+0000","last_peered":"2024-05-16T22:27:27.157021+0000","last_clean":"2024-05-16T22:27:27.157021+0000","last_became_active":"2024-05-16T22:27:26.181525+0000","last_became_peered":"2024-05-16T22:27:26.181525+0000","last_unstale":"2024-05-16T22:27:27.157021+0000","last_undegraded":"2024-05-16T22:27:27.157021+0000","last_fullsized":"2024-05-16T22:27:27.157021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:12:56.101802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897161+0000","last_change":"2024-05-16T22:27:26.176534+0000","last_active":"2024-05-16T22:27:27.897161+0000","last_peered":"2024-05-16T22:27:27.897161+0000","last_clean":"2024-05-16T22:27:27.897161+0000","last_became_active":"2024-05-16T22:27:26.176043+0000","last_became_peered":"2024-05-16T22:27:26.176043+0000","last_unstale":"2024-05-16T22:27:27.897161+0000","last_undegraded":"2024-05-16T22:27:27.897161+0000","last_fullsized":"2024-05-16T22:27:27.897161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:16:39.733997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.164555+0000","last_change":"2024-05-16T22:27:26.188282+0000","last_active":"2024-05-16T22:27:27.164555+0000","last_peered":"2024-05-16T22:27:27.164555+0000","last_clean":"2024-05-16T22:27:27.164555+0000","last_became_active":"2024-05-16T22:27:26.187967+0000","last_became_peered":"2024-05-16T22:27:26.187967+0000","last_unstale":"2024-05-16T22:27:27.164555+0000","last_undegraded":"2024-05-16T22:27:27.164555+0000","last_fullsized":"2024-05-16T22:27:27.164555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:56:00.004438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897616+0000","last_change":"2024-05-16T22:27:26.165300+0000","last_active":"2024-05-16T22:27:27.897616+0000","last_peered":"2024-05-16T22:27:27.897616+0000","last_clean":"2024-05-16T22:27:27.897616+0000","last_became_active":"2024-05-16T22:27:26.164962+0000","last_became_peered":"2024-05-16T22:27:26.164962+0000","last_unstale":"2024-05-16T22:27:27.897616+0000","last_undegraded":"2024-05-16T22:27:27.897616+0000","last_fullsized":"2024-05-16T22:27:27.897616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:16:39.733997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.831169+0000","last_change":"2024-05-16T22:27:25.175691+0000","last_active":"2024-05-16T22:27:27.831169+0000","last_peered":"2024-05-16T22:27:27.831169+0000","last_clean":"2024-05-16T22:27:27.831169+0000","last_became_active":"2024-05-16T22:27:25.175379+0000","last_became_peered":"2024-05-16T22:27:25.175379+0000","last_unstale":"2024-05-16T22:27:27.831169+0000","last_undegraded":"2024-05-16T22:27:27.831169+0000","last_fullsized":"2024-05-16T22:27:27.831169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:28:33.593207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.762390+0000","last_change":"2024-05-16T22:27:26.189662+0000","last_active":"2024-05-16T22:27:27.762390+0000","last_peered":"2024-05-16T22:27:27.762390+0000","last_clean":"2024-05-16T22:27:27.762390+0000","last_became_active":"2024-05-16T22:27:26.188320+0000","last_became_peered":"2024-05-16T22:27:26.188320+0000","last_unstale":"2024-05-16T22:27:27.762390+0000","last_undegraded":"2024-05-16T22:27:27.762390+0000","last_fullsized":"2024-05-16T22:27:27.762390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:35:53.031312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.164229+0000","last_change":"2024-05-16T22:27:25.165881+0000","last_active":"2024-05-16T22:27:27.164229+0000","last_peered":"2024-05-16T22:27:27.164229+0000","last_clean":"2024-05-16T22:27:27.164229+0000","last_became_active":"2024-05-16T22:27:25.165496+0000","last_became_peered":"2024-05-16T22:27:25.165496+0000","last_unstale":"2024-05-16T22:27:27.164229+0000","last_undegraded":"2024-05-16T22:27:27.164229+0000","last_fullsized":"2024-05-16T22:27:27.164229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:00:19.434832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.830593+0000","last_change":"2024-05-16T22:27:25.176342+0000","last_active":"2024-05-16T22:27:27.830593+0000","last_peered":"2024-05-16T22:27:27.830593+0000","last_clean":"2024-05-16T22:27:27.830593+0000","last_became_active":"2024-05-16T22:27:25.175687+0000","last_became_peered":"2024-05-16T22:27:25.175687+0000","last_unstale":"2024-05-16T22:27:27.830593+0000","last_undegraded":"2024-05-16T22:27:27.830593+0000","last_fullsized":"2024-05-16T22:27:27.830593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:56:06.681858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.830570+0000","last_change":"2024-05-16T22:27:26.193793+0000","last_active":"2024-05-16T22:27:27.830570+0000","last_peered":"2024-05-16T22:27:27.830570+0000","last_clean":"2024-05-16T22:27:27.830570+0000","last_became_active":"2024-05-16T22:27:26.193433+0000","last_became_peered":"2024-05-16T22:27:26.193433+0000","last_unstale":"2024-05-16T22:27:27.830570+0000","last_undegraded":"2024-05-16T22:27:27.830570+0000","last_fullsized":"2024-05-16T22:27:27.830570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:15:24.877779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.156512+0000","last_change":"2024-05-16T22:27:25.171113+0000","last_active":"2024-05-16T22:27:27.156512+0000","last_peered":"2024-05-16T22:27:27.156512+0000","last_clean":"2024-05-16T22:27:27.156512+0000","last_became_active":"2024-05-16T22:27:25.170779+0000","last_became_peered":"2024-05-16T22:27:25.170779+0000","last_unstale":"2024-05-16T22:27:27.156512+0000","last_undegraded":"2024-05-16T22:27:27.156512+0000","last_fullsized":"2024-05-16T22:27:27.156512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:38:18.098766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.155360+0000","last_change":"2024-05-16T22:27:26.174986+0000","last_active":"2024-05-16T22:27:27.155360+0000","last_peered":"2024-05-16T22:27:27.155360+0000","last_clean":"2024-05-16T22:27:27.155360+0000","last_became_active":"2024-05-16T22:27:26.173790+0000","last_became_peered":"2024-05-16T22:27:26.173790+0000","last_unstale":"2024-05-16T22:27:27.155360+0000","last_undegraded":"2024-05-16T22:27:27.155360+0000","last_fullsized":"2024-05-16T22:27:27.155360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:09:35.504713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.164660+0000","last_change":"2024-05-16T22:27:25.170470+0000","last_active":"2024-05-16T22:27:27.164660+0000","last_peered":"2024-05-16T22:27:27.164660+0000","last_clean":"2024-05-16T22:27:27.164660+0000","last_became_active":"2024-05-16T22:27:25.170149+0000","last_became_peered":"2024-05-16T22:27:25.170149+0000","last_unstale":"2024-05-16T22:27:27.164660+0000","last_undegraded":"2024-05-16T22:27:27.164660+0000","last_fullsized":"2024-05-16T22:27:27.164660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:14:19.598037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.156971+0000","last_change":"2024-05-16T22:27:26.170048+0000","last_active":"2024-05-16T22:27:27.156971+0000","last_peered":"2024-05-16T22:27:27.156971+0000","last_clean":"2024-05-16T22:27:27.156971+0000","last_became_active":"2024-05-16T22:27:26.169708+0000","last_became_peered":"2024-05-16T22:27:26.169708+0000","last_unstale":"2024-05-16T22:27:27.156971+0000","last_undegraded":"2024-05-16T22:27:27.156971+0000","last_fullsized":"2024-05-16T22:27:27.156971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:15:00.704481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.157006+0000","last_change":"2024-05-16T22:27:25.167775+0000","last_active":"2024-05-16T22:27:27.157006+0000","last_peered":"2024-05-16T22:27:27.157006+0000","last_clean":"2024-05-16T22:27:27.157006+0000","last_became_active":"2024-05-16T22:27:25.167459+0000","last_became_peered":"2024-05-16T22:27:25.167459+0000","last_unstale":"2024-05-16T22:27:27.157006+0000","last_undegraded":"2024-05-16T22:27:27.157006+0000","last_fullsized":"2024-05-16T22:27:27.157006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:14:19.598037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.762359+0000","last_change":"2024-05-16T22:27:26.188683+0000","last_active":"2024-05-16T22:27:27.762359+0000","last_peered":"2024-05-16T22:27:27.762359+0000","last_clean":"2024-05-16T22:27:27.762359+0000","last_became_active":"2024-05-16T22:27:26.187904+0000","last_became_peered":"2024-05-16T22:27:26.187904+0000","last_unstale":"2024-05-16T22:27:27.762359+0000","last_undegraded":"2024-05-16T22:27:27.762359+0000","last_fullsized":"2024-05-16T22:27:27.762359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:53:35.410252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.155764+0000","last_change":"2024-05-16T22:27:25.164952+0000","last_active":"2024-05-16T22:27:27.155764+0000","last_peered":"2024-05-16T22:27:27.155764+0000","last_clean":"2024-05-16T22:27:27.155764+0000","last_became_active":"2024-05-16T22:27:25.164597+0000","last_became_peered":"2024-05-16T22:27:25.164597+0000","last_unstale":"2024-05-16T22:27:27.155764+0000","last_undegraded":"2024-05-16T22:27:27.155764+0000","last_fullsized":"2024-05-16T22:27:27.155764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:16:38.727975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897760+0000","last_change":"2024-05-16T22:27:26.173240+0000","last_active":"2024-05-16T22:27:27.897760+0000","last_peered":"2024-05-16T22:27:27.897760+0000","last_clean":"2024-05-16T22:27:27.897760+0000","last_became_active":"2024-05-16T22:27:26.172926+0000","last_became_peered":"2024-05-16T22:27:26.172926+0000","last_unstale":"2024-05-16T22:27:27.897760+0000","last_undegraded":"2024-05-16T22:27:27.897760+0000","last_fullsized":"2024-05-16T22:27:27.897760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:05:33.386159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.164787+0000","last_change":"2024-05-16T22:27:25.172637+0000","last_active":"2024-05-16T22:27:27.164787+0000","last_peered":"2024-05-16T22:27:27.164787+0000","last_clean":"2024-05-16T22:27:27.164787+0000","last_became_active":"2024-05-16T22:27:25.172289+0000","last_became_peered":"2024-05-16T22:27:25.172289+0000","last_unstale":"2024-05-16T22:27:27.164787+0000","last_undegraded":"2024-05-16T22:27:27.164787+0000","last_fullsized":"2024-05-16T22:27:27.164787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:10:24.692416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897946+0000","last_change":"2024-05-16T22:27:26.174259+0000","last_active":"2024-05-16T22:27:27.897946+0000","last_peered":"2024-05-16T22:27:27.897946+0000","last_clean":"2024-05-16T22:27:27.897946+0000","last_became_active":"2024-05-16T22:27:26.173945+0000","last_became_peered":"2024-05-16T22:27:26.173945+0000","last_unstale":"2024-05-16T22:27:27.897946+0000","last_undegraded":"2024-05-16T22:27:27.897946+0000","last_fullsized":"2024-05-16T22:27:27.897946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:15:00.704481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.762422+0000","last_change":"2024-05-16T22:27:25.173178+0000","last_active":"2024-05-16T22:27:27.762422+0000","last_peered":"2024-05-16T22:27:27.762422+0000","last_clean":"2024-05-16T22:27:27.762422+0000","last_became_active":"2024-05-16T22:27:25.172768+0000","last_became_peered":"2024-05-16T22:27:25.172768+0000","last_unstale":"2024-05-16T22:27:27.762422+0000","last_undegraded":"2024-05-16T22:27:27.762422+0000","last_fullsized":"2024-05-16T22:27:27.762422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:56:06.681858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.762027+0000","last_change":"2024-05-16T22:27:26.187919+0000","last_active":"2024-05-16T22:27:27.762027+0000","last_peered":"2024-05-16T22:27:27.762027+0000","last_clean":"2024-05-16T22:27:27.762027+0000","last_became_active":"2024-05-16T22:27:26.187589+0000","last_became_peered":"2024-05-16T22:27:26.187589+0000","last_unstale":"2024-05-16T22:27:27.762027+0000","last_undegraded":"2024-05-16T22:27:27.762027+0000","last_fullsized":"2024-05-16T22:27:27.762027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:56:00.004438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.156849+0000","last_change":"2024-05-16T22:27:25.177083+0000","last_active":"2024-05-16T22:27:27.156849+0000","last_peered":"2024-05-16T22:27:27.156849+0000","last_clean":"2024-05-16T22:27:27.156849+0000","last_became_active":"2024-05-16T22:27:25.176737+0000","last_became_peered":"2024-05-16T22:27:25.176737+0000","last_unstale":"2024-05-16T22:27:27.156849+0000","last_undegraded":"2024-05-16T22:27:27.156849+0000","last_fullsized":"2024-05-16T22:27:27.156849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:00:19.434832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.898411+0000","last_change":"2024-05-16T22:27:26.173306+0000","last_active":"2024-05-16T22:27:27.898411+0000","last_peered":"2024-05-16T22:27:27.898411+0000","last_clean":"2024-05-16T22:27:27.898411+0000","last_became_active":"2024-05-16T22:27:26.173016+0000","last_became_peered":"2024-05-16T22:27:26.173016+0000","last_unstale":"2024-05-16T22:27:27.898411+0000","last_undegraded":"2024-05-16T22:27:27.898411+0000","last_fullsized":"2024-05-16T22:27:27.898411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:18:14.496079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.164327+0000","last_change":"2024-05-16T22:27:25.163375+0000","last_active":"2024-05-16T22:27:27.164327+0000","last_peered":"2024-05-16T22:27:27.164327+0000","last_clean":"2024-05-16T22:27:27.164327+0000","last_became_active":"2024-05-16T22:27:25.163055+0000","last_became_peered":"2024-05-16T22:27:25.163055+0000","last_unstale":"2024-05-16T22:27:27.164327+0000","last_undegraded":"2024-05-16T22:27:27.164327+0000","last_fullsized":"2024-05-16T22:27:27.164327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:28:33.593207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.164260+0000","last_change":"2024-05-16T22:27:26.188199+0000","last_active":"2024-05-16T22:27:27.164260+0000","last_peered":"2024-05-16T22:27:27.164260+0000","last_clean":"2024-05-16T22:27:27.164260+0000","last_became_active":"2024-05-16T22:27:26.187894+0000","last_became_peered":"2024-05-16T22:27:26.187894+0000","last_unstale":"2024-05-16T22:27:27.164260+0000","last_undegraded":"2024-05-16T22:27:27.164260+0000","last_fullsized":"2024-05-16T22:27:27.164260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:56:14.312711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897108+0000","last_change":"2024-05-16T22:27:25.171882+0000","last_active":"2024-05-16T22:27:27.897108+0000","last_peered":"2024-05-16T22:27:27.897108+0000","last_clean":"2024-05-16T22:27:27.897108+0000","last_became_active":"2024-05-16T22:27:25.171503+0000","last_became_peered":"2024-05-16T22:27:25.171503+0000","last_unstale":"2024-05-16T22:27:27.897108+0000","last_undegraded":"2024-05-16T22:27:27.897108+0000","last_fullsized":"2024-05-16T22:27:27.897108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:49:34.698714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897827+0000","last_change":"2024-05-16T22:27:26.172931+0000","last_active":"2024-05-16T22:27:27.897827+0000","last_peered":"2024-05-16T22:27:27.897827+0000","last_clean":"2024-05-16T22:27:27.897827+0000","last_became_active":"2024-05-16T22:27:26.172603+0000","last_became_peered":"2024-05-16T22:27:26.172603+0000","last_unstale":"2024-05-16T22:27:27.897827+0000","last_undegraded":"2024-05-16T22:27:27.897827+0000","last_fullsized":"2024-05-16T22:27:27.897827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:54:03.308645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897822+0000","last_change":"2024-05-16T22:27:25.174004+0000","last_active":"2024-05-16T22:27:27.897822+0000","last_peered":"2024-05-16T22:27:27.897822+0000","last_clean":"2024-05-16T22:27:27.897822+0000","last_became_active":"2024-05-16T22:27:25.173652+0000","last_became_peered":"2024-05-16T22:27:25.173652+0000","last_unstale":"2024-05-16T22:27:27.897822+0000","last_undegraded":"2024-05-16T22:27:27.897822+0000","last_fullsized":"2024-05-16T22:27:27.897822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:12:36.673821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897650+0000","last_change":"2024-05-16T22:27:26.173271+0000","last_active":"2024-05-16T22:27:27.897650+0000","last_peered":"2024-05-16T22:27:27.897650+0000","last_clean":"2024-05-16T22:27:27.897650+0000","last_became_active":"2024-05-16T22:27:26.172922+0000","last_became_peered":"2024-05-16T22:27:26.172922+0000","last_unstale":"2024-05-16T22:27:27.897650+0000","last_undegraded":"2024-05-16T22:27:27.897650+0000","last_fullsized":"2024-05-16T22:27:27.897650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:35:53.031312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897354+0000","last_change":"2024-05-16T22:27:25.173377+0000","last_active":"2024-05-16T22:27:27.897354+0000","last_peered":"2024-05-16T22:27:27.897354+0000","last_clean":"2024-05-16T22:27:27.897354+0000","last_became_active":"2024-05-16T22:27:25.172463+0000","last_became_peered":"2024-05-16T22:27:25.172463+0000","last_unstale":"2024-05-16T22:27:27.897354+0000","last_undegraded":"2024-05-16T22:27:27.897354+0000","last_fullsized":"2024-05-16T22:27:27.897354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:10:24.692416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.898476+0000","last_change":"2024-05-16T22:27:26.174266+0000","last_active":"2024-05-16T22:27:27.898476+0000","last_peered":"2024-05-16T22:27:27.898476+0000","last_clean":"2024-05-16T22:27:27.898476+0000","last_became_active":"2024-05-16T22:27:26.174003+0000","last_became_peered":"2024-05-16T22:27:26.174003+0000","last_unstale":"2024-05-16T22:27:27.898476+0000","last_undegraded":"2024-05-16T22:27:27.898476+0000","last_fullsized":"2024-05-16T22:27:27.898476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:07:55.802033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.155873+0000","last_change":"2024-05-16T22:27:25.159445+0000","last_active":"2024-05-16T22:27:27.155873+0000","last_peered":"2024-05-16T22:27:27.155873+0000","last_clean":"2024-05-16T22:27:27.155873+0000","last_became_active":"2024-05-16T22:27:25.159100+0000","last_became_peered":"2024-05-16T22:27:25.159100+0000","last_unstale":"2024-05-16T22:27:27.155873+0000","last_undegraded":"2024-05-16T22:27:27.155873+0000","last_fullsized":"2024-05-16T22:27:27.155873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:05:32.380138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.157069+0000","last_change":"2024-05-16T22:27:26.179538+0000","last_active":"2024-05-16T22:27:27.157069+0000","last_peered":"2024-05-16T22:27:27.157069+0000","last_clean":"2024-05-16T22:27:27.157069+0000","last_became_active":"2024-05-16T22:27:26.179179+0000","last_became_peered":"2024-05-16T22:27:26.179179+0000","last_unstale":"2024-05-16T22:27:27.157069+0000","last_undegraded":"2024-05-16T22:27:27.157069+0000","last_fullsized":"2024-05-16T22:27:27.157069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:38:13.961707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897295+0000","last_change":"2024-05-16T22:27:25.168953+0000","last_active":"2024-05-16T22:27:27.897295+0000","last_peered":"2024-05-16T22:27:27.897295+0000","last_clean":"2024-05-16T22:27:27.897295+0000","last_became_active":"2024-05-16T22:27:25.168090+0000","last_became_peered":"2024-05-16T22:27:25.168090+0000","last_unstale":"2024-05-16T22:27:27.897295+0000","last_undegraded":"2024-05-16T22:27:27.897295+0000","last_fullsized":"2024-05-16T22:27:27.897295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:28:33.593207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.898029+0000","last_change":"2024-05-16T22:27:26.175603+0000","last_active":"2024-05-16T22:27:27.898029+0000","last_peered":"2024-05-16T22:27:27.898029+0000","last_clean":"2024-05-16T22:27:27.898029+0000","last_became_active":"2024-05-16T22:27:26.175300+0000","last_became_peered":"2024-05-16T22:27:26.175300+0000","last_unstale":"2024-05-16T22:27:27.898029+0000","last_undegraded":"2024-05-16T22:27:27.898029+0000","last_fullsized":"2024-05-16T22:27:27.898029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:12:56.101802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":110,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897117+0000","last_change":"2024-05-16T22:27:15.950850+0000","last_active":"2024-05-16T22:27:27.897117+0000","last_peered":"2024-05-16T22:27:27.897117+0000","last_clean":"2024-05-16T22:27:27.897117+0000","last_became_active":"2024-05-16T22:27:15.949553+0000","last_became_peered":"2024-05-16T22:27:15.949553+0000","last_unstale":"2024-05-16T22:27:27.897117+0000","last_undegraded":"2024-05-16T22:27:27.897117+0000","last_fullsized":"2024-05-16T22:27:27.897117+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:14.702385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:14.702385+0000","last_clean_scrub_stamp":"2024-05-16T22:27:14.702385+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:46:07.495562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.156689+0000","last_change":"2024-05-16T22:27:25.168854+0000","last_active":"2024-05-16T22:27:27.156689+0000","last_peered":"2024-05-16T22:27:27.156689+0000","last_clean":"2024-05-16T22:27:27.156689+0000","last_became_active":"2024-05-16T22:27:25.168548+0000","last_became_peered":"2024-05-16T22:27:25.168548+0000","last_unstale":"2024-05-16T22:27:27.156689+0000","last_undegraded":"2024-05-16T22:27:27.156689+0000","last_fullsized":"2024-05-16T22:27:27.156689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:10:24.692416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.831072+0000","last_change":"2024-05-16T22:27:26.187669+0000","last_active":"2024-05-16T22:27:27.831072+0000","last_peered":"2024-05-16T22:27:27.831072+0000","last_clean":"2024-05-16T22:27:27.831072+0000","last_became_active":"2024-05-16T22:27:26.187358+0000","last_became_peered":"2024-05-16T22:27:26.187358+0000","last_unstale":"2024-05-16T22:27:27.831072+0000","last_undegraded":"2024-05-16T22:27:27.831072+0000","last_fullsized":"2024-05-16T22:27:27.831072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:49:00.124634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.896951+0000","last_change":"2024-05-16T22:27:25.179705+0000","last_active":"2024-05-16T22:27:27.896951+0000","last_peered":"2024-05-16T22:27:27.896951+0000","last_clean":"2024-05-16T22:27:27.896951+0000","last_became_active":"2024-05-16T22:27:25.179338+0000","last_became_peered":"2024-05-16T22:27:25.179338+0000","last_unstale":"2024-05-16T22:27:27.896951+0000","last_undegraded":"2024-05-16T22:27:27.896951+0000","last_fullsized":"2024-05-16T22:27:27.896951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:38:18.098766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.761944+0000","last_change":"2024-05-16T22:27:26.185157+0000","last_active":"2024-05-16T22:27:27.761944+0000","last_peered":"2024-05-16T22:27:27.761944+0000","last_clean":"2024-05-16T22:27:27.761944+0000","last_became_active":"2024-05-16T22:27:26.184780+0000","last_became_peered":"2024-05-16T22:27:26.184780+0000","last_unstale":"2024-05-16T22:27:27.761944+0000","last_undegraded":"2024-05-16T22:27:27.761944+0000","last_fullsized":"2024-05-16T22:27:27.761944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:56:14.312711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897243+0000","last_change":"2024-05-16T22:27:25.172921+0000","last_active":"2024-05-16T22:27:27.897243+0000","last_peered":"2024-05-16T22:27:27.897243+0000","last_clean":"2024-05-16T22:27:27.897243+0000","last_became_active":"2024-05-16T22:27:25.172582+0000","last_became_peered":"2024-05-16T22:27:25.172582+0000","last_unstale":"2024-05-16T22:27:27.897243+0000","last_undegraded":"2024-05-16T22:27:27.897243+0000","last_fullsized":"2024-05-16T22:27:27.897243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:14:19.598037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.155424+0000","last_change":"2024-05-16T22:27:26.180819+0000","last_active":"2024-05-16T22:27:27.155424+0000","last_peered":"2024-05-16T22:27:27.155424+0000","last_clean":"2024-05-16T22:27:27.155424+0000","last_became_active":"2024-05-16T22:27:26.180533+0000","last_became_peered":"2024-05-16T22:27:26.180533+0000","last_unstale":"2024-05-16T22:27:27.155424+0000","last_undegraded":"2024-05-16T22:27:27.155424+0000","last_fullsized":"2024-05-16T22:27:27.155424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:15:24.877779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.157126+0000","last_change":"2024-05-16T22:27:25.164143+0000","last_active":"2024-05-16T22:27:27.157126+0000","last_peered":"2024-05-16T22:27:27.157126+0000","last_clean":"2024-05-16T22:27:27.157126+0000","last_became_active":"2024-05-16T22:27:25.163816+0000","last_became_peered":"2024-05-16T22:27:25.163816+0000","last_unstale":"2024-05-16T22:27:27.157126+0000","last_undegraded":"2024-05-16T22:27:27.157126+0000","last_fullsized":"2024-05-16T22:27:27.157126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:18:45.799763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897611+0000","last_change":"2024-05-16T22:27:26.190255+0000","last_active":"2024-05-16T22:27:27.897611+0000","last_peered":"2024-05-16T22:27:27.897611+0000","last_clean":"2024-05-16T22:27:27.897611+0000","last_became_active":"2024-05-16T22:27:26.189958+0000","last_became_peered":"2024-05-16T22:27:26.189958+0000","last_unstale":"2024-05-16T22:27:27.897611+0000","last_undegraded":"2024-05-16T22:27:27.897611+0000","last_fullsized":"2024-05-16T22:27:27.897611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:18:46.805784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.155441+0000","last_change":"2024-05-16T22:27:25.168229+0000","last_active":"2024-05-16T22:27:27.155441+0000","last_peered":"2024-05-16T22:27:27.155441+0000","last_clean":"2024-05-16T22:27:27.155441+0000","last_became_active":"2024-05-16T22:27:25.167870+0000","last_became_peered":"2024-05-16T22:27:25.167870+0000","last_unstale":"2024-05-16T22:27:27.155441+0000","last_undegraded":"2024-05-16T22:27:27.155441+0000","last_fullsized":"2024-05-16T22:27:27.155441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:00:19.434832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.157322+0000","last_change":"2024-05-16T22:27:26.180054+0000","last_active":"2024-05-16T22:27:27.157322+0000","last_peered":"2024-05-16T22:27:27.157322+0000","last_clean":"2024-05-16T22:27:27.157322+0000","last_became_active":"2024-05-16T22:27:26.179579+0000","last_became_peered":"2024-05-16T22:27:26.179579+0000","last_unstale":"2024-05-16T22:27:27.157322+0000","last_undegraded":"2024-05-16T22:27:27.157322+0000","last_fullsized":"2024-05-16T22:27:27.157322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:23:26.496588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.898140+0000","last_change":"2024-05-16T22:27:25.179765+0000","last_active":"2024-05-16T22:27:27.898140+0000","last_peered":"2024-05-16T22:27:27.898140+0000","last_clean":"2024-05-16T22:27:27.898140+0000","last_became_active":"2024-05-16T22:27:25.179478+0000","last_became_peered":"2024-05-16T22:27:25.179478+0000","last_unstale":"2024-05-16T22:27:27.898140+0000","last_undegraded":"2024-05-16T22:27:27.898140+0000","last_fullsized":"2024-05-16T22:27:27.898140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:00:19.434832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.155474+0000","last_change":"2024-05-16T22:27:26.176594+0000","last_active":"2024-05-16T22:27:27.155474+0000","last_peered":"2024-05-16T22:27:27.155474+0000","last_clean":"2024-05-16T22:27:27.155474+0000","last_became_active":"2024-05-16T22:27:26.176164+0000","last_became_peered":"2024-05-16T22:27:26.176164+0000","last_unstale":"2024-05-16T22:27:27.155474+0000","last_undegraded":"2024-05-16T22:27:27.155474+0000","last_fullsized":"2024-05-16T22:27:27.155474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:00:54.570632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.163540+0000","last_change":"2024-05-16T22:27:25.167314+0000","last_active":"2024-05-16T22:27:27.163540+0000","last_peered":"2024-05-16T22:27:27.163540+0000","last_clean":"2024-05-16T22:27:27.163540+0000","last_became_active":"2024-05-16T22:27:25.166970+0000","last_became_peered":"2024-05-16T22:27:25.166970+0000","last_unstale":"2024-05-16T22:27:27.163540+0000","last_undegraded":"2024-05-16T22:27:27.163540+0000","last_fullsized":"2024-05-16T22:27:27.163540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:38:18.098766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.831087+0000","last_change":"2024-05-16T22:27:26.179815+0000","last_active":"2024-05-16T22:27:27.831087+0000","last_peered":"2024-05-16T22:27:27.831087+0000","last_clean":"2024-05-16T22:27:27.831087+0000","last_became_active":"2024-05-16T22:27:26.179100+0000","last_became_peered":"2024-05-16T22:27:26.179100+0000","last_unstale":"2024-05-16T22:27:27.831087+0000","last_undegraded":"2024-05-16T22:27:27.831087+0000","last_fullsized":"2024-05-16T22:27:27.831087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:15:00.704481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.164789+0000","last_change":"2024-05-16T22:27:25.175426+0000","last_active":"2024-05-16T22:27:27.164789+0000","last_peered":"2024-05-16T22:27:27.164789+0000","last_clean":"2024-05-16T22:27:27.164789+0000","last_became_active":"2024-05-16T22:27:25.175074+0000","last_became_peered":"2024-05-16T22:27:25.175074+0000","last_unstale":"2024-05-16T22:27:27.164789+0000","last_undegraded":"2024-05-16T22:27:27.164789+0000","last_fullsized":"2024-05-16T22:27:27.164789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:38:18.098766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.762368+0000","last_change":"2024-05-16T22:27:26.186566+0000","last_active":"2024-05-16T22:27:27.762368+0000","last_peered":"2024-05-16T22:27:27.762368+0000","last_clean":"2024-05-16T22:27:27.762368+0000","last_became_active":"2024-05-16T22:27:26.185741+0000","last_became_peered":"2024-05-16T22:27:26.185741+0000","last_unstale":"2024-05-16T22:27:27.762368+0000","last_undegraded":"2024-05-16T22:27:27.762368+0000","last_fullsized":"2024-05-16T22:27:27.762368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:51:58.232014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.896927+0000","last_change":"2024-05-16T22:27:25.179797+0000","last_active":"2024-05-16T22:27:27.896927+0000","last_peered":"2024-05-16T22:27:27.896927+0000","last_clean":"2024-05-16T22:27:27.896927+0000","last_became_active":"2024-05-16T22:27:25.179523+0000","last_became_peered":"2024-05-16T22:27:25.179523+0000","last_unstale":"2024-05-16T22:27:27.896927+0000","last_undegraded":"2024-05-16T22:27:27.896927+0000","last_fullsized":"2024-05-16T22:27:27.896927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:05:32.380138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897242+0000","last_change":"2024-05-16T22:27:26.176417+0000","last_active":"2024-05-16T22:27:27.897242+0000","last_peered":"2024-05-16T22:27:27.897242+0000","last_clean":"2024-05-16T22:27:27.897242+0000","last_became_active":"2024-05-16T22:27:26.176117+0000","last_became_peered":"2024-05-16T22:27:26.176117+0000","last_unstale":"2024-05-16T22:27:27.897242+0000","last_undegraded":"2024-05-16T22:27:27.897242+0000","last_fullsized":"2024-05-16T22:27:27.897242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:38:19.104787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.155475+0000","last_change":"2024-05-16T22:27:25.173786+0000","last_active":"2024-05-16T22:27:27.155475+0000","last_peered":"2024-05-16T22:27:27.155475+0000","last_clean":"2024-05-16T22:27:27.155475+0000","last_became_active":"2024-05-16T22:27:25.173340+0000","last_became_peered":"2024-05-16T22:27:25.173340+0000","last_unstale":"2024-05-16T22:27:27.155475+0000","last_undegraded":"2024-05-16T22:27:27.155475+0000","last_fullsized":"2024-05-16T22:27:27.155475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:18:45.799763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.830624+0000","last_change":"2024-05-16T22:27:26.173368+0000","last_active":"2024-05-16T22:27:27.830624+0000","last_peered":"2024-05-16T22:27:27.830624+0000","last_clean":"2024-05-16T22:27:27.830624+0000","last_became_active":"2024-05-16T22:27:26.172519+0000","last_became_peered":"2024-05-16T22:27:26.172519+0000","last_unstale":"2024-05-16T22:27:27.830624+0000","last_undegraded":"2024-05-16T22:27:27.830624+0000","last_fullsized":"2024-05-16T22:27:27.830624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:00:54.570632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.155439+0000","last_change":"2024-05-16T22:27:25.170729+0000","last_active":"2024-05-16T22:27:27.155439+0000","last_peered":"2024-05-16T22:27:27.155439+0000","last_clean":"2024-05-16T22:27:27.155439+0000","last_became_active":"2024-05-16T22:27:25.170385+0000","last_became_peered":"2024-05-16T22:27:25.170385+0000","last_unstale":"2024-05-16T22:27:27.155439+0000","last_undegraded":"2024-05-16T22:27:27.155439+0000","last_fullsized":"2024-05-16T22:27:27.155439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:14:19.598037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.830840+0000","last_change":"2024-05-16T22:27:26.193277+0000","last_active":"2024-05-16T22:27:27.830840+0000","last_peered":"2024-05-16T22:27:27.830840+0000","last_clean":"2024-05-16T22:27:27.830840+0000","last_became_active":"2024-05-16T22:27:26.192885+0000","last_became_peered":"2024-05-16T22:27:26.192885+0000","last_unstale":"2024-05-16T22:27:27.830840+0000","last_undegraded":"2024-05-16T22:27:27.830840+0000","last_fullsized":"2024-05-16T22:27:27.830840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:06:36.076585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.898275+0000","last_change":"2024-05-16T22:27:25.173350+0000","last_active":"2024-05-16T22:27:27.898275+0000","last_peered":"2024-05-16T22:27:27.898275+0000","last_clean":"2024-05-16T22:27:27.898275+0000","last_became_active":"2024-05-16T22:27:25.172986+0000","last_became_peered":"2024-05-16T22:27:25.172986+0000","last_unstale":"2024-05-16T22:27:27.898275+0000","last_undegraded":"2024-05-16T22:27:27.898275+0000","last_fullsized":"2024-05-16T22:27:27.898275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:18:45.799763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.164381+0000","last_change":"2024-05-16T22:27:26.178022+0000","last_active":"2024-05-16T22:27:27.164381+0000","last_peered":"2024-05-16T22:27:27.164381+0000","last_clean":"2024-05-16T22:27:27.164381+0000","last_became_active":"2024-05-16T22:27:26.177657+0000","last_became_peered":"2024-05-16T22:27:26.177657+0000","last_unstale":"2024-05-16T22:27:27.164381+0000","last_undegraded":"2024-05-16T22:27:27.164381+0000","last_fullsized":"2024-05-16T22:27:27.164381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:09:35.504713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.157307+0000","last_change":"2024-05-16T22:27:26.182079+0000","last_active":"2024-05-16T22:27:27.157307+0000","last_peered":"2024-05-16T22:27:27.157307+0000","last_clean":"2024-05-16T22:27:27.157307+0000","last_became_active":"2024-05-16T22:27:26.181164+0000","last_became_peered":"2024-05-16T22:27:26.181164+0000","last_unstale":"2024-05-16T22:27:27.157307+0000","last_undegraded":"2024-05-16T22:27:27.157307+0000","last_fullsized":"2024-05-16T22:27:27.157307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:18:14.496079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897381+0000","last_change":"2024-05-16T22:27:25.176553+0000","last_active":"2024-05-16T22:27:27.897381+0000","last_peered":"2024-05-16T22:27:27.897381+0000","last_clean":"2024-05-16T22:27:27.897381+0000","last_became_active":"2024-05-16T22:27:25.176195+0000","last_became_peered":"2024-05-16T22:27:25.176195+0000","last_unstale":"2024-05-16T22:27:27.897381+0000","last_undegraded":"2024-05-16T22:27:27.897381+0000","last_fullsized":"2024-05-16T22:27:27.897381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:16:38.727975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.157220+0000","last_change":"2024-05-16T22:27:26.176499+0000","last_active":"2024-05-16T22:27:27.157220+0000","last_peered":"2024-05-16T22:27:27.157220+0000","last_clean":"2024-05-16T22:27:27.157220+0000","last_became_active":"2024-05-16T22:27:26.176201+0000","last_became_peered":"2024-05-16T22:27:26.176201+0000","last_unstale":"2024-05-16T22:27:27.157220+0000","last_undegraded":"2024-05-16T22:27:27.157220+0000","last_fullsized":"2024-05-16T22:27:27.157220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:39:13.259116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.898018+0000","last_change":"2024-05-16T22:27:25.176489+0000","last_active":"2024-05-16T22:27:27.898018+0000","last_peered":"2024-05-16T22:27:27.898018+0000","last_clean":"2024-05-16T22:27:27.898018+0000","last_became_active":"2024-05-16T22:27:25.175878+0000","last_became_peered":"2024-05-16T22:27:25.175878+0000","last_unstale":"2024-05-16T22:27:27.898018+0000","last_undegraded":"2024-05-16T22:27:27.898018+0000","last_fullsized":"2024-05-16T22:27:27.898018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:14:19.598037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.762117+0000","last_change":"2024-05-16T22:27:26.188958+0000","last_active":"2024-05-16T22:27:27.762117+0000","last_peered":"2024-05-16T22:27:27.762117+0000","last_clean":"2024-05-16T22:27:27.762117+0000","last_became_active":"2024-05-16T22:27:26.188364+0000","last_became_peered":"2024-05-16T22:27:26.188364+0000","last_unstale":"2024-05-16T22:27:27.762117+0000","last_undegraded":"2024-05-16T22:27:27.762117+0000","last_fullsized":"2024-05-16T22:27:27.762117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:09:35.504713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.831034+0000","last_change":"2024-05-16T22:27:25.172230+0000","last_active":"2024-05-16T22:27:27.831034+0000","last_peered":"2024-05-16T22:27:27.831034+0000","last_clean":"2024-05-16T22:27:27.831034+0000","last_became_active":"2024-05-16T22:27:25.171609+0000","last_became_peered":"2024-05-16T22:27:25.171609+0000","last_unstale":"2024-05-16T22:27:27.831034+0000","last_undegraded":"2024-05-16T22:27:27.831034+0000","last_fullsized":"2024-05-16T22:27:27.831034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:49:34.698714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.831003+0000","last_change":"2024-05-16T22:27:26.174545+0000","last_active":"2024-05-16T22:27:27.831003+0000","last_peered":"2024-05-16T22:27:27.831003+0000","last_clean":"2024-05-16T22:27:27.831003+0000","last_became_active":"2024-05-16T22:27:26.174218+0000","last_became_peered":"2024-05-16T22:27:26.174218+0000","last_unstale":"2024-05-16T22:27:27.831003+0000","last_undegraded":"2024-05-16T22:27:27.831003+0000","last_fullsized":"2024-05-16T22:27:27.831003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:54:03.308645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.762375+0000","last_change":"2024-05-16T22:27:25.175258+0000","last_active":"2024-05-16T22:27:27.762375+0000","last_peered":"2024-05-16T22:27:27.762375+0000","last_clean":"2024-05-16T22:27:27.762375+0000","last_became_active":"2024-05-16T22:27:25.174778+0000","last_became_peered":"2024-05-16T22:27:25.174778+0000","last_unstale":"2024-05-16T22:27:27.762375+0000","last_undegraded":"2024-05-16T22:27:27.762375+0000","last_fullsized":"2024-05-16T22:27:27.762375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:12:36.673821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31980,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339860,"statfs":{"total":96636764160,"available":96604016640,"internally_reserved":0,"allocated":815104,"data_stored":666275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":229376,"data_stored":76937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":221184,"data_stored":75415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":75451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":76937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":75325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":75485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":823296,"data_stored":666331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-16T22:27:34.966 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-16T22:27:35.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.114+0000 7f5e415ff640 1 Processor -- start 2024-05-16T22:27:35.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.114+0000 7f5e415ff640 1 -- start start 2024-05-16T22:27:35.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.115+0000 7f5e415ff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5e3c0be380 0x7f5e3c06d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:35.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.115+0000 7f5e415ff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f5e3c14ef80 0x7f5e3c158c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:35.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.115+0000 7f5e415ff640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e3c06dad0 con 0x7f5e3c14eb70 2024-05-16T22:27:35.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.115+0000 7f5e415ff640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f5e3c14e6e0 con 0x7f5e3c0be380 2024-05-16T22:27:35.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.115+0000 7f5e415ff640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f5e3c0bfd60 con 0x7f5e3c14ef80 2024-05-16T22:27:35.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.115+0000 7f5e3affd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5e3c0be380 0x7f5e3c06d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:35.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.115+0000 7f5e3a7fc640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f5e3c14eb70 0x7f5e3c0bd120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59046/0 (socket says 172.21.15.44:59046) 2024-05-16T22:27:35.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.115+0000 7f5e3affd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5e3c0be380 0x7f5e3c06d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58294/0 (socket says 172.21.15.44:58294) 2024-05-16T22:27:35.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.115+0000 7f5e3a7fc640 1 -- 172.21.15.44:0/1552428829 learned_addr learned my addr 172.21.15.44:0/1552428829 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:27:35.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.116+0000 7f5e3b7fe640 1 --2- 172.21.15.44:0/1552428829 >> v2:172.21.15.70:3300/0 conn(0x7f5e3c14ef80 0x7f5e3c158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:35.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.116+0000 7f5e3affd640 1 -- 172.21.15.44:0/1552428829 >> v2:172.21.15.70:3300/0 conn(0x7f5e3c14ef80 msgr2=0x7f5e3c158c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:35.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.116+0000 7f5e3affd640 1 --2- 172.21.15.44:0/1552428829 >> v2:172.21.15.70:3300/0 conn(0x7f5e3c14ef80 0x7f5e3c158c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:35.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.116+0000 7f5e3affd640 1 -- 172.21.15.44:0/1552428829 >> v1:172.21.15.44:6789/0 conn(0x7f5e3c14eb70 legacy=0x7f5e3c0bd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:35.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.116+0000 7f5e39ffb640 1 -- 172.21.15.44:0/1552428829 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1351592369 0 0) 0x7f5e3c06dad0 con 0x7f5e3c14eb70 2024-05-16T22:27:35.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.116+0000 7f5e3affd640 1 -- 172.21.15.44:0/1552428829 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e3c14e3b0 con 0x7f5e3c0be380 2024-05-16T22:27:35.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.116+0000 7f5e3affd640 1 --2- 172.21.15.44:0/1552428829 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e3c0be380 0x7f5e3c06d590 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c06d260 tx=0x7f5e3402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc8ed8e2ba49fb49 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:35.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.117+0000 7f5e39ffb640 1 -- 172.21.15.44:0/1552428829 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e34037070 con 0x7f5e3c0be380 2024-05-16T22:27:35.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.117+0000 7f5e39ffb640 1 -- 172.21.15.44:0/1552428829 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e34032440 con 0x7f5e3c0be380 2024-05-16T22:27:35.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.117+0000 7f5e39ffb640 1 -- 172.21.15.44:0/1552428829 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e34032810 con 0x7f5e3c0be380 2024-05-16T22:27:35.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.117+0000 7f5e415ff640 1 -- 172.21.15.44:0/1552428829 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e3c0be380 msgr2=0x7f5e3c06d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:35.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.117+0000 7f5e415ff640 1 --2- 172.21.15.44:0/1552428829 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e3c0be380 0x7f5e3c06d590 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c06d260 tx=0x7f5e3402a1a0 comp rx=0 tx=0).stop 2024-05-16T22:27:35.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.117+0000 7f5e415ff640 1 -- 172.21.15.44:0/1552428829 shutdown_connections 2024-05-16T22:27:35.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.117+0000 7f5e415ff640 1 --2- 172.21.15.44:0/1552428829 >> v2:172.21.15.70:3300/0 conn(0x7f5e3c14ef80 0x7f5e3c158c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:35.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.117+0000 7f5e415ff640 1 --2- 172.21.15.44:0/1552428829 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e3c0be380 0x7f5e3c06d590 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:35.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.117+0000 7f5e415ff640 1 -- 172.21.15.44:0/1552428829 >> 172.21.15.44:0/1552428829 conn(0x7f5e3c0c3840 msgr2=0x7f5e3c0c3c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:35.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.117+0000 7f5e415ff640 1 -- 172.21.15.44:0/1552428829 shutdown_connections 2024-05-16T22:27:35.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.117+0000 7f5e415ff640 1 -- 172.21.15.44:0/1552428829 wait complete. 2024-05-16T22:27:35.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.119+0000 7f5e415ff640 1 Processor -- start 2024-05-16T22:27:35.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.119+0000 7f5e415ff640 1 -- start start 2024-05-16T22:27:35.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.120+0000 7f5e415ff640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5e3c0be380 0x7f5e3c1e7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:35.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.120+0000 7f5e415ff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e3c14eb70 0x7f5e3c150e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:35.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.120+0000 7f5e415ff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e3c14ef80 0x7f5e3c0b96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:35.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.120+0000 7f5e415ff640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3c0bedd0 con 0x7f5e3c14eb70 2024-05-16T22:27:35.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.120+0000 7f5e415ff640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3c0beaf0 con 0x7f5e3c14ef80 2024-05-16T22:27:35.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.120+0000 7f5e415ff640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f5e3c0c33d0 con 0x7f5e3c0be380 2024-05-16T22:27:35.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.120+0000 7f5e3a7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e3c14eb70 0x7f5e3c150e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:35.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.120+0000 7f5e3a7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e3c14eb70 0x7f5e3c150e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58310/0 (socket says 172.21.15.44:58310) 2024-05-16T22:27:35.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.120+0000 7f5e3a7fc640 1 -- 172.21.15.44:0/2073073170 learned_addr learned my addr 172.21.15.44:0/2073073170 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:35.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.120+0000 7f5e3b7fe640 1 --2- 172.21.15.44:0/2073073170 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e3c14ef80 0x7f5e3c0b96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:35.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.120+0000 7f5e3affd640 1 --2- 172.21.15.44:0/2073073170 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5e3c0be380 0x7f5e3c1e7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:35.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.121+0000 7f5e3a7fc640 1 -- 172.21.15.44:0/2073073170 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5e3c0be380 msgr2=0x7f5e3c1e7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:35.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.121+0000 7f5e3a7fc640 1 --2- 172.21.15.44:0/2073073170 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5e3c0be380 0x7f5e3c1e7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:35.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.121+0000 7f5e3a7fc640 1 -- 172.21.15.44:0/2073073170 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e3c14ef80 msgr2=0x7f5e3c0b96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:35.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.121+0000 7f5e3a7fc640 1 --2- 172.21.15.44:0/2073073170 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e3c14ef80 0x7f5e3c0b96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:35.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.121+0000 7f5e3a7fc640 1 -- 172.21.15.44:0/2073073170 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e3c1e8000 con 0x7f5e3c14eb70 2024-05-16T22:27:35.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.121+0000 7f5e3a7fc640 1 --2- 172.21.15.44:0/2073073170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e3c14eb70 0x7f5e3c150e60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5e2400c460 tx=0x7f5e2400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:35.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.121+0000 7f5e337fe640 1 -- 172.21.15.44:0/2073073170 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e24017070 con 0x7f5e3c14eb70 2024-05-16T22:27:35.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.121+0000 7f5e337fe640 1 -- 172.21.15.44:0/2073073170 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e24005ce0 con 0x7f5e3c14eb70 2024-05-16T22:27:35.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.121+0000 7f5e415ff640 1 -- 172.21.15.44:0/2073073170 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e3c14f7c0 con 0x7f5e3c14eb70 2024-05-16T22:27:35.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.121+0000 7f5e337fe640 1 -- 172.21.15.44:0/2073073170 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e240072b0 con 0x7f5e3c14eb70 2024-05-16T22:27:35.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.121+0000 7f5e415ff640 1 -- 172.21.15.44:0/2073073170 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e3c150080 con 0x7f5e3c14eb70 2024-05-16T22:27:35.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.122+0000 7f5e415ff640 1 -- 172.21.15.44:0/2073073170 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e3c14f5d0 con 0x7f5e3c14eb70 2024-05-16T22:27:35.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.123+0000 7f5e337fe640 1 -- 172.21.15.44:0/2073073170 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5e2401a070 con 0x7f5e3c14eb70 2024-05-16T22:27:35.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.123+0000 7f5e337fe640 1 --2- 172.21.15.44:0/2073073170 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f5e1c0762d0 0x7f5e1c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:35.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.124+0000 7f5e3affd640 1 --2- 172.21.15.44:0/2073073170 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f5e1c0762d0 0x7f5e1c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:35.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.124+0000 7f5e337fe640 1 -- 172.21.15.44:0/2073073170 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5e240968b0 con 0x7f5e3c14eb70 2024-05-16T22:27:35.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.124+0000 7f5e3affd640 1 --2- 172.21.15.44:0/2073073170 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f5e1c0762d0 0x7f5e1c0787e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5e34034000 tx=0x7f5e3402e000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:35.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.128+0000 7f5e337fe640 1 -- 172.21.15.44:0/2073073170 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5e2405fb20 con 0x7f5e3c14eb70 2024-05-16T22:27:35.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.319+0000 7f5e415ff640 1 -- 172.21.15.44:0/2073073170 --> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5e3c050860 con 0x7f5e1c0762d0 2024-05-16T22:27:35.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.326+0000 7f5e337fe640 1 -- 172.21.15.44:0/2073073170 <== mgr.4114 v2:172.21.15.70:6832/4049588098 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251825 (secure 0 0 0) 0x7f5e3c050860 con 0x7f5e1c0762d0 2024-05-16T22:27:35.328 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:27:35.329 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-05-16T22:27:35.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.329+0000 7f5e415ff640 1 -- 172.21.15.44:0/2073073170 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f5e1c0762d0 msgr2=0x7f5e1c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:35.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.329+0000 7f5e415ff640 1 --2- 172.21.15.44:0/2073073170 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f5e1c0762d0 0x7f5e1c0787e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5e34034000 tx=0x7f5e3402e000 comp rx=0 tx=0).stop 2024-05-16T22:27:35.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.329+0000 7f5e415ff640 1 -- 172.21.15.44:0/2073073170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e3c14eb70 msgr2=0x7f5e3c150e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:35.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.329+0000 7f5e415ff640 1 --2- 172.21.15.44:0/2073073170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e3c14eb70 0x7f5e3c150e60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5e2400c460 tx=0x7f5e2400c920 comp rx=0 tx=0).stop 2024-05-16T22:27:35.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.329+0000 7f5e415ff640 1 -- 172.21.15.44:0/2073073170 shutdown_connections 2024-05-16T22:27:35.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.329+0000 7f5e415ff640 1 --2- 172.21.15.44:0/2073073170 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f5e1c0762d0 0x7f5e1c0787e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:35.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.329+0000 7f5e415ff640 1 --2- 172.21.15.44:0/2073073170 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e3c14ef80 0x7f5e3c0b96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:35.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.329+0000 7f5e415ff640 1 --2- 172.21.15.44:0/2073073170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e3c14eb70 0x7f5e3c150e60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:35.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.329+0000 7f5e415ff640 1 --2- 172.21.15.44:0/2073073170 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5e3c0be380 0x7f5e3c1e7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:35.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.329+0000 7f5e415ff640 1 -- 172.21.15.44:0/2073073170 >> 172.21.15.44:0/2073073170 conn(0x7f5e3c0c3840 msgr2=0x7f5e3c0c3c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:35.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.329+0000 7f5e415ff640 1 -- 172.21.15.44:0/2073073170 shutdown_connections 2024-05-16T22:27:35.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.329+0000 7f5e415ff640 1 -- 172.21.15.44:0/2073073170 wait complete. 2024-05-16T22:27:35.339 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-05-16T22:27:34.546851+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231568,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754743152,"statfs":{"total":773094113280,"available":772856987648,"internally_reserved":0,"allocated":2990080,"data_stored":1788156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":234016305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.393481"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.898292+0000","last_change":"2024-05-16T22:27:26.169639+0000","last_active":"2024-05-16T22:27:27.898292+0000","last_peered":"2024-05-16T22:27:27.898292+0000","last_clean":"2024-05-16T22:27:27.898292+0000","last_became_active":"2024-05-16T22:27:26.168686+0000","last_became_peered":"2024-05-16T22:27:26.168686+0000","last_unstale":"2024-05-16T22:27:27.898292+0000","last_undegraded":"2024-05-16T22:27:27.898292+0000","last_fullsized":"2024-05-16T22:27:27.898292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:39:13.259116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.155697+0000","last_change":"2024-05-16T22:27:26.188439+0000","last_active":"2024-05-16T22:27:27.155697+0000","last_peered":"2024-05-16T22:27:27.155697+0000","last_clean":"2024-05-16T22:27:27.155697+0000","last_became_active":"2024-05-16T22:27:26.188099+0000","last_became_peered":"2024-05-16T22:27:26.188099+0000","last_unstale":"2024-05-16T22:27:27.155697+0000","last_undegraded":"2024-05-16T22:27:27.155697+0000","last_fullsized":"2024-05-16T22:27:27.155697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:53:35.410252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.762271+0000","last_change":"2024-05-16T22:27:26.187026+0000","last_active":"2024-05-16T22:27:27.762271+0000","last_peered":"2024-05-16T22:27:27.762271+0000","last_clean":"2024-05-16T22:27:27.762271+0000","last_became_active":"2024-05-16T22:27:26.186037+0000","last_became_peered":"2024-05-16T22:27:26.186037+0000","last_unstale":"2024-05-16T22:27:27.762271+0000","last_undegraded":"2024-05-16T22:27:27.762271+0000","last_fullsized":"2024-05-16T22:27:27.762271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:00:54.570632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.156701+0000","last_change":"2024-05-16T22:27:26.179800+0000","last_active":"2024-05-16T22:27:27.156701+0000","last_peered":"2024-05-16T22:27:27.156701+0000","last_clean":"2024-05-16T22:27:27.156701+0000","last_became_active":"2024-05-16T22:27:26.178823+0000","last_became_peered":"2024-05-16T22:27:26.178823+0000","last_unstale":"2024-05-16T22:27:27.156701+0000","last_undegraded":"2024-05-16T22:27:27.156701+0000","last_fullsized":"2024-05-16T22:27:27.156701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:54:03.308645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897854+0000","last_change":"2024-05-16T22:27:26.180782+0000","last_active":"2024-05-16T22:27:27.897854+0000","last_peered":"2024-05-16T22:27:27.897854+0000","last_clean":"2024-05-16T22:27:27.897854+0000","last_became_active":"2024-05-16T22:27:26.180495+0000","last_became_peered":"2024-05-16T22:27:26.180495+0000","last_unstale":"2024-05-16T22:27:27.897854+0000","last_undegraded":"2024-05-16T22:27:27.897854+0000","last_fullsized":"2024-05-16T22:27:27.897854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:49:00.124634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.156432+0000","last_change":"2024-05-16T22:27:26.188526+0000","last_active":"2024-05-16T22:27:27.156432+0000","last_peered":"2024-05-16T22:27:27.156432+0000","last_clean":"2024-05-16T22:27:27.156432+0000","last_became_active":"2024-05-16T22:27:26.187884+0000","last_became_peered":"2024-05-16T22:27:26.187884+0000","last_unstale":"2024-05-16T22:27:27.156432+0000","last_undegraded":"2024-05-16T22:27:27.156432+0000","last_fullsized":"2024-05-16T22:27:27.156432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:51:58.232014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897445+0000","last_change":"2024-05-16T22:27:26.192943+0000","last_active":"2024-05-16T22:27:27.897445+0000","last_peered":"2024-05-16T22:27:27.897445+0000","last_clean":"2024-05-16T22:27:27.897445+0000","last_became_active":"2024-05-16T22:27:26.192498+0000","last_became_peered":"2024-05-16T22:27:26.192498+0000","last_unstale":"2024-05-16T22:27:27.897445+0000","last_undegraded":"2024-05-16T22:27:27.897445+0000","last_fullsized":"2024-05-16T22:27:27.897445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:51:58.232014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.830431+0000","last_change":"2024-05-16T22:27:26.186897+0000","last_active":"2024-05-16T22:27:27.830431+0000","last_peered":"2024-05-16T22:27:27.830431+0000","last_clean":"2024-05-16T22:27:27.830431+0000","last_became_active":"2024-05-16T22:27:26.186571+0000","last_became_peered":"2024-05-16T22:27:26.186571+0000","last_unstale":"2024-05-16T22:27:27.830431+0000","last_undegraded":"2024-05-16T22:27:27.830431+0000","last_fullsized":"2024-05-16T22:27:27.830431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:56:00.004438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.898457+0000","last_change":"2024-05-16T22:27:26.170959+0000","last_active":"2024-05-16T22:27:27.898457+0000","last_peered":"2024-05-16T22:27:27.898457+0000","last_clean":"2024-05-16T22:27:27.898457+0000","last_became_active":"2024-05-16T22:27:26.170095+0000","last_became_peered":"2024-05-16T22:27:26.170095+0000","last_unstale":"2024-05-16T22:27:27.898457+0000","last_undegraded":"2024-05-16T22:27:27.898457+0000","last_fullsized":"2024-05-16T22:27:27.898457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:23:26.496588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.164762+0000","last_change":"2024-05-16T22:27:26.177170+0000","last_active":"2024-05-16T22:27:27.164762+0000","last_peered":"2024-05-16T22:27:27.164762+0000","last_clean":"2024-05-16T22:27:27.164762+0000","last_became_active":"2024-05-16T22:27:26.176840+0000","last_became_peered":"2024-05-16T22:27:26.176840+0000","last_unstale":"2024-05-16T22:27:27.164762+0000","last_undegraded":"2024-05-16T22:27:27.164762+0000","last_fullsized":"2024-05-16T22:27:27.164762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:06:36.076585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.164865+0000","last_change":"2024-05-16T22:27:26.185020+0000","last_active":"2024-05-16T22:27:27.164865+0000","last_peered":"2024-05-16T22:27:27.164865+0000","last_clean":"2024-05-16T22:27:27.164865+0000","last_became_active":"2024-05-16T22:27:26.184695+0000","last_became_peered":"2024-05-16T22:27:26.184695+0000","last_unstale":"2024-05-16T22:27:27.164865+0000","last_undegraded":"2024-05-16T22:27:27.164865+0000","last_fullsized":"2024-05-16T22:27:27.164865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:53:35.410252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897534+0000","last_change":"2024-05-16T22:27:26.171746+0000","last_active":"2024-05-16T22:27:27.897534+0000","last_peered":"2024-05-16T22:27:27.897534+0000","last_clean":"2024-05-16T22:27:27.897534+0000","last_became_active":"2024-05-16T22:27:26.171394+0000","last_became_peered":"2024-05-16T22:27:26.171394+0000","last_unstale":"2024-05-16T22:27:27.897534+0000","last_undegraded":"2024-05-16T22:27:27.897534+0000","last_fullsized":"2024-05-16T22:27:27.897534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:00:20.440853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.830873+0000","last_change":"2024-05-16T22:27:26.173414+0000","last_active":"2024-05-16T22:27:27.830873+0000","last_peered":"2024-05-16T22:27:27.830873+0000","last_clean":"2024-05-16T22:27:27.830873+0000","last_became_active":"2024-05-16T22:27:26.173089+0000","last_became_peered":"2024-05-16T22:27:26.173089+0000","last_unstale":"2024-05-16T22:27:27.830873+0000","last_undegraded":"2024-05-16T22:27:27.830873+0000","last_fullsized":"2024-05-16T22:27:27.830873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:53:35.410252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.761942+0000","last_change":"2024-05-16T22:27:26.187223+0000","last_active":"2024-05-16T22:27:27.761942+0000","last_peered":"2024-05-16T22:27:27.761942+0000","last_clean":"2024-05-16T22:27:27.761942+0000","last_became_active":"2024-05-16T22:27:26.186573+0000","last_became_peered":"2024-05-16T22:27:26.186573+0000","last_unstale":"2024-05-16T22:27:27.761942+0000","last_undegraded":"2024-05-16T22:27:27.761942+0000","last_fullsized":"2024-05-16T22:27:27.761942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:00:57.160863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.155581+0000","last_change":"2024-05-16T22:27:26.159254+0000","last_active":"2024-05-16T22:27:27.155581+0000","last_peered":"2024-05-16T22:27:27.155581+0000","last_clean":"2024-05-16T22:27:27.155581+0000","last_became_active":"2024-05-16T22:27:26.158883+0000","last_became_peered":"2024-05-16T22:27:26.158883+0000","last_unstale":"2024-05-16T22:27:27.155581+0000","last_undegraded":"2024-05-16T22:27:27.155581+0000","last_fullsized":"2024-05-16T22:27:27.155581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:06:36.076585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.156375+0000","last_change":"2024-05-16T22:27:26.188285+0000","last_active":"2024-05-16T22:27:27.156375+0000","last_peered":"2024-05-16T22:27:27.156375+0000","last_clean":"2024-05-16T22:27:27.156375+0000","last_became_active":"2024-05-16T22:27:26.187895+0000","last_became_peered":"2024-05-16T22:27:26.187895+0000","last_unstale":"2024-05-16T22:27:27.156375+0000","last_undegraded":"2024-05-16T22:27:27.156375+0000","last_fullsized":"2024-05-16T22:27:27.156375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:53:35.410252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.157378+0000","last_change":"2024-05-16T22:27:26.170197+0000","last_active":"2024-05-16T22:27:27.157378+0000","last_peered":"2024-05-16T22:27:27.157378+0000","last_clean":"2024-05-16T22:27:27.157378+0000","last_became_active":"2024-05-16T22:27:26.169877+0000","last_became_peered":"2024-05-16T22:27:26.169877+0000","last_unstale":"2024-05-16T22:27:27.157378+0000","last_undegraded":"2024-05-16T22:27:27.157378+0000","last_fullsized":"2024-05-16T22:27:27.157378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:07:55.802033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897382+0000","last_change":"2024-05-16T22:27:26.168473+0000","last_active":"2024-05-16T22:27:27.897382+0000","last_peered":"2024-05-16T22:27:27.897382+0000","last_clean":"2024-05-16T22:27:27.897382+0000","last_became_active":"2024-05-16T22:27:26.168104+0000","last_became_peered":"2024-05-16T22:27:26.168104+0000","last_unstale":"2024-05-16T22:27:27.897382+0000","last_undegraded":"2024-05-16T22:27:27.897382+0000","last_fullsized":"2024-05-16T22:27:27.897382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:05:33.386159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.898203+0000","last_change":"2024-05-16T22:27:26.178885+0000","last_active":"2024-05-16T22:27:27.898203+0000","last_peered":"2024-05-16T22:27:27.898203+0000","last_clean":"2024-05-16T22:27:27.898203+0000","last_became_active":"2024-05-16T22:27:26.178192+0000","last_became_peered":"2024-05-16T22:27:26.178192+0000","last_unstale":"2024-05-16T22:27:27.898203+0000","last_undegraded":"2024-05-16T22:27:27.898203+0000","last_fullsized":"2024-05-16T22:27:27.898203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:38:13.961707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.164660+0000","last_change":"2024-05-16T22:27:26.178104+0000","last_active":"2024-05-16T22:27:27.164660+0000","last_peered":"2024-05-16T22:27:27.164660+0000","last_clean":"2024-05-16T22:27:27.164660+0000","last_became_active":"2024-05-16T22:27:26.177764+0000","last_became_peered":"2024-05-16T22:27:26.177764+0000","last_unstale":"2024-05-16T22:27:27.164660+0000","last_undegraded":"2024-05-16T22:27:27.164660+0000","last_fullsized":"2024-05-16T22:27:27.164660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:15:24.877779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.762260+0000","last_change":"2024-05-16T22:27:26.190476+0000","last_active":"2024-05-16T22:27:27.762260+0000","last_peered":"2024-05-16T22:27:27.762260+0000","last_clean":"2024-05-16T22:27:27.762260+0000","last_became_active":"2024-05-16T22:27:26.190058+0000","last_became_peered":"2024-05-16T22:27:26.190058+0000","last_unstale":"2024-05-16T22:27:27.762260+0000","last_undegraded":"2024-05-16T22:27:27.762260+0000","last_fullsized":"2024-05-16T22:27:27.762260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:15:24.877779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.156703+0000","last_change":"2024-05-16T22:27:26.177470+0000","last_active":"2024-05-16T22:27:27.156703+0000","last_peered":"2024-05-16T22:27:27.156703+0000","last_clean":"2024-05-16T22:27:27.156703+0000","last_became_active":"2024-05-16T22:27:26.170806+0000","last_became_peered":"2024-05-16T22:27:26.170806+0000","last_unstale":"2024-05-16T22:27:27.156703+0000","last_undegraded":"2024-05-16T22:27:27.156703+0000","last_fullsized":"2024-05-16T22:27:27.156703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:49:00.124634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.830542+0000","last_change":"2024-05-16T22:27:26.171962+0000","last_active":"2024-05-16T22:27:27.830542+0000","last_peered":"2024-05-16T22:27:27.830542+0000","last_clean":"2024-05-16T22:27:27.830542+0000","last_became_active":"2024-05-16T22:27:26.171144+0000","last_became_peered":"2024-05-16T22:27:26.171144+0000","last_unstale":"2024-05-16T22:27:27.830542+0000","last_undegraded":"2024-05-16T22:27:27.830542+0000","last_fullsized":"2024-05-16T22:27:27.830542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:09:35.504713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.156462+0000","last_change":"2024-05-16T22:27:26.179980+0000","last_active":"2024-05-16T22:27:27.156462+0000","last_peered":"2024-05-16T22:27:27.156462+0000","last_clean":"2024-05-16T22:27:27.156462+0000","last_became_active":"2024-05-16T22:27:26.179609+0000","last_became_peered":"2024-05-16T22:27:26.179609+0000","last_unstale":"2024-05-16T22:27:27.156462+0000","last_undegraded":"2024-05-16T22:27:27.156462+0000","last_fullsized":"2024-05-16T22:27:27.156462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:35:53.031312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.830937+0000","last_change":"2024-05-16T22:27:26.180257+0000","last_active":"2024-05-16T22:27:27.830937+0000","last_peered":"2024-05-16T22:27:27.830937+0000","last_clean":"2024-05-16T22:27:27.830937+0000","last_became_active":"2024-05-16T22:27:26.179478+0000","last_became_peered":"2024-05-16T22:27:26.179478+0000","last_unstale":"2024-05-16T22:27:27.830937+0000","last_undegraded":"2024-05-16T22:27:27.830937+0000","last_fullsized":"2024-05-16T22:27:27.830937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:35:53.031312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.164694+0000","last_change":"2024-05-16T22:27:26.176451+0000","last_active":"2024-05-16T22:27:27.164694+0000","last_peered":"2024-05-16T22:27:27.164694+0000","last_clean":"2024-05-16T22:27:27.164694+0000","last_became_active":"2024-05-16T22:27:26.176119+0000","last_became_peered":"2024-05-16T22:27:26.176119+0000","last_unstale":"2024-05-16T22:27:27.164694+0000","last_undegraded":"2024-05-16T22:27:27.164694+0000","last_fullsized":"2024-05-16T22:27:27.164694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:00:54.570632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.155780+0000","last_change":"2024-05-16T22:27:26.179933+0000","last_active":"2024-05-16T22:27:27.155780+0000","last_peered":"2024-05-16T22:27:27.155780+0000","last_clean":"2024-05-16T22:27:27.155780+0000","last_became_active":"2024-05-16T22:27:26.174184+0000","last_became_peered":"2024-05-16T22:27:26.174184+0000","last_unstale":"2024-05-16T22:27:27.155780+0000","last_undegraded":"2024-05-16T22:27:27.155780+0000","last_fullsized":"2024-05-16T22:27:27.155780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:51:58.232014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.830881+0000","last_change":"2024-05-16T22:27:26.176821+0000","last_active":"2024-05-16T22:27:27.830881+0000","last_peered":"2024-05-16T22:27:27.830881+0000","last_clean":"2024-05-16T22:27:27.830881+0000","last_became_active":"2024-05-16T22:27:26.176467+0000","last_became_peered":"2024-05-16T22:27:26.176467+0000","last_unstale":"2024-05-16T22:27:27.830881+0000","last_undegraded":"2024-05-16T22:27:27.830881+0000","last_fullsized":"2024-05-16T22:27:27.830881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:51:58.232014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.762287+0000","last_change":"2024-05-16T22:27:26.189691+0000","last_active":"2024-05-16T22:27:27.762287+0000","last_peered":"2024-05-16T22:27:27.762287+0000","last_clean":"2024-05-16T22:27:27.762287+0000","last_became_active":"2024-05-16T22:27:26.188674+0000","last_became_peered":"2024-05-16T22:27:26.188674+0000","last_unstale":"2024-05-16T22:27:27.762287+0000","last_undegraded":"2024-05-16T22:27:27.762287+0000","last_fullsized":"2024-05-16T22:27:27.762287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:06:36.076585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.157021+0000","last_change":"2024-05-16T22:27:26.181862+0000","last_active":"2024-05-16T22:27:27.157021+0000","last_peered":"2024-05-16T22:27:27.157021+0000","last_clean":"2024-05-16T22:27:27.157021+0000","last_became_active":"2024-05-16T22:27:26.181525+0000","last_became_peered":"2024-05-16T22:27:26.181525+0000","last_unstale":"2024-05-16T22:27:27.157021+0000","last_undegraded":"2024-05-16T22:27:27.157021+0000","last_fullsized":"2024-05-16T22:27:27.157021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:12:56.101802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897161+0000","last_change":"2024-05-16T22:27:26.176534+0000","last_active":"2024-05-16T22:27:27.897161+0000","last_peered":"2024-05-16T22:27:27.897161+0000","last_clean":"2024-05-16T22:27:27.897161+0000","last_became_active":"2024-05-16T22:27:26.176043+0000","last_became_peered":"2024-05-16T22:27:26.176043+0000","last_unstale":"2024-05-16T22:27:27.897161+0000","last_undegraded":"2024-05-16T22:27:27.897161+0000","last_fullsized":"2024-05-16T22:27:27.897161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:16:39.733997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.164555+0000","last_change":"2024-05-16T22:27:26.188282+0000","last_active":"2024-05-16T22:27:27.164555+0000","last_peered":"2024-05-16T22:27:27.164555+0000","last_clean":"2024-05-16T22:27:27.164555+0000","last_became_active":"2024-05-16T22:27:26.187967+0000","last_became_peered":"2024-05-16T22:27:26.187967+0000","last_unstale":"2024-05-16T22:27:27.164555+0000","last_undegraded":"2024-05-16T22:27:27.164555+0000","last_fullsized":"2024-05-16T22:27:27.164555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:56:00.004438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897616+0000","last_change":"2024-05-16T22:27:26.165300+0000","last_active":"2024-05-16T22:27:27.897616+0000","last_peered":"2024-05-16T22:27:27.897616+0000","last_clean":"2024-05-16T22:27:27.897616+0000","last_became_active":"2024-05-16T22:27:26.164962+0000","last_became_peered":"2024-05-16T22:27:26.164962+0000","last_unstale":"2024-05-16T22:27:27.897616+0000","last_undegraded":"2024-05-16T22:27:27.897616+0000","last_fullsized":"2024-05-16T22:27:27.897616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:16:39.733997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.831169+0000","last_change":"2024-05-16T22:27:25.175691+0000","last_active":"2024-05-16T22:27:27.831169+0000","last_peered":"2024-05-16T22:27:27.831169+0000","last_clean":"2024-05-16T22:27:27.831169+0000","last_became_active":"2024-05-16T22:27:25.175379+0000","last_became_peered":"2024-05-16T22:27:25.175379+0000","last_unstale":"2024-05-16T22:27:27.831169+0000","last_undegraded":"2024-05-16T22:27:27.831169+0000","last_fullsized":"2024-05-16T22:27:27.831169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:28:33.593207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.762390+0000","last_change":"2024-05-16T22:27:26.189662+0000","last_active":"2024-05-16T22:27:27.762390+0000","last_peered":"2024-05-16T22:27:27.762390+0000","last_clean":"2024-05-16T22:27:27.762390+0000","last_became_active":"2024-05-16T22:27:26.188320+0000","last_became_peered":"2024-05-16T22:27:26.188320+0000","last_unstale":"2024-05-16T22:27:27.762390+0000","last_undegraded":"2024-05-16T22:27:27.762390+0000","last_fullsized":"2024-05-16T22:27:27.762390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:35:53.031312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.164229+0000","last_change":"2024-05-16T22:27:25.165881+0000","last_active":"2024-05-16T22:27:27.164229+0000","last_peered":"2024-05-16T22:27:27.164229+0000","last_clean":"2024-05-16T22:27:27.164229+0000","last_became_active":"2024-05-16T22:27:25.165496+0000","last_became_peered":"2024-05-16T22:27:25.165496+0000","last_unstale":"2024-05-16T22:27:27.164229+0000","last_undegraded":"2024-05-16T22:27:27.164229+0000","last_fullsized":"2024-05-16T22:27:27.164229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:00:19.434832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.830593+0000","last_change":"2024-05-16T22:27:25.176342+0000","last_active":"2024-05-16T22:27:27.830593+0000","last_peered":"2024-05-16T22:27:27.830593+0000","last_clean":"2024-05-16T22:27:27.830593+0000","last_became_active":"2024-05-16T22:27:25.175687+0000","last_became_peered":"2024-05-16T22:27:25.175687+0000","last_unstale":"2024-05-16T22:27:27.830593+0000","last_undegraded":"2024-05-16T22:27:27.830593+0000","last_fullsized":"2024-05-16T22:27:27.830593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:56:06.681858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.830570+0000","last_change":"2024-05-16T22:27:26.193793+0000","last_active":"2024-05-16T22:27:27.830570+0000","last_peered":"2024-05-16T22:27:27.830570+0000","last_clean":"2024-05-16T22:27:27.830570+0000","last_became_active":"2024-05-16T22:27:26.193433+0000","last_became_peered":"2024-05-16T22:27:26.193433+0000","last_unstale":"2024-05-16T22:27:27.830570+0000","last_undegraded":"2024-05-16T22:27:27.830570+0000","last_fullsized":"2024-05-16T22:27:27.830570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:15:24.877779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.156512+0000","last_change":"2024-05-16T22:27:25.171113+0000","last_active":"2024-05-16T22:27:27.156512+0000","last_peered":"2024-05-16T22:27:27.156512+0000","last_clean":"2024-05-16T22:27:27.156512+0000","last_became_active":"2024-05-16T22:27:25.170779+0000","last_became_peered":"2024-05-16T22:27:25.170779+0000","last_unstale":"2024-05-16T22:27:27.156512+0000","last_undegraded":"2024-05-16T22:27:27.156512+0000","last_fullsized":"2024-05-16T22:27:27.156512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:38:18.098766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.155360+0000","last_change":"2024-05-16T22:27:26.174986+0000","last_active":"2024-05-16T22:27:27.155360+0000","last_peered":"2024-05-16T22:27:27.155360+0000","last_clean":"2024-05-16T22:27:27.155360+0000","last_became_active":"2024-05-16T22:27:26.173790+0000","last_became_peered":"2024-05-16T22:27:26.173790+0000","last_unstale":"2024-05-16T22:27:27.155360+0000","last_undegraded":"2024-05-16T22:27:27.155360+0000","last_fullsized":"2024-05-16T22:27:27.155360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:09:35.504713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.164660+0000","last_change":"2024-05-16T22:27:25.170470+0000","last_active":"2024-05-16T22:27:27.164660+0000","last_peered":"2024-05-16T22:27:27.164660+0000","last_clean":"2024-05-16T22:27:27.164660+0000","last_became_active":"2024-05-16T22:27:25.170149+0000","last_became_peered":"2024-05-16T22:27:25.170149+0000","last_unstale":"2024-05-16T22:27:27.164660+0000","last_undegraded":"2024-05-16T22:27:27.164660+0000","last_fullsized":"2024-05-16T22:27:27.164660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:14:19.598037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.156971+0000","last_change":"2024-05-16T22:27:26.170048+0000","last_active":"2024-05-16T22:27:27.156971+0000","last_peered":"2024-05-16T22:27:27.156971+0000","last_clean":"2024-05-16T22:27:27.156971+0000","last_became_active":"2024-05-16T22:27:26.169708+0000","last_became_peered":"2024-05-16T22:27:26.169708+0000","last_unstale":"2024-05-16T22:27:27.156971+0000","last_undegraded":"2024-05-16T22:27:27.156971+0000","last_fullsized":"2024-05-16T22:27:27.156971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:15:00.704481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.157006+0000","last_change":"2024-05-16T22:27:25.167775+0000","last_active":"2024-05-16T22:27:27.157006+0000","last_peered":"2024-05-16T22:27:27.157006+0000","last_clean":"2024-05-16T22:27:27.157006+0000","last_became_active":"2024-05-16T22:27:25.167459+0000","last_became_peered":"2024-05-16T22:27:25.167459+0000","last_unstale":"2024-05-16T22:27:27.157006+0000","last_undegraded":"2024-05-16T22:27:27.157006+0000","last_fullsized":"2024-05-16T22:27:27.157006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:14:19.598037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.762359+0000","last_change":"2024-05-16T22:27:26.188683+0000","last_active":"2024-05-16T22:27:27.762359+0000","last_peered":"2024-05-16T22:27:27.762359+0000","last_clean":"2024-05-16T22:27:27.762359+0000","last_became_active":"2024-05-16T22:27:26.187904+0000","last_became_peered":"2024-05-16T22:27:26.187904+0000","last_unstale":"2024-05-16T22:27:27.762359+0000","last_undegraded":"2024-05-16T22:27:27.762359+0000","last_fullsized":"2024-05-16T22:27:27.762359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:53:35.410252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.155764+0000","last_change":"2024-05-16T22:27:25.164952+0000","last_active":"2024-05-16T22:27:27.155764+0000","last_peered":"2024-05-16T22:27:27.155764+0000","last_clean":"2024-05-16T22:27:27.155764+0000","last_became_active":"2024-05-16T22:27:25.164597+0000","last_became_peered":"2024-05-16T22:27:25.164597+0000","last_unstale":"2024-05-16T22:27:27.155764+0000","last_undegraded":"2024-05-16T22:27:27.155764+0000","last_fullsized":"2024-05-16T22:27:27.155764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:16:38.727975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897760+0000","last_change":"2024-05-16T22:27:26.173240+0000","last_active":"2024-05-16T22:27:27.897760+0000","last_peered":"2024-05-16T22:27:27.897760+0000","last_clean":"2024-05-16T22:27:27.897760+0000","last_became_active":"2024-05-16T22:27:26.172926+0000","last_became_peered":"2024-05-16T22:27:26.172926+0000","last_unstale":"2024-05-16T22:27:27.897760+0000","last_undegraded":"2024-05-16T22:27:27.897760+0000","last_fullsized":"2024-05-16T22:27:27.897760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:05:33.386159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.164787+0000","last_change":"2024-05-16T22:27:25.172637+0000","last_active":"2024-05-16T22:27:27.164787+0000","last_peered":"2024-05-16T22:27:27.164787+0000","last_clean":"2024-05-16T22:27:27.164787+0000","last_became_active":"2024-05-16T22:27:25.172289+0000","last_became_peered":"2024-05-16T22:27:25.172289+0000","last_unstale":"2024-05-16T22:27:27.164787+0000","last_undegraded":"2024-05-16T22:27:27.164787+0000","last_fullsized":"2024-05-16T22:27:27.164787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:10:24.692416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897946+0000","last_change":"2024-05-16T22:27:26.174259+0000","last_active":"2024-05-16T22:27:27.897946+0000","last_peered":"2024-05-16T22:27:27.897946+0000","last_clean":"2024-05-16T22:27:27.897946+0000","last_became_active":"2024-05-16T22:27:26.173945+0000","last_became_peered":"2024-05-16T22:27:26.173945+0000","last_unstale":"2024-05-16T22:27:27.897946+0000","last_undegraded":"2024-05-16T22:27:27.897946+0000","last_fullsized":"2024-05-16T22:27:27.897946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:15:00.704481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.762422+0000","last_change":"2024-05-16T22:27:25.173178+0000","last_active":"2024-05-16T22:27:27.762422+0000","last_peered":"2024-05-16T22:27:27.762422+0000","last_clean":"2024-05-16T22:27:27.762422+0000","last_became_active":"2024-05-16T22:27:25.172768+0000","last_became_peered":"2024-05-16T22:27:25.172768+0000","last_unstale":"2024-05-16T22:27:27.762422+0000","last_undegraded":"2024-05-16T22:27:27.762422+0000","last_fullsized":"2024-05-16T22:27:27.762422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:56:06.681858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.762027+0000","last_change":"2024-05-16T22:27:26.187919+0000","last_active":"2024-05-16T22:27:27.762027+0000","last_peered":"2024-05-16T22:27:27.762027+0000","last_clean":"2024-05-16T22:27:27.762027+0000","last_became_active":"2024-05-16T22:27:26.187589+0000","last_became_peered":"2024-05-16T22:27:26.187589+0000","last_unstale":"2024-05-16T22:27:27.762027+0000","last_undegraded":"2024-05-16T22:27:27.762027+0000","last_fullsized":"2024-05-16T22:27:27.762027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:56:00.004438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.156849+0000","last_change":"2024-05-16T22:27:25.177083+0000","last_active":"2024-05-16T22:27:27.156849+0000","last_peered":"2024-05-16T22:27:27.156849+0000","last_clean":"2024-05-16T22:27:27.156849+0000","last_became_active":"2024-05-16T22:27:25.176737+0000","last_became_peered":"2024-05-16T22:27:25.176737+0000","last_unstale":"2024-05-16T22:27:27.156849+0000","last_undegraded":"2024-05-16T22:27:27.156849+0000","last_fullsized":"2024-05-16T22:27:27.156849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:00:19.434832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.898411+0000","last_change":"2024-05-16T22:27:26.173306+0000","last_active":"2024-05-16T22:27:27.898411+0000","last_peered":"2024-05-16T22:27:27.898411+0000","last_clean":"2024-05-16T22:27:27.898411+0000","last_became_active":"2024-05-16T22:27:26.173016+0000","last_became_peered":"2024-05-16T22:27:26.173016+0000","last_unstale":"2024-05-16T22:27:27.898411+0000","last_undegraded":"2024-05-16T22:27:27.898411+0000","last_fullsized":"2024-05-16T22:27:27.898411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:18:14.496079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.164327+0000","last_change":"2024-05-16T22:27:25.163375+0000","last_active":"2024-05-16T22:27:27.164327+0000","last_peered":"2024-05-16T22:27:27.164327+0000","last_clean":"2024-05-16T22:27:27.164327+0000","last_became_active":"2024-05-16T22:27:25.163055+0000","last_became_peered":"2024-05-16T22:27:25.163055+0000","last_unstale":"2024-05-16T22:27:27.164327+0000","last_undegraded":"2024-05-16T22:27:27.164327+0000","last_fullsized":"2024-05-16T22:27:27.164327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:28:33.593207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.164260+0000","last_change":"2024-05-16T22:27:26.188199+0000","last_active":"2024-05-16T22:27:27.164260+0000","last_peered":"2024-05-16T22:27:27.164260+0000","last_clean":"2024-05-16T22:27:27.164260+0000","last_became_active":"2024-05-16T22:27:26.187894+0000","last_became_peered":"2024-05-16T22:27:26.187894+0000","last_unstale":"2024-05-16T22:27:27.164260+0000","last_undegraded":"2024-05-16T22:27:27.164260+0000","last_fullsized":"2024-05-16T22:27:27.164260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:56:14.312711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897108+0000","last_change":"2024-05-16T22:27:25.171882+0000","last_active":"2024-05-16T22:27:27.897108+0000","last_peered":"2024-05-16T22:27:27.897108+0000","last_clean":"2024-05-16T22:27:27.897108+0000","last_became_active":"2024-05-16T22:27:25.171503+0000","last_became_peered":"2024-05-16T22:27:25.171503+0000","last_unstale":"2024-05-16T22:27:27.897108+0000","last_undegraded":"2024-05-16T22:27:27.897108+0000","last_fullsized":"2024-05-16T22:27:27.897108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:49:34.698714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897827+0000","last_change":"2024-05-16T22:27:26.172931+0000","last_active":"2024-05-16T22:27:27.897827+0000","last_peered":"2024-05-16T22:27:27.897827+0000","last_clean":"2024-05-16T22:27:27.897827+0000","last_became_active":"2024-05-16T22:27:26.172603+0000","last_became_peered":"2024-05-16T22:27:26.172603+0000","last_unstale":"2024-05-16T22:27:27.897827+0000","last_undegraded":"2024-05-16T22:27:27.897827+0000","last_fullsized":"2024-05-16T22:27:27.897827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:54:03.308645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897822+0000","last_change":"2024-05-16T22:27:25.174004+0000","last_active":"2024-05-16T22:27:27.897822+0000","last_peered":"2024-05-16T22:27:27.897822+0000","last_clean":"2024-05-16T22:27:27.897822+0000","last_became_active":"2024-05-16T22:27:25.173652+0000","last_became_peered":"2024-05-16T22:27:25.173652+0000","last_unstale":"2024-05-16T22:27:27.897822+0000","last_undegraded":"2024-05-16T22:27:27.897822+0000","last_fullsized":"2024-05-16T22:27:27.897822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:12:36.673821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897650+0000","last_change":"2024-05-16T22:27:26.173271+0000","last_active":"2024-05-16T22:27:27.897650+0000","last_peered":"2024-05-16T22:27:27.897650+0000","last_clean":"2024-05-16T22:27:27.897650+0000","last_became_active":"2024-05-16T22:27:26.172922+0000","last_became_peered":"2024-05-16T22:27:26.172922+0000","last_unstale":"2024-05-16T22:27:27.897650+0000","last_undegraded":"2024-05-16T22:27:27.897650+0000","last_fullsized":"2024-05-16T22:27:27.897650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:35:53.031312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897354+0000","last_change":"2024-05-16T22:27:25.173377+0000","last_active":"2024-05-16T22:27:27.897354+0000","last_peered":"2024-05-16T22:27:27.897354+0000","last_clean":"2024-05-16T22:27:27.897354+0000","last_became_active":"2024-05-16T22:27:25.172463+0000","last_became_peered":"2024-05-16T22:27:25.172463+0000","last_unstale":"2024-05-16T22:27:27.897354+0000","last_undegraded":"2024-05-16T22:27:27.897354+0000","last_fullsized":"2024-05-16T22:27:27.897354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:10:24.692416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.898476+0000","last_change":"2024-05-16T22:27:26.174266+0000","last_active":"2024-05-16T22:27:27.898476+0000","last_peered":"2024-05-16T22:27:27.898476+0000","last_clean":"2024-05-16T22:27:27.898476+0000","last_became_active":"2024-05-16T22:27:26.174003+0000","last_became_peered":"2024-05-16T22:27:26.174003+0000","last_unstale":"2024-05-16T22:27:27.898476+0000","last_undegraded":"2024-05-16T22:27:27.898476+0000","last_fullsized":"2024-05-16T22:27:27.898476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:07:55.802033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.155873+0000","last_change":"2024-05-16T22:27:25.159445+0000","last_active":"2024-05-16T22:27:27.155873+0000","last_peered":"2024-05-16T22:27:27.155873+0000","last_clean":"2024-05-16T22:27:27.155873+0000","last_became_active":"2024-05-16T22:27:25.159100+0000","last_became_peered":"2024-05-16T22:27:25.159100+0000","last_unstale":"2024-05-16T22:27:27.155873+0000","last_undegraded":"2024-05-16T22:27:27.155873+0000","last_fullsized":"2024-05-16T22:27:27.155873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:05:32.380138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.157069+0000","last_change":"2024-05-16T22:27:26.179538+0000","last_active":"2024-05-16T22:27:27.157069+0000","last_peered":"2024-05-16T22:27:27.157069+0000","last_clean":"2024-05-16T22:27:27.157069+0000","last_became_active":"2024-05-16T22:27:26.179179+0000","last_became_peered":"2024-05-16T22:27:26.179179+0000","last_unstale":"2024-05-16T22:27:27.157069+0000","last_undegraded":"2024-05-16T22:27:27.157069+0000","last_fullsized":"2024-05-16T22:27:27.157069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:38:13.961707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897295+0000","last_change":"2024-05-16T22:27:25.168953+0000","last_active":"2024-05-16T22:27:27.897295+0000","last_peered":"2024-05-16T22:27:27.897295+0000","last_clean":"2024-05-16T22:27:27.897295+0000","last_became_active":"2024-05-16T22:27:25.168090+0000","last_became_peered":"2024-05-16T22:27:25.168090+0000","last_unstale":"2024-05-16T22:27:27.897295+0000","last_undegraded":"2024-05-16T22:27:27.897295+0000","last_fullsized":"2024-05-16T22:27:27.897295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:28:33.593207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.898029+0000","last_change":"2024-05-16T22:27:26.175603+0000","last_active":"2024-05-16T22:27:27.898029+0000","last_peered":"2024-05-16T22:27:27.898029+0000","last_clean":"2024-05-16T22:27:27.898029+0000","last_became_active":"2024-05-16T22:27:26.175300+0000","last_became_peered":"2024-05-16T22:27:26.175300+0000","last_unstale":"2024-05-16T22:27:27.898029+0000","last_undegraded":"2024-05-16T22:27:27.898029+0000","last_fullsized":"2024-05-16T22:27:27.898029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:12:56.101802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":110,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897117+0000","last_change":"2024-05-16T22:27:15.950850+0000","last_active":"2024-05-16T22:27:27.897117+0000","last_peered":"2024-05-16T22:27:27.897117+0000","last_clean":"2024-05-16T22:27:27.897117+0000","last_became_active":"2024-05-16T22:27:15.949553+0000","last_became_peered":"2024-05-16T22:27:15.949553+0000","last_unstale":"2024-05-16T22:27:27.897117+0000","last_undegraded":"2024-05-16T22:27:27.897117+0000","last_fullsized":"2024-05-16T22:27:27.897117+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:14.702385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:14.702385+0000","last_clean_scrub_stamp":"2024-05-16T22:27:14.702385+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:46:07.495562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.156689+0000","last_change":"2024-05-16T22:27:25.168854+0000","last_active":"2024-05-16T22:27:27.156689+0000","last_peered":"2024-05-16T22:27:27.156689+0000","last_clean":"2024-05-16T22:27:27.156689+0000","last_became_active":"2024-05-16T22:27:25.168548+0000","last_became_peered":"2024-05-16T22:27:25.168548+0000","last_unstale":"2024-05-16T22:27:27.156689+0000","last_undegraded":"2024-05-16T22:27:27.156689+0000","last_fullsized":"2024-05-16T22:27:27.156689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:10:24.692416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.831072+0000","last_change":"2024-05-16T22:27:26.187669+0000","last_active":"2024-05-16T22:27:27.831072+0000","last_peered":"2024-05-16T22:27:27.831072+0000","last_clean":"2024-05-16T22:27:27.831072+0000","last_became_active":"2024-05-16T22:27:26.187358+0000","last_became_peered":"2024-05-16T22:27:26.187358+0000","last_unstale":"2024-05-16T22:27:27.831072+0000","last_undegraded":"2024-05-16T22:27:27.831072+0000","last_fullsized":"2024-05-16T22:27:27.831072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:49:00.124634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.896951+0000","last_change":"2024-05-16T22:27:25.179705+0000","last_active":"2024-05-16T22:27:27.896951+0000","last_peered":"2024-05-16T22:27:27.896951+0000","last_clean":"2024-05-16T22:27:27.896951+0000","last_became_active":"2024-05-16T22:27:25.179338+0000","last_became_peered":"2024-05-16T22:27:25.179338+0000","last_unstale":"2024-05-16T22:27:27.896951+0000","last_undegraded":"2024-05-16T22:27:27.896951+0000","last_fullsized":"2024-05-16T22:27:27.896951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:38:18.098766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.761944+0000","last_change":"2024-05-16T22:27:26.185157+0000","last_active":"2024-05-16T22:27:27.761944+0000","last_peered":"2024-05-16T22:27:27.761944+0000","last_clean":"2024-05-16T22:27:27.761944+0000","last_became_active":"2024-05-16T22:27:26.184780+0000","last_became_peered":"2024-05-16T22:27:26.184780+0000","last_unstale":"2024-05-16T22:27:27.761944+0000","last_undegraded":"2024-05-16T22:27:27.761944+0000","last_fullsized":"2024-05-16T22:27:27.761944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:56:14.312711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897243+0000","last_change":"2024-05-16T22:27:25.172921+0000","last_active":"2024-05-16T22:27:27.897243+0000","last_peered":"2024-05-16T22:27:27.897243+0000","last_clean":"2024-05-16T22:27:27.897243+0000","last_became_active":"2024-05-16T22:27:25.172582+0000","last_became_peered":"2024-05-16T22:27:25.172582+0000","last_unstale":"2024-05-16T22:27:27.897243+0000","last_undegraded":"2024-05-16T22:27:27.897243+0000","last_fullsized":"2024-05-16T22:27:27.897243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:14:19.598037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.155424+0000","last_change":"2024-05-16T22:27:26.180819+0000","last_active":"2024-05-16T22:27:27.155424+0000","last_peered":"2024-05-16T22:27:27.155424+0000","last_clean":"2024-05-16T22:27:27.155424+0000","last_became_active":"2024-05-16T22:27:26.180533+0000","last_became_peered":"2024-05-16T22:27:26.180533+0000","last_unstale":"2024-05-16T22:27:27.155424+0000","last_undegraded":"2024-05-16T22:27:27.155424+0000","last_fullsized":"2024-05-16T22:27:27.155424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:15:24.877779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.157126+0000","last_change":"2024-05-16T22:27:25.164143+0000","last_active":"2024-05-16T22:27:27.157126+0000","last_peered":"2024-05-16T22:27:27.157126+0000","last_clean":"2024-05-16T22:27:27.157126+0000","last_became_active":"2024-05-16T22:27:25.163816+0000","last_became_peered":"2024-05-16T22:27:25.163816+0000","last_unstale":"2024-05-16T22:27:27.157126+0000","last_undegraded":"2024-05-16T22:27:27.157126+0000","last_fullsized":"2024-05-16T22:27:27.157126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:18:45.799763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897611+0000","last_change":"2024-05-16T22:27:26.190255+0000","last_active":"2024-05-16T22:27:27.897611+0000","last_peered":"2024-05-16T22:27:27.897611+0000","last_clean":"2024-05-16T22:27:27.897611+0000","last_became_active":"2024-05-16T22:27:26.189958+0000","last_became_peered":"2024-05-16T22:27:26.189958+0000","last_unstale":"2024-05-16T22:27:27.897611+0000","last_undegraded":"2024-05-16T22:27:27.897611+0000","last_fullsized":"2024-05-16T22:27:27.897611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:18:46.805784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.155441+0000","last_change":"2024-05-16T22:27:25.168229+0000","last_active":"2024-05-16T22:27:27.155441+0000","last_peered":"2024-05-16T22:27:27.155441+0000","last_clean":"2024-05-16T22:27:27.155441+0000","last_became_active":"2024-05-16T22:27:25.167870+0000","last_became_peered":"2024-05-16T22:27:25.167870+0000","last_unstale":"2024-05-16T22:27:27.155441+0000","last_undegraded":"2024-05-16T22:27:27.155441+0000","last_fullsized":"2024-05-16T22:27:27.155441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:00:19.434832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.157322+0000","last_change":"2024-05-16T22:27:26.180054+0000","last_active":"2024-05-16T22:27:27.157322+0000","last_peered":"2024-05-16T22:27:27.157322+0000","last_clean":"2024-05-16T22:27:27.157322+0000","last_became_active":"2024-05-16T22:27:26.179579+0000","last_became_peered":"2024-05-16T22:27:26.179579+0000","last_unstale":"2024-05-16T22:27:27.157322+0000","last_undegraded":"2024-05-16T22:27:27.157322+0000","last_fullsized":"2024-05-16T22:27:27.157322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:23:26.496588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.898140+0000","last_change":"2024-05-16T22:27:25.179765+0000","last_active":"2024-05-16T22:27:27.898140+0000","last_peered":"2024-05-16T22:27:27.898140+0000","last_clean":"2024-05-16T22:27:27.898140+0000","last_became_active":"2024-05-16T22:27:25.179478+0000","last_became_peered":"2024-05-16T22:27:25.179478+0000","last_unstale":"2024-05-16T22:27:27.898140+0000","last_undegraded":"2024-05-16T22:27:27.898140+0000","last_fullsized":"2024-05-16T22:27:27.898140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:00:19.434832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.155474+0000","last_change":"2024-05-16T22:27:26.176594+0000","last_active":"2024-05-16T22:27:27.155474+0000","last_peered":"2024-05-16T22:27:27.155474+0000","last_clean":"2024-05-16T22:27:27.155474+0000","last_became_active":"2024-05-16T22:27:26.176164+0000","last_became_peered":"2024-05-16T22:27:26.176164+0000","last_unstale":"2024-05-16T22:27:27.155474+0000","last_undegraded":"2024-05-16T22:27:27.155474+0000","last_fullsized":"2024-05-16T22:27:27.155474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:00:54.570632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.163540+0000","last_change":"2024-05-16T22:27:25.167314+0000","last_active":"2024-05-16T22:27:27.163540+0000","last_peered":"2024-05-16T22:27:27.163540+0000","last_clean":"2024-05-16T22:27:27.163540+0000","last_became_active":"2024-05-16T22:27:25.166970+0000","last_became_peered":"2024-05-16T22:27:25.166970+0000","last_unstale":"2024-05-16T22:27:27.163540+0000","last_undegraded":"2024-05-16T22:27:27.163540+0000","last_fullsized":"2024-05-16T22:27:27.163540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:38:18.098766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.831087+0000","last_change":"2024-05-16T22:27:26.179815+0000","last_active":"2024-05-16T22:27:27.831087+0000","last_peered":"2024-05-16T22:27:27.831087+0000","last_clean":"2024-05-16T22:27:27.831087+0000","last_became_active":"2024-05-16T22:27:26.179100+0000","last_became_peered":"2024-05-16T22:27:26.179100+0000","last_unstale":"2024-05-16T22:27:27.831087+0000","last_undegraded":"2024-05-16T22:27:27.831087+0000","last_fullsized":"2024-05-16T22:27:27.831087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:15:00.704481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.164789+0000","last_change":"2024-05-16T22:27:25.175426+0000","last_active":"2024-05-16T22:27:27.164789+0000","last_peered":"2024-05-16T22:27:27.164789+0000","last_clean":"2024-05-16T22:27:27.164789+0000","last_became_active":"2024-05-16T22:27:25.175074+0000","last_became_peered":"2024-05-16T22:27:25.175074+0000","last_unstale":"2024-05-16T22:27:27.164789+0000","last_undegraded":"2024-05-16T22:27:27.164789+0000","last_fullsized":"2024-05-16T22:27:27.164789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:38:18.098766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.762368+0000","last_change":"2024-05-16T22:27:26.186566+0000","last_active":"2024-05-16T22:27:27.762368+0000","last_peered":"2024-05-16T22:27:27.762368+0000","last_clean":"2024-05-16T22:27:27.762368+0000","last_became_active":"2024-05-16T22:27:26.185741+0000","last_became_peered":"2024-05-16T22:27:26.185741+0000","last_unstale":"2024-05-16T22:27:27.762368+0000","last_undegraded":"2024-05-16T22:27:27.762368+0000","last_fullsized":"2024-05-16T22:27:27.762368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:51:58.232014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.896927+0000","last_change":"2024-05-16T22:27:25.179797+0000","last_active":"2024-05-16T22:27:27.896927+0000","last_peered":"2024-05-16T22:27:27.896927+0000","last_clean":"2024-05-16T22:27:27.896927+0000","last_became_active":"2024-05-16T22:27:25.179523+0000","last_became_peered":"2024-05-16T22:27:25.179523+0000","last_unstale":"2024-05-16T22:27:27.896927+0000","last_undegraded":"2024-05-16T22:27:27.896927+0000","last_fullsized":"2024-05-16T22:27:27.896927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:05:32.380138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897242+0000","last_change":"2024-05-16T22:27:26.176417+0000","last_active":"2024-05-16T22:27:27.897242+0000","last_peered":"2024-05-16T22:27:27.897242+0000","last_clean":"2024-05-16T22:27:27.897242+0000","last_became_active":"2024-05-16T22:27:26.176117+0000","last_became_peered":"2024-05-16T22:27:26.176117+0000","last_unstale":"2024-05-16T22:27:27.897242+0000","last_undegraded":"2024-05-16T22:27:27.897242+0000","last_fullsized":"2024-05-16T22:27:27.897242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:38:19.104787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.155475+0000","last_change":"2024-05-16T22:27:25.173786+0000","last_active":"2024-05-16T22:27:27.155475+0000","last_peered":"2024-05-16T22:27:27.155475+0000","last_clean":"2024-05-16T22:27:27.155475+0000","last_became_active":"2024-05-16T22:27:25.173340+0000","last_became_peered":"2024-05-16T22:27:25.173340+0000","last_unstale":"2024-05-16T22:27:27.155475+0000","last_undegraded":"2024-05-16T22:27:27.155475+0000","last_fullsized":"2024-05-16T22:27:27.155475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:18:45.799763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.830624+0000","last_change":"2024-05-16T22:27:26.173368+0000","last_active":"2024-05-16T22:27:27.830624+0000","last_peered":"2024-05-16T22:27:27.830624+0000","last_clean":"2024-05-16T22:27:27.830624+0000","last_became_active":"2024-05-16T22:27:26.172519+0000","last_became_peered":"2024-05-16T22:27:26.172519+0000","last_unstale":"2024-05-16T22:27:27.830624+0000","last_undegraded":"2024-05-16T22:27:27.830624+0000","last_fullsized":"2024-05-16T22:27:27.830624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:00:54.570632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.155439+0000","last_change":"2024-05-16T22:27:25.170729+0000","last_active":"2024-05-16T22:27:27.155439+0000","last_peered":"2024-05-16T22:27:27.155439+0000","last_clean":"2024-05-16T22:27:27.155439+0000","last_became_active":"2024-05-16T22:27:25.170385+0000","last_became_peered":"2024-05-16T22:27:25.170385+0000","last_unstale":"2024-05-16T22:27:27.155439+0000","last_undegraded":"2024-05-16T22:27:27.155439+0000","last_fullsized":"2024-05-16T22:27:27.155439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:14:19.598037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.830840+0000","last_change":"2024-05-16T22:27:26.193277+0000","last_active":"2024-05-16T22:27:27.830840+0000","last_peered":"2024-05-16T22:27:27.830840+0000","last_clean":"2024-05-16T22:27:27.830840+0000","last_became_active":"2024-05-16T22:27:26.192885+0000","last_became_peered":"2024-05-16T22:27:26.192885+0000","last_unstale":"2024-05-16T22:27:27.830840+0000","last_undegraded":"2024-05-16T22:27:27.830840+0000","last_fullsized":"2024-05-16T22:27:27.830840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:06:36.076585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.898275+0000","last_change":"2024-05-16T22:27:25.173350+0000","last_active":"2024-05-16T22:27:27.898275+0000","last_peered":"2024-05-16T22:27:27.898275+0000","last_clean":"2024-05-16T22:27:27.898275+0000","last_became_active":"2024-05-16T22:27:25.172986+0000","last_became_peered":"2024-05-16T22:27:25.172986+0000","last_unstale":"2024-05-16T22:27:27.898275+0000","last_undegraded":"2024-05-16T22:27:27.898275+0000","last_fullsized":"2024-05-16T22:27:27.898275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:18:45.799763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.164381+0000","last_change":"2024-05-16T22:27:26.178022+0000","last_active":"2024-05-16T22:27:27.164381+0000","last_peered":"2024-05-16T22:27:27.164381+0000","last_clean":"2024-05-16T22:27:27.164381+0000","last_became_active":"2024-05-16T22:27:26.177657+0000","last_became_peered":"2024-05-16T22:27:26.177657+0000","last_unstale":"2024-05-16T22:27:27.164381+0000","last_undegraded":"2024-05-16T22:27:27.164381+0000","last_fullsized":"2024-05-16T22:27:27.164381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:09:35.504713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.157307+0000","last_change":"2024-05-16T22:27:26.182079+0000","last_active":"2024-05-16T22:27:27.157307+0000","last_peered":"2024-05-16T22:27:27.157307+0000","last_clean":"2024-05-16T22:27:27.157307+0000","last_became_active":"2024-05-16T22:27:26.181164+0000","last_became_peered":"2024-05-16T22:27:26.181164+0000","last_unstale":"2024-05-16T22:27:27.157307+0000","last_undegraded":"2024-05-16T22:27:27.157307+0000","last_fullsized":"2024-05-16T22:27:27.157307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:18:14.496079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.897381+0000","last_change":"2024-05-16T22:27:25.176553+0000","last_active":"2024-05-16T22:27:27.897381+0000","last_peered":"2024-05-16T22:27:27.897381+0000","last_clean":"2024-05-16T22:27:27.897381+0000","last_became_active":"2024-05-16T22:27:25.176195+0000","last_became_peered":"2024-05-16T22:27:25.176195+0000","last_unstale":"2024-05-16T22:27:27.897381+0000","last_undegraded":"2024-05-16T22:27:27.897381+0000","last_fullsized":"2024-05-16T22:27:27.897381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:16:38.727975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.157220+0000","last_change":"2024-05-16T22:27:26.176499+0000","last_active":"2024-05-16T22:27:27.157220+0000","last_peered":"2024-05-16T22:27:27.157220+0000","last_clean":"2024-05-16T22:27:27.157220+0000","last_became_active":"2024-05-16T22:27:26.176201+0000","last_became_peered":"2024-05-16T22:27:26.176201+0000","last_unstale":"2024-05-16T22:27:27.157220+0000","last_undegraded":"2024-05-16T22:27:27.157220+0000","last_fullsized":"2024-05-16T22:27:27.157220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:39:13.259116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.898018+0000","last_change":"2024-05-16T22:27:25.176489+0000","last_active":"2024-05-16T22:27:27.898018+0000","last_peered":"2024-05-16T22:27:27.898018+0000","last_clean":"2024-05-16T22:27:27.898018+0000","last_became_active":"2024-05-16T22:27:25.175878+0000","last_became_peered":"2024-05-16T22:27:25.175878+0000","last_unstale":"2024-05-16T22:27:27.898018+0000","last_undegraded":"2024-05-16T22:27:27.898018+0000","last_fullsized":"2024-05-16T22:27:27.898018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:14:19.598037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.762117+0000","last_change":"2024-05-16T22:27:26.188958+0000","last_active":"2024-05-16T22:27:27.762117+0000","last_peered":"2024-05-16T22:27:27.762117+0000","last_clean":"2024-05-16T22:27:27.762117+0000","last_became_active":"2024-05-16T22:27:26.188364+0000","last_became_peered":"2024-05-16T22:27:26.188364+0000","last_unstale":"2024-05-16T22:27:27.762117+0000","last_undegraded":"2024-05-16T22:27:27.762117+0000","last_fullsized":"2024-05-16T22:27:27.762117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:09:35.504713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.831034+0000","last_change":"2024-05-16T22:27:25.172230+0000","last_active":"2024-05-16T22:27:27.831034+0000","last_peered":"2024-05-16T22:27:27.831034+0000","last_clean":"2024-05-16T22:27:27.831034+0000","last_became_active":"2024-05-16T22:27:25.171609+0000","last_became_peered":"2024-05-16T22:27:25.171609+0000","last_unstale":"2024-05-16T22:27:27.831034+0000","last_undegraded":"2024-05-16T22:27:27.831034+0000","last_fullsized":"2024-05-16T22:27:27.831034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:49:34.698714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.831003+0000","last_change":"2024-05-16T22:27:26.174545+0000","last_active":"2024-05-16T22:27:27.831003+0000","last_peered":"2024-05-16T22:27:27.831003+0000","last_clean":"2024-05-16T22:27:27.831003+0000","last_became_active":"2024-05-16T22:27:26.174218+0000","last_became_peered":"2024-05-16T22:27:26.174218+0000","last_unstale":"2024-05-16T22:27:27.831003+0000","last_undegraded":"2024-05-16T22:27:27.831003+0000","last_fullsized":"2024-05-16T22:27:27.831003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:25.144982+0000","last_clean_scrub_stamp":"2024-05-16T22:27:25.144982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:54:03.308645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-16T22:27:27.762375+0000","last_change":"2024-05-16T22:27:25.175258+0000","last_active":"2024-05-16T22:27:27.762375+0000","last_peered":"2024-05-16T22:27:27.762375+0000","last_clean":"2024-05-16T22:27:27.762375+0000","last_became_active":"2024-05-16T22:27:25.174778+0000","last_became_peered":"2024-05-16T22:27:25.174778+0000","last_unstale":"2024-05-16T22:27:27.762375+0000","last_undegraded":"2024-05-16T22:27:27.762375+0000","last_fullsized":"2024-05-16T22:27:27.762375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:24.138961+0000","last_clean_scrub_stamp":"2024-05-16T22:27:24.138961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:12:36.673821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31980,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339860,"statfs":{"total":96636764160,"available":96604016640,"internally_reserved":0,"allocated":815104,"data_stored":666275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":229376,"data_stored":76937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":221184,"data_stored":75415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":75451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":76937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":75325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":75485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":823296,"data_stored":666331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-16T22:27:35.344 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-16T22:27:35.344 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-16T22:27:35.344 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-16T22:27:35.344 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-16T22:27:35.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.491+0000 7f0f57e49640 1 Processor -- start 2024-05-16T22:27:35.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.491+0000 7f0f57e49640 1 -- start start 2024-05-16T22:27:35.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.492+0000 7f0f57e49640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0f5014e260 0x7f0f5014e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:35.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.492+0000 7f0f57e49640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f0f500bfaa0 0x7f0f500bfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:35.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.492+0000 7f0f57e49640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f500be9d0 con 0x7f0f50148330 2024-05-16T22:27:35.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.492+0000 7f0f57e49640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f0f50148740 con 0x7f0f5014e260 2024-05-16T22:27:35.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.492+0000 7f0f57e49640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f0f501518d0 con 0x7f0f500bfaa0 2024-05-16T22:27:35.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.492+0000 7f0f553e4640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0f5014e260 0x7f0f5014e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:35.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.492+0000 7f0f553e4640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0f5014e260 0x7f0f5014e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58322/0 (socket says 172.21.15.44:58322) 2024-05-16T22:27:35.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.492+0000 7f0f553e4640 1 -- 172.21.15.44:0/712320236 learned_addr learned my addr 172.21.15.44:0/712320236 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:35.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.492+0000 7f0f563e6640 1 --2- 172.21.15.44:0/712320236 >> v2:172.21.15.70:3300/0 conn(0x7f0f500bfaa0 0x7f0f500bfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:35.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.492+0000 7f0f553e4640 1 -- 172.21.15.44:0/712320236 >> v2:172.21.15.70:3300/0 conn(0x7f0f500bfaa0 msgr2=0x7f0f500bfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:35.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.492+0000 7f0f553e4640 1 --2- 172.21.15.44:0/712320236 >> v2:172.21.15.70:3300/0 conn(0x7f0f500bfaa0 0x7f0f500bfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:35.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.492+0000 7f0f553e4640 1 -- 172.21.15.44:0/712320236 >> v1:172.21.15.70:6789/0 conn(0x7f0f50148330 legacy=0x7f0f500be2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:35.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.492+0000 7f0f553e4640 1 -- 172.21.15.44:0/712320236 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f50151bb0 con 0x7f0f5014e260 2024-05-16T22:27:35.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.493+0000 7f0f553e4640 1 --2- 172.21.15.44:0/712320236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f5014e260 0x7f0f5014e670 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0f500733c0 tx=0x7f0f4002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3552fddee1e73975 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:35.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.493+0000 7f0f54be3640 1 -- 172.21.15.44:0/712320236 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f40037070 con 0x7f0f5014e260 2024-05-16T22:27:35.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.493+0000 7f0f54be3640 1 -- 172.21.15.44:0/712320236 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f40032440 con 0x7f0f5014e260 2024-05-16T22:27:35.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.493+0000 7f0f54be3640 1 -- 172.21.15.44:0/712320236 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f40032810 con 0x7f0f5014e260 2024-05-16T22:27:35.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.494+0000 7f0f57e49640 1 -- 172.21.15.44:0/712320236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f5014e260 msgr2=0x7f0f5014e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:35.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.494+0000 7f0f57e49640 1 --2- 172.21.15.44:0/712320236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f5014e260 0x7f0f5014e670 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0f500733c0 tx=0x7f0f4002a1e0 comp rx=0 tx=0).stop 2024-05-16T22:27:35.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.494+0000 7f0f57e49640 1 -- 172.21.15.44:0/712320236 shutdown_connections 2024-05-16T22:27:35.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.494+0000 7f0f57e49640 1 --2- 172.21.15.44:0/712320236 >> v2:172.21.15.70:3300/0 conn(0x7f0f500bfaa0 0x7f0f500bfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:35.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.494+0000 7f0f57e49640 1 --2- 172.21.15.44:0/712320236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f5014e260 0x7f0f5014e670 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:35.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.494+0000 7f0f57e49640 1 -- 172.21.15.44:0/712320236 >> 172.21.15.44:0/712320236 conn(0x7f0f500c17c0 msgr2=0x7f0f500c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:35.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.494+0000 7f0f57e49640 1 -- 172.21.15.44:0/712320236 shutdown_connections 2024-05-16T22:27:35.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.494+0000 7f0f57e49640 1 -- 172.21.15.44:0/712320236 wait complete. 2024-05-16T22:27:35.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.496+0000 7f0f57e49640 1 Processor -- start 2024-05-16T22:27:35.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.496+0000 7f0f57e49640 1 -- start start 2024-05-16T22:27:35.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.497+0000 7f0f57e49640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0f500bfaa0 0x7f0f501d78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:35.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.497+0000 7f0f57e49640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f50148330 0x7f0f500b6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:35.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.497+0000 7f0f57e49640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f5014e260 0x7f0f500bdac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:35.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.497+0000 7f0f57e49640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0f500c10b0 con 0x7f0f5014e260 2024-05-16T22:27:35.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.497+0000 7f0f57e49640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0f50152170 con 0x7f0f50148330 2024-05-16T22:27:35.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.497+0000 7f0f57e49640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f0f50152690 con 0x7f0f500bfaa0 2024-05-16T22:27:35.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.497+0000 7f0f563e6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f5014e260 0x7f0f500bdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:35.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.497+0000 7f0f563e6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f5014e260 0x7f0f500bdac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58332/0 (socket says 172.21.15.44:58332) 2024-05-16T22:27:35.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.497+0000 7f0f563e6640 1 -- 172.21.15.44:0/4021740557 learned_addr learned my addr 172.21.15.44:0/4021740557 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:35.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.497+0000 7f0f553e4640 1 --2- 172.21.15.44:0/4021740557 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f50148330 0x7f0f500b6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:35.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.497+0000 7f0f55be5640 1 --2- 172.21.15.44:0/4021740557 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0f500bfaa0 0x7f0f501d78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:35.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.497+0000 7f0f563e6640 1 -- 172.21.15.44:0/4021740557 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0f500bfaa0 msgr2=0x7f0f501d78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:35.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.497+0000 7f0f563e6640 1 --2- 172.21.15.44:0/4021740557 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0f500bfaa0 0x7f0f501d78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:35.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.497+0000 7f0f563e6640 1 -- 172.21.15.44:0/4021740557 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f50148330 msgr2=0x7f0f500b6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:35.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.497+0000 7f0f563e6640 1 --2- 172.21.15.44:0/4021740557 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f50148330 0x7f0f500b6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:35.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.497+0000 7f0f563e6640 1 -- 172.21.15.44:0/4021740557 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f500b70e0 con 0x7f0f5014e260 2024-05-16T22:27:35.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.497+0000 7f0f563e6640 1 --2- 172.21.15.44:0/4021740557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f5014e260 0x7f0f500bdac0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0f48007e60 tx=0x7f0f4800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:35.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.497+0000 7f0f467fc640 1 -- 172.21.15.44:0/4021740557 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f48014420 con 0x7f0f5014e260 2024-05-16T22:27:35.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.498+0000 7f0f467fc640 1 -- 172.21.15.44:0/4021740557 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f48019070 con 0x7f0f5014e260 2024-05-16T22:27:35.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.498+0000 7f0f57e49640 1 -- 172.21.15.44:0/4021740557 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f500be000 con 0x7f0f5014e260 2024-05-16T22:27:35.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.498+0000 7f0f467fc640 1 -- 172.21.15.44:0/4021740557 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f48014820 con 0x7f0f5014e260 2024-05-16T22:27:35.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.498+0000 7f0f57e49640 1 -- 172.21.15.44:0/4021740557 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f500b83b0 con 0x7f0f5014e260 2024-05-16T22:27:35.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.499+0000 7f0f57e49640 1 -- 172.21.15.44:0/4021740557 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f500b67e0 con 0x7f0f5014e260 2024-05-16T22:27:35.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.499+0000 7f0f467fc640 1 -- 172.21.15.44:0/4021740557 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0f480149c0 con 0x7f0f5014e260 2024-05-16T22:27:35.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.500+0000 7f0f467fc640 1 --2- 172.21.15.44:0/4021740557 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0f340762d0 0x7f0f340787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:35.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.500+0000 7f0f467fc640 1 -- 172.21.15.44:0/4021740557 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0f48097d80 con 0x7f0f5014e260 2024-05-16T22:27:35.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.500+0000 7f0f55be5640 1 --2- 172.21.15.44:0/4021740557 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0f340762d0 0x7f0f340787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:35.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.501+0000 7f0f55be5640 1 --2- 172.21.15.44:0/4021740557 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0f340762d0 0x7f0f340787e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c006fd0 tx=0x7f0f4c009060 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:35.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.505+0000 7f0f467fc640 1 -- 172.21.15.44:0/4021740557 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0f48061000 con 0x7f0f5014e260 2024-05-16T22:27:35.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.736+0000 7f0f57e49640 1 -- 172.21.15.44:0/4021740557 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0f50050940 con 0x7f0f5014e260 2024-05-16T22:27:35.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.736+0000 7f0f467fc640 1 -- 172.21.15.44:0/4021740557 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f0f48065300 con 0x7f0f5014e260 2024-05-16T22:27:35.736 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:27:35.736 INFO:teuthology.orchestra.run.smithi044.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-16T22:27:35.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.738+0000 7f0f57e49640 1 -- 172.21.15.44:0/4021740557 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0f340762d0 msgr2=0x7f0f340787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:35.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.738+0000 7f0f57e49640 1 --2- 172.21.15.44:0/4021740557 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0f340762d0 0x7f0f340787e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c006fd0 tx=0x7f0f4c009060 comp rx=0 tx=0).stop 2024-05-16T22:27:35.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.738+0000 7f0f57e49640 1 -- 172.21.15.44:0/4021740557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f5014e260 msgr2=0x7f0f500bdac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:35.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.738+0000 7f0f57e49640 1 --2- 172.21.15.44:0/4021740557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f5014e260 0x7f0f500bdac0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0f48007e60 tx=0x7f0f4800e4b0 comp rx=0 tx=0).stop 2024-05-16T22:27:35.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.738+0000 7f0f57e49640 1 -- 172.21.15.44:0/4021740557 shutdown_connections 2024-05-16T22:27:35.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.738+0000 7f0f57e49640 1 --2- 172.21.15.44:0/4021740557 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0f340762d0 0x7f0f340787e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:35.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.738+0000 7f0f57e49640 1 --2- 172.21.15.44:0/4021740557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f5014e260 0x7f0f500bdac0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:35.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.738+0000 7f0f57e49640 1 --2- 172.21.15.44:0/4021740557 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f50148330 0x7f0f500b6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:35.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.738+0000 7f0f57e49640 1 --2- 172.21.15.44:0/4021740557 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0f500bfaa0 0x7f0f501d78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:35.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.738+0000 7f0f57e49640 1 -- 172.21.15.44:0/4021740557 >> 172.21.15.44:0/4021740557 conn(0x7f0f500c17c0 msgr2=0x7f0f501447f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:35.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.738+0000 7f0f57e49640 1 -- 172.21.15.44:0/4021740557 shutdown_connections 2024-05-16T22:27:35.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.738+0000 7f0f57e49640 1 -- 172.21.15.44:0/4021740557 wait complete. 2024-05-16T22:27:35.749 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-16T22:27:35.749 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T22:27:35.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.860+0000 7f2d7d6c8640 1 Processor -- start 2024-05-16T22:27:35.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.860+0000 7f2d7d6c8640 1 -- start start 2024-05-16T22:27:35.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.861+0000 7f2d7d6c8640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d780bd6d0 0x7f2d780be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:35.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.861+0000 7f2d7d6c8640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2d780bee80 0x7f2d78158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:35.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.861+0000 7f2d7d6c8640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d7806e140 con 0x7f2d78151fc0 2024-05-16T22:27:35.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.861+0000 7f2d7d6c8640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f2d780c36f0 con 0x7f2d780bee80 2024-05-16T22:27:35.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.861+0000 7f2d7d6c8640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f2d78152530 con 0x7f2d780bd6d0 2024-05-16T22:27:35.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.862+0000 7f2d777fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2d780bee80 0x7f2d78158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:35.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.862+0000 7f2d777fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2d780bee80 0x7f2d78158e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58334/0 (socket says 172.21.15.44:58334) 2024-05-16T22:27:35.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.862+0000 7f2d777fe640 1 -- 172.21.15.44:0/3445953965 learned_addr learned my addr 172.21.15.44:0/3445953965 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:35.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.862+0000 7f2d767fc640 1 --2- 172.21.15.44:0/3445953965 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d780bd6d0 0x7f2d780be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:35.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.862+0000 7f2d777fe640 1 -- 172.21.15.44:0/3445953965 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d780bd6d0 msgr2=0x7f2d780be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:35.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.862+0000 7f2d777fe640 1 --2- 172.21.15.44:0/3445953965 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d780bd6d0 0x7f2d780be940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:35.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.862+0000 7f2d777fe640 1 -- 172.21.15.44:0/3445953965 >> v1:172.21.15.70:6789/0 conn(0x7f2d78151fc0 legacy=0x7f2d7806da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:35.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.862+0000 7f2d777fe640 1 -- 172.21.15.44:0/3445953965 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d78152810 con 0x7f2d780bee80 2024-05-16T22:27:35.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.862+0000 7f2d767fc640 1 --2- 172.21.15.44:0/3445953965 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d780bd6d0 0x7f2d780be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:27:35.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.863+0000 7f2d777fe640 1 --2- 172.21.15.44:0/3445953965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d780bee80 0x7f2d78158e90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2d70009870 tx=0x7f2d7002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5fd9406be0fdb6d server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:35.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.863+0000 7f2d75ffb640 1 -- 172.21.15.44:0/3445953965 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d70037070 con 0x7f2d780bee80 2024-05-16T22:27:35.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.863+0000 7f2d75ffb640 1 -- 172.21.15.44:0/3445953965 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d70032440 con 0x7f2d780bee80 2024-05-16T22:27:35.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.863+0000 7f2d75ffb640 1 -- 172.21.15.44:0/3445953965 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d70032810 con 0x7f2d780bee80 2024-05-16T22:27:35.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.863+0000 7f2d7d6c8640 1 -- 172.21.15.44:0/3445953965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d780bee80 msgr2=0x7f2d78158e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:35.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.863+0000 7f2d7d6c8640 1 --2- 172.21.15.44:0/3445953965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d780bee80 0x7f2d78158e90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2d70009870 tx=0x7f2d7002a270 comp rx=0 tx=0).stop 2024-05-16T22:27:35.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.863+0000 7f2d7d6c8640 1 -- 172.21.15.44:0/3445953965 shutdown_connections 2024-05-16T22:27:35.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.863+0000 7f2d7d6c8640 1 --2- 172.21.15.44:0/3445953965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d780bee80 0x7f2d78158e90 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:35.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.863+0000 7f2d7d6c8640 1 --2- 172.21.15.44:0/3445953965 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d780bd6d0 0x7f2d780be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:35.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.864+0000 7f2d7d6c8640 1 -- 172.21.15.44:0/3445953965 >> 172.21.15.44:0/3445953965 conn(0x7f2d780c3d20 msgr2=0x7f2d780c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:35.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.864+0000 7f2d7d6c8640 1 -- 172.21.15.44:0/3445953965 shutdown_connections 2024-05-16T22:27:35.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.864+0000 7f2d7d6c8640 1 -- 172.21.15.44:0/3445953965 wait complete. 2024-05-16T22:27:35.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.865+0000 7f2d7d6c8640 1 Processor -- start 2024-05-16T22:27:35.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.865+0000 7f2d7d6c8640 1 -- start start 2024-05-16T22:27:35.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.866+0000 7f2d7d6c8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d780bd6d0 0x7f2d780b7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:35.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.866+0000 7f2d7d6c8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d780bee80 0x7f2d780b9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:35.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.866+0000 7f2d7d6c8640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d78151fc0 0x7f2d781e4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:35.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.866+0000 7f2d7d6c8640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2d780bdae0 con 0x7f2d780bd6d0 2024-05-16T22:27:35.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.866+0000 7f2d7d6c8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2d780c0070 con 0x7f2d780bee80 2024-05-16T22:27:35.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.866+0000 7f2d7d6c8640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f2d780a2ed0 con 0x7f2d78151fc0 2024-05-16T22:27:35.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.866+0000 7f2d76ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d780bd6d0 0x7f2d780b7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:35.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.866+0000 7f2d76ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d780bd6d0 0x7f2d780b7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58346/0 (socket says 172.21.15.44:58346) 2024-05-16T22:27:35.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.866+0000 7f2d76ffd640 1 -- 172.21.15.44:0/1415186193 learned_addr learned my addr 172.21.15.44:0/1415186193 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:35.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.867+0000 7f2d767fc640 1 --2- 172.21.15.44:0/1415186193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d780bee80 0x7f2d780b9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:35.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.867+0000 7f2d777fe640 1 --2- 172.21.15.44:0/1415186193 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d78151fc0 0x7f2d781e4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:35.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.867+0000 7f2d76ffd640 1 -- 172.21.15.44:0/1415186193 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d78151fc0 msgr2=0x7f2d781e4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:35.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.867+0000 7f2d76ffd640 1 --2- 172.21.15.44:0/1415186193 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d78151fc0 0x7f2d781e4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:35.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.867+0000 7f2d76ffd640 1 -- 172.21.15.44:0/1415186193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d780bee80 msgr2=0x7f2d780b9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:35.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.867+0000 7f2d76ffd640 1 --2- 172.21.15.44:0/1415186193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d780bee80 0x7f2d780b9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:35.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.867+0000 7f2d76ffd640 1 -- 172.21.15.44:0/1415186193 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d780b7b50 con 0x7f2d780bd6d0 2024-05-16T22:27:35.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.867+0000 7f2d777fe640 1 --2- 172.21.15.44:0/1415186193 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d78151fc0 0x7f2d781e4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:27:35.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.867+0000 7f2d767fc640 1 --2- 172.21.15.44:0/1415186193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d780bee80 0x7f2d780b9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:27:35.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.867+0000 7f2d76ffd640 1 --2- 172.21.15.44:0/1415186193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d780bd6d0 0x7f2d780b7610 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2d6800c730 tx=0x7f2d6800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:35.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.867+0000 7f2d6f7fe640 1 -- 172.21.15.44:0/1415186193 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d68003b70 con 0x7f2d780bd6d0 2024-05-16T22:27:35.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.867+0000 7f2d6f7fe640 1 -- 172.21.15.44:0/1415186193 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d68003d30 con 0x7f2d780bd6d0 2024-05-16T22:27:35.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.867+0000 7f2d7d6c8640 1 -- 172.21.15.44:0/1415186193 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d780b8690 con 0x7f2d780bd6d0 2024-05-16T22:27:35.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.867+0000 7f2d6f7fe640 1 -- 172.21.15.44:0/1415186193 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6800aa90 con 0x7f2d780bd6d0 2024-05-16T22:27:35.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.867+0000 7f2d7d6c8640 1 -- 172.21.15.44:0/1415186193 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d780b8890 con 0x7f2d780bd6d0 2024-05-16T22:27:35.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.868+0000 7f2d7d6c8640 1 -- 172.21.15.44:0/1415186193 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d78050940 con 0x7f2d780bd6d0 2024-05-16T22:27:35.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.869+0000 7f2d6f7fe640 1 -- 172.21.15.44:0/1415186193 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2d6800ac30 con 0x7f2d780bd6d0 2024-05-16T22:27:35.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.869+0000 7f2d6f7fe640 1 --2- 172.21.15.44:0/1415186193 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f2d58076300 0x7f2d58078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:35.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.870+0000 7f2d6f7fe640 1 -- 172.21.15.44:0/1415186193 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2d68097460 con 0x7f2d780bd6d0 2024-05-16T22:27:35.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.870+0000 7f2d767fc640 1 --2- 172.21.15.44:0/1415186193 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f2d58076300 0x7f2d58078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:35.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.870+0000 7f2d767fc640 1 --2- 172.21.15.44:0/1415186193 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f2d58076300 0x7f2d58078810 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2d780b6cc0 tx=0x7f2d60008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:35.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:35.874+0000 7f2d6f7fe640 1 -- 172.21.15.44:0/1415186193 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2d780b8690 con 0x7f2d780bd6d0 2024-05-16T22:27:36.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.105+0000 7f2d7d6c8640 1 -- 172.21.15.44:0/1415186193 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2d7806eb40 con 0x7f2d780bd6d0 2024-05-16T22:27:36.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.105+0000 7f2d6f7fe640 1 -- 172.21.15.44:0/1415186193 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+4351 (secure 0 0 0) 0x7f2d7806e140 con 0x7f2d780bd6d0 2024-05-16T22:27:36.105 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:27:36.105 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2940970977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2940970977},{"type":"v1","addr":"172.21.15.44:6833","nonce":2940970977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1653435882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1653435882},{"type":"v1","addr":"172.21.15.70:6835","nonce":1653435882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T22:27:25.548066+0000","modified":"2024-05-16T22:27:28.554539+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/3060763624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3060763624},{"type":"v1","addr":"172.21.15.44:6835","nonce":3060763624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-05-16T22:27:36.105 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 7 2024-05-16T22:27:36.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.107+0000 7f2d7d6c8640 1 -- 172.21.15.44:0/1415186193 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f2d58076300 msgr2=0x7f2d58078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:36.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.107+0000 7f2d7d6c8640 1 --2- 172.21.15.44:0/1415186193 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f2d58076300 0x7f2d58078810 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2d780b6cc0 tx=0x7f2d60008040 comp rx=0 tx=0).stop 2024-05-16T22:27:36.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.107+0000 7f2d7d6c8640 1 -- 172.21.15.44:0/1415186193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d780bd6d0 msgr2=0x7f2d780b7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:36.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.107+0000 7f2d7d6c8640 1 --2- 172.21.15.44:0/1415186193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d780bd6d0 0x7f2d780b7610 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2d6800c730 tx=0x7f2d6800cbf0 comp rx=0 tx=0).stop 2024-05-16T22:27:36.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.107+0000 7f2d7d6c8640 1 -- 172.21.15.44:0/1415186193 shutdown_connections 2024-05-16T22:27:36.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.107+0000 7f2d7d6c8640 1 --2- 172.21.15.44:0/1415186193 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f2d58076300 0x7f2d58078810 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:36.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.107+0000 7f2d7d6c8640 1 --2- 172.21.15.44:0/1415186193 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d78151fc0 0x7f2d781e4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:36.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.107+0000 7f2d7d6c8640 1 --2- 172.21.15.44:0/1415186193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d780bee80 0x7f2d780b9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:36.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.107+0000 7f2d7d6c8640 1 --2- 172.21.15.44:0/1415186193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d780bd6d0 0x7f2d780b7610 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:36.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.107+0000 7f2d7d6c8640 1 -- 172.21.15.44:0/1415186193 >> 172.21.15.44:0/1415186193 conn(0x7f2d780c3d20 msgr2=0x7f2d780c17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:36.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.107+0000 7f2d7d6c8640 1 -- 172.21.15.44:0/1415186193 shutdown_connections 2024-05-16T22:27:36.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.107+0000 7f2d7d6c8640 1 -- 172.21.15.44:0/1415186193 wait complete. 2024-05-16T22:27:36.118 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T22:27:36.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.229+0000 7f101b6f9640 1 Processor -- start 2024-05-16T22:27:36.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.230+0000 7f101b6f9640 1 -- start start 2024-05-16T22:27:36.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.231+0000 7f101b6f9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1014151fc0 0x7f10140bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:36.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.231+0000 7f101b6f9640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f101406da30 0x7f10140be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:36.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.231+0000 7f101b6f9640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f101406de40 0x7f10140bee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:36.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.231+0000 7f101b6f9640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f10140bdc10 con 0x7f1014151fc0 2024-05-16T22:27:36.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.231+0000 7f101b6f9640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f10140c36f0 con 0x7f101406da30 2024-05-16T22:27:36.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.231+0000 7f101b6f9640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f1014152530 con 0x7f101406de40 2024-05-16T22:27:36.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.231+0000 7f1019495640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1014151fc0 0x7f10140bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:36.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.231+0000 7f1019495640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1014151fc0 0x7f10140bd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58350/0 (socket says 172.21.15.44:58350) 2024-05-16T22:27:36.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.231+0000 7f1019495640 1 -- 172.21.15.44:0/604410252 learned_addr learned my addr 172.21.15.44:0/604410252 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:36.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.231+0000 7f1019495640 1 -- 172.21.15.44:0/604410252 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f101406de40 msgr2=0x7f10140bee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:36.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.231+0000 7f1018c94640 1 --2- 172.21.15.44:0/604410252 >> v2:172.21.15.70:3300/0 conn(0x7f101406da30 0x7f10140be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:36.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.231+0000 7f1019495640 1 --2- 172.21.15.44:0/604410252 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f101406de40 0x7f10140bee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:36.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.231+0000 7f1019495640 1 -- 172.21.15.44:0/604410252 >> v2:172.21.15.70:3300/0 conn(0x7f101406da30 msgr2=0x7f10140be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:36.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.231+0000 7f1019495640 1 --2- 172.21.15.44:0/604410252 >> v2:172.21.15.70:3300/0 conn(0x7f101406da30 0x7f10140be940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:36.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.231+0000 7f1019495640 1 -- 172.21.15.44:0/604410252 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1014152810 con 0x7f1014151fc0 2024-05-16T22:27:36.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.231+0000 7f1018c94640 1 --2- 172.21.15.44:0/604410252 >> v2:172.21.15.70:3300/0 conn(0x7f101406da30 0x7f10140be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T22:27:36.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.232+0000 7f1019495640 1 --2- 172.21.15.44:0/604410252 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1014151fc0 0x7f10140bd6d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f10140c38d0 tx=0x7f100402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d4b2cf7efbf4dfb server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:36.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.232+0000 7f1013fff640 1 -- 172.21.15.44:0/604410252 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1004036070 con 0x7f1014151fc0 2024-05-16T22:27:36.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.232+0000 7f1013fff640 1 -- 172.21.15.44:0/604410252 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1004031600 con 0x7f1014151fc0 2024-05-16T22:27:36.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.232+0000 7f1013fff640 1 -- 172.21.15.44:0/604410252 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10040319d0 con 0x7f1014151fc0 2024-05-16T22:27:36.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.233+0000 7f101b6f9640 1 -- 172.21.15.44:0/604410252 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1014151fc0 msgr2=0x7f10140bd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:36.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.233+0000 7f101b6f9640 1 --2- 172.21.15.44:0/604410252 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1014151fc0 0x7f10140bd6d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f10140c38d0 tx=0x7f100402a680 comp rx=0 tx=0).stop 2024-05-16T22:27:36.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.233+0000 7f101b6f9640 1 -- 172.21.15.44:0/604410252 shutdown_connections 2024-05-16T22:27:36.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.233+0000 7f101b6f9640 1 --2- 172.21.15.44:0/604410252 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f101406de40 0x7f10140bee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:36.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.233+0000 7f101b6f9640 1 --2- 172.21.15.44:0/604410252 >> v2:172.21.15.70:3300/0 conn(0x7f101406da30 0x7f10140be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:36.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.233+0000 7f101b6f9640 1 --2- 172.21.15.44:0/604410252 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1014151fc0 0x7f10140bd6d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:36.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.233+0000 7f101b6f9640 1 -- 172.21.15.44:0/604410252 >> 172.21.15.44:0/604410252 conn(0x7f10140c3d20 msgr2=0x7f10140c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:36.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.233+0000 7f101b6f9640 1 -- 172.21.15.44:0/604410252 shutdown_connections 2024-05-16T22:27:36.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.233+0000 7f101b6f9640 1 -- 172.21.15.44:0/604410252 wait complete. 2024-05-16T22:27:36.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.234+0000 7f101b6f9640 1 Processor -- start 2024-05-16T22:27:36.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.234+0000 7f101b6f9640 1 -- start start 2024-05-16T22:27:36.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.235+0000 7f101b6f9640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f101406da30 0x7f10140bb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:36.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.235+0000 7f101b6f9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f101406de40 0x7f10140b5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:36.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.235+0000 7f101b6f9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1014151fc0 0x7f101414c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:36.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.235+0000 7f101b6f9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f10140a3050 con 0x7f101406de40 2024-05-16T22:27:36.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.235+0000 7f101b6f9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f10140a2ed0 con 0x7f1014151fc0 2024-05-16T22:27:36.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.235+0000 7f101b6f9640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f101414e570 con 0x7f101406da30 2024-05-16T22:27:36.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.235+0000 7f1018c94640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f101406de40 0x7f10140b5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:36.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.235+0000 7f1018c94640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f101406de40 0x7f10140b5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58356/0 (socket says 172.21.15.44:58356) 2024-05-16T22:27:36.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.235+0000 7f1018c94640 1 -- 172.21.15.44:0/2482702741 learned_addr learned my addr 172.21.15.44:0/2482702741 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:36.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.236+0000 7f1019495640 1 --2- 172.21.15.44:0/2482702741 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f101406da30 0x7f10140bb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:36.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.236+0000 7f1019c96640 1 --2- 172.21.15.44:0/2482702741 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1014151fc0 0x7f101414c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:36.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.236+0000 7f1018c94640 1 -- 172.21.15.44:0/2482702741 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f101406da30 msgr2=0x7f10140bb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:36.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.236+0000 7f1018c94640 1 --2- 172.21.15.44:0/2482702741 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f101406da30 0x7f10140bb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:36.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.236+0000 7f1018c94640 1 -- 172.21.15.44:0/2482702741 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1014151fc0 msgr2=0x7f101414c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:36.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.236+0000 7f1018c94640 1 --2- 172.21.15.44:0/2482702741 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1014151fc0 0x7f101414c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:36.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.236+0000 7f1018c94640 1 -- 172.21.15.44:0/2482702741 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f101414e340 con 0x7f101406de40 2024-05-16T22:27:36.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.236+0000 7f1018c94640 1 --2- 172.21.15.44:0/2482702741 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f101406de40 0x7f10140b5940 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f100800c7f0 tx=0x7f100800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:36.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.236+0000 7f1011ffb640 1 -- 172.21.15.44:0/2482702741 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1008015070 con 0x7f101406de40 2024-05-16T22:27:36.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.236+0000 7f1011ffb640 1 -- 172.21.15.44:0/2482702741 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10080077c0 con 0x7f101406de40 2024-05-16T22:27:36.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.236+0000 7f1011ffb640 1 -- 172.21.15.44:0/2482702741 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1008007b90 con 0x7f101406de40 2024-05-16T22:27:36.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.236+0000 7f101b6f9640 1 -- 172.21.15.44:0/2482702741 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10141e4800 con 0x7f101406de40 2024-05-16T22:27:36.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.236+0000 7f101b6f9640 1 -- 172.21.15.44:0/2482702741 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10141e4dc0 con 0x7f101406de40 2024-05-16T22:27:36.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.238+0000 7f101b6f9640 1 -- 172.21.15.44:0/2482702741 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10140bc0f0 con 0x7f101406de40 2024-05-16T22:27:36.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.238+0000 7f1011ffb640 1 -- 172.21.15.44:0/2482702741 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1008018070 con 0x7f101406de40 2024-05-16T22:27:36.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.238+0000 7f1011ffb640 1 --2- 172.21.15.44:0/2482702741 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f1000076300 0x7f1000078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:36.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.239+0000 7f1011ffb640 1 -- 172.21.15.44:0/2482702741 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1008097560 con 0x7f101406de40 2024-05-16T22:27:36.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.239+0000 7f1019495640 1 --2- 172.21.15.44:0/2482702741 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f1000076300 0x7f1000078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:36.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.239+0000 7f1019495640 1 --2- 172.21.15.44:0/2482702741 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f1000076300 0x7f1000078810 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1004033000 tx=0x7f1004009000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:36.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.243+0000 7f1011ffb640 1 -- 172.21.15.44:0/2482702741 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1008060870 con 0x7f101406de40 2024-05-16T22:27:36.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.476+0000 7f101b6f9640 1 -- 172.21.15.44:0/2482702741 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f101414bc40 con 0x7f101406de40 2024-05-16T22:27:36.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.476+0000 7f1011ffb640 1 -- 172.21.15.44:0/2482702741 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+4351 (secure 0 0 0) 0x7f1008064b70 con 0x7f101406de40 2024-05-16T22:27:36.476 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:27:36.476 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2940970977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2940970977},{"type":"v1","addr":"172.21.15.44:6833","nonce":2940970977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1653435882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1653435882},{"type":"v1","addr":"172.21.15.70:6835","nonce":1653435882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T22:27:25.548066+0000","modified":"2024-05-16T22:27:28.554539+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/3060763624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3060763624},{"type":"v1","addr":"172.21.15.44:6835","nonce":3060763624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-05-16T22:27:36.476 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 7 2024-05-16T22:27:36.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.478+0000 7f101b6f9640 1 -- 172.21.15.44:0/2482702741 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f1000076300 msgr2=0x7f1000078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:36.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.478+0000 7f101b6f9640 1 --2- 172.21.15.44:0/2482702741 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f1000076300 0x7f1000078810 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1004033000 tx=0x7f1004009000 comp rx=0 tx=0).stop 2024-05-16T22:27:36.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.478+0000 7f101b6f9640 1 -- 172.21.15.44:0/2482702741 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f101406de40 msgr2=0x7f10140b5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:36.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.478+0000 7f101b6f9640 1 --2- 172.21.15.44:0/2482702741 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f101406de40 0x7f10140b5940 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f100800c7f0 tx=0x7f100800ccb0 comp rx=0 tx=0).stop 2024-05-16T22:27:36.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.478+0000 7f101b6f9640 1 -- 172.21.15.44:0/2482702741 shutdown_connections 2024-05-16T22:27:36.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.478+0000 7f101b6f9640 1 --2- 172.21.15.44:0/2482702741 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f1000076300 0x7f1000078810 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:36.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.478+0000 7f101b6f9640 1 --2- 172.21.15.44:0/2482702741 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1014151fc0 0x7f101414c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:36.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.478+0000 7f101b6f9640 1 --2- 172.21.15.44:0/2482702741 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f101406de40 0x7f10140b5940 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:36.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.478+0000 7f101b6f9640 1 --2- 172.21.15.44:0/2482702741 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f101406da30 0x7f10140bb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:36.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.478+0000 7f101b6f9640 1 -- 172.21.15.44:0/2482702741 >> 172.21.15.44:0/2482702741 conn(0x7f10140c3d20 msgr2=0x7f10140a3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:36.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.478+0000 7f101b6f9640 1 -- 172.21.15.44:0/2482702741 shutdown_connections 2024-05-16T22:27:36.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.478+0000 7f101b6f9640 1 -- 172.21.15.44:0/2482702741 wait complete. 2024-05-16T22:27:36.489 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-16T22:27:36.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.600+0000 7f19ec8af640 1 Processor -- start 2024-05-16T22:27:36.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.600+0000 7f19ec8af640 1 -- start start 2024-05-16T22:27:36.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.601+0000 7f19ec8af640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f19e80be4f0 0x7f19e80bfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:36.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.601+0000 7f19ec8af640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f19e814d0f0 0x7f19e8156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:36.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.601+0000 7f19ec8af640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19e80720d0 con 0x7f19e814cce0 2024-05-16T22:27:36.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.601+0000 7f19ec8af640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f19e80bfa60 con 0x7f19e80be4f0 2024-05-16T22:27:36.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.601+0000 7f19ec8af640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f19e8071310 con 0x7f19e814d0f0 2024-05-16T22:27:36.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.602+0000 7f19e659c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f19e80be4f0 0x7f19e80bfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:36.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.602+0000 7f19e5d9b640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f19e814cce0 0x7f19e80716a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59058/0 (socket says 172.21.15.44:59058) 2024-05-16T22:27:36.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.602+0000 7f19e5d9b640 1 -- 172.21.15.44:0/97722611 learned_addr learned my addr 172.21.15.44:0/97722611 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:27:36.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.602+0000 7f19e6d9d640 1 --2- 172.21.15.44:0/97722611 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f19e814d0f0 0x7f19e8156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:36.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.602+0000 7f19e659c640 1 -- 172.21.15.44:0/97722611 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f19e814d0f0 msgr2=0x7f19e8156cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:36.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.602+0000 7f19e659c640 1 --2- 172.21.15.44:0/97722611 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f19e814d0f0 0x7f19e8156cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:36.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.602+0000 7f19e659c640 1 -- 172.21.15.44:0/97722611 >> v1:172.21.15.44:6789/0 conn(0x7f19e814cce0 legacy=0x7f19e80716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:36.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.602+0000 7f19e559a640 1 -- 172.21.15.44:0/97722611 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1762787197 0 0) 0x7f19e80720d0 con 0x7f19e814cce0 2024-05-16T22:27:36.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.602+0000 7f19e659c640 1 -- 172.21.15.44:0/97722611 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19e80bf6f0 con 0x7f19e80be4f0 2024-05-16T22:27:36.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.602+0000 7f19e6d9d640 1 --2- 172.21.15.44:0/97722611 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f19e814d0f0 0x7f19e8156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T22:27:36.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.603+0000 7f19e659c640 1 --2- 172.21.15.44:0/97722611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19e80be4f0 0x7f19e80bfef0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f19d8009d90 tx=0x7f19d802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=445de7ee50d52185 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:36.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.603+0000 7f19e559a640 1 -- 172.21.15.44:0/97722611 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d8031600 con 0x7f19e80be4f0 2024-05-16T22:27:36.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.603+0000 7f19e559a640 1 -- 172.21.15.44:0/97722611 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19d80317a0 con 0x7f19e80be4f0 2024-05-16T22:27:36.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.603+0000 7f19e559a640 1 -- 172.21.15.44:0/97722611 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d8031b70 con 0x7f19e80be4f0 2024-05-16T22:27:36.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.603+0000 7f19ec8af640 1 -- 172.21.15.44:0/97722611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19e80be4f0 msgr2=0x7f19e80bfef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:36.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.603+0000 7f19ec8af640 1 --2- 172.21.15.44:0/97722611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19e80be4f0 0x7f19e80bfef0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f19d8009d90 tx=0x7f19d802a5d0 comp rx=0 tx=0).stop 2024-05-16T22:27:36.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.604+0000 7f19ec8af640 1 -- 172.21.15.44:0/97722611 shutdown_connections 2024-05-16T22:27:36.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.604+0000 7f19ec8af640 1 --2- 172.21.15.44:0/97722611 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f19e814d0f0 0x7f19e8156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:36.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.604+0000 7f19ec8af640 1 --2- 172.21.15.44:0/97722611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19e80be4f0 0x7f19e80bfef0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:36.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.604+0000 7f19ec8af640 1 -- 172.21.15.44:0/97722611 >> 172.21.15.44:0/97722611 conn(0x7f19e80c17c0 msgr2=0x7f19e80c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:36.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.604+0000 7f19ec8af640 1 -- 172.21.15.44:0/97722611 shutdown_connections 2024-05-16T22:27:36.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.604+0000 7f19ec8af640 1 -- 172.21.15.44:0/97722611 wait complete. 2024-05-16T22:27:36.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.605+0000 7f19ec8af640 1 Processor -- start 2024-05-16T22:27:36.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.605+0000 7f19ec8af640 1 -- start start 2024-05-16T22:27:36.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.607+0000 7f19ec8af640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f19e80be4f0 0x7f19e809ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:36.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.607+0000 7f19ec8af640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f19e814cce0 0x7f19e81d4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:36.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.607+0000 7f19ec8af640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19e814d0f0 0x7f19e8149a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:36.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.607+0000 7f19ec8af640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f19e8071db0 con 0x7f19e814d0f0 2024-05-16T22:27:36.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.607+0000 7f19ec8af640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f19e80723b0 con 0x7f19e814cce0 2024-05-16T22:27:36.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.607+0000 7f19ec8af640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f19e80c0430 con 0x7f19e80be4f0 2024-05-16T22:27:36.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.607+0000 7f19e6d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19e814d0f0 0x7f19e8149a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:36.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.607+0000 7f19e6d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19e814d0f0 0x7f19e8149a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58378/0 (socket says 172.21.15.44:58378) 2024-05-16T22:27:36.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.607+0000 7f19e6d9d640 1 -- 172.21.15.44:0/2464292704 learned_addr learned my addr 172.21.15.44:0/2464292704 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:36.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.607+0000 7f19e659c640 1 --2- 172.21.15.44:0/2464292704 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f19e80be4f0 0x7f19e809ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:36.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.607+0000 7f19e5d9b640 1 --2- 172.21.15.44:0/2464292704 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f19e814cce0 0x7f19e81d4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:36.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.607+0000 7f19e6d9d640 1 -- 172.21.15.44:0/2464292704 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f19e80be4f0 msgr2=0x7f19e809ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:36.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.607+0000 7f19e6d9d640 1 --2- 172.21.15.44:0/2464292704 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f19e80be4f0 0x7f19e809ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:36.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.607+0000 7f19e6d9d640 1 -- 172.21.15.44:0/2464292704 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f19e814cce0 msgr2=0x7f19e81d4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:36.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.607+0000 7f19e6d9d640 1 --2- 172.21.15.44:0/2464292704 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f19e814cce0 0x7f19e81d4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:36.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.607+0000 7f19e6d9d640 1 -- 172.21.15.44:0/2464292704 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19e80a0470 con 0x7f19e814d0f0 2024-05-16T22:27:36.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.607+0000 7f19e5d9b640 1 --2- 172.21.15.44:0/2464292704 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f19e814cce0 0x7f19e81d4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:27:36.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.607+0000 7f19e6d9d640 1 --2- 172.21.15.44:0/2464292704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19e814d0f0 0x7f19e8149a60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f19e000c5f0 tx=0x7f19e000cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:36.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.607+0000 7f19deffd640 1 -- 172.21.15.44:0/2464292704 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e0015070 con 0x7f19e814d0f0 2024-05-16T22:27:36.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.607+0000 7f19deffd640 1 -- 172.21.15.44:0/2464292704 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19e0011820 con 0x7f19e814d0f0 2024-05-16T22:27:36.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.607+0000 7f19ec8af640 1 -- 172.21.15.44:0/2464292704 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19e81d4970 con 0x7f19e814d0f0 2024-05-16T22:27:36.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.607+0000 7f19deffd640 1 -- 172.21.15.44:0/2464292704 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e0011c10 con 0x7f19e814d0f0 2024-05-16T22:27:36.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.607+0000 7f19ec8af640 1 -- 172.21.15.44:0/2464292704 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19e81d36f0 con 0x7f19e814d0f0 2024-05-16T22:27:36.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.608+0000 7f19ec8af640 1 -- 172.21.15.44:0/2464292704 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19e80bbef0 con 0x7f19e814d0f0 2024-05-16T22:27:36.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.609+0000 7f19deffd640 1 -- 172.21.15.44:0/2464292704 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f19e0018070 con 0x7f19e814d0f0 2024-05-16T22:27:36.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.610+0000 7f19deffd640 1 --2- 172.21.15.44:0/2464292704 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f19c8076300 0x7f19c8078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:36.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.610+0000 7f19deffd640 1 -- 172.21.15.44:0/2464292704 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f19e0097360 con 0x7f19e814d0f0 2024-05-16T22:27:36.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.610+0000 7f19e659c640 1 --2- 172.21.15.44:0/2464292704 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f19c8076300 0x7f19c8078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:36.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.610+0000 7f19e659c640 1 --2- 172.21.15.44:0/2464292704 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f19c8076300 0x7f19c8078810 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f19d8034000 tx=0x7f19d802f000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:36.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.614+0000 7f19deffd640 1 -- 172.21.15.44:0/2464292704 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f19e0060680 con 0x7f19e814d0f0 2024-05-16T22:27:36.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.806+0000 7f19ec8af640 1 -- 172.21.15.44:0/2464292704 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f19e814cac0 con 0x7f19e814d0f0 2024-05-16T22:27:36.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.807+0000 7f19deffd640 1 -- 172.21.15.44:0/2464292704 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16569 (secure 0 0 0) 0x7f19e0064980 con 0x7f19e814d0f0 2024-05-16T22:27:36.807 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:27:36.807 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":21,"fsid":"572ab7cc-b103-4548-ae8f-c6614d57f0c8","created":"2024-05-16T22:27:02.216874+0000","modified":"2024-05-16T22:27:27.151884+0000","last_up_change":"2024-05-16T22:27:13.693953+0000","last_in_change":"2024-05-16T22:27:04.455119+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-16T22:27:14.562409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-16T22:27:23.458618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-16T22:27:24.495231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a7003e89-c706-4562-9f25-670bb35ae108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6825","nonce":1074109859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6827","nonce":1074109859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6831","nonce":1074109859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6829","nonce":1074109859}]},"public_addr":"172.21.15.44:6825/1074109859","cluster_addr":"172.21.15.44:6827/1074109859","heartbeat_back_addr":"172.21.15.44:6831/1074109859","heartbeat_front_addr":"172.21.15.44:6829/1074109859","state":["exists","up"]},{"osd":1,"uuid":"a4d5169d-8327-4494-9c7c-58db21b00636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6817","nonce":2909429972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6819","nonce":2909429972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6823","nonce":2909429972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6821","nonce":2909429972}]},"public_addr":"172.21.15.44:6817/2909429972","cluster_addr":"172.21.15.44:6819/2909429972","heartbeat_back_addr":"172.21.15.44:6823/2909429972","heartbeat_front_addr":"172.21.15.44:6821/2909429972","state":["exists","up"]},{"osd":2,"uuid":"d4a834f8-83a5-400f-9814-eb0a25124df4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6801","nonce":2908194156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6803","nonce":2908194156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6807","nonce":2908194156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6805","nonce":2908194156}]},"public_addr":"172.21.15.44:6801/2908194156","cluster_addr":"172.21.15.44:6803/2908194156","heartbeat_back_addr":"172.21.15.44:6807/2908194156","heartbeat_front_addr":"172.21.15.44:6805/2908194156","state":["exists","up"]},{"osd":3,"uuid":"b9d24a56-ad43-4674-a395-5ec24d135ae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6809","nonce":2168695793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6811","nonce":2168695793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6815","nonce":2168695793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6813","nonce":2168695793}]},"public_addr":"172.21.15.44:6809/2168695793","cluster_addr":"172.21.15.44:6811/2168695793","heartbeat_back_addr":"172.21.15.44:6815/2168695793","heartbeat_front_addr":"172.21.15.44:6813/2168695793","state":["exists","up"]},{"osd":4,"uuid":"9bd94af5-3e17-4cbe-995a-8f837a66c653","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6823","nonce":1540297751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6825","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6827","nonce":1540297751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6831","nonce":1540297751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6829","nonce":1540297751}]},"public_addr":"172.21.15.70:6823/1540297751","cluster_addr":"172.21.15.70:6827/1540297751","heartbeat_back_addr":"172.21.15.70:6831/1540297751","heartbeat_front_addr":"172.21.15.70:6829/1540297751","state":["exists","up"]},{"osd":5,"uuid":"a5b0cfa5-b259-48bd-98b6-96b44f5ebabd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6804","nonce":4218901987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6808","nonce":4218901987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6815","nonce":4218901987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6812","nonce":4218901987}]},"public_addr":"172.21.15.70:6804/4218901987","cluster_addr":"172.21.15.70:6808/4218901987","heartbeat_back_addr":"172.21.15.70:6815/4218901987","heartbeat_front_addr":"172.21.15.70:6812/4218901987","state":["exists","up"]},{"osd":6,"uuid":"0b6af6df-1358-4fc6-a62c-ba57e02914ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6801","nonce":2389556489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6805","nonce":2389556489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6813","nonce":2389556489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6807","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6809","nonce":2389556489}]},"public_addr":"172.21.15.70:6801/2389556489","cluster_addr":"172.21.15.70:6805/2389556489","heartbeat_back_addr":"172.21.15.70:6813/2389556489","heartbeat_front_addr":"172.21.15.70:6809/2389556489","state":["exists","up"]},{"osd":7,"uuid":"eb1a2c5d-42cf-47d0-9e03-b9d26944a589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6817","nonce":3619691281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6819","nonce":3619691281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6826","nonce":3619691281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6822","nonce":3619691281}]},"public_addr":"172.21.15.70:6817/3619691281","cluster_addr":"172.21.15.70:6819/3619691281","heartbeat_back_addr":"172.21.15.70:6826/3619691281","heartbeat_front_addr":"172.21.15.70:6822/3619691281","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.652256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.613348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.528454+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.625204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.678845+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.680829+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.556200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.647030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T22:27:36.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.809+0000 7f19ec8af640 1 -- 172.21.15.44:0/2464292704 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f19c8076300 msgr2=0x7f19c8078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:36.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.809+0000 7f19ec8af640 1 --2- 172.21.15.44:0/2464292704 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f19c8076300 0x7f19c8078810 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f19d8034000 tx=0x7f19d802f000 comp rx=0 tx=0).stop 2024-05-16T22:27:36.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.809+0000 7f19ec8af640 1 -- 172.21.15.44:0/2464292704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19e814d0f0 msgr2=0x7f19e8149a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:36.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.809+0000 7f19ec8af640 1 --2- 172.21.15.44:0/2464292704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19e814d0f0 0x7f19e8149a60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f19e000c5f0 tx=0x7f19e000cab0 comp rx=0 tx=0).stop 2024-05-16T22:27:36.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.809+0000 7f19ec8af640 1 -- 172.21.15.44:0/2464292704 shutdown_connections 2024-05-16T22:27:36.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.809+0000 7f19ec8af640 1 --2- 172.21.15.44:0/2464292704 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f19c8076300 0x7f19c8078810 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:36.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.809+0000 7f19ec8af640 1 --2- 172.21.15.44:0/2464292704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19e814d0f0 0x7f19e8149a60 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:36.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.809+0000 7f19ec8af640 1 --2- 172.21.15.44:0/2464292704 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f19e814cce0 0x7f19e81d4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:36.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.809+0000 7f19ec8af640 1 --2- 172.21.15.44:0/2464292704 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f19e80be4f0 0x7f19e809ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:36.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.809+0000 7f19ec8af640 1 -- 172.21.15.44:0/2464292704 >> 172.21.15.44:0/2464292704 conn(0x7f19e80c17c0 msgr2=0x7f19e80a4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:36.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.809+0000 7f19ec8af640 1 -- 172.21.15.44:0/2464292704 shutdown_connections 2024-05-16T22:27:36.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.809+0000 7f19ec8af640 1 -- 172.21.15.44:0/2464292704 wait complete. 2024-05-16T22:27:36.820 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T22:27:36.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.932+0000 7f2d19534640 1 Processor -- start 2024-05-16T22:27:36.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.932+0000 7f2d19534640 1 -- start start 2024-05-16T22:27:36.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.933+0000 7f2d19534640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d14152180 0x7f2d14152590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:36.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.933+0000 7f2d19534640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f2d14074320 0x7f2d14074730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:36.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.933+0000 7f2d19534640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d140bbc80 con 0x7f2d1406c8c0 2024-05-16T22:27:36.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.933+0000 7f2d19534640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f2d14151a10 con 0x7f2d14074320 2024-05-16T22:27:36.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.933+0000 7f2d19534640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f2d140bb090 con 0x7f2d14152180 2024-05-16T22:27:36.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.933+0000 7f2d137fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f2d14074320 0x7f2d14074730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:36.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.933+0000 7f2d12ffd640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f2d1406c8c0 0x7f2d140bb4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.44:45658/0 (socket says 172.21.15.44:45658) 2024-05-16T22:27:36.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.933+0000 7f2d0a7fc640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d14152180 0x7f2d14152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:36.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.933+0000 7f2d137fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f2d14074320 0x7f2d14074730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.44:57600/0 (socket says 172.21.15.44:57600) 2024-05-16T22:27:36.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.933+0000 7f2d12ffd640 1 -- 172.21.15.44:0/283876000 learned_addr learned my addr 172.21.15.44:0/283876000 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:27:36.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.933+0000 7f2d0a7fc640 1 -- 172.21.15.44:0/283876000 >> v2:172.21.15.70:3300/0 conn(0x7f2d14074320 msgr2=0x7f2d14074730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:36.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.933+0000 7f2d0a7fc640 1 --2- 172.21.15.44:0/283876000 >> v2:172.21.15.70:3300/0 conn(0x7f2d14074320 0x7f2d14074730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:36.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.933+0000 7f2d0a7fc640 1 -- 172.21.15.44:0/283876000 >> v1:172.21.15.70:6789/0 conn(0x7f2d1406c8c0 legacy=0x7f2d140bb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:36.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.933+0000 7f2d0a7fc640 1 -- 172.21.15.44:0/283876000 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d140bbf60 con 0x7f2d14152180 2024-05-16T22:27:36.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.934+0000 7f2d0a7fc640 1 --2- 172.21.15.44:0/283876000 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d14152180 0x7f2d14152590 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc0097a0 tx=0x7f2cfc02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=533527a9c0aad117 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:36.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.934+0000 7f2d127fc640 1 -- 172.21.15.44:0/283876000 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc037070 con 0x7f2d14152180 2024-05-16T22:27:36.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.934+0000 7f2d127fc640 1 -- 172.21.15.44:0/283876000 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cfc032440 con 0x7f2d14152180 2024-05-16T22:27:36.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.935+0000 7f2d127fc640 1 -- 172.21.15.44:0/283876000 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc032810 con 0x7f2d14152180 2024-05-16T22:27:36.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.935+0000 7f2d19534640 1 -- 172.21.15.44:0/283876000 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d14152180 msgr2=0x7f2d14152590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:36.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.935+0000 7f2d19534640 1 --2- 172.21.15.44:0/283876000 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d14152180 0x7f2d14152590 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc0097a0 tx=0x7f2cfc02a180 comp rx=0 tx=0).stop 2024-05-16T22:27:36.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.935+0000 7f2d19534640 1 -- 172.21.15.44:0/283876000 shutdown_connections 2024-05-16T22:27:36.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.935+0000 7f2d19534640 1 --2- 172.21.15.44:0/283876000 >> v2:172.21.15.70:3300/0 conn(0x7f2d14074320 0x7f2d14074730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:36.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.935+0000 7f2d19534640 1 --2- 172.21.15.44:0/283876000 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d14152180 0x7f2d14152590 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:36.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.935+0000 7f2d19534640 1 -- 172.21.15.44:0/283876000 >> 172.21.15.44:0/283876000 conn(0x7f2d140bd0f0 msgr2=0x7f2d140bd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:36.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.935+0000 7f2d19534640 1 -- 172.21.15.44:0/283876000 shutdown_connections 2024-05-16T22:27:36.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.935+0000 7f2d19534640 1 -- 172.21.15.44:0/283876000 wait complete. 2024-05-16T22:27:36.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.937+0000 7f2d19534640 1 Processor -- start 2024-05-16T22:27:36.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.937+0000 7f2d19534640 1 -- start start 2024-05-16T22:27:36.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.938+0000 7f2d19534640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d1406c8c0 0x7f2d141e7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:36.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.938+0000 7f2d19534640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d14074320 0x7f2d141e81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:36.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.938+0000 7f2d19534640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d14152180 0x7f2d1414bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:36.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.938+0000 7f2d19534640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1406ccd0 con 0x7f2d1406c8c0 2024-05-16T22:27:36.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.938+0000 7f2d19534640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1414e4c0 con 0x7f2d14152180 2024-05-16T22:27:36.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.938+0000 7f2d19534640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f2d1406ce50 con 0x7f2d14074320 2024-05-16T22:27:36.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.938+0000 7f2d12ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d1406c8c0 0x7f2d141e7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:36.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.938+0000 7f2d12ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d1406c8c0 0x7f2d141e7930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58382/0 (socket says 172.21.15.44:58382) 2024-05-16T22:27:36.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.938+0000 7f2d12ffd640 1 -- 172.21.15.44:0/1953792047 learned_addr learned my addr 172.21.15.44:0/1953792047 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:36.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.938+0000 7f2d137fe640 1 --2- 172.21.15.44:0/1953792047 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d14152180 0x7f2d1414bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:36.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.938+0000 7f2d0a7fc640 1 --2- 172.21.15.44:0/1953792047 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d14074320 0x7f2d141e81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:36.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.938+0000 7f2d12ffd640 1 -- 172.21.15.44:0/1953792047 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d14074320 msgr2=0x7f2d141e81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:36.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.938+0000 7f2d12ffd640 1 --2- 172.21.15.44:0/1953792047 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d14074320 0x7f2d141e81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:36.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.938+0000 7f2d12ffd640 1 -- 172.21.15.44:0/1953792047 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d14152180 msgr2=0x7f2d1414bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:36.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.938+0000 7f2d12ffd640 1 --2- 172.21.15.44:0/1953792047 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d14152180 0x7f2d1414bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:36.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.938+0000 7f2d12ffd640 1 -- 172.21.15.44:0/1953792047 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d141d9ce0 con 0x7f2d1406c8c0 2024-05-16T22:27:36.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.938+0000 7f2d137fe640 1 --2- 172.21.15.44:0/1953792047 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d14152180 0x7f2d1414bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:27:36.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.939+0000 7f2d12ffd640 1 --2- 172.21.15.44:0/1953792047 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d1406c8c0 0x7f2d141e7930 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2d04001eb0 tx=0x7f2d0400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:36.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.939+0000 7f2d0bfff640 1 -- 172.21.15.44:0/1953792047 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d04017070 con 0x7f2d1406c8c0 2024-05-16T22:27:36.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.939+0000 7f2d0bfff640 1 -- 172.21.15.44:0/1953792047 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d04005d00 con 0x7f2d1406c8c0 2024-05-16T22:27:36.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.939+0000 7f2d19534640 1 -- 172.21.15.44:0/1953792047 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d141d7340 con 0x7f2d1406c8c0 2024-05-16T22:27:36.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.939+0000 7f2d0bfff640 1 -- 172.21.15.44:0/1953792047 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d04007310 con 0x7f2d1406c8c0 2024-05-16T22:27:36.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.939+0000 7f2d19534640 1 -- 172.21.15.44:0/1953792047 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d141d7900 con 0x7f2d1406c8c0 2024-05-16T22:27:36.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.940+0000 7f2d19534640 1 -- 172.21.15.44:0/1953792047 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d140a3eb0 con 0x7f2d1406c8c0 2024-05-16T22:27:36.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.940+0000 7f2d0bfff640 1 -- 172.21.15.44:0/1953792047 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2d0401a070 con 0x7f2d1406c8c0 2024-05-16T22:27:36.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.941+0000 7f2d0bfff640 1 --2- 172.21.15.44:0/1953792047 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f2cf40762d0 0x7f2cf40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:36.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.941+0000 7f2d0bfff640 1 -- 172.21.15.44:0/1953792047 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2d04096a00 con 0x7f2d1406c8c0 2024-05-16T22:27:36.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.941+0000 7f2d0a7fc640 1 --2- 172.21.15.44:0/1953792047 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f2cf40762d0 0x7f2cf40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:36.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.942+0000 7f2d0a7fc640 1 --2- 172.21.15.44:0/1953792047 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f2cf40762d0 0x7f2cf40787e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc034000 tx=0x7f2cfc02e000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:36.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:36.946+0000 7f2d0bfff640 1 -- 172.21.15.44:0/1953792047 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2d140a3eb0 con 0x7f2d1406c8c0 2024-05-16T22:27:37.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.177+0000 7f2d19534640 1 -- 172.21.15.44:0/1953792047 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2d140be3f0 con 0x7f2d1406c8c0 2024-05-16T22:27:37.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.178+0000 7f2d0bfff640 1 -- 172.21.15.44:0/1953792047 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+4351 (secure 0 0 0) 0x7f2d040602c0 con 0x7f2d1406c8c0 2024-05-16T22:27:37.177 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:27:37.177 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2940970977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2940970977},{"type":"v1","addr":"172.21.15.44:6833","nonce":2940970977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1653435882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1653435882},{"type":"v1","addr":"172.21.15.70:6835","nonce":1653435882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T22:27:25.548066+0000","modified":"2024-05-16T22:27:28.554539+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/3060763624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3060763624},{"type":"v1","addr":"172.21.15.44:6835","nonce":3060763624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-05-16T22:27:37.178 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 7 2024-05-16T22:27:37.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.180+0000 7f2d19534640 1 -- 172.21.15.44:0/1953792047 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f2cf40762d0 msgr2=0x7f2cf40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:37.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.180+0000 7f2d19534640 1 --2- 172.21.15.44:0/1953792047 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f2cf40762d0 0x7f2cf40787e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc034000 tx=0x7f2cfc02e000 comp rx=0 tx=0).stop 2024-05-16T22:27:37.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.180+0000 7f2d19534640 1 -- 172.21.15.44:0/1953792047 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d1406c8c0 msgr2=0x7f2d141e7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:37.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.180+0000 7f2d19534640 1 --2- 172.21.15.44:0/1953792047 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d1406c8c0 0x7f2d141e7930 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2d04001eb0 tx=0x7f2d0400c890 comp rx=0 tx=0).stop 2024-05-16T22:27:37.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.180+0000 7f2d19534640 1 -- 172.21.15.44:0/1953792047 shutdown_connections 2024-05-16T22:27:37.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.180+0000 7f2d19534640 1 --2- 172.21.15.44:0/1953792047 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f2cf40762d0 0x7f2cf40787e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:37.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.180+0000 7f2d19534640 1 --2- 172.21.15.44:0/1953792047 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d14074320 0x7f2d141e81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:37.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.180+0000 7f2d19534640 1 --2- 172.21.15.44:0/1953792047 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d14152180 0x7f2d1414bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:37.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.180+0000 7f2d19534640 1 --2- 172.21.15.44:0/1953792047 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d1406c8c0 0x7f2d141e7930 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:37.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.180+0000 7f2d19534640 1 -- 172.21.15.44:0/1953792047 >> 172.21.15.44:0/1953792047 conn(0x7f2d140bd0f0 msgr2=0x7f2d140a37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:37.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.180+0000 7f2d19534640 1 -- 172.21.15.44:0/1953792047 shutdown_connections 2024-05-16T22:27:37.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.180+0000 7f2d19534640 1 -- 172.21.15.44:0/1953792047 wait complete. 2024-05-16T22:27:37.492 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-16T22:27:25.548066+0000', 'modified': '2024-05-16T22:27:28.554539+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4285}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4285': {'gid': 4285, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.44:6835/3060763624', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6834', 'nonce': 3060763624}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 3060763624}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4285, 'qdb_cluster': [4285]} 2024-05-16T22:27:37.492 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-16T22:27:37.492 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-16T22:27:37.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.609+0000 7fd6aa1ce640 1 Processor -- start 2024-05-16T22:27:37.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.610+0000 7fd6aa1ce640 1 -- start start 2024-05-16T22:27:37.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.611+0000 7fd6aa1ce640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd6a4151fc0 0x7fd6a40bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:37.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.611+0000 7fd6aa1ce640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd6a40bf050 0x7fd6a4158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:37.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.611+0000 7fd6aa1ce640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6a40c36f0 con 0x7fd6a406da30 2024-05-16T22:27:37.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.611+0000 7fd6aa1ce640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fd6a40bdc10 con 0x7fd6a40bf050 2024-05-16T22:27:37.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.611+0000 7fd6aa1ce640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fd6a4152530 con 0x7fd6a4151fc0 2024-05-16T22:27:37.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.611+0000 7fd6a3fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd6a40bf050 0x7fd6a4158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:37.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.611+0000 7fd6a3fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd6a40bf050 0x7fd6a4158e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58390/0 (socket says 172.21.15.44:58390) 2024-05-16T22:27:37.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.611+0000 7fd6a3fff640 1 -- 172.21.15.44:0/4239055708 learned_addr learned my addr 172.21.15.44:0/4239055708 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:37.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.611+0000 7fd6a37fe640 1 --2- 172.21.15.44:0/4239055708 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd6a4151fc0 0x7fd6a40bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:37.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.611+0000 7fd6a3fff640 1 -- 172.21.15.44:0/4239055708 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd6a4151fc0 msgr2=0x7fd6a40bd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:37.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.611+0000 7fd6a3fff640 1 --2- 172.21.15.44:0/4239055708 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd6a4151fc0 0x7fd6a40bd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:37.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.611+0000 7fd6a3fff640 1 -- 172.21.15.44:0/4239055708 >> v1:172.21.15.70:6789/0 conn(0x7fd6a406da30 legacy=0x7fd6a40be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:37.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.611+0000 7fd6a3fff640 1 -- 172.21.15.44:0/4239055708 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6a4152810 con 0x7fd6a40bf050 2024-05-16T22:27:37.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.611+0000 7fd6a37fe640 1 --2- 172.21.15.44:0/4239055708 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd6a4151fc0 0x7fd6a40bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:27:37.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.612+0000 7fd6a3fff640 1 --2- 172.21.15.44:0/4239055708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6a40bf050 0x7fd6a4158e90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd69c009e50 tx=0x7fd69c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2d9718b57f7a769 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:37.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.612+0000 7fd6a27fc640 1 -- 172.21.15.44:0/4239055708 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69c036070 con 0x7fd6a40bf050 2024-05-16T22:27:37.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.612+0000 7fd6a27fc640 1 -- 172.21.15.44:0/4239055708 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd69c031600 con 0x7fd6a40bf050 2024-05-16T22:27:37.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.612+0000 7fd6a27fc640 1 -- 172.21.15.44:0/4239055708 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69c0319d0 con 0x7fd6a40bf050 2024-05-16T22:27:37.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.613+0000 7fd6aa1ce640 1 -- 172.21.15.44:0/4239055708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6a40bf050 msgr2=0x7fd6a4158e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:37.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.613+0000 7fd6aa1ce640 1 --2- 172.21.15.44:0/4239055708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6a40bf050 0x7fd6a4158e90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd69c009e50 tx=0x7fd69c02a6a0 comp rx=0 tx=0).stop 2024-05-16T22:27:37.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.613+0000 7fd6aa1ce640 1 -- 172.21.15.44:0/4239055708 shutdown_connections 2024-05-16T22:27:37.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.613+0000 7fd6aa1ce640 1 --2- 172.21.15.44:0/4239055708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6a40bf050 0x7fd6a4158e90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:37.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.613+0000 7fd6aa1ce640 1 --2- 172.21.15.44:0/4239055708 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd6a4151fc0 0x7fd6a40bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:37.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.613+0000 7fd6aa1ce640 1 -- 172.21.15.44:0/4239055708 >> 172.21.15.44:0/4239055708 conn(0x7fd6a40c3d20 msgr2=0x7fd6a40c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:37.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.613+0000 7fd6aa1ce640 1 -- 172.21.15.44:0/4239055708 shutdown_connections 2024-05-16T22:27:37.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.613+0000 7fd6aa1ce640 1 -- 172.21.15.44:0/4239055708 wait complete. 2024-05-16T22:27:37.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.614+0000 7fd6aa1ce640 1 Processor -- start 2024-05-16T22:27:37.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.615+0000 7fd6aa1ce640 1 -- start start 2024-05-16T22:27:37.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.616+0000 7fd6aa1ce640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd6a406da30 0x7fd6a40b8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:37.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.616+0000 7fd6aa1ce640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6a40bf050 0x7fd6a40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:37.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.616+0000 7fd6aa1ce640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6a4151fc0 0x7fd6a40b5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:37.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.616+0000 7fd6aa1ce640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a40a3050 con 0x7fd6a40bf050 2024-05-16T22:27:37.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.616+0000 7fd6aa1ce640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a40a2ed0 con 0x7fd6a4151fc0 2024-05-16T22:27:37.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.616+0000 7fd6aa1ce640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fd6a406de40 con 0x7fd6a406da30 2024-05-16T22:27:37.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.616+0000 7fd6a2ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6a40bf050 0x7fd6a40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:37.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.616+0000 7fd6a2ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6a40bf050 0x7fd6a40b8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58402/0 (socket says 172.21.15.44:58402) 2024-05-16T22:27:37.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.616+0000 7fd6a2ffd640 1 -- 172.21.15.44:0/1625210123 learned_addr learned my addr 172.21.15.44:0/1625210123 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:37.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.616+0000 7fd6a37fe640 1 --2- 172.21.15.44:0/1625210123 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd6a406da30 0x7fd6a40b8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:37.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.616+0000 7fd6a3fff640 1 --2- 172.21.15.44:0/1625210123 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6a4151fc0 0x7fd6a40b5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:37.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.616+0000 7fd6a2ffd640 1 -- 172.21.15.44:0/1625210123 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd6a406da30 msgr2=0x7fd6a40b8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:37.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.616+0000 7fd6a2ffd640 1 --2- 172.21.15.44:0/1625210123 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd6a406da30 0x7fd6a40b8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:37.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.616+0000 7fd6a2ffd640 1 -- 172.21.15.44:0/1625210123 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6a4151fc0 msgr2=0x7fd6a40b5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:37.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.616+0000 7fd6a2ffd640 1 --2- 172.21.15.44:0/1625210123 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6a4151fc0 0x7fd6a40b5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:37.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.616+0000 7fd6a2ffd640 1 -- 172.21.15.44:0/1625210123 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6a40b8540 con 0x7fd6a40bf050 2024-05-16T22:27:37.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.616+0000 7fd6a2ffd640 1 --2- 172.21.15.44:0/1625210123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6a40bf050 0x7fd6a40b8a20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd69800c3a0 tx=0x7fd69800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:37.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.616+0000 7fd68bfff640 1 -- 172.21.15.44:0/1625210123 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd698017070 con 0x7fd6a40bf050 2024-05-16T22:27:37.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.617+0000 7fd68bfff640 1 -- 172.21.15.44:0/1625210123 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6980052d0 con 0x7fd6a40bf050 2024-05-16T22:27:37.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.617+0000 7fd68bfff640 1 -- 172.21.15.44:0/1625210123 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd698003830 con 0x7fd6a40bf050 2024-05-16T22:27:37.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.617+0000 7fd6aa1ce640 1 -- 172.21.15.44:0/1625210123 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6a40b8f60 con 0x7fd6a40bf050 2024-05-16T22:27:37.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.617+0000 7fd6aa1ce640 1 -- 172.21.15.44:0/1625210123 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6a40a3ad0 con 0x7fd6a40bf050 2024-05-16T22:27:37.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.618+0000 7fd68bfff640 1 -- 172.21.15.44:0/1625210123 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd69801a070 con 0x7fd6a40bf050 2024-05-16T22:27:37.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.619+0000 7fd68bfff640 1 --2- 172.21.15.44:0/1625210123 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd690076300 0x7fd690078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:37.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.619+0000 7fd68bfff640 1 -- 172.21.15.44:0/1625210123 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd698096980 con 0x7fd6a40bf050 2024-05-16T22:27:37.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.619+0000 7fd6a37fe640 1 --2- 172.21.15.44:0/1625210123 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd690076300 0x7fd690078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:37.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.620+0000 7fd6b107f740 1 Processor -- start 2024-05-16T22:27:37.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.620+0000 7fd6b107f740 1 -- start start 2024-05-16T22:27:37.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.620+0000 7fd6a37fe640 1 --2- 172.21.15.44:0/1625210123 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd690076300 0x7fd690078810 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd694006fd0 tx=0x7fd694008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:37.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.621+0000 7fd6b107f740 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55ac72748270 0x55ac72b211b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:37.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.621+0000 7fd6b107f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ac7271f3b0 0x55ac72ae5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:37.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.621+0000 7fd6b107f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac72727590 0x55ac72b162a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:37.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.621+0000 7fd6b107f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ac72a5bf10 con 0x55ac72727590 2024-05-16T22:27:37.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.621+0000 7fd6b107f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ac72a4bab0 con 0x55ac7271f3b0 2024-05-16T22:27:37.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.621+0000 7fd6b107f740 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x55ac72a4faf0 con 0x55ac72748270 2024-05-16T22:27:37.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.621+0000 7fd6a3fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac72727590 0x55ac72b162a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:37.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.621+0000 7fd6a3fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac72727590 0x55ac72b162a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58410/0 (socket says 172.21.15.44:58410) 2024-05-16T22:27:37.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.621+0000 7fd6a3fff640 1 -- 172.21.15.44:0/1787726991 learned_addr learned my addr 172.21.15.44:0/1787726991 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:37.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.621+0000 7fd6a2ffd640 1 --2- 172.21.15.44:0/1787726991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ac7271f3b0 0x55ac72ae5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:37.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.621+0000 7fd6a37fe640 1 --2- 172.21.15.44:0/1787726991 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55ac72748270 0x55ac72b211b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:37.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.622+0000 7fd6a3fff640 1 -- 172.21.15.44:0/1787726991 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55ac72748270 msgr2=0x55ac72b211b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:37.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.622+0000 7fd6a3fff640 1 --2- 172.21.15.44:0/1787726991 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55ac72748270 0x55ac72b211b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:37.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.622+0000 7fd6a3fff640 1 -- 172.21.15.44:0/1787726991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ac7271f3b0 msgr2=0x55ac72ae5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:37.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.622+0000 7fd6a3fff640 1 --2- 172.21.15.44:0/1787726991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ac7271f3b0 0x55ac72ae5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:37.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.622+0000 7fd6a3fff640 1 -- 172.21.15.44:0/1787726991 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac72a0f5d0 con 0x55ac72727590 2024-05-16T22:27:37.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.622+0000 7fd6a3fff640 1 --2- 172.21.15.44:0/1787726991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac72727590 0x55ac72b162a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd69c034040 tx=0x7fd69c02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1e76a82b8694b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:37.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.622+0000 7fd6897fa640 1 -- 172.21.15.44:0/1787726991 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69c036040 con 0x55ac72727590 2024-05-16T22:27:37.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.622+0000 7fd6897fa640 1 -- 172.21.15.44:0/1787726991 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd69c037040 con 0x55ac72727590 2024-05-16T22:27:37.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.622+0000 7fd6897fa640 1 -- 172.21.15.44:0/1787726991 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69c031880 con 0x55ac72727590 2024-05-16T22:27:37.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.623+0000 7fd6b107f740 1 -- 172.21.15.44:0/1787726991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac72727590 msgr2=0x55ac72b162a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:37.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.623+0000 7fd6b107f740 1 --2- 172.21.15.44:0/1787726991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac72727590 0x55ac72b162a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd69c034040 tx=0x7fd69c02e000 comp rx=0 tx=0).stop 2024-05-16T22:27:37.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.623+0000 7fd6b107f740 1 -- 172.21.15.44:0/1787726991 shutdown_connections 2024-05-16T22:27:37.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.623+0000 7fd6b107f740 1 --2- 172.21.15.44:0/1787726991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac72727590 0x55ac72b162a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:37.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.623+0000 7fd6b107f740 1 --2- 172.21.15.44:0/1787726991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ac7271f3b0 0x55ac72ae5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:37.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.623+0000 7fd6b107f740 1 --2- 172.21.15.44:0/1787726991 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55ac72748270 0x55ac72b211b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:37.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.623+0000 7fd6b107f740 1 -- 172.21.15.44:0/1787726991 >> 172.21.15.44:0/1787726991 conn(0x55ac7273c3c0 msgr2=0x55ac72b208b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:37.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.623+0000 7fd6b107f740 1 -- 172.21.15.44:0/1787726991 shutdown_connections 2024-05-16T22:27:37.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.623+0000 7fd6b107f740 1 -- 172.21.15.44:0/1787726991 wait complete. 2024-05-16T22:27:37.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.624+0000 7fd6b107f740 1 -- start start 2024-05-16T22:27:37.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.624+0000 7fd6b107f740 1 Processor -- start 2024-05-16T22:27:37.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.625+0000 7fd6b107f740 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55ac7271f3b0 0x55ac72b305d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:37.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.625+0000 7fd6b107f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ac72727590 0x55ac72b16130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:37.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.625+0000 7fd6b107f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac72748270 0x55ac72b16670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:37.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.625+0000 7fd6b107f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ac72731850 con 0x55ac72748270 2024-05-16T22:27:37.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.625+0000 7fd6b107f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ac72a07c10 con 0x55ac72727590 2024-05-16T22:27:37.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.625+0000 7fd6b107f740 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x55ac72ae6080 con 0x55ac7271f3b0 2024-05-16T22:27:37.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.625+0000 7fd6b107f740 10 client.0 _ll_register_callbacks cb 0x55ac72a0b150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-16T22:27:37.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.625+0000 7fd6a3fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac72748270 0x55ac72b16670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:37.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.625+0000 7fd6a3fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac72748270 0x55ac72b16670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58426/0 (socket says 172.21.15.44:58426) 2024-05-16T22:27:37.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.625+0000 7fd6a3fff640 1 -- 172.21.15.44:0/3530330394 learned_addr learned my addr 172.21.15.44:0/3530330394 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:37.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.625+0000 7fd6a2ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ac72727590 0x55ac72b16130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:37.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.625+0000 7fd6a37fe640 1 --2- 172.21.15.44:0/3530330394 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55ac7271f3b0 0x55ac72b305d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:37.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.625+0000 7fd6a3fff640 1 -- 172.21.15.44:0/3530330394 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55ac7271f3b0 msgr2=0x55ac72b305d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:37.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.625+0000 7fd6a3fff640 1 --2- 172.21.15.44:0/3530330394 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55ac7271f3b0 0x55ac72b305d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:37.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.625+0000 7fd6a3fff640 1 -- 172.21.15.44:0/3530330394 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ac72727590 msgr2=0x55ac72b16130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:37.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.625+0000 7fd6a3fff640 1 --2- 172.21.15.44:0/3530330394 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ac72727590 0x55ac72b16130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:37.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.625+0000 7fd6a3fff640 1 -- 172.21.15.44:0/3530330394 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac727602d0 con 0x55ac72748270 2024-05-16T22:27:37.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.625+0000 7fd6a3fff640 1 --2- 172.21.15.44:0/3530330394 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac72748270 0x55ac72b16670 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd69c02ac90 tx=0x7fd69c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1e29c20e169ceca server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:37.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.625+0000 7fd6827fc640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-05-16T22:27:37.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.626+0000 7fd6827fc640 1 -- 172.21.15.44:0/3530330394 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69c04a070 con 0x55ac72748270 2024-05-16T22:27:37.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.626+0000 7fd6827fc640 1 -- 172.21.15.44:0/3530330394 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd69c032cd0 con 0x55ac72748270 2024-05-16T22:27:37.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.626+0000 7fd6b107f740 1 -- 172.21.15.44:0/3530330394 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd69c037040 con 0x55ac72748270 2024-05-16T22:27:37.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.626+0000 7fd6827fc640 1 -- 172.21.15.44:0/3530330394 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7fd69c055050 con 0x55ac72748270 2024-05-16T22:27:37.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.626+0000 7fd6b107f740 10 client.4593 fetch_fsmap learned FSMap version 7 2024-05-16T22:27:37.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.626+0000 7fd6b107f740 1 -- 172.21.15.44:0/3530330394 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55ac7282a6b0 con 0x55ac72748270 2024-05-16T22:27:37.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.626+0000 7fd6827fc640 1 -- 172.21.15.44:0/3530330394 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd69c037040 con 0x55ac72748270 2024-05-16T22:27:37.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.626+0000 7fd6827fc640 1 -- 172.21.15.44:0/3530330394 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 7) ==== 2889+0+0 (secure 0 0 0) 0x7fd69c058020 con 0x55ac72748270 2024-05-16T22:27:37.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.626+0000 7fd6b107f740 10 client.4593 fetch_fsmap finished waiting for FSMap version 7 2024-05-16T22:27:37.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.626+0000 7fd6b107f740 10 client.4593 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-16T22:27:37.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.626+0000 7fd6b107f740 20 client.4593 populate_metadata read hostname 'smithi044' 2024-05-16T22:27:37.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.626+0000 7fd6b107f740 1 --2- 172.21.15.44:0/3530330394 >> [v2:172.21.15.44:6834/3060763624,v1:172.21.15.44:6835/3060763624] conn(0x55ac72706e40 0x55ac72b0a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:37.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.626+0000 7fd6b107f740 4 client.4593 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-16T22:27:37.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.626+0000 7fd6b107f740 1 -- 172.21.15.44:0/3530330394 --> [v2:172.21.15.44:6834/3060763624,v1:172.21.15.44:6835/3060763624] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ac72a5de60 con 0x55ac72706e40 2024-05-16T22:27:37.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.626+0000 7fd6a37fe640 1 --2- 172.21.15.44:0/3530330394 >> [v2:172.21.15.44:6834/3060763624,v1:172.21.15.44:6835/3060763624] conn(0x55ac72706e40 0x55ac72b0a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:37.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.626+0000 7fd6827fc640 10 client.4593 ms_handle_connect on v2:172.21.15.44:6834/3060763624 2024-05-16T22:27:37.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.627+0000 7fd6a37fe640 1 --2- 172.21.15.44:0/3530330394 >> [v2:172.21.15.44:6834/3060763624,v1:172.21.15.44:6835/3060763624] conn(0x55ac72706e40 0x55ac72b0a470 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87bf9a0ac9383d52 server_cookie=dd5ca47ce4f6f6af in_seq=0 out_seq=0 2024-05-16T22:27:37.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.627+0000 7fd6827fc640 1 -- 172.21.15.44:0/3530330394 <== mds.0 v2:172.21.15.44:6834/3060763624 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ac72a5de60 con 0x55ac72706e40 2024-05-16T22:27:37.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.627+0000 7fd6827fc640 10 client.4593 handle_command_reply: tid=0 2024-05-16T22:27:37.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.627+0000 7fd6b107f740 1 client.4593 shutdown 2024-05-16T22:27:37.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.628+0000 7fd6b107f740 1 -- 172.21.15.44:0/3530330394 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac72748270 msgr2=0x55ac72b16670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:37.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.628+0000 7fd6b107f740 1 --2- 172.21.15.44:0/3530330394 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac72748270 0x55ac72b16670 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd69c02ac90 tx=0x7fd69c004ab0 comp rx=0 tx=0).stop 2024-05-16T22:27:37.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.628+0000 7fd6b107f740 1 -- 172.21.15.44:0/3530330394 shutdown_connections 2024-05-16T22:27:37.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.628+0000 7fd6b107f740 1 --2- 172.21.15.44:0/3530330394 >> [v2:172.21.15.44:6834/3060763624,v1:172.21.15.44:6835/3060763624] conn(0x55ac72706e40 0x55ac72b0a470 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:37.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.628+0000 7fd6b107f740 1 --2- 172.21.15.44:0/3530330394 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac72748270 0x55ac72b16670 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:37.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.628+0000 7fd6b107f740 1 --2- 172.21.15.44:0/3530330394 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ac72727590 0x55ac72b16130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:37.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.628+0000 7fd6827fc640 0 client.4593 ms_handle_reset on v2:172.21.15.44:6834/3060763624 2024-05-16T22:27:37.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.628+0000 7fd6b107f740 1 --2- 172.21.15.44:0/3530330394 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55ac7271f3b0 0x55ac72b305d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:37.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.628+0000 7fd6b107f740 1 -- 172.21.15.44:0/3530330394 >> 172.21.15.44:0/3530330394 conn(0x55ac7273c3c0 msgr2=0x55ac72ae3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:37.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.628+0000 7fd6b107f740 1 -- 172.21.15.44:0/3530330394 shutdown_connections 2024-05-16T22:27:37.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.628+0000 7fd6b107f740 1 -- 172.21.15.44:0/3530330394 wait complete. 2024-05-16T22:27:37.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.628+0000 7fd6b107f740 20 client.4593 trim_cache size 0 max 16384 2024-05-16T22:27:37.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.647+0000 7fd6b107f740 1 Processor -- start 2024-05-16T22:27:37.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.647+0000 7fd6b107f740 1 -- start start 2024-05-16T22:27:37.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.648+0000 7fd6b107f740 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55ac7271f3b0 0x55ac72ae3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:37.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.648+0000 7fd6b107f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac72727590 0x55ac72b40ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:37.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.648+0000 7fd6b107f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ac72748270 0x55ac72b411e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:37.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.648+0000 7fd6b107f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a41f0fd0 con 0x55ac72727590 2024-05-16T22:27:37.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.648+0000 7fd6b107f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a4150420 con 0x55ac72748270 2024-05-16T22:27:37.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.648+0000 7fd6b107f740 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fd6a41f00b0 con 0x55ac7271f3b0 2024-05-16T22:27:37.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.648+0000 7fd6a2ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac72727590 0x55ac72b40ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:37.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.648+0000 7fd6a2ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac72727590 0x55ac72b40ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58432/0 (socket says 172.21.15.44:58432) 2024-05-16T22:27:37.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.648+0000 7fd6a2ffd640 1 -- 172.21.15.44:0/1213957897 learned_addr learned my addr 172.21.15.44:0/1213957897 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:37.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.648+0000 7fd6a3fff640 1 --2- 172.21.15.44:0/1213957897 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ac72748270 0x55ac72b411e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:37.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.648+0000 7fd6a2ffd640 1 -- 172.21.15.44:0/1213957897 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55ac7271f3b0 msgr2=0x55ac72ae3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:37.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.648+0000 7fd6a37fe640 1 --2- 172.21.15.44:0/1213957897 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55ac7271f3b0 0x55ac72ae3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:37.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.648+0000 7fd6a2ffd640 1 --2- 172.21.15.44:0/1213957897 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55ac7271f3b0 0x55ac72ae3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:37.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.648+0000 7fd6a2ffd640 1 -- 172.21.15.44:0/1213957897 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ac72748270 msgr2=0x55ac72b411e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:37.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.648+0000 7fd6a2ffd640 1 --2- 172.21.15.44:0/1213957897 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ac72748270 0x55ac72b411e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:37.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.648+0000 7fd6a2ffd640 1 -- 172.21.15.44:0/1213957897 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac72ae4ab0 con 0x55ac72727590 2024-05-16T22:27:37.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.649+0000 7fd6a2ffd640 1 --2- 172.21.15.44:0/1213957897 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac72727590 0x55ac72b40ca0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd69800cd60 tx=0x7fd698014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b5e881908f9e904 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:37.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.649+0000 7fd688ff9640 1 -- 172.21.15.44:0/1213957897 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd698063e60 con 0x55ac72727590 2024-05-16T22:27:37.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.649+0000 7fd688ff9640 1 -- 172.21.15.44:0/1213957897 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd698068910 con 0x55ac72727590 2024-05-16T22:27:37.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.649+0000 7fd688ff9640 1 -- 172.21.15.44:0/1213957897 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69805edc0 con 0x55ac72727590 2024-05-16T22:27:37.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.650+0000 7fd6b107f740 1 -- 172.21.15.44:0/1213957897 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac72727590 msgr2=0x55ac72b40ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:37.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.650+0000 7fd6b107f740 1 --2- 172.21.15.44:0/1213957897 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac72727590 0x55ac72b40ca0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd69800cd60 tx=0x7fd698014040 comp rx=0 tx=0).stop 2024-05-16T22:27:37.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.650+0000 7fd6b107f740 1 -- 172.21.15.44:0/1213957897 shutdown_connections 2024-05-16T22:27:37.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.650+0000 7fd6b107f740 1 --2- 172.21.15.44:0/1213957897 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ac72748270 0x55ac72b411e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:37.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.650+0000 7fd6b107f740 1 --2- 172.21.15.44:0/1213957897 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac72727590 0x55ac72b40ca0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:37.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.650+0000 7fd6b107f740 1 --2- 172.21.15.44:0/1213957897 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55ac7271f3b0 0x55ac72ae3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:37.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.650+0000 7fd6b107f740 1 -- 172.21.15.44:0/1213957897 >> 172.21.15.44:0/1213957897 conn(0x55ac7273c3c0 msgr2=0x55ac72b29b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:37.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.650+0000 7fd6b107f740 1 -- 172.21.15.44:0/1213957897 shutdown_connections 2024-05-16T22:27:37.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.650+0000 7fd6b107f740 1 -- 172.21.15.44:0/1213957897 wait complete. 2024-05-16T22:27:37.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.650+0000 7fd6b107f740 1 -- start start 2024-05-16T22:27:37.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.650+0000 7fd6b107f740 1 Processor -- start 2024-05-16T22:27:37.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.651+0000 7fd6b107f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac7271f3b0 0x55ac72b94910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:37.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.651+0000 7fd6b107f740 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55ac72727590 0x55ac72b25e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:37.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.652+0000 7fd6b107f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ac72748270 0x55ac72b26390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:37.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.652+0000 7fd6b107f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ac72b30c10 con 0x55ac7271f3b0 2024-05-16T22:27:37.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.652+0000 7fd6b107f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ac72b2db40 con 0x55ac72748270 2024-05-16T22:27:37.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.652+0000 7fd6b107f740 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x55ac72b09ed0 con 0x55ac72727590 2024-05-16T22:27:37.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.652+0000 7fd6b107f740 10 client.0 _ll_register_callbacks cb 0x7fd69c0095a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-16T22:27:37.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.652+0000 7fd6a37fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac7271f3b0 0x55ac72b94910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:37.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.652+0000 7fd6a37fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac7271f3b0 0x55ac72b94910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58448/0 (socket says 172.21.15.44:58448) 2024-05-16T22:27:37.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.652+0000 7fd6a37fe640 1 -- 172.21.15.44:0/2872982533 learned_addr learned my addr 172.21.15.44:0/2872982533 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:37.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.652+0000 7fd6a3fff640 1 --2- 172.21.15.44:0/2872982533 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ac72748270 0x55ac72b26390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:37.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.652+0000 7fd6a2ffd640 1 --2- 172.21.15.44:0/2872982533 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55ac72727590 0x55ac72b25e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:37.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.652+0000 7fd6a37fe640 1 -- 172.21.15.44:0/2872982533 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55ac72727590 msgr2=0x55ac72b25e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:37.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.652+0000 7fd6a37fe640 1 --2- 172.21.15.44:0/2872982533 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55ac72727590 0x55ac72b25e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:37.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.652+0000 7fd6a37fe640 1 -- 172.21.15.44:0/2872982533 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ac72748270 msgr2=0x55ac72b26390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:37.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.652+0000 7fd6a37fe640 1 --2- 172.21.15.44:0/2872982533 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ac72748270 0x55ac72b26390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:37.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.652+0000 7fd6a37fe640 1 -- 172.21.15.44:0/2872982533 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac72b157d0 con 0x55ac7271f3b0 2024-05-16T22:27:37.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.652+0000 7fd6a37fe640 1 --2- 172.21.15.44:0/2872982533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac7271f3b0 0x55ac72b94910 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x55ac72b30e50 tx=0x7fd694004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8ed759f77d7697c server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:37.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.652+0000 7fd6827fc640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-05-16T22:27:37.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.652+0000 7fd6827fc640 1 -- 172.21.15.44:0/2872982533 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69401c040 con 0x55ac7271f3b0 2024-05-16T22:27:37.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.652+0000 7fd6827fc640 1 -- 172.21.15.44:0/2872982533 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd694024650 con 0x55ac7271f3b0 2024-05-16T22:27:37.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.652+0000 7fd6b107f740 1 -- 172.21.15.44:0/2872982533 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd698068910 con 0x55ac7271f3b0 2024-05-16T22:27:37.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.652+0000 7fd6827fc640 1 -- 172.21.15.44:0/2872982533 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7fd694036050 con 0x55ac7271f3b0 2024-05-16T22:27:37.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.652+0000 7fd6b107f740 10 client.4599 fetch_fsmap learned FSMap version 7 2024-05-16T22:27:37.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.652+0000 7fd6b107f740 1 -- 172.21.15.44:0/2872982533 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55ac72b9ad30 con 0x55ac7271f3b0 2024-05-16T22:27:37.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.653+0000 7fd6827fc640 1 -- 172.21.15.44:0/2872982533 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd698068910 con 0x55ac7271f3b0 2024-05-16T22:27:37.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.653+0000 7fd6827fc640 1 -- 172.21.15.44:0/2872982533 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 7) ==== 2889+0+0 (secure 0 0 0) 0x7fd694039020 con 0x55ac7271f3b0 2024-05-16T22:27:37.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.653+0000 7fd6b107f740 10 client.4599 fetch_fsmap finished waiting for FSMap version 7 2024-05-16T22:27:37.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.653+0000 7fd6b107f740 10 client.4599 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-16T22:27:37.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.653+0000 7fd6b107f740 20 client.4599 populate_metadata read hostname 'smithi044' 2024-05-16T22:27:37.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.653+0000 7fd6b107f740 1 --2- 172.21.15.44:0/2872982533 >> [v2:172.21.15.44:6834/3060763624,v1:172.21.15.44:6835/3060763624] conn(0x55ac72b94e50 0x55ac72b268d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:37.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.653+0000 7fd6b107f740 4 client.4599 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-16T22:27:37.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.653+0000 7fd6b107f740 1 -- 172.21.15.44:0/2872982533 --> [v2:172.21.15.44:6834/3060763624,v1:172.21.15.44:6835/3060763624] -- command(tid 0: {"prefix": "status"}) -- 0x55ac72a57640 con 0x55ac72b94e50 2024-05-16T22:27:37.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.653+0000 7fd6a2ffd640 1 --2- 172.21.15.44:0/2872982533 >> [v2:172.21.15.44:6834/3060763624,v1:172.21.15.44:6835/3060763624] conn(0x55ac72b94e50 0x55ac72b268d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:37.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.653+0000 7fd6827fc640 10 client.4599 ms_handle_connect on v2:172.21.15.44:6834/3060763624 2024-05-16T22:27:37.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.653+0000 7fd6a2ffd640 1 --2- 172.21.15.44:0/2872982533 >> [v2:172.21.15.44:6834/3060763624,v1:172.21.15.44:6835/3060763624] conn(0x55ac72b94e50 0x55ac72b268d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f6a098af78a9db5 server_cookie=a23feaee9bb4a80f in_seq=0 out_seq=0 2024-05-16T22:27:37.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.653+0000 7fd6827fc640 1 -- 172.21.15.44:0/2872982533 <== mds.0 v2:172.21.15.44:6834/3060763624 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55ac72a57640 con 0x55ac72b94e50 2024-05-16T22:27:37.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.653+0000 7fd6827fc640 10 client.4599 handle_command_reply: tid=0 2024-05-16T22:27:37.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.653+0000 7fd6b107f740 1 client.4599 shutdown 2024-05-16T22:27:37.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.654+0000 7fd6b107f740 1 -- 172.21.15.44:0/2872982533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac7271f3b0 msgr2=0x55ac72b94910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:37.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.654+0000 7fd6b107f740 1 --2- 172.21.15.44:0/2872982533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac7271f3b0 0x55ac72b94910 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x55ac72b30e50 tx=0x7fd694004730 comp rx=0 tx=0).stop 2024-05-16T22:27:37.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.654+0000 7fd6b107f740 1 -- 172.21.15.44:0/2872982533 shutdown_connections 2024-05-16T22:27:37.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.654+0000 7fd6b107f740 1 --2- 172.21.15.44:0/2872982533 >> [v2:172.21.15.44:6834/3060763624,v1:172.21.15.44:6835/3060763624] conn(0x55ac72b94e50 0x55ac72b268d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:37.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.654+0000 7fd6b107f740 1 --2- 172.21.15.44:0/2872982533 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55ac72727590 0x55ac72b25e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:37.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.654+0000 7fd6b107f740 1 --2- 172.21.15.44:0/2872982533 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ac72748270 0x55ac72b26390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:37.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.654+0000 7fd6827fc640 0 client.4599 ms_handle_reset on v2:172.21.15.44:6834/3060763624 2024-05-16T22:27:37.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.654+0000 7fd6b107f740 1 --2- 172.21.15.44:0/2872982533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac7271f3b0 0x55ac72b94910 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:37.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.654+0000 7fd6b107f740 1 -- 172.21.15.44:0/2872982533 >> 172.21.15.44:0/2872982533 conn(0x55ac7273c3c0 msgr2=0x55ac72b30050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:37.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.654+0000 7fd6b107f740 1 -- 172.21.15.44:0/2872982533 shutdown_connections 2024-05-16T22:27:37.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.654+0000 7fd6b107f740 1 -- 172.21.15.44:0/2872982533 wait complete. 2024-05-16T22:27:37.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.654+0000 7fd6b107f740 20 client.4599 trim_cache size 0 max 16384 2024-05-16T22:27:37.662 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-05-16T22:27:37.662 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "572ab7cc-b103-4548-ae8f-c6614d57f0c8", 2024-05-16T22:27:37.662 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2024-05-16T22:27:37.662 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 4285, 2024-05-16T22:27:37.662 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-05-16T22:27:37.662 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-05-16T22:27:37.662 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-05-16T22:27:37.662 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 11.501445712000001, 2024-05-16T22:27:37.662 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 7, 2024-05-16T22:27:37.662 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 21, 2024-05-16T22:27:37.663 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 21, 2024-05-16T22:27:37.663 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 17.528373636000001 2024-05-16T22:27:37.663 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-05-16T22:27:37.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.654+0000 7fd6aa1ce640 1 -- 172.21.15.44:0/1625210123 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd690076300 msgr2=0x7fd690078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:37.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.654+0000 7fd6aa1ce640 1 --2- 172.21.15.44:0/1625210123 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd690076300 0x7fd690078810 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd694006fd0 tx=0x7fd694008040 comp rx=0 tx=0).stop 2024-05-16T22:27:37.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.654+0000 7fd6aa1ce640 1 -- 172.21.15.44:0/1625210123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6a40bf050 msgr2=0x7fd6a40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:37.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.654+0000 7fd6aa1ce640 1 --2- 172.21.15.44:0/1625210123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6a40bf050 0x7fd6a40b8a20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd69800c3a0 tx=0x7fd69800c860 comp rx=0 tx=0).stop 2024-05-16T22:27:37.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.654+0000 7fd6aa1ce640 1 -- 172.21.15.44:0/1625210123 shutdown_connections 2024-05-16T22:27:37.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.654+0000 7fd6aa1ce640 1 --2- 172.21.15.44:0/1625210123 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd690076300 0x7fd690078810 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:37.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.654+0000 7fd6aa1ce640 1 --2- 172.21.15.44:0/1625210123 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6a4151fc0 0x7fd6a40b5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:37.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.654+0000 7fd6aa1ce640 1 --2- 172.21.15.44:0/1625210123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6a40bf050 0x7fd6a40b8a20 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:37.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.654+0000 7fd6aa1ce640 1 --2- 172.21.15.44:0/1625210123 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd6a406da30 0x7fd6a40b8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:37.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.654+0000 7fd6aa1ce640 1 -- 172.21.15.44:0/1625210123 >> 172.21.15.44:0/1625210123 conn(0x7fd6a40c3d20 msgr2=0x7fd6a40c09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:37.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.655+0000 7fd6aa1ce640 1 -- 172.21.15.44:0/1625210123 shutdown_connections 2024-05-16T22:27:37.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.655+0000 7fd6aa1ce640 1 -- 172.21.15.44:0/1625210123 wait complete. 2024-05-16T22:27:37.666 INFO:teuthology.run_tasks:Running task sequential... 2024-05-16T22:27:37.675 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-16T22:27:37.675 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-16T22:27:37.675 INFO:teuthology.task.print:Enabling mgr modules 2024-05-16T22:27:37.676 INFO:teuthology.run_tasks:Running task kclient... 2024-05-16T22:27:37.732 INFO:tasks.kclient:Mounting kernel clients... 2024-05-16T22:27:37.732 INFO:tasks.kclient:config is {'client.0': {}} 2024-05-16T22:27:37.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T22:27:37.732 DEBUG:teuthology.orchestra.run.smithi196:> ip netns list 2024-05-16T22:27:37.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T22:27:37.789 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link delete ceph-brx 2024-05-16T22:27:37.870 INFO:teuthology.orchestra.run.smithi196.stderr:Cannot find device "ceph-brx" 2024-05-16T22:27:37.874 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-16T22:27:37.874 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-05-16T22:27:37.875 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-16T22:27:37.875 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-16T22:27:37.875 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-16T22:27:37.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.987+0000 7f2a13c2b640 1 Processor -- start 2024-05-16T22:27:37.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.987+0000 7f2a13c2b640 1 -- start start 2024-05-16T22:27:37.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.988+0000 7f2a13c2b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f2a0c14e440 0x7f2a0c0b99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:37.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.988+0000 7f2a13c2b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2a0c0bd770 0x7f2a0c0ba240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:37.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.988+0000 7f2a13c2b640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a0c14e9b0 con 0x7f2a0c0b8a20 2024-05-16T22:27:37.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.988+0000 7f2a13c2b640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f2a0c14ec90 con 0x7f2a0c0bd770 2024-05-16T22:27:37.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.988+0000 7f2a13c2b640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f2a0c14ef70 con 0x7f2a0c14e440 2024-05-16T22:27:37.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.989+0000 7f2a111c6640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2a0c0bd770 0x7f2a0c0ba240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:37.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.989+0000 7f2a121c8640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f2a0c0b8a20 0x7f2a0c0b8e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59074/0 (socket says 172.21.15.44:59074) 2024-05-16T22:27:37.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.989+0000 7f2a121c8640 1 -- 172.21.15.44:0/2787963454 learned_addr learned my addr 172.21.15.44:0/2787963454 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:27:37.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.989+0000 7f2a119c7640 1 --2- 172.21.15.44:0/2787963454 >> v2:172.21.15.70:3300/0 conn(0x7f2a0c14e440 0x7f2a0c0b99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:37.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.989+0000 7f2a111c6640 1 -- 172.21.15.44:0/2787963454 >> v2:172.21.15.70:3300/0 conn(0x7f2a0c14e440 msgr2=0x7f2a0c0b99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:37.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.989+0000 7f2a111c6640 1 --2- 172.21.15.44:0/2787963454 >> v2:172.21.15.70:3300/0 conn(0x7f2a0c14e440 0x7f2a0c0b99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:37.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.989+0000 7f2a111c6640 1 -- 172.21.15.44:0/2787963454 >> v1:172.21.15.44:6789/0 conn(0x7f2a0c0b8a20 legacy=0x7f2a0c0b8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:37.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.989+0000 7f2a111c6640 1 -- 172.21.15.44:0/2787963454 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a0c14f250 con 0x7f2a0c0bd770 2024-05-16T22:27:37.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.989+0000 7f2a109c5640 1 -- 172.21.15.44:0/2787963454 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1527926067 0 0) 0x7f2a0c14e9b0 con 0x7f2a0c0b8a20 2024-05-16T22:27:37.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.990+0000 7f2a111c6640 1 --2- 172.21.15.44:0/2787963454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a0c0bd770 0x7f2a0c0ba240 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c08d290 tx=0x7f2a0002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=871e9de539a82956 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:37.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.990+0000 7f2a109c5640 1 -- 172.21.15.44:0/2787963454 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a00037070 con 0x7f2a0c0bd770 2024-05-16T22:27:37.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.990+0000 7f2a109c5640 1 -- 172.21.15.44:0/2787963454 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a00032440 con 0x7f2a0c0bd770 2024-05-16T22:27:37.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.990+0000 7f2a109c5640 1 -- 172.21.15.44:0/2787963454 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a00032810 con 0x7f2a0c0bd770 2024-05-16T22:27:37.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.990+0000 7f2a13c2b640 1 -- 172.21.15.44:0/2787963454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a0c0bd770 msgr2=0x7f2a0c0ba240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:37.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.990+0000 7f2a13c2b640 1 --2- 172.21.15.44:0/2787963454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a0c0bd770 0x7f2a0c0ba240 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c08d290 tx=0x7f2a0002a1a0 comp rx=0 tx=0).stop 2024-05-16T22:27:37.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.991+0000 7f2a13c2b640 1 -- 172.21.15.44:0/2787963454 shutdown_connections 2024-05-16T22:27:37.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.991+0000 7f2a13c2b640 1 --2- 172.21.15.44:0/2787963454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a0c0bd770 0x7f2a0c0ba240 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:37.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.991+0000 7f2a13c2b640 1 --2- 172.21.15.44:0/2787963454 >> v2:172.21.15.70:3300/0 conn(0x7f2a0c14e440 0x7f2a0c0b99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:37.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.991+0000 7f2a13c2b640 1 -- 172.21.15.44:0/2787963454 >> 172.21.15.44:0/2787963454 conn(0x7f2a0c0c0390 msgr2=0x7f2a0c0c07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:37.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.991+0000 7f2a13c2b640 1 -- 172.21.15.44:0/2787963454 shutdown_connections 2024-05-16T22:27:37.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.991+0000 7f2a13c2b640 1 -- 172.21.15.44:0/2787963454 wait complete. 2024-05-16T22:27:37.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.992+0000 7f2a13c2b640 1 Processor -- start 2024-05-16T22:27:37.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.992+0000 7f2a13c2b640 1 -- start start 2024-05-16T22:27:37.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.993+0000 7f2a13c2b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a0c0b8a20 0x7f2a0c1d83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:37.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.993+0000 7f2a13c2b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a0c0bd770 0x7f2a0c146700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:37.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.993+0000 7f2a13c2b640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2a0c14e440 0x7f2a0c1d6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:37.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.993+0000 7f2a13c2b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2a0c0ba900 con 0x7f2a0c0bd770 2024-05-16T22:27:37.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.993+0000 7f2a13c2b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2a0c0ba780 con 0x7f2a0c0b8a20 2024-05-16T22:27:37.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.993+0000 7f2a13c2b640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f2a0c0bdb80 con 0x7f2a0c14e440 2024-05-16T22:27:37.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.993+0000 7f2a111c6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a0c0bd770 0x7f2a0c146700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:37.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.993+0000 7f2a111c6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a0c0bd770 0x7f2a0c146700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58474/0 (socket says 172.21.15.44:58474) 2024-05-16T22:27:37.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.993+0000 7f2a111c6640 1 -- 172.21.15.44:0/1322826640 learned_addr learned my addr 172.21.15.44:0/1322826640 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:37.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.993+0000 7f2a119c7640 1 --2- 172.21.15.44:0/1322826640 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a0c0b8a20 0x7f2a0c1d83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:37.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.993+0000 7f2a121c8640 1 --2- 172.21.15.44:0/1322826640 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2a0c14e440 0x7f2a0c1d6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:37.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.994+0000 7f2a111c6640 1 -- 172.21.15.44:0/1322826640 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2a0c14e440 msgr2=0x7f2a0c1d6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:37.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.994+0000 7f2a111c6640 1 --2- 172.21.15.44:0/1322826640 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2a0c14e440 0x7f2a0c1d6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:37.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.994+0000 7f2a111c6640 1 -- 172.21.15.44:0/1322826640 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a0c0b8a20 msgr2=0x7f2a0c1d83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:37.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.994+0000 7f2a111c6640 1 --2- 172.21.15.44:0/1322826640 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a0c0b8a20 0x7f2a0c1d83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:37.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.994+0000 7f2a111c6640 1 -- 172.21.15.44:0/1322826640 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a0c1d8910 con 0x7f2a0c0bd770 2024-05-16T22:27:37.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.994+0000 7f2a111c6640 1 --2- 172.21.15.44:0/1322826640 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a0c0bd770 0x7f2a0c146700 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2a00000c00 tx=0x7f2a000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:37.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.994+0000 7f2a0a7fc640 1 -- 172.21.15.44:0/1322826640 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a00037050 con 0x7f2a0c0bd770 2024-05-16T22:27:37.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.994+0000 7f2a0a7fc640 1 -- 172.21.15.44:0/1322826640 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a00038040 con 0x7f2a0c0bd770 2024-05-16T22:27:37.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.994+0000 7f2a13c2b640 1 -- 172.21.15.44:0/1322826640 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a0c1d8b20 con 0x7f2a0c0bd770 2024-05-16T22:27:37.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.994+0000 7f2a0a7fc640 1 -- 172.21.15.44:0/1322826640 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a00004450 con 0x7f2a0c0bd770 2024-05-16T22:27:37.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.994+0000 7f2a13c2b640 1 -- 172.21.15.44:0/1322826640 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a0c1db3e0 con 0x7f2a0c0bd770 2024-05-16T22:27:37.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.995+0000 7f2a13c2b640 1 -- 172.21.15.44:0/1322826640 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a0c050940 con 0x7f2a0c0bd770 2024-05-16T22:27:37.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.996+0000 7f2a0a7fc640 1 -- 172.21.15.44:0/1322826640 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2a0003c6d0 con 0x7f2a0c0bd770 2024-05-16T22:27:37.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.996+0000 7f2a0a7fc640 1 --2- 172.21.15.44:0/1322826640 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f29f8076300 0x7f29f8078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:37.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.996+0000 7f2a0a7fc640 1 -- 172.21.15.44:0/1322826640 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2a000b7c60 con 0x7f2a0c0bd770 2024-05-16T22:27:37.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.996+0000 7f2a119c7640 1 --2- 172.21.15.44:0/1322826640 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f29f8076300 0x7f29f8078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:37.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:37.997+0000 7f2a119c7640 1 --2- 172.21.15.44:0/1322826640 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f29f8076300 0x7f29f8078810 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c0a9720 tx=0x7f2a04009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:38.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:38.001+0000 7f2a0a7fc640 1 -- 172.21.15.44:0/1322826640 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2a00081000 con 0x7f2a0c0bd770 2024-05-16T22:27:38.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:38.231+0000 7f2a13c2b640 1 -- 172.21.15.44:0/1322826640 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2a0c1d98a0 con 0x7f2a0c0bd770 2024-05-16T22:27:38.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:38.231+0000 7f2a0a7fc640 1 -- 172.21.15.44:0/1322826640 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7f2a00085300 con 0x7f2a0c0bd770 2024-05-16T22:27:38.231 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-16T22:27:38.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:38.233+0000 7f2a13c2b640 1 -- 172.21.15.44:0/1322826640 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f29f8076300 msgr2=0x7f29f8078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:38.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:38.233+0000 7f2a13c2b640 1 --2- 172.21.15.44:0/1322826640 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f29f8076300 0x7f29f8078810 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c0a9720 tx=0x7f2a04009190 comp rx=0 tx=0).stop 2024-05-16T22:27:38.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:38.233+0000 7f2a13c2b640 1 -- 172.21.15.44:0/1322826640 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a0c0bd770 msgr2=0x7f2a0c146700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:38.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:38.233+0000 7f2a13c2b640 1 --2- 172.21.15.44:0/1322826640 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a0c0bd770 0x7f2a0c146700 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2a00000c00 tx=0x7f2a000046c0 comp rx=0 tx=0).stop 2024-05-16T22:27:38.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:38.233+0000 7f2a13c2b640 1 -- 172.21.15.44:0/1322826640 shutdown_connections 2024-05-16T22:27:38.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:38.234+0000 7f2a13c2b640 1 --2- 172.21.15.44:0/1322826640 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f29f8076300 0x7f29f8078810 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:38.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:38.234+0000 7f2a13c2b640 1 --2- 172.21.15.44:0/1322826640 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2a0c14e440 0x7f2a0c1d6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:38.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:38.234+0000 7f2a13c2b640 1 --2- 172.21.15.44:0/1322826640 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a0c0bd770 0x7f2a0c146700 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:38.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:38.234+0000 7f2a13c2b640 1 --2- 172.21.15.44:0/1322826640 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a0c0b8a20 0x7f2a0c1d83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:38.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:38.234+0000 7f2a13c2b640 1 -- 172.21.15.44:0/1322826640 >> 172.21.15.44:0/1322826640 conn(0x7f2a0c0c0390 msgr2=0x7f2a0c0c07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:38.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:38.234+0000 7f2a13c2b640 1 -- 172.21.15.44:0/1322826640 shutdown_connections 2024-05-16T22:27:38.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:38.234+0000 7f2a13c2b640 1 -- 172.21.15.44:0/1322826640 wait complete. 2024-05-16T22:27:38.244 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-16T22:27:38.244 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-16T22:27:38.244 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi196.front.sepia.ceph.com 2024-05-16T22:27:38.244 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-16T22:27:38.244 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-16T22:27:38.244 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-16T22:27:38.244 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-16T22:27:38.244 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-16T22:27:38.244 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-16T22:27:38.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T22:27:38.245 DEBUG:teuthology.orchestra.run.smithi196:> ip addr 2024-05-16T22:27:38.302 INFO:teuthology.orchestra.run.smithi196.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-16T22:27:38.302 INFO:teuthology.orchestra.run.smithi196.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-16T22:27:38.302 INFO:teuthology.orchestra.run.smithi196.stdout: inet 127.0.0.1/8 scope host lo 2024-05-16T22:27:38.302 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2024-05-16T22:27:38.302 INFO:teuthology.orchestra.run.smithi196.stdout: inet6 ::1/128 scope host 2024-05-16T22:27:38.302 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2024-05-16T22:27:38.303 INFO:teuthology.orchestra.run.smithi196.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-16T22:27:38.303 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 0c:c4:7a:d9:38:be brd ff:ff:ff:ff:ff:ff 2024-05-16T22:27:38.303 INFO:teuthology.orchestra.run.smithi196.stdout: altname enp7s0f0 2024-05-16T22:27:38.303 INFO:teuthology.orchestra.run.smithi196.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-16T22:27:38.303 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 0c:c4:7a:d9:38:bf brd ff:ff:ff:ff:ff:ff 2024-05-16T22:27:38.303 INFO:teuthology.orchestra.run.smithi196.stdout: altname enp7s0f1 2024-05-16T22:27:38.303 INFO:teuthology.orchestra.run.smithi196.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-16T22:27:38.303 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 0c:c4:7a:88:7f:46 brd ff:ff:ff:ff:ff:ff 2024-05-16T22:27:38.303 INFO:teuthology.orchestra.run.smithi196.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-16T22:27:38.303 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 0c:c4:7a:88:7f:47 brd ff:ff:ff:ff:ff:ff 2024-05-16T22:27:38.303 INFO:teuthology.orchestra.run.smithi196.stdout: inet 172.21.15.196/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-16T22:27:38.303 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft 42633sec preferred_lft 42633sec 2024-05-16T22:27:38.303 INFO:teuthology.orchestra.run.smithi196.stdout: inet6 fe80::ec4:7aff:fe88:7f47/64 scope link 2024-05-16T22:27:38.303 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2024-05-16T22:27:38.304 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-16T22:27:38.305 DEBUG:teuthology.orchestra.run.smithi196:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-16T22:27:38.305 DEBUG:teuthology.orchestra.run.smithi196:> set -e 2024-05-16T22:27:38.305 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link add name ceph-brx type bridge 2024-05-16T22:27:38.305 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip addr flush dev ceph-brx 2024-05-16T22:27:38.305 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link set ceph-brx up 2024-05-16T22:27:38.305 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-16T22:27:38.305 DEBUG:teuthology.orchestra.run.smithi196:> ') 2024-05-16T22:27:38.409 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:27:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-16T22:27:38.779 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:27:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T22:27:38.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T22:27:38.793 DEBUG:teuthology.orchestra.run.smithi196:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-16T22:27:38.856 INFO:teuthology.orchestra.run.smithi196.stdout:1 2024-05-16T22:27:38.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T22:27:38.860 DEBUG:teuthology.orchestra.run.smithi196:> route 2024-05-16T22:27:38.911 INFO:teuthology.orchestra.run.smithi196.stdout:Kernel IP routing table 2024-05-16T22:27:38.911 INFO:teuthology.orchestra.run.smithi196.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-16T22:27:38.911 INFO:teuthology.orchestra.run.smithi196.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-16T22:27:38.911 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-16T22:27:38.911 INFO:teuthology.orchestra.run.smithi196.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-16T22:27:38.912 DEBUG:teuthology.orchestra.run.smithi196:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-16T22:27:38.912 DEBUG:teuthology.orchestra.run.smithi196:> set -e 2024-05-16T22:27:38.912 DEBUG:teuthology.orchestra.run.smithi196:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-16T22:27:38.912 DEBUG:teuthology.orchestra.run.smithi196:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-16T22:27:38.912 DEBUG:teuthology.orchestra.run.smithi196:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-16T22:27:38.912 DEBUG:teuthology.orchestra.run.smithi196:> ') 2024-05-16T22:27:38.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:27:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-16T22:27:39.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:27:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T22:27:39.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T22:27:39.592 DEBUG:teuthology.orchestra.run.smithi196:> ip netns list 2024-05-16T22:27:39.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T22:27:39.638 DEBUG:teuthology.orchestra.run.smithi196:> ip netns list-id 2024-05-16T22:27:39.727 DEBUG:teuthology.orchestra.run.smithi196:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-16T22:27:39.727 DEBUG:teuthology.orchestra.run.smithi196:> set -e 2024-05-16T22:27:39.727 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-16T22:27:39.727 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-16T22:27:39.727 DEBUG:teuthology.orchestra.run.smithi196:> ') 2024-05-16T22:27:39.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:27:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-16T22:27:39.880 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:27:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T22:27:39.889 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-16T22:27:39.889 DEBUG:teuthology.orchestra.run.smithi196:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-16T22:27:39.889 DEBUG:teuthology.orchestra.run.smithi196:> set -e 2024-05-16T22:27:39.889 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-16T22:27:39.889 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-16T22:27:39.889 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-16T22:27:39.889 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-16T22:27:39.889 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-16T22:27:39.889 DEBUG:teuthology.orchestra.run.smithi196:> ') 2024-05-16T22:27:39.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:27:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-16T22:27:40.165 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:27:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T22:27:40.177 DEBUG:teuthology.orchestra.run.smithi196:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-16T22:27:40.177 DEBUG:teuthology.orchestra.run.smithi196:> set -e 2024-05-16T22:27:40.177 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link set brx.0 up 2024-05-16T22:27:40.177 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link set dev brx.0 master ceph-brx 2024-05-16T22:27:40.177 DEBUG:teuthology.orchestra.run.smithi196:> ') 2024-05-16T22:27:40.264 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:27:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-16T22:27:40.352 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:27:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T22:27:40.361 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-16T22:27:40.361 DEBUG:teuthology.orchestra.run.smithi196:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-16T22:27:40.401 INFO:teuthology.orchestra.run.smithi196.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-16T22:27:40.402 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-16T22:27:40.402 DEBUG:teuthology.orchestra.run.smithi196:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-16T22:27:40.492 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-16T22:27:40.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T22:27:40.493 DEBUG:teuthology.orchestra.run.smithi196:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-16T22:27:40.710 INFO:teuthology.orchestra.run.smithi196.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-16T22:27:40.710 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-16T22:27:40.710 INFO:teuthology.orchestra.run.smithi196.stdout:invalid new device string format 2024-05-16T22:27:41.459 INFO:teuthology.orchestra.run.smithi196.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-16T22:27:41.459 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-16T22:27:41.459 INFO:teuthology.orchestra.run.smithi196.stdout:invalid new device string format 2024-05-16T22:27:41.459 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.70:3300,172.21.15.70:3301" 2024-05-16T22:27:41.459 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-16T22:27:41.509 INFO:teuthology.orchestra.run.smithi196.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-16T22:27:41.509 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-16T22:27:41.509 INFO:teuthology.orchestra.run.smithi196.stdout:invalid new device string format 2024-05-16T22:27:41.509 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.70:3300,172.21.15.70:3301" 2024-05-16T22:27:41.510 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-16T22:27:41.510 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: resolved to: "172.21.15.44:6789,172.21.15.70:6789,172.21.15.70:6790" 2024-05-16T22:27:41.510 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.44:6789,172.21.15.70:6789,172.21.15.70:6790:/ 2024-05-16T22:27:41.510 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=572ab7cc-b103-4548-ae8f-c6614d57f0c8" will pass to kernel 2024-05-16T22:27:41.514 INFO:teuthology.orchestra.run.smithi196.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-16T22:27:41.514 INFO:teuthology.orchestra.run.smithi196.stdout: You just mounted a file system that supports labels which does not 2024-05-16T22:27:41.515 INFO:teuthology.orchestra.run.smithi196.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-16T22:27:41.515 INFO:teuthology.orchestra.run.smithi196.stdout: applications will generate AVC messages and not be allowed access to 2024-05-16T22:27:41.515 INFO:teuthology.orchestra.run.smithi196.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-16T22:27:41.520 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-16T22:27:41.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T22:27:41.520 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-16T22:27:41.604 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-16T22:27:41.716 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:27:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T22:27:41.728 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:27:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T22:27:41.737 INFO:teuthology.orchestra.run.smithi196.stdout:client4466 2024-05-16T22:27:41.738 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-16T22:27:41.738 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-16T22:27:41.785 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-16T22:27:41.944 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:27:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T22:27:41.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:27:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T22:27:41.966 INFO:teuthology.orchestra.run.smithi196.stdout:client4466 2024-05-16T22:27:41.967 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-16T22:27:42.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:27:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T22:27:42.091 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:27:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T22:27:42.100 INFO:teuthology.orchestra.run.smithi196.stdout:client4466 2024-05-16T22:27:42.100 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/572ab7cc-b103-4548-ae8f-c6614d57f0c8.client4466/status') 2024-05-16T22:27:42.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:27:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-16T22:27:42.246 INFO:teuthology.orchestra.run.smithi196.stdout:instance: client.4466 (3)172.21.15.196:0/2041107630 2024-05-16T22:27:42.246 INFO:teuthology.orchestra.run.smithi196.stdout:blocklisted: false 2024-05-16T22:27:42.246 INFO:teuthology.orchestra.run.smithi196.stderr:0+1 records in 2024-05-16T22:27:42.246 INFO:teuthology.orchestra.run.smithi196.stderr:0+1 records out 2024-05-16T22:27:42.246 INFO:teuthology.orchestra.run.smithi196.stderr:71 bytes copied, 8.2831e-05 s, 857 kB/s 2024-05-16T22:27:42.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:27:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T22:27:42.259 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-05-16T22:27:42.268 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-05-16T22:27:42.314 INFO:tasks.cephfs_test_runner:Starting test: test_fscrypt_basic_mount (tasks.cephfs.test_fscrypt.TestFSCrypt) That fscrypt can be setup and ingest files. 2024-05-16T22:27:42.314 INFO:tasks.cephfs_test_runner:test_fscrypt_basic_mount (tasks.cephfs.test_fscrypt.TestFSCrypt) 2024-05-16T22:27:42.314 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-16T22:27:42.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.440+0000 7f18fb025640 1 Processor -- start 2024-05-16T22:27:42.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.440+0000 7f18fb025640 1 -- start start 2024-05-16T22:27:42.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.441+0000 7f18fb025640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f18f40bdc50 0x7f18f4070a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:42.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.441+0000 7f18fb025640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f18f4146510 0x7f18f414f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:42.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.441+0000 7f18fb025640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18f4071020 con 0x7f18f40721a0 2024-05-16T22:27:42.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.441+0000 7f18fb025640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f18f40bc740 con 0x7f18f40bdc50 2024-05-16T22:27:42.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.441+0000 7f18fb025640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f18f40bca20 con 0x7f18f4146510 2024-05-16T22:27:42.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.441+0000 7f18f95c2640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f18f40721a0 0x7f18f414c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:47120/0 (socket says 172.21.15.44:47120) 2024-05-16T22:27:42.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.441+0000 7f18f95c2640 1 -- 172.21.15.44:0/1113704351 learned_addr learned my addr 172.21.15.44:0/1113704351 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:27:42.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.442+0000 7f18f3fff640 1 --2- 172.21.15.44:0/1113704351 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f18f4146510 0x7f18f414f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:42.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.442+0000 7f18f8dc1640 1 --2- 172.21.15.44:0/1113704351 >> v2:172.21.15.70:3300/0 conn(0x7f18f40bdc50 0x7f18f4070a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:42.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.442+0000 7f18f37fe640 1 -- 172.21.15.44:0/1113704351 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4130701376 0 0) 0x7f18ec001490 con 0x7f18f40721a0 2024-05-16T22:27:42.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.442+0000 7f18f37fe640 1 -- 172.21.15.44:0/1113704351 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18dc003520 con 0x7f18f40721a0 2024-05-16T22:27:42.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.442+0000 7f18f3fff640 1 -- 172.21.15.44:0/1113704351 >> v2:172.21.15.70:3300/0 conn(0x7f18f40bdc50 msgr2=0x7f18f4070a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:42.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.442+0000 7f18f3fff640 1 --2- 172.21.15.44:0/1113704351 >> v2:172.21.15.70:3300/0 conn(0x7f18f40bdc50 0x7f18f4070a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:42.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.442+0000 7f18f3fff640 1 -- 172.21.15.44:0/1113704351 >> v1:172.21.15.44:6789/0 conn(0x7f18f40721a0 legacy=0x7f18f414c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:42.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.442+0000 7f18f3fff640 1 -- 172.21.15.44:0/1113704351 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18f40bd5f0 con 0x7f18f4146510 2024-05-16T22:27:42.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.442+0000 7f18f8dc1640 1 --2- 172.21.15.44:0/1113704351 >> v2:172.21.15.70:3300/0 conn(0x7f18f40bdc50 0x7f18f4070a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:27:42.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.443+0000 7f18f3fff640 1 --2- 172.21.15.44:0/1113704351 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f18f4146510 0x7f18f414f7f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f18e80097a0 tx=0x7f18e802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42889bcf233941ae server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:42.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.443+0000 7f18f37fe640 1 -- 172.21.15.44:0/1113704351 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e8037070 con 0x7f18f4146510 2024-05-16T22:27:42.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.443+0000 7f18f37fe640 1 -- 172.21.15.44:0/1113704351 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18e8032440 con 0x7f18f4146510 2024-05-16T22:27:42.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.443+0000 7f18f37fe640 1 -- 172.21.15.44:0/1113704351 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e80327f0 con 0x7f18f4146510 2024-05-16T22:27:42.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.444+0000 7f18fb025640 1 -- 172.21.15.44:0/1113704351 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f18f4146510 msgr2=0x7f18f414f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:42.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.444+0000 7f18fb025640 1 --2- 172.21.15.44:0/1113704351 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f18f4146510 0x7f18f414f7f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f18e80097a0 tx=0x7f18e802a180 comp rx=0 tx=0).stop 2024-05-16T22:27:42.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.444+0000 7f18fb025640 1 -- 172.21.15.44:0/1113704351 shutdown_connections 2024-05-16T22:27:42.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.444+0000 7f18fb025640 1 --2- 172.21.15.44:0/1113704351 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f18f4146510 0x7f18f414f7f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:42.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.444+0000 7f18fb025640 1 --2- 172.21.15.44:0/1113704351 >> v2:172.21.15.70:3300/0 conn(0x7f18f40bdc50 0x7f18f4070a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:42.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.444+0000 7f18fb025640 1 -- 172.21.15.44:0/1113704351 >> 172.21.15.44:0/1113704351 conn(0x7f18f406c6e0 msgr2=0x7f18f406caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:42.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.444+0000 7f18fb025640 1 -- 172.21.15.44:0/1113704351 shutdown_connections 2024-05-16T22:27:42.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.444+0000 7f18fb025640 1 -- 172.21.15.44:0/1113704351 wait complete. 2024-05-16T22:27:42.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.445+0000 7f18fb025640 1 Processor -- start 2024-05-16T22:27:42.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.445+0000 7f18fb025640 1 -- start start 2024-05-16T22:27:42.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.447+0000 7f18fb025640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18f40721a0 0x7f18f41d7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:42.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.447+0000 7f18fb025640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18f40bdc50 0x7f18f41e5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:42.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.447+0000 7f18fb025640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f18f4146510 0x7f18f4146bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:42.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.447+0000 7f18fb025640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f18f414fd30 con 0x7f18f40721a0 2024-05-16T22:27:42.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.447+0000 7f18fb025640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f18f40bd220 con 0x7f18f40bdc50 2024-05-16T22:27:42.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.447+0000 7f18fb025640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f18f414feb0 con 0x7f18f4146510 2024-05-16T22:27:42.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.447+0000 7f18f8dc1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18f40721a0 0x7f18f41d7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:42.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.447+0000 7f18f8dc1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18f40721a0 0x7f18f41d7d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44168/0 (socket says 172.21.15.44:44168) 2024-05-16T22:27:42.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.447+0000 7f18f8dc1640 1 -- 172.21.15.44:0/3030769785 learned_addr learned my addr 172.21.15.44:0/3030769785 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:42.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.447+0000 7f18f3fff640 1 --2- 172.21.15.44:0/3030769785 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18f40bdc50 0x7f18f41e5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:42.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.447+0000 7f18f95c2640 1 --2- 172.21.15.44:0/3030769785 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f18f4146510 0x7f18f4146bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:42.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.447+0000 7f18f8dc1640 1 -- 172.21.15.44:0/3030769785 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f18f4146510 msgr2=0x7f18f4146bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:42.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.447+0000 7f18f8dc1640 1 --2- 172.21.15.44:0/3030769785 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f18f4146510 0x7f18f4146bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:42.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.447+0000 7f18f8dc1640 1 -- 172.21.15.44:0/3030769785 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18f40bdc50 msgr2=0x7f18f41e5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:42.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.447+0000 7f18f8dc1640 1 --2- 172.21.15.44:0/3030769785 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18f40bdc50 0x7f18f41e5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:42.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.447+0000 7f18f8dc1640 1 -- 172.21.15.44:0/3030769785 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18f41e61f0 con 0x7f18f40721a0 2024-05-16T22:27:42.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.447+0000 7f18f8dc1640 1 --2- 172.21.15.44:0/3030769785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18f40721a0 0x7f18f41d7d60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f18e400e960 tx=0x7f18e400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:42.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.447+0000 7f18f17fa640 1 -- 172.21.15.44:0/3030769785 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e4017070 con 0x7f18f40721a0 2024-05-16T22:27:42.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.447+0000 7f18f17fa640 1 -- 172.21.15.44:0/3030769785 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18e400ca00 con 0x7f18f40721a0 2024-05-16T22:27:42.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.447+0000 7f18fb025640 1 -- 172.21.15.44:0/3030769785 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18f4148dd0 con 0x7f18f40721a0 2024-05-16T22:27:42.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.448+0000 7f18f17fa640 1 -- 172.21.15.44:0/3030769785 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e400cdd0 con 0x7f18f40721a0 2024-05-16T22:27:42.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.448+0000 7f18fb025640 1 -- 172.21.15.44:0/3030769785 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18f4149390 con 0x7f18f40721a0 2024-05-16T22:27:42.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.449+0000 7f18fb025640 1 -- 172.21.15.44:0/3030769785 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18f4050940 con 0x7f18f40721a0 2024-05-16T22:27:42.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.449+0000 7f18f17fa640 1 -- 172.21.15.44:0/3030769785 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f18e401a070 con 0x7f18f40721a0 2024-05-16T22:27:42.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.450+0000 7f18f17fa640 1 --2- 172.21.15.44:0/3030769785 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f18e00762d0 0x7f18e00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:42.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.450+0000 7f18f17fa640 1 -- 172.21.15.44:0/3030769785 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f18e4097890 con 0x7f18f40721a0 2024-05-16T22:27:42.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.450+0000 7f18f3fff640 1 --2- 172.21.15.44:0/3030769785 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f18e00762d0 0x7f18e00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:42.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.451+0000 7f18f3fff640 1 --2- 172.21.15.44:0/3030769785 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f18e00762d0 0x7f18e00787e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f18e8034000 tx=0x7f18e802e000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:42.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.455+0000 7f18f17fa640 1 -- 172.21.15.44:0/3030769785 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f18e4060b10 con 0x7f18f40721a0 2024-05-16T22:27:42.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.645+0000 7f18fb025640 1 -- 172.21.15.44:0/3030769785 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f18f40bc380 con 0x7f18f40721a0 2024-05-16T22:27:42.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.646+0000 7f18f17fa640 1 -- 172.21.15.44:0/3030769785 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16569 (secure 0 0 0) 0x7f18e4064e10 con 0x7f18f40721a0 2024-05-16T22:27:42.646 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:27:42.646 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":21,"fsid":"572ab7cc-b103-4548-ae8f-c6614d57f0c8","created":"2024-05-16T22:27:02.216874+0000","modified":"2024-05-16T22:27:27.151884+0000","last_up_change":"2024-05-16T22:27:13.693953+0000","last_in_change":"2024-05-16T22:27:04.455119+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-16T22:27:14.562409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-16T22:27:23.458618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-16T22:27:24.495231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a7003e89-c706-4562-9f25-670bb35ae108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6825","nonce":1074109859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6827","nonce":1074109859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6831","nonce":1074109859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6829","nonce":1074109859}]},"public_addr":"172.21.15.44:6825/1074109859","cluster_addr":"172.21.15.44:6827/1074109859","heartbeat_back_addr":"172.21.15.44:6831/1074109859","heartbeat_front_addr":"172.21.15.44:6829/1074109859","state":["exists","up"]},{"osd":1,"uuid":"a4d5169d-8327-4494-9c7c-58db21b00636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6817","nonce":2909429972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6819","nonce":2909429972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6823","nonce":2909429972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6821","nonce":2909429972}]},"public_addr":"172.21.15.44:6817/2909429972","cluster_addr":"172.21.15.44:6819/2909429972","heartbeat_back_addr":"172.21.15.44:6823/2909429972","heartbeat_front_addr":"172.21.15.44:6821/2909429972","state":["exists","up"]},{"osd":2,"uuid":"d4a834f8-83a5-400f-9814-eb0a25124df4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6801","nonce":2908194156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6803","nonce":2908194156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6807","nonce":2908194156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6805","nonce":2908194156}]},"public_addr":"172.21.15.44:6801/2908194156","cluster_addr":"172.21.15.44:6803/2908194156","heartbeat_back_addr":"172.21.15.44:6807/2908194156","heartbeat_front_addr":"172.21.15.44:6805/2908194156","state":["exists","up"]},{"osd":3,"uuid":"b9d24a56-ad43-4674-a395-5ec24d135ae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6809","nonce":2168695793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6811","nonce":2168695793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6815","nonce":2168695793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6813","nonce":2168695793}]},"public_addr":"172.21.15.44:6809/2168695793","cluster_addr":"172.21.15.44:6811/2168695793","heartbeat_back_addr":"172.21.15.44:6815/2168695793","heartbeat_front_addr":"172.21.15.44:6813/2168695793","state":["exists","up"]},{"osd":4,"uuid":"9bd94af5-3e17-4cbe-995a-8f837a66c653","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6823","nonce":1540297751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6825","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6827","nonce":1540297751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6831","nonce":1540297751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6829","nonce":1540297751}]},"public_addr":"172.21.15.70:6823/1540297751","cluster_addr":"172.21.15.70:6827/1540297751","heartbeat_back_addr":"172.21.15.70:6831/1540297751","heartbeat_front_addr":"172.21.15.70:6829/1540297751","state":["exists","up"]},{"osd":5,"uuid":"a5b0cfa5-b259-48bd-98b6-96b44f5ebabd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6804","nonce":4218901987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6808","nonce":4218901987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6815","nonce":4218901987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6812","nonce":4218901987}]},"public_addr":"172.21.15.70:6804/4218901987","cluster_addr":"172.21.15.70:6808/4218901987","heartbeat_back_addr":"172.21.15.70:6815/4218901987","heartbeat_front_addr":"172.21.15.70:6812/4218901987","state":["exists","up"]},{"osd":6,"uuid":"0b6af6df-1358-4fc6-a62c-ba57e02914ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6801","nonce":2389556489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6805","nonce":2389556489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6813","nonce":2389556489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6807","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6809","nonce":2389556489}]},"public_addr":"172.21.15.70:6801/2389556489","cluster_addr":"172.21.15.70:6805/2389556489","heartbeat_back_addr":"172.21.15.70:6813/2389556489","heartbeat_front_addr":"172.21.15.70:6809/2389556489","state":["exists","up"]},{"osd":7,"uuid":"eb1a2c5d-42cf-47d0-9e03-b9d26944a589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6817","nonce":3619691281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6819","nonce":3619691281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6826","nonce":3619691281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6822","nonce":3619691281}]},"public_addr":"172.21.15.70:6817/3619691281","cluster_addr":"172.21.15.70:6819/3619691281","heartbeat_back_addr":"172.21.15.70:6826/3619691281","heartbeat_front_addr":"172.21.15.70:6822/3619691281","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.652256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.613348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.528454+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.625204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.678845+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.680829+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.556200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.647030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T22:27:42.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.648+0000 7f18fb025640 1 -- 172.21.15.44:0/3030769785 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f18e00762d0 msgr2=0x7f18e00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:42.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.648+0000 7f18fb025640 1 --2- 172.21.15.44:0/3030769785 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f18e00762d0 0x7f18e00787e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f18e8034000 tx=0x7f18e802e000 comp rx=0 tx=0).stop 2024-05-16T22:27:42.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.648+0000 7f18fb025640 1 -- 172.21.15.44:0/3030769785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18f40721a0 msgr2=0x7f18f41d7d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:42.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.648+0000 7f18fb025640 1 --2- 172.21.15.44:0/3030769785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18f40721a0 0x7f18f41d7d60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f18e400e960 tx=0x7f18e400ee20 comp rx=0 tx=0).stop 2024-05-16T22:27:42.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.648+0000 7f18fb025640 1 -- 172.21.15.44:0/3030769785 shutdown_connections 2024-05-16T22:27:42.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.648+0000 7f18fb025640 1 --2- 172.21.15.44:0/3030769785 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f18e00762d0 0x7f18e00787e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:42.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.648+0000 7f18fb025640 1 --2- 172.21.15.44:0/3030769785 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f18f4146510 0x7f18f4146bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:42.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.648+0000 7f18fb025640 1 --2- 172.21.15.44:0/3030769785 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18f40bdc50 0x7f18f41e5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:42.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.648+0000 7f18fb025640 1 --2- 172.21.15.44:0/3030769785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18f40721a0 0x7f18f41d7d60 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:42.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.648+0000 7f18fb025640 1 -- 172.21.15.44:0/3030769785 >> 172.21.15.44:0/3030769785 conn(0x7f18f406c6e0 msgr2=0x7f18f4145cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:42.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.648+0000 7f18fb025640 1 -- 172.21.15.44:0/3030769785 shutdown_connections 2024-05-16T22:27:42.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.648+0000 7f18fb025640 1 -- 172.21.15.44:0/3030769785 wait complete. 2024-05-16T22:27:42.659 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-16T22:27:14.562409+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-16T22:27:23.458618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-16T22:27:24.495231+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-16T22:27:42.659 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-16T22:27:42.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.774+0000 7f5653496640 1 Processor -- start 2024-05-16T22:27:42.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.774+0000 7f5653496640 1 -- start start 2024-05-16T22:27:42.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.775+0000 7f5653496640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f564c0bd6d0 0x7f564c0be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:42.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.775+0000 7f5653496640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f564c06e140 con 0x7f564c151fc0 2024-05-16T22:27:42.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.775+0000 7f5653496640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f564c0c36f0 con 0x7f564c0bee80 2024-05-16T22:27:42.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.775+0000 7f5653496640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f564c152530 con 0x7f564c0bd6d0 2024-05-16T22:27:42.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.775+0000 7f5651232640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f564c151fc0 0x7f564c06da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:47134/0 (socket says 172.21.15.44:47134) 2024-05-16T22:27:42.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.775+0000 7f5651232640 1 -- 172.21.15.44:0/3799879257 learned_addr learned my addr 172.21.15.44:0/3799879257 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:27:42.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.775+0000 7f5650a31640 1 --2- 172.21.15.44:0/3799879257 >> v2:172.21.15.70:3300/0 conn(0x7f564c0bd6d0 0x7f564c0be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:42.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.775+0000 7f5643fff640 1 -- 172.21.15.44:0/3799879257 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 130743699 0 0) 0x7f5648001110 con 0x7f564c151fc0 2024-05-16T22:27:42.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.776+0000 7f5643fff640 1 -- 172.21.15.44:0/3799879257 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5638003520 con 0x7f564c151fc0 2024-05-16T22:27:42.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.776+0000 7f5643fff640 1 -- 172.21.15.44:0/3799879257 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2888590205 0 0) 0x7f5638003520 con 0x7f564c151fc0 2024-05-16T22:27:42.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.776+0000 7f5650a31640 1 -- 172.21.15.44:0/3799879257 >> v1:172.21.15.70:6789/0 conn(0x7f564c0bee80 legacy=0x7f564c158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:42.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.776+0000 7f5650a31640 1 -- 172.21.15.44:0/3799879257 >> v1:172.21.15.44:6789/0 conn(0x7f564c151fc0 legacy=0x7f564c06da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:42.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.776+0000 7f5650a31640 1 -- 172.21.15.44:0/3799879257 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f564c152810 con 0x7f564c0bd6d0 2024-05-16T22:27:42.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.777+0000 7f5650a31640 1 --2- 172.21.15.44:0/3799879257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f564c0bd6d0 0x7f564c0be940 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f563c0097a0 tx=0x7f563c02a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a06f382f4a0c5fe server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:42.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.777+0000 7f5643fff640 1 -- 172.21.15.44:0/3799879257 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f563c037070 con 0x7f564c0bd6d0 2024-05-16T22:27:42.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.777+0000 7f5643fff640 1 -- 172.21.15.44:0/3799879257 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f563c02aad0 con 0x7f564c0bd6d0 2024-05-16T22:27:42.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.777+0000 7f5643fff640 1 -- 172.21.15.44:0/3799879257 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56480018e0 con 0x7f564c0bd6d0 2024-05-16T22:27:42.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.777+0000 7f5653496640 1 -- 172.21.15.44:0/3799879257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f564c0bd6d0 msgr2=0x7f564c0be940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:42.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.777+0000 7f5653496640 1 --2- 172.21.15.44:0/3799879257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f564c0bd6d0 0x7f564c0be940 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f563c0097a0 tx=0x7f563c02a040 comp rx=0 tx=0).stop 2024-05-16T22:27:42.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.777+0000 7f5653496640 1 -- 172.21.15.44:0/3799879257 shutdown_connections 2024-05-16T22:27:42.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.777+0000 7f5653496640 1 --2- 172.21.15.44:0/3799879257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f564c0bd6d0 0x7f564c0be940 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:42.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.777+0000 7f5653496640 1 -- 172.21.15.44:0/3799879257 >> 172.21.15.44:0/3799879257 conn(0x7f564c0c3d20 msgr2=0x7f564c0c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:42.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.778+0000 7f5653496640 1 -- 172.21.15.44:0/3799879257 shutdown_connections 2024-05-16T22:27:42.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.778+0000 7f5653496640 1 -- 172.21.15.44:0/3799879257 wait complete. 2024-05-16T22:27:42.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.779+0000 7f5653496640 1 Processor -- start 2024-05-16T22:27:42.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.779+0000 7f5653496640 1 -- start start 2024-05-16T22:27:42.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.780+0000 7f5653496640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f564c0bd6d0 0x7f564c0b5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:42.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.780+0000 7f5653496640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f564c0bee80 0x7f564c150350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:42.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.780+0000 7f5653496640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f564c151fc0 0x7f564c1e4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:42.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.780+0000 7f5653496640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f564c0bdae0 con 0x7f564c0bd6d0 2024-05-16T22:27:42.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.780+0000 7f5653496640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f564c0c0070 con 0x7f564c0bee80 2024-05-16T22:27:42.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.780+0000 7f5653496640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f564c0a2ed0 con 0x7f564c151fc0 2024-05-16T22:27:42.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.780+0000 7f5651232640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f564c0bd6d0 0x7f564c0b5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:42.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.780+0000 7f5651232640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f564c0bd6d0 0x7f564c0b5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44174/0 (socket says 172.21.15.44:44174) 2024-05-16T22:27:42.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.780+0000 7f5651232640 1 -- 172.21.15.44:0/1580795533 learned_addr learned my addr 172.21.15.44:0/1580795533 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:42.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.780+0000 7f5650a31640 1 --2- 172.21.15.44:0/1580795533 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f564c0bee80 0x7f564c150350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:42.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.780+0000 7f5651a33640 1 --2- 172.21.15.44:0/1580795533 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f564c151fc0 0x7f564c1e4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:42.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.780+0000 7f5651232640 1 -- 172.21.15.44:0/1580795533 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f564c151fc0 msgr2=0x7f564c1e4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:42.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.780+0000 7f5651232640 1 --2- 172.21.15.44:0/1580795533 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f564c151fc0 0x7f564c1e4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:42.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.780+0000 7f5651232640 1 -- 172.21.15.44:0/1580795533 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f564c0bee80 msgr2=0x7f564c150350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:42.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.780+0000 7f5651232640 1 --2- 172.21.15.44:0/1580795533 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f564c0bee80 0x7f564c150350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:42.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.781+0000 7f5651232640 1 -- 172.21.15.44:0/1580795533 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f564c14f3b0 con 0x7f564c0bd6d0 2024-05-16T22:27:42.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.781+0000 7f5651232640 1 --2- 172.21.15.44:0/1580795533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f564c0bd6d0 0x7f564c0b5d50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f564800c440 tx=0x7f564800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:42.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.781+0000 7f5641ffb640 1 -- 172.21.15.44:0/1580795533 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5648018070 con 0x7f564c0bd6d0 2024-05-16T22:27:42.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.781+0000 7f5641ffb640 1 -- 172.21.15.44:0/1580795533 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5648007500 con 0x7f564c0bd6d0 2024-05-16T22:27:42.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.781+0000 7f5653496640 1 -- 172.21.15.44:0/1580795533 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f564c150890 con 0x7f564c0bd6d0 2024-05-16T22:27:42.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.781+0000 7f5641ffb640 1 -- 172.21.15.44:0/1580795533 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5648004a20 con 0x7f564c0bd6d0 2024-05-16T22:27:42.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.781+0000 7f5653496640 1 -- 172.21.15.44:0/1580795533 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f564c14f870 con 0x7f564c0bd6d0 2024-05-16T22:27:42.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.782+0000 7f5653496640 1 -- 172.21.15.44:0/1580795533 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f564c0b6960 con 0x7f564c0bd6d0 2024-05-16T22:27:42.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.783+0000 7f5641ffb640 1 -- 172.21.15.44:0/1580795533 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f564801b070 con 0x7f564c0bd6d0 2024-05-16T22:27:42.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.783+0000 7f5641ffb640 1 --2- 172.21.15.44:0/1580795533 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f56300762d0 0x7f56300787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:42.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.783+0000 7f5641ffb640 1 -- 172.21.15.44:0/1580795533 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5648096980 con 0x7f564c0bd6d0 2024-05-16T22:27:42.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.783+0000 7f5650a31640 1 --2- 172.21.15.44:0/1580795533 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f56300762d0 0x7f56300787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:42.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.784+0000 7f5650a31640 1 --2- 172.21.15.44:0/1580795533 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f56300762d0 0x7f56300787e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f563c034000 tx=0x7f563c02e000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:42.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.788+0000 7f5641ffb640 1 -- 172.21.15.44:0/1580795533 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f564c06e140 con 0x7f564c0bd6d0 2024-05-16T22:27:42.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.976+0000 7f5653496640 1 -- 172.21.15.44:0/1580795533 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f564c050940 con 0x7f564c0bd6d0 2024-05-16T22:27:42.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.977+0000 7f5641ffb640 1 -- 172.21.15.44:0/1580795533 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f5648060250 con 0x7f564c0bd6d0 2024-05-16T22:27:42.976 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-05-16T22:27:42.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.979+0000 7f5653496640 1 -- 172.21.15.44:0/1580795533 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f56300762d0 msgr2=0x7f56300787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:42.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.979+0000 7f5653496640 1 --2- 172.21.15.44:0/1580795533 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f56300762d0 0x7f56300787e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f563c034000 tx=0x7f563c02e000 comp rx=0 tx=0).stop 2024-05-16T22:27:42.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.979+0000 7f5653496640 1 -- 172.21.15.44:0/1580795533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f564c0bd6d0 msgr2=0x7f564c0b5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:42.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.979+0000 7f5653496640 1 --2- 172.21.15.44:0/1580795533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f564c0bd6d0 0x7f564c0b5d50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f564800c440 tx=0x7f564800c900 comp rx=0 tx=0).stop 2024-05-16T22:27:42.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.979+0000 7f5653496640 1 -- 172.21.15.44:0/1580795533 shutdown_connections 2024-05-16T22:27:42.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.979+0000 7f5653496640 1 --2- 172.21.15.44:0/1580795533 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f56300762d0 0x7f56300787e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:42.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.979+0000 7f5653496640 1 --2- 172.21.15.44:0/1580795533 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f564c151fc0 0x7f564c1e4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:42.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.979+0000 7f5653496640 1 --2- 172.21.15.44:0/1580795533 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f564c0bee80 0x7f564c150350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:42.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.979+0000 7f5653496640 1 --2- 172.21.15.44:0/1580795533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f564c0bd6d0 0x7f564c0b5d50 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:42.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.979+0000 7f5653496640 1 -- 172.21.15.44:0/1580795533 >> 172.21.15.44:0/1580795533 conn(0x7f564c0c3d20 msgr2=0x7f564c0a4910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:42.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.979+0000 7f5653496640 1 -- 172.21.15.44:0/1580795533 shutdown_connections 2024-05-16T22:27:42.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:42.979+0000 7f5653496640 1 -- 172.21.15.44:0/1580795533 wait complete. 2024-05-16T22:27:42.989 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-16T22:27:43.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.104+0000 7f07761a8640 1 Processor -- start 2024-05-16T22:27:43.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.104+0000 7f07761a8640 1 -- start start 2024-05-16T22:27:43.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.106+0000 7f07761a8640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f07700bd6d0 0x7f07700be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:43.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.106+0000 7f07761a8640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f07700bee80 0x7f0770158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:43.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.106+0000 7f07761a8640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f077006e140 con 0x7f0770151fc0 2024-05-16T22:27:43.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.106+0000 7f07761a8640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f07700c36f0 con 0x7f07700bd6d0 2024-05-16T22:27:43.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.106+0000 7f07761a8640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f0770152530 con 0x7f07700bee80 2024-05-16T22:27:43.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.106+0000 7f076effd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f07700bd6d0 0x7f07700be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:43.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.106+0000 7f076effd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f07700bd6d0 0x7f07700be940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44184/0 (socket says 172.21.15.44:44184) 2024-05-16T22:27:43.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.106+0000 7f076effd640 1 -- 172.21.15.44:0/950680823 learned_addr learned my addr 172.21.15.44:0/950680823 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:43.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.106+0000 7f076ffff640 1 --2- 172.21.15.44:0/950680823 >> v2:172.21.15.70:3300/0 conn(0x7f07700bee80 0x7f0770158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:43.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.106+0000 7f076effd640 1 -- 172.21.15.44:0/950680823 >> v2:172.21.15.70:3300/0 conn(0x7f07700bee80 msgr2=0x7f0770158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:43.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.106+0000 7f076effd640 1 --2- 172.21.15.44:0/950680823 >> v2:172.21.15.70:3300/0 conn(0x7f07700bee80 0x7f0770158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:43.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.106+0000 7f076effd640 1 -- 172.21.15.44:0/950680823 >> v1:172.21.15.70:6789/0 conn(0x7f0770151fc0 legacy=0x7f077006da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:43.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.106+0000 7f076effd640 1 -- 172.21.15.44:0/950680823 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0770152810 con 0x7f07700bd6d0 2024-05-16T22:27:43.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.107+0000 7f076effd640 1 --2- 172.21.15.44:0/950680823 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07700bd6d0 0x7f07700be940 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f07700bf8f0 tx=0x7f076402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e45a2cc726fe82e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:43.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.107+0000 7f076e7fc640 1 -- 172.21.15.44:0/950680823 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0764037070 con 0x7f07700bd6d0 2024-05-16T22:27:43.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.107+0000 7f076e7fc640 1 -- 172.21.15.44:0/950680823 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0764032440 con 0x7f07700bd6d0 2024-05-16T22:27:43.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.107+0000 7f076e7fc640 1 -- 172.21.15.44:0/950680823 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0764032810 con 0x7f07700bd6d0 2024-05-16T22:27:43.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.108+0000 7f07761a8640 1 -- 172.21.15.44:0/950680823 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07700bd6d0 msgr2=0x7f07700be940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:43.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.108+0000 7f07761a8640 1 --2- 172.21.15.44:0/950680823 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07700bd6d0 0x7f07700be940 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f07700bf8f0 tx=0x7f076402a1e0 comp rx=0 tx=0).stop 2024-05-16T22:27:43.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.108+0000 7f07761a8640 1 -- 172.21.15.44:0/950680823 shutdown_connections 2024-05-16T22:27:43.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.108+0000 7f07761a8640 1 --2- 172.21.15.44:0/950680823 >> v2:172.21.15.70:3300/0 conn(0x7f07700bee80 0x7f0770158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:43.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.108+0000 7f07761a8640 1 --2- 172.21.15.44:0/950680823 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07700bd6d0 0x7f07700be940 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:43.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.108+0000 7f07761a8640 1 -- 172.21.15.44:0/950680823 >> 172.21.15.44:0/950680823 conn(0x7f07700c3d20 msgr2=0x7f07700c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:43.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.108+0000 7f07761a8640 1 -- 172.21.15.44:0/950680823 shutdown_connections 2024-05-16T22:27:43.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.108+0000 7f07761a8640 1 -- 172.21.15.44:0/950680823 wait complete. 2024-05-16T22:27:43.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.109+0000 7f07761a8640 1 Processor -- start 2024-05-16T22:27:43.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.109+0000 7f07761a8640 1 -- start start 2024-05-16T22:27:43.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.110+0000 7f07761a8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07700bd6d0 0x7f07700b8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:43.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.110+0000 7f07761a8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07700bee80 0x7f07701e4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:43.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.110+0000 7f07761a8640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0770151fc0 0x7f077014b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:43.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.110+0000 7f07761a8640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f07700bdae0 con 0x7f07700bd6d0 2024-05-16T22:27:43.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.110+0000 7f07761a8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f07700c0070 con 0x7f07700bee80 2024-05-16T22:27:43.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.110+0000 7f07761a8640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f07700a2ed0 con 0x7f0770151fc0 2024-05-16T22:27:43.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.110+0000 7f076f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07700bd6d0 0x7f07700b8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:43.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.111+0000 7f076f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07700bd6d0 0x7f07700b8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44200/0 (socket says 172.21.15.44:44200) 2024-05-16T22:27:43.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.111+0000 7f076f7fe640 1 -- 172.21.15.44:0/24698497 learned_addr learned my addr 172.21.15.44:0/24698497 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:43.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.111+0000 7f076effd640 1 --2- 172.21.15.44:0/24698497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07700bee80 0x7f07701e4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:43.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.111+0000 7f076ffff640 1 --2- 172.21.15.44:0/24698497 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0770151fc0 0x7f077014b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:43.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.111+0000 7f076f7fe640 1 -- 172.21.15.44:0/24698497 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0770151fc0 msgr2=0x7f077014b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:43.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.111+0000 7f076f7fe640 1 --2- 172.21.15.44:0/24698497 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0770151fc0 0x7f077014b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:43.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.111+0000 7f076f7fe640 1 -- 172.21.15.44:0/24698497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07700bee80 msgr2=0x7f07701e4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:43.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.111+0000 7f076f7fe640 1 --2- 172.21.15.44:0/24698497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07700bee80 0x7f07701e4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:43.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.111+0000 7f076f7fe640 1 -- 172.21.15.44:0/24698497 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07700b90e0 con 0x7f07700bd6d0 2024-05-16T22:27:43.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.111+0000 7f076ffff640 1 --2- 172.21.15.44:0/24698497 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0770151fc0 0x7f077014b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:27:43.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.111+0000 7f076f7fe640 1 --2- 172.21.15.44:0/24698497 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07700bd6d0 0x7f07700b8ba0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f076000c3f0 tx=0x7f076000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:43.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.111+0000 7f0757fff640 1 -- 172.21.15.44:0/24698497 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0760017070 con 0x7f07700bd6d0 2024-05-16T22:27:43.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.111+0000 7f0757fff640 1 -- 172.21.15.44:0/24698497 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07600052f0 con 0x7f07700bd6d0 2024-05-16T22:27:43.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.111+0000 7f07761a8640 1 -- 172.21.15.44:0/24698497 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07700b8550 con 0x7f07700bd6d0 2024-05-16T22:27:43.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.111+0000 7f0757fff640 1 -- 172.21.15.44:0/24698497 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0760003850 con 0x7f07700bd6d0 2024-05-16T22:27:43.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.111+0000 7f07761a8640 1 -- 172.21.15.44:0/24698497 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07700b7560 con 0x7f07700bd6d0 2024-05-16T22:27:43.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.112+0000 7f07761a8640 1 -- 172.21.15.44:0/24698497 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0770050940 con 0x7f07700bd6d0 2024-05-16T22:27:43.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.113+0000 7f0757fff640 1 -- 172.21.15.44:0/24698497 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f076001a070 con 0x7f07700bd6d0 2024-05-16T22:27:43.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.113+0000 7f0757fff640 1 --2- 172.21.15.44:0/24698497 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f075c076300 0x7f075c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:43.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.114+0000 7f0757fff640 1 -- 172.21.15.44:0/24698497 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0760096820 con 0x7f07700bd6d0 2024-05-16T22:27:43.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.114+0000 7f076effd640 1 --2- 172.21.15.44:0/24698497 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f075c076300 0x7f075c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:43.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.114+0000 7f076effd640 1 --2- 172.21.15.44:0/24698497 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f075c076300 0x7f075c078810 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0764034000 tx=0x7f076402e000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:43.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.118+0000 7f0757fff640 1 -- 172.21.15.44:0/24698497 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f077006e140 con 0x7f07700bd6d0 2024-05-16T22:27:43.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.310+0000 7f07761a8640 1 -- 172.21.15.44:0/24698497 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f077006eb40 con 0x7f07700bd6d0 2024-05-16T22:27:43.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.311+0000 7f0757fff640 1 -- 172.21.15.44:0/24698497 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f076005fb20 con 0x7f07700bd6d0 2024-05-16T22:27:43.310 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-05-16T22:27:43.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.312+0000 7f07761a8640 1 -- 172.21.15.44:0/24698497 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f075c076300 msgr2=0x7f075c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:43.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.312+0000 7f07761a8640 1 --2- 172.21.15.44:0/24698497 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f075c076300 0x7f075c078810 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0764034000 tx=0x7f076402e000 comp rx=0 tx=0).stop 2024-05-16T22:27:43.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.312+0000 7f07761a8640 1 -- 172.21.15.44:0/24698497 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07700bd6d0 msgr2=0x7f07700b8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:43.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.312+0000 7f07761a8640 1 --2- 172.21.15.44:0/24698497 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07700bd6d0 0x7f07700b8ba0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f076000c3f0 tx=0x7f076000c8b0 comp rx=0 tx=0).stop 2024-05-16T22:27:43.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.313+0000 7f07761a8640 1 -- 172.21.15.44:0/24698497 shutdown_connections 2024-05-16T22:27:43.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.313+0000 7f07761a8640 1 --2- 172.21.15.44:0/24698497 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f075c076300 0x7f075c078810 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:43.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.313+0000 7f07761a8640 1 --2- 172.21.15.44:0/24698497 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0770151fc0 0x7f077014b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:43.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.313+0000 7f07761a8640 1 --2- 172.21.15.44:0/24698497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07700bee80 0x7f07701e4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:43.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.313+0000 7f07761a8640 1 --2- 172.21.15.44:0/24698497 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07700bd6d0 0x7f07700b8ba0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:43.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.313+0000 7f07761a8640 1 -- 172.21.15.44:0/24698497 >> 172.21.15.44:0/24698497 conn(0x7f07700c3d20 msgr2=0x7f07700a44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:43.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.313+0000 7f07761a8640 1 -- 172.21.15.44:0/24698497 shutdown_connections 2024-05-16T22:27:43.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.313+0000 7f07761a8640 1 -- 172.21.15.44:0/24698497 wait complete. 2024-05-16T22:27:43.323 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-16T22:27:43.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.438+0000 7f1be9005640 1 Processor -- start 2024-05-16T22:27:43.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.438+0000 7f1be9005640 1 -- start start 2024-05-16T22:27:43.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.439+0000 7f1be9005640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1be4151fc0 0x7f1be40bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:43.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.439+0000 7f1be9005640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1be40c36f0 con 0x7f1be40bf050 2024-05-16T22:27:43.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.439+0000 7f1be9005640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1be4152530 con 0x7f1be406da30 2024-05-16T22:27:43.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.439+0000 7f1be9005640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f1be40bdc10 con 0x7f1be4151fc0 2024-05-16T22:27:43.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.439+0000 7f1be359e640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f1be40bf050 0x7f1be4158e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:47140/0 (socket says 172.21.15.44:47140) 2024-05-16T22:27:43.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.439+0000 7f1be359e640 1 -- 172.21.15.44:0/3161321310 learned_addr learned my addr 172.21.15.44:0/3161321310 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:27:43.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.439+0000 7f1be2d9d640 1 --2- 172.21.15.44:0/3161321310 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1be4151fc0 0x7f1be40bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:43.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.439+0000 7f1be1d9b640 1 -- 172.21.15.44:0/3161321310 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2614180818 0 0) 0x7f1be40c36f0 con 0x7f1be40bf050 2024-05-16T22:27:43.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.440+0000 7f1be1d9b640 1 -- 172.21.15.44:0/3161321310 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1bd0003520 con 0x7f1be40bf050 2024-05-16T22:27:43.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.440+0000 7f1be1d9b640 1 -- 172.21.15.44:0/3161321310 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3507373441 0 0) 0x7f1bd0003520 con 0x7f1be40bf050 2024-05-16T22:27:43.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.440+0000 7f1be1d9b640 1 -- 172.21.15.44:0/3161321310 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1be4151fc0 msgr2=0x7f1be40bd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:43.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.440+0000 7f1be1d9b640 1 --2- 172.21.15.44:0/3161321310 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1be4151fc0 0x7f1be40bd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:43.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.440+0000 7f1be1d9b640 1 -- 172.21.15.44:0/3161321310 >> v1:172.21.15.70:6789/0 conn(0x7f1be406da30 legacy=0x7f1be40be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:43.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.440+0000 7f1be1d9b640 1 -- 172.21.15.44:0/3161321310 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1be4152810 con 0x7f1be40bf050 2024-05-16T22:27:43.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.440+0000 7f1be1d9b640 1 -- 172.21.15.44:0/3161321310 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 568431863 0 0) 0x7f1bd4001a70 con 0x7f1be40bf050 2024-05-16T22:27:43.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.440+0000 7f1be1d9b640 1 -- 172.21.15.44:0/3161321310 >> v1:172.21.15.44:6789/0 conn(0x7f1be40bf050 legacy=0x7f1be4158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:43.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.440+0000 7f1be1d9b640 1 --2- 172.21.15.44:0/3161321310 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bd00039e0 0x7f1bd0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:43.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.440+0000 7f1be1d9b640 1 --2- 172.21.15.44:0/3161321310 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1be4151fc0 0x7f1bd0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:43.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.440+0000 7f1be1d9b640 1 --2- 172.21.15.44:0/3161321310 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bd0004d40 0x7f1bd0005170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:43.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.440+0000 7f1be1d9b640 1 -- 172.21.15.44:0/3161321310 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1be40bdc10 con 0x7f1bd0004d40 2024-05-16T22:27:43.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.440+0000 7f1be1d9b640 1 -- 172.21.15.44:0/3161321310 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd000bba0 con 0x7f1bd00039e0 2024-05-16T22:27:43.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.440+0000 7f1be1d9b640 1 -- 172.21.15.44:0/3161321310 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f1bd000bda0 con 0x7f1be4151fc0 2024-05-16T22:27:43.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.440+0000 7f1be359e640 1 --2- 172.21.15.44:0/3161321310 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bd0004d40 0x7f1bd0005170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:43.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.440+0000 7f1be2d9d640 1 --2- 172.21.15.44:0/3161321310 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bd00039e0 0x7f1bd0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:43.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.440+0000 7f1be259c640 1 --2- 172.21.15.44:0/3161321310 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1be4151fc0 0x7f1bd0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:43.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.440+0000 7f1be359e640 1 -- 172.21.15.44:0/3161321310 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1be4151fc0 msgr2=0x7f1bd0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:43.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.440+0000 7f1be359e640 1 --2- 172.21.15.44:0/3161321310 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1be4151fc0 0x7f1bd0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:43.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.440+0000 7f1be359e640 1 -- 172.21.15.44:0/3161321310 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bd00039e0 msgr2=0x7f1bd0003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:43.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.440+0000 7f1be359e640 1 --2- 172.21.15.44:0/3161321310 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bd00039e0 0x7f1bd0003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:43.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.440+0000 7f1be359e640 1 -- 172.21.15.44:0/3161321310 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bd0003520 con 0x7f1bd0004d40 2024-05-16T22:27:43.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.441+0000 7f1be359e640 1 --2- 172.21.15.44:0/3161321310 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bd0004d40 0x7f1bd0005170 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1bd400a850 tx=0x7f1bd0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9325119a80bb88a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:43.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.441+0000 7f1be1d9b640 1 -- 172.21.15.44:0/3161321310 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd400a4a0 con 0x7f1bd0004d40 2024-05-16T22:27:43.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.441+0000 7f1be1d9b640 1 -- 172.21.15.44:0/3161321310 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bd402f070 con 0x7f1bd0004d40 2024-05-16T22:27:43.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.441+0000 7f1be1d9b640 1 -- 172.21.15.44:0/3161321310 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd402bc20 con 0x7f1bd0004d40 2024-05-16T22:27:43.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.442+0000 7f1be9005640 1 -- 172.21.15.44:0/3161321310 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bd0004d40 msgr2=0x7f1bd0005170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:43.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.442+0000 7f1be9005640 1 --2- 172.21.15.44:0/3161321310 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bd0004d40 0x7f1bd0005170 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1bd400a850 tx=0x7f1bd0005830 comp rx=0 tx=0).stop 2024-05-16T22:27:43.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.442+0000 7f1be359e640 1 -- 172.21.15.44:0/3161321310 reap_dead start 2024-05-16T22:27:43.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.442+0000 7f1be9005640 1 -- 172.21.15.44:0/3161321310 shutdown_connections 2024-05-16T22:27:43.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.442+0000 7f1be9005640 1 -- 172.21.15.44:0/3161321310 >> 172.21.15.44:0/3161321310 conn(0x7f1be40c3d20 msgr2=0x7f1be40c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:43.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.442+0000 7f1be9005640 1 -- 172.21.15.44:0/3161321310 shutdown_connections 2024-05-16T22:27:43.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.442+0000 7f1be9005640 1 -- 172.21.15.44:0/3161321310 wait complete. 2024-05-16T22:27:43.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.444+0000 7f1be9005640 1 Processor -- start 2024-05-16T22:27:43.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.444+0000 7f1be9005640 1 -- start start 2024-05-16T22:27:43.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.445+0000 7f1be9005640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bd0004d40 0x7f1be414f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:43.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.445+0000 7f1be9005640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1be41e4610 0x7f1be414df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:43.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.445+0000 7f1be9005640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1be414c9a0 0x7f1be414cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:43.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.445+0000 7f1be9005640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1be40a3050 con 0x7f1bd0004d40 2024-05-16T22:27:43.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.445+0000 7f1be9005640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1be40a2ed0 con 0x7f1be41e4610 2024-05-16T22:27:43.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.445+0000 7f1be9005640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f1be406de40 con 0x7f1be414c9a0 2024-05-16T22:27:43.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.445+0000 7f1be2d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bd0004d40 0x7f1be414f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:43.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.445+0000 7f1be2d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bd0004d40 0x7f1be414f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44222/0 (socket says 172.21.15.44:44222) 2024-05-16T22:27:43.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.445+0000 7f1be2d9d640 1 -- 172.21.15.44:0/3635509376 learned_addr learned my addr 172.21.15.44:0/3635509376 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:43.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.445+0000 7f1be259c640 1 --2- 172.21.15.44:0/3635509376 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1be41e4610 0x7f1be414df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:43.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.445+0000 7f1be359e640 1 --2- 172.21.15.44:0/3635509376 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1be414c9a0 0x7f1be414cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:43.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.445+0000 7f1be2d9d640 1 -- 172.21.15.44:0/3635509376 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1be414c9a0 msgr2=0x7f1be414cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:43.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.445+0000 7f1be2d9d640 1 --2- 172.21.15.44:0/3635509376 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1be414c9a0 0x7f1be414cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:43.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.445+0000 7f1be2d9d640 1 -- 172.21.15.44:0/3635509376 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1be41e4610 msgr2=0x7f1be414df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:43.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.445+0000 7f1be2d9d640 1 --2- 172.21.15.44:0/3635509376 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1be41e4610 0x7f1be414df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:43.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.445+0000 7f1be2d9d640 1 -- 172.21.15.44:0/3635509376 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1be41e3e50 con 0x7f1bd0004d40 2024-05-16T22:27:43.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.445+0000 7f1be2d9d640 1 --2- 172.21.15.44:0/3635509376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bd0004d40 0x7f1be414f050 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc0119a0 tx=0x7f1bdc011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:43.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.445+0000 7f1bdb7fe640 1 -- 172.21.15.44:0/3635509376 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc00faf0 con 0x7f1bd0004d40 2024-05-16T22:27:43.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.445+0000 7f1bdb7fe640 1 -- 172.21.15.44:0/3635509376 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bdc00fc90 con 0x7f1bd0004d40 2024-05-16T22:27:43.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.446+0000 7f1be9005640 1 -- 172.21.15.44:0/3635509376 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1be414eae0 con 0x7f1bd0004d40 2024-05-16T22:27:43.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.446+0000 7f1bdb7fe640 1 -- 172.21.15.44:0/3635509376 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc014440 con 0x7f1bd0004d40 2024-05-16T22:27:43.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.446+0000 7f1be9005640 1 -- 172.21.15.44:0/3635509376 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1be414e800 con 0x7f1bd0004d40 2024-05-16T22:27:43.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.446+0000 7f1be9005640 1 -- 172.21.15.44:0/3635509376 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1be4050940 con 0x7f1bd0004d40 2024-05-16T22:27:43.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.447+0000 7f1bdb7fe640 1 -- 172.21.15.44:0/3635509376 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1bdc012040 con 0x7f1bd0004d40 2024-05-16T22:27:43.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.448+0000 7f1bdb7fe640 1 --2- 172.21.15.44:0/3635509376 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f1bc4076300 0x7f1bc4078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:43.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.448+0000 7f1bdb7fe640 1 -- 172.21.15.44:0/3635509376 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1bdc097c00 con 0x7f1bd0004d40 2024-05-16T22:27:43.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.448+0000 7f1be259c640 1 --2- 172.21.15.44:0/3635509376 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f1bc4076300 0x7f1bc4078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:43.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.449+0000 7f1be259c640 1 --2- 172.21.15.44:0/3635509376 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f1bc4076300 0x7f1bc4078810 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1be40a4570 tx=0x7f1bcc009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:43.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.453+0000 7f1bdb7fe640 1 -- 172.21.15.44:0/3635509376 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1bdc09e080 con 0x7f1bd0004d40 2024-05-16T22:27:43.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.648+0000 7f1be9005640 1 -- 172.21.15.44:0/3635509376 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f1be41e3c80 con 0x7f1bd0004d40 2024-05-16T22:27:43.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.648+0000 7f1bdb7fe640 1 -- 172.21.15.44:0/3635509376 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f1bdc019030 con 0x7f1bd0004d40 2024-05-16T22:27:43.648 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-05-16T22:27:43.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.650+0000 7f1be9005640 1 -- 172.21.15.44:0/3635509376 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f1bc4076300 msgr2=0x7f1bc4078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:43.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.650+0000 7f1be9005640 1 --2- 172.21.15.44:0/3635509376 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f1bc4076300 0x7f1bc4078810 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1be40a4570 tx=0x7f1bcc009040 comp rx=0 tx=0).stop 2024-05-16T22:27:43.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.650+0000 7f1be9005640 1 -- 172.21.15.44:0/3635509376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bd0004d40 msgr2=0x7f1be414f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:43.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.650+0000 7f1be9005640 1 --2- 172.21.15.44:0/3635509376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bd0004d40 0x7f1be414f050 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc0119a0 tx=0x7f1bdc011e60 comp rx=0 tx=0).stop 2024-05-16T22:27:43.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.650+0000 7f1be9005640 1 -- 172.21.15.44:0/3635509376 shutdown_connections 2024-05-16T22:27:43.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.650+0000 7f1be9005640 1 --2- 172.21.15.44:0/3635509376 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f1bc4076300 0x7f1bc4078810 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:43.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.650+0000 7f1be9005640 1 --2- 172.21.15.44:0/3635509376 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1be414c9a0 0x7f1be414cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:43.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.650+0000 7f1be9005640 1 --2- 172.21.15.44:0/3635509376 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1be41e4610 0x7f1be414df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:43.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.650+0000 7f1be9005640 1 --2- 172.21.15.44:0/3635509376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bd0004d40 0x7f1be414f050 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:43.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.650+0000 7f1be9005640 1 -- 172.21.15.44:0/3635509376 >> 172.21.15.44:0/3635509376 conn(0x7f1be40c3d20 msgr2=0x7f1be40a4630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:43.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.651+0000 7f1be9005640 1 -- 172.21.15.44:0/3635509376 shutdown_connections 2024-05-16T22:27:43.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.651+0000 7f1be9005640 1 -- 172.21.15.44:0/3635509376 wait complete. 2024-05-16T22:27:43.661 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_fscrypt.TestFSCrypt.test_fscrypt_basic_mount' 2024-05-16T22:27:43.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.773+0000 7f5f555d6640 1 Processor -- start 2024-05-16T22:27:43.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.773+0000 7f5f555d6640 1 -- start start 2024-05-16T22:27:43.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.774+0000 7f5f555d6640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f5f50151fc0 0x7f5f500bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:43.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.774+0000 7f5f555d6640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5f500bf050 0x7f5f50158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:43.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.774+0000 7f5f555d6640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f500c36f0 con 0x7f5f5006da30 2024-05-16T22:27:43.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.774+0000 7f5f555d6640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f5f500bdc10 con 0x7f5f50151fc0 2024-05-16T22:27:43.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.774+0000 7f5f555d6640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f5f50152530 con 0x7f5f500bf050 2024-05-16T22:27:43.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.774+0000 7f5f467fc640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f5f5006da30 0x7f5f500be940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:47146/0 (socket says 172.21.15.44:47146) 2024-05-16T22:27:43.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.774+0000 7f5f467fc640 1 -- 172.21.15.44:0/2747248211 learned_addr learned my addr 172.21.15.44:0/2747248211 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:27:43.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.774+0000 7f5f4f7fe640 1 --2- 172.21.15.44:0/2747248211 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5f500bf050 0x7f5f50158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:43.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.774+0000 7f5f4effd640 1 --2- 172.21.15.44:0/2747248211 >> v2:172.21.15.70:3300/0 conn(0x7f5f50151fc0 0x7f5f500bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:43.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.774+0000 7f5f4e7fc640 1 -- 172.21.15.44:0/2747248211 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4280355417 0 0) 0x7f5f500c36f0 con 0x7f5f5006da30 2024-05-16T22:27:43.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.774+0000 7f5f4e7fc640 1 -- 172.21.15.44:0/2747248211 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f3c003520 con 0x7f5f5006da30 2024-05-16T22:27:43.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.775+0000 7f5f4f7fe640 1 -- 172.21.15.44:0/2747248211 >> v2:172.21.15.70:3300/0 conn(0x7f5f50151fc0 msgr2=0x7f5f500bd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:43.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.775+0000 7f5f4f7fe640 1 --2- 172.21.15.44:0/2747248211 >> v2:172.21.15.70:3300/0 conn(0x7f5f50151fc0 0x7f5f500bd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:43.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.775+0000 7f5f4e7fc640 1 -- 172.21.15.44:0/2747248211 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4278346451 0 0) 0x7f5f3c003520 con 0x7f5f5006da30 2024-05-16T22:27:43.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.775+0000 7f5f4f7fe640 1 -- 172.21.15.44:0/2747248211 >> v1:172.21.15.44:6789/0 conn(0x7f5f5006da30 legacy=0x7f5f500be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:43.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.775+0000 7f5f4f7fe640 1 -- 172.21.15.44:0/2747248211 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f50152810 con 0x7f5f500bf050 2024-05-16T22:27:43.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.775+0000 7f5f4f7fe640 1 --2- 172.21.15.44:0/2747248211 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5f500bf050 0x7f5f50158e90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5f48009d90 tx=0x7f5f4802a560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=545278b8939eabec server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:43.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.776+0000 7f5f4e7fc640 1 -- 172.21.15.44:0/2747248211 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f380016f0 con 0x7f5f500bf050 2024-05-16T22:27:43.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.776+0000 7f5f4e7fc640 1 -- 172.21.15.44:0/2747248211 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f48007540 con 0x7f5f500bf050 2024-05-16T22:27:43.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.776+0000 7f5f4e7fc640 1 -- 172.21.15.44:0/2747248211 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f480078f0 con 0x7f5f500bf050 2024-05-16T22:27:43.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.776+0000 7f5f555d6640 1 -- 172.21.15.44:0/2747248211 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5f500bf050 msgr2=0x7f5f50158e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:43.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.776+0000 7f5f555d6640 1 --2- 172.21.15.44:0/2747248211 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5f500bf050 0x7f5f50158e90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5f48009d90 tx=0x7f5f4802a560 comp rx=0 tx=0).stop 2024-05-16T22:27:43.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.776+0000 7f5f555d6640 1 -- 172.21.15.44:0/2747248211 shutdown_connections 2024-05-16T22:27:43.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.776+0000 7f5f555d6640 1 --2- 172.21.15.44:0/2747248211 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5f500bf050 0x7f5f50158e90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:43.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.776+0000 7f5f555d6640 1 --2- 172.21.15.44:0/2747248211 >> v2:172.21.15.70:3300/0 conn(0x7f5f50151fc0 0x7f5f500bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:43.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.776+0000 7f5f555d6640 1 -- 172.21.15.44:0/2747248211 >> 172.21.15.44:0/2747248211 conn(0x7f5f500c3d20 msgr2=0x7f5f500c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:43.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.776+0000 7f5f555d6640 1 -- 172.21.15.44:0/2747248211 shutdown_connections 2024-05-16T22:27:43.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.776+0000 7f5f555d6640 1 -- 172.21.15.44:0/2747248211 wait complete. 2024-05-16T22:27:43.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.778+0000 7f5f555d6640 1 Processor -- start 2024-05-16T22:27:43.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.778+0000 7f5f555d6640 1 -- start start 2024-05-16T22:27:43.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.779+0000 7f5f555d6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5f5006da30 0x7f5f501db100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:43.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.779+0000 7f5f555d6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f500bf050 0x7f5f5014f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:43.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.779+0000 7f5f555d6640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5f50151fc0 0x7f5f5014fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:43.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.779+0000 7f5f555d6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5f500a3050 con 0x7f5f5006da30 2024-05-16T22:27:43.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.779+0000 7f5f555d6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5f500a2ed0 con 0x7f5f500bf050 2024-05-16T22:27:43.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.779+0000 7f5f555d6640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f5f5006de40 con 0x7f5f50151fc0 2024-05-16T22:27:43.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.779+0000 7f5f4effd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5f5006da30 0x7f5f501db100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:43.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.779+0000 7f5f4effd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5f5006da30 0x7f5f501db100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44234/0 (socket says 172.21.15.44:44234) 2024-05-16T22:27:43.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.779+0000 7f5f4effd640 1 -- 172.21.15.44:0/2766611339 learned_addr learned my addr 172.21.15.44:0/2766611339 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:43.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.780+0000 7f5f467fc640 1 --2- 172.21.15.44:0/2766611339 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f500bf050 0x7f5f5014f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:43.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.780+0000 7f5f4f7fe640 1 --2- 172.21.15.44:0/2766611339 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5f50151fc0 0x7f5f5014fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:43.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.780+0000 7f5f4effd640 1 -- 172.21.15.44:0/2766611339 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5f50151fc0 msgr2=0x7f5f5014fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:43.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.780+0000 7f5f4effd640 1 --2- 172.21.15.44:0/2766611339 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5f50151fc0 0x7f5f5014fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:43.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.780+0000 7f5f4effd640 1 -- 172.21.15.44:0/2766611339 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f500bf050 msgr2=0x7f5f5014f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:43.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.780+0000 7f5f4effd640 1 --2- 172.21.15.44:0/2766611339 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f500bf050 0x7f5f5014f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:43.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.780+0000 7f5f4effd640 1 -- 172.21.15.44:0/2766611339 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f500b9b40 con 0x7f5f5006da30 2024-05-16T22:27:43.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.780+0000 7f5f4effd640 1 --2- 172.21.15.44:0/2766611339 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5f5006da30 0x7f5f501db100 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5f4000e870 tx=0x7f5f4000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:43.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.780+0000 7f5f47fff640 1 -- 172.21.15.44:0/2766611339 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f40017070 con 0x7f5f5006da30 2024-05-16T22:27:43.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.780+0000 7f5f47fff640 1 -- 172.21.15.44:0/2766611339 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f4000c940 con 0x7f5f5006da30 2024-05-16T22:27:43.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.780+0000 7f5f555d6640 1 -- 172.21.15.44:0/2766611339 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f501db640 con 0x7f5f5006da30 2024-05-16T22:27:43.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.780+0000 7f5f47fff640 1 -- 172.21.15.44:0/2766611339 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f4000cd30 con 0x7f5f5006da30 2024-05-16T22:27:43.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.780+0000 7f5f555d6640 1 -- 172.21.15.44:0/2766611339 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f501e7890 con 0x7f5f5006da30 2024-05-16T22:27:43.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.781+0000 7f5f555d6640 1 -- 172.21.15.44:0/2766611339 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f50050940 con 0x7f5f5006da30 2024-05-16T22:27:43.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.782+0000 7f5f47fff640 1 -- 172.21.15.44:0/2766611339 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5f4001a070 con 0x7f5f5006da30 2024-05-16T22:27:43.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.782+0000 7f5f47fff640 1 --2- 172.21.15.44:0/2766611339 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f5f300762d0 0x7f5f300787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:43.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.782+0000 7f5f47fff640 1 -- 172.21.15.44:0/2766611339 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5f400974f0 con 0x7f5f5006da30 2024-05-16T22:27:43.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.782+0000 7f5f467fc640 1 --2- 172.21.15.44:0/2766611339 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f5f300762d0 0x7f5f300787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:43.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.783+0000 7f5f467fc640 1 --2- 172.21.15.44:0/2766611339 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f5f300762d0 0x7f5f300787e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5f38001220 tx=0x7f5f38009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:43.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:43.787+0000 7f5f47fff640 1 -- 172.21.15.44:0/2766611339 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5f40060dc0 con 0x7f5f5006da30 2024-05-16T22:27:44.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.052+0000 7f5f555d6640 1 -- 172.21.15.44:0/2766611339 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFSCrypt.test_fscrypt_basic_mount"]} v 0) -- 0x7f5f5006eb40 con 0x7f5f5006da30 2024-05-16T22:27:44.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.214+0000 7f5f47fff640 1 -- 172.21.15.44:0/2766611339 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFSCrypt.test_fscrypt_basic_mount"]}]=0 v41) ==== 144+0+0 (secure 0 0 0) 0x7f5f400606c0 con 0x7f5f5006da30 2024-05-16T22:27:44.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.217+0000 7f5f555d6640 1 -- 172.21.15.44:0/2766611339 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f5f300762d0 msgr2=0x7f5f300787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:44.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.217+0000 7f5f555d6640 1 --2- 172.21.15.44:0/2766611339 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f5f300762d0 0x7f5f300787e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5f38001220 tx=0x7f5f38009040 comp rx=0 tx=0).stop 2024-05-16T22:27:44.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.217+0000 7f5f555d6640 1 -- 172.21.15.44:0/2766611339 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5f5006da30 msgr2=0x7f5f501db100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:44.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.217+0000 7f5f555d6640 1 --2- 172.21.15.44:0/2766611339 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5f5006da30 0x7f5f501db100 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5f4000e870 tx=0x7f5f4000ed30 comp rx=0 tx=0).stop 2024-05-16T22:27:44.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.217+0000 7f5f555d6640 1 -- 172.21.15.44:0/2766611339 shutdown_connections 2024-05-16T22:27:44.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.217+0000 7f5f555d6640 1 --2- 172.21.15.44:0/2766611339 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f5f300762d0 0x7f5f300787e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:44.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.217+0000 7f5f555d6640 1 --2- 172.21.15.44:0/2766611339 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5f50151fc0 0x7f5f5014fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:44.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.217+0000 7f5f555d6640 1 --2- 172.21.15.44:0/2766611339 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f500bf050 0x7f5f5014f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:44.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.217+0000 7f5f555d6640 1 --2- 172.21.15.44:0/2766611339 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5f5006da30 0x7f5f501db100 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:44.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.217+0000 7f5f555d6640 1 -- 172.21.15.44:0/2766611339 >> 172.21.15.44:0/2766611339 conn(0x7f5f500c3d20 msgr2=0x7f5f500c09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:44.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.217+0000 7f5f555d6640 1 -- 172.21.15.44:0/2766611339 shutdown_connections 2024-05-16T22:27:44.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.217+0000 7f5f555d6640 1 -- 172.21.15.44:0/2766611339 wait complete. 2024-05-16T22:27:44.228 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-16T22:27:44.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.343+0000 7fd814dc7640 1 Processor -- start 2024-05-16T22:27:44.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.343+0000 7fd814dc7640 1 -- start start 2024-05-16T22:27:44.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.344+0000 7fd814dc7640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd81014cce0 0x7fd8100716a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:44.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.344+0000 7fd814dc7640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8100720d0 con 0x7fd810071be0 2024-05-16T22:27:44.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.344+0000 7fd814dc7640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8100bf6f0 con 0x7fd8100be4f0 2024-05-16T22:27:44.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.344+0000 7fd814dc7640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fd8100bfa60 con 0x7fd81014cce0 2024-05-16T22:27:44.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.344+0000 7fd80ed9d640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fd810071be0 0x7fd810156cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:47162/0 (socket says 172.21.15.44:47162) 2024-05-16T22:27:44.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.344+0000 7fd80ed9d640 1 -- 172.21.15.44:0/1294386719 learned_addr learned my addr 172.21.15.44:0/1294386719 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:27:44.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.345+0000 7fd80dd9b640 1 --2- 172.21.15.44:0/1294386719 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd81014cce0 0x7fd8100716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:44.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.345+0000 7fd80d59a640 1 -- 172.21.15.44:0/1294386719 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2116649871 0 0) 0x7fd8100720d0 con 0x7fd810071be0 2024-05-16T22:27:44.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.345+0000 7fd80d59a640 1 -- 172.21.15.44:0/1294386719 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7f8003520 con 0x7fd810071be0 2024-05-16T22:27:44.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.345+0000 7fd80d59a640 1 -- 172.21.15.44:0/1294386719 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3176844118 0 0) 0x7fd7f8003520 con 0x7fd810071be0 2024-05-16T22:27:44.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.345+0000 7fd80d59a640 1 -- 172.21.15.44:0/1294386719 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd81014cce0 msgr2=0x7fd8100716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:44.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.345+0000 7fd80d59a640 1 --2- 172.21.15.44:0/1294386719 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd81014cce0 0x7fd8100716a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:44.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.345+0000 7fd80d59a640 1 -- 172.21.15.44:0/1294386719 >> v1:172.21.15.70:6789/0 conn(0x7fd8100be4f0 legacy=0x7fd8100bfef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:44.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.345+0000 7fd80d59a640 1 -- 172.21.15.44:0/1294386719 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8100be900 con 0x7fd810071be0 2024-05-16T22:27:44.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.345+0000 7fd80d59a640 1 -- 172.21.15.44:0/1294386719 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 568431863 0 0) 0x7fd808001a70 con 0x7fd810071be0 2024-05-16T22:27:44.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.345+0000 7fd80d59a640 1 -- 172.21.15.44:0/1294386719 >> v1:172.21.15.44:6789/0 conn(0x7fd810071be0 legacy=0x7fd810156cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:44.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.345+0000 7fd80d59a640 1 --2- 172.21.15.44:0/1294386719 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd81014cce0 0x7fd7f80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:44.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.345+0000 7fd80d59a640 1 --2- 172.21.15.44:0/1294386719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd7f8003f90 0x7fd7f8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:44.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.345+0000 7fd80d59a640 1 --2- 172.21.15.44:0/1294386719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd7f8004d40 0x7fd7f8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:44.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.345+0000 7fd80d59a640 1 -- 172.21.15.44:0/1294386719 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd8100bfa60 con 0x7fd7f8003f90 2024-05-16T22:27:44.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.345+0000 7fd80d59a640 1 -- 172.21.15.44:0/1294386719 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f800bc20 con 0x7fd7f8004d40 2024-05-16T22:27:44.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.345+0000 7fd80d59a640 1 -- 172.21.15.44:0/1294386719 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fd7f800be20 con 0x7fd81014cce0 2024-05-16T22:27:44.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.345+0000 7fd80dd9b640 1 --2- 172.21.15.44:0/1294386719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd7f8003f90 0x7fd7f8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:44.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.345+0000 7fd80e59c640 1 --2- 172.21.15.44:0/1294386719 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd81014cce0 0x7fd7f80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:44.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.345+0000 7fd80ed9d640 1 --2- 172.21.15.44:0/1294386719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd7f8004d40 0x7fd7f8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:44.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.345+0000 7fd80dd9b640 1 -- 172.21.15.44:0/1294386719 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd81014cce0 msgr2=0x7fd7f80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:44.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.345+0000 7fd80dd9b640 1 --2- 172.21.15.44:0/1294386719 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd81014cce0 0x7fd7f80039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:44.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.345+0000 7fd80dd9b640 1 -- 172.21.15.44:0/1294386719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd7f8004d40 msgr2=0x7fd7f8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:44.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.345+0000 7fd80dd9b640 1 --2- 172.21.15.44:0/1294386719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd7f8004d40 0x7fd7f8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:44.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.345+0000 7fd80dd9b640 1 -- 172.21.15.44:0/1294386719 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7f8003520 con 0x7fd7f8003f90 2024-05-16T22:27:44.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.346+0000 7fd80ed9d640 1 --2- 172.21.15.44:0/1294386719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd7f8004d40 0x7fd7f8005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:27:44.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.346+0000 7fd80dd9b640 1 --2- 172.21.15.44:0/1294386719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd7f8003f90 0x7fd7f8004800 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd810070940 tx=0x7fd7f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e6cc361f36e0e60 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:44.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.346+0000 7fd80d59a640 1 -- 172.21.15.44:0/1294386719 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd804036070 con 0x7fd7f8003f90 2024-05-16T22:27:44.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.346+0000 7fd80d59a640 1 -- 172.21.15.44:0/1294386719 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd804031400 con 0x7fd7f8003f90 2024-05-16T22:27:44.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.346+0000 7fd80d59a640 1 -- 172.21.15.44:0/1294386719 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd804009690 con 0x7fd7f8003f90 2024-05-16T22:27:44.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.347+0000 7fd814dc7640 1 -- 172.21.15.44:0/1294386719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd7f8003f90 msgr2=0x7fd7f8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:44.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.347+0000 7fd814dc7640 1 --2- 172.21.15.44:0/1294386719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd7f8003f90 0x7fd7f8004800 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd810070940 tx=0x7fd7f8005830 comp rx=0 tx=0).stop 2024-05-16T22:27:44.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.347+0000 7fd80ed9d640 1 -- 172.21.15.44:0/1294386719 reap_dead start 2024-05-16T22:27:44.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.347+0000 7fd814dc7640 1 -- 172.21.15.44:0/1294386719 shutdown_connections 2024-05-16T22:27:44.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.347+0000 7fd814dc7640 1 -- 172.21.15.44:0/1294386719 >> 172.21.15.44:0/1294386719 conn(0x7fd8100c17c0 msgr2=0x7fd8100c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:44.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.347+0000 7fd814dc7640 1 -- 172.21.15.44:0/1294386719 shutdown_connections 2024-05-16T22:27:44.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.347+0000 7fd814dc7640 1 -- 172.21.15.44:0/1294386719 wait complete. 2024-05-16T22:27:44.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.349+0000 7fd814dc7640 1 Processor -- start 2024-05-16T22:27:44.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.349+0000 7fd814dc7640 1 -- start start 2024-05-16T22:27:44.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.350+0000 7fd814dc7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd7f8003f90 0x7fd8101d4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:44.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.350+0000 7fd814dc7640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd8101e2490 0x7fd810146130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:44.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.350+0000 7fd814dc7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd810146670 0x7fd8101e5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:44.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.350+0000 7fd814dc7640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd8100723b0 con 0x7fd7f8003f90 2024-05-16T22:27:44.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.350+0000 7fd814dc7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd810071310 con 0x7fd810146670 2024-05-16T22:27:44.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.350+0000 7fd814dc7640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fd8100bc1c0 con 0x7fd8101e2490 2024-05-16T22:27:44.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.350+0000 7fd80e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd7f8003f90 0x7fd8101d4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:44.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.350+0000 7fd80e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd7f8003f90 0x7fd8101d4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44252/0 (socket says 172.21.15.44:44252) 2024-05-16T22:27:44.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.350+0000 7fd80e59c640 1 -- 172.21.15.44:0/2837545328 learned_addr learned my addr 172.21.15.44:0/2837545328 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:44.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.350+0000 7fd80dd9b640 1 --2- 172.21.15.44:0/2837545328 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd8101e2490 0x7fd810146130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:44.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.350+0000 7fd80ed9d640 1 --2- 172.21.15.44:0/2837545328 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd810146670 0x7fd8101e5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:44.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.350+0000 7fd80e59c640 1 -- 172.21.15.44:0/2837545328 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd8101e2490 msgr2=0x7fd810146130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:44.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.350+0000 7fd80e59c640 1 --2- 172.21.15.44:0/2837545328 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd8101e2490 0x7fd810146130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:44.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.350+0000 7fd80e59c640 1 -- 172.21.15.44:0/2837545328 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd810146670 msgr2=0x7fd8101e5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:44.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.350+0000 7fd80e59c640 1 --2- 172.21.15.44:0/2837545328 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd810146670 0x7fd8101e5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:44.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.350+0000 7fd80e59c640 1 -- 172.21.15.44:0/2837545328 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8101d48d0 con 0x7fd7f8003f90 2024-05-16T22:27:44.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.350+0000 7fd80ed9d640 1 --2- 172.21.15.44:0/2837545328 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd810146670 0x7fd8101e5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T22:27:44.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.350+0000 7fd80e59c640 1 --2- 172.21.15.44:0/2837545328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd7f8003f90 0x7fd8101d4390 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd80000f770 tx=0x7fd80000fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:44.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.351+0000 7fd7feffd640 1 -- 172.21.15.44:0/2837545328 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd80000fe80 con 0x7fd7f8003f90 2024-05-16T22:27:44.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.351+0000 7fd7feffd640 1 -- 172.21.15.44:0/2837545328 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd800018070 con 0x7fd7f8003f90 2024-05-16T22:27:44.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.351+0000 7fd814dc7640 1 -- 172.21.15.44:0/2837545328 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8101d4b40 con 0x7fd7f8003f90 2024-05-16T22:27:44.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.351+0000 7fd7feffd640 1 -- 172.21.15.44:0/2837545328 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd80000d730 con 0x7fd7f8003f90 2024-05-16T22:27:44.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.351+0000 7fd814dc7640 1 -- 172.21.15.44:0/2837545328 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8101d5bb0 con 0x7fd7f8003f90 2024-05-16T22:27:44.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.352+0000 7fd814dc7640 1 -- 172.21.15.44:0/2837545328 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8100bf020 con 0x7fd7f8003f90 2024-05-16T22:27:44.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.352+0000 7fd7feffd640 1 -- 172.21.15.44:0/2837545328 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd80000d8d0 con 0x7fd7f8003f90 2024-05-16T22:27:44.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.353+0000 7fd7feffd640 1 --2- 172.21.15.44:0/2837545328 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd7f0076300 0x7fd7f0078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:44.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.353+0000 7fd7feffd640 1 -- 172.21.15.44:0/2837545328 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd800097610 con 0x7fd7f8003f90 2024-05-16T22:27:44.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.353+0000 7fd80dd9b640 1 --2- 172.21.15.44:0/2837545328 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd7f0076300 0x7fd7f0078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:44.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.353+0000 7fd80dd9b640 1 --2- 172.21.15.44:0/2837545328 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd7f0076300 0x7fd7f0078810 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd804033000 tx=0x7fd804008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:44.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.357+0000 7fd7feffd640 1 -- 172.21.15.44:0/2837545328 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd800060ee0 con 0x7fd7f8003f90 2024-05-16T22:27:44.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.553+0000 7fd814dc7640 1 -- 172.21.15.44:0/2837545328 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fd810050940 con 0x7fd7f8003f90 2024-05-16T22:27:44.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.556+0000 7fd7feffd640 1 -- 172.21.15.44:0/2837545328 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7fd8000607e0 con 0x7fd7f8003f90 2024-05-16T22:27:44.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.559+0000 7fd814dc7640 1 -- 172.21.15.44:0/2837545328 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd7f0076300 msgr2=0x7fd7f0078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:44.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.559+0000 7fd814dc7640 1 --2- 172.21.15.44:0/2837545328 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd7f0076300 0x7fd7f0078810 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd804033000 tx=0x7fd804008030 comp rx=0 tx=0).stop 2024-05-16T22:27:44.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.559+0000 7fd814dc7640 1 -- 172.21.15.44:0/2837545328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd7f8003f90 msgr2=0x7fd8101d4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:44.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.559+0000 7fd814dc7640 1 --2- 172.21.15.44:0/2837545328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd7f8003f90 0x7fd8101d4390 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd80000f770 tx=0x7fd80000fc30 comp rx=0 tx=0).stop 2024-05-16T22:27:44.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.559+0000 7fd814dc7640 1 -- 172.21.15.44:0/2837545328 shutdown_connections 2024-05-16T22:27:44.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.559+0000 7fd814dc7640 1 --2- 172.21.15.44:0/2837545328 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd7f0076300 0x7fd7f0078810 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:44.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.559+0000 7fd814dc7640 1 --2- 172.21.15.44:0/2837545328 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd8101e2490 0x7fd810146130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:44.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.559+0000 7fd814dc7640 1 --2- 172.21.15.44:0/2837545328 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd810146670 0x7fd8101e5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:44.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.559+0000 7fd814dc7640 1 --2- 172.21.15.44:0/2837545328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd7f8003f90 0x7fd8101d4390 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:44.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.559+0000 7fd814dc7640 1 -- 172.21.15.44:0/2837545328 >> 172.21.15.44:0/2837545328 conn(0x7fd8100c17c0 msgr2=0x7fd8100a6580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:44.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.559+0000 7fd814dc7640 1 -- 172.21.15.44:0/2837545328 shutdown_connections 2024-05-16T22:27:44.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:44.559+0000 7fd814dc7640 1 -- 172.21.15.44:0/2837545328 wait complete. 2024-05-16T22:27:44.569 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-16T22:27:44.570 DEBUG:teuthology.orchestra.run.smithi044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-16T22:27:44.634 DEBUG:teuthology.orchestra.run.smithi070:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-16T22:27:44.715 DEBUG:teuthology.orchestra.run.smithi196:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-16T22:27:44.835 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-16T22:27:44.836 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-16T22:27:44.836 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-16T22:27:44.885 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-16T22:27:44.886 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-16T22:27:44.937 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-16T22:27:44.937 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-16T22:27:44.989 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-16T22:27:45.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.106+0000 7f9ec660c640 1 Processor -- start 2024-05-16T22:27:45.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.106+0000 7f9ec660c640 1 -- start start 2024-05-16T22:27:45.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.107+0000 7f9ec660c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f9ec00b4500 0x7f9ec00b5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:45.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.107+0000 7f9ec660c640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ec00bba80 con 0x7f9ec00bb490 2024-05-16T22:27:45.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.107+0000 7f9ec660c640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ec00bbd20 con 0x7f9ec00b9ee0 2024-05-16T22:27:45.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.107+0000 7f9ec660c640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f9ec00b4f60 con 0x7f9ec00b4500 2024-05-16T22:27:45.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.107+0000 7f9ebf7fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f9ec00bb490 0x7f9ec006faa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:47170/0 (socket says 172.21.15.44:47170) 2024-05-16T22:27:45.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.107+0000 7f9ebf7fe640 1 -- 172.21.15.44:0/3097726355 learned_addr learned my addr 172.21.15.44:0/3097726355 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:27:45.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.107+0000 7f9ebffff640 1 --2- 172.21.15.44:0/3097726355 >> v2:172.21.15.70:3300/0 conn(0x7f9ec00b4500 0x7f9ec00b5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:45.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.107+0000 7f9ebeffd640 1 -- 172.21.15.44:0/3097726355 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3132418464 0 0) 0x7f9ec00bba80 con 0x7f9ec00bb490 2024-05-16T22:27:45.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.107+0000 7f9ebeffd640 1 -- 172.21.15.44:0/3097726355 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ea8003520 con 0x7f9ec00bb490 2024-05-16T22:27:45.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.107+0000 7f9ebeffd640 1 -- 172.21.15.44:0/3097726355 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4225467027 0 0) 0x7f9ea8003520 con 0x7f9ec00bb490 2024-05-16T22:27:45.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.107+0000 7f9ebeffd640 1 -- 172.21.15.44:0/3097726355 >> v2:172.21.15.70:3300/0 conn(0x7f9ec00b4500 msgr2=0x7f9ec00b5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:45.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.107+0000 7f9ebeffd640 1 --2- 172.21.15.44:0/3097726355 >> v2:172.21.15.70:3300/0 conn(0x7f9ec00b4500 0x7f9ec00b5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:45.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.107+0000 7f9ebeffd640 1 -- 172.21.15.44:0/3097726355 >> v1:172.21.15.70:6789/0 conn(0x7f9ec00b9ee0 legacy=0x7f9ec00a3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:45.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.107+0000 7f9ebeffd640 1 -- 172.21.15.44:0/3097726355 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ec00b5240 con 0x7f9ec00bb490 2024-05-16T22:27:45.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.107+0000 7f9ebeffd640 1 -- 172.21.15.44:0/3097726355 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 568431863 0 0) 0x7f9eb40016f0 con 0x7f9ec00bb490 2024-05-16T22:27:45.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.107+0000 7f9ebeffd640 1 -- 172.21.15.44:0/3097726355 >> v1:172.21.15.44:6789/0 conn(0x7f9ec00bb490 legacy=0x7f9ec006faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:45.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.108+0000 7f9ebeffd640 1 --2- 172.21.15.44:0/3097726355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ea8003a50 0x7f9ea8003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:45.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.108+0000 7f9ebeffd640 1 --2- 172.21.15.44:0/3097726355 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9ea8004800 0x7f9ea8004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:45.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.108+0000 7f9ebeffd640 1 --2- 172.21.15.44:0/3097726355 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ea8005250 0x7f9ea800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:45.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.108+0000 7f9ebeffd640 1 -- 172.21.15.44:0/3097726355 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec00b4f60 con 0x7f9ea8005250 2024-05-16T22:27:45.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.108+0000 7f9ebeffd640 1 -- 172.21.15.44:0/3097726355 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea800c1e0 con 0x7f9ea8003a50 2024-05-16T22:27:45.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.108+0000 7f9ebeffd640 1 -- 172.21.15.44:0/3097726355 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f9ea800c3e0 con 0x7f9ea8004800 2024-05-16T22:27:45.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.108+0000 7f9ec4ba9640 1 --2- 172.21.15.44:0/3097726355 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ea8005250 0x7f9ea800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:45.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.108+0000 7f9ebf7fe640 1 --2- 172.21.15.44:0/3097726355 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9ea8004800 0x7f9ea8004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:45.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.108+0000 7f9ebffff640 1 --2- 172.21.15.44:0/3097726355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ea8003a50 0x7f9ea8003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:45.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.108+0000 7f9ec4ba9640 1 -- 172.21.15.44:0/3097726355 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9ea8004800 msgr2=0x7f9ea8004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:45.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.108+0000 7f9ec4ba9640 1 --2- 172.21.15.44:0/3097726355 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9ea8004800 0x7f9ea8004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:45.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.108+0000 7f9ec4ba9640 1 -- 172.21.15.44:0/3097726355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ea8003a50 msgr2=0x7f9ea8003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:45.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.108+0000 7f9ec4ba9640 1 --2- 172.21.15.44:0/3097726355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ea8003a50 0x7f9ea8003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:45.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.108+0000 7f9ec4ba9640 1 -- 172.21.15.44:0/3097726355 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea8003520 con 0x7f9ea8005250 2024-05-16T22:27:45.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.109+0000 7f9ec4ba9640 1 -- 172.21.15.44:0/3097726355 reap_dead start 2024-05-16T22:27:45.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.109+0000 7f9ec4ba9640 1 --2- 172.21.15.44:0/3097726355 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ea8005250 0x7f9ea800b9c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8001e60 tx=0x7f9ea8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a482a8aa6a1da34 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:45.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.109+0000 7f9ebeffd640 1 -- 172.21.15.44:0/3097726355 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb8001ab0 con 0x7f9ea8005250 2024-05-16T22:27:45.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.109+0000 7f9ebeffd640 1 -- 172.21.15.44:0/3097726355 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9eb802ae40 con 0x7f9ea8005250 2024-05-16T22:27:45.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.109+0000 7f9ebeffd640 1 -- 172.21.15.44:0/3097726355 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb8003bb0 con 0x7f9ea8005250 2024-05-16T22:27:45.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.109+0000 7f9ec660c640 1 -- 172.21.15.44:0/3097726355 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ea8005250 msgr2=0x7f9ea800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:45.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.109+0000 7f9ec660c640 1 --2- 172.21.15.44:0/3097726355 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ea8005250 0x7f9ea800b9c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8001e60 tx=0x7f9ea8005830 comp rx=0 tx=0).stop 2024-05-16T22:27:45.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.109+0000 7f9ec660c640 1 -- 172.21.15.44:0/3097726355 shutdown_connections 2024-05-16T22:27:45.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.109+0000 7f9ec660c640 1 --2- 172.21.15.44:0/3097726355 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ea8005250 0x7f9ea800b9c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:45.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.109+0000 7f9ec660c640 1 -- 172.21.15.44:0/3097726355 >> 172.21.15.44:0/3097726355 conn(0x7f9ec00a1ac0 msgr2=0x7f9ec00bbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:45.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.110+0000 7f9ec660c640 1 -- 172.21.15.44:0/3097726355 shutdown_connections 2024-05-16T22:27:45.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.110+0000 7f9ec660c640 1 -- 172.21.15.44:0/3097726355 wait complete. 2024-05-16T22:27:45.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.111+0000 7f9ec660c640 1 Processor -- start 2024-05-16T22:27:45.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.111+0000 7f9ec660c640 1 -- start start 2024-05-16T22:27:45.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.112+0000 7f9ec660c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9ea8005250 0x7f9ec014aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:45.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.112+0000 7f9ec660c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ec01e58c0 0x7f9ec00b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:45.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.112+0000 7f9ec660c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ec00b6b00 0x7f9ec00b6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:45.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.112+0000 7f9ec660c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec00b5760 con 0x7f9ec01e58c0 2024-05-16T22:27:45.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.112+0000 7f9ec660c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec00ba2f0 con 0x7f9ec00b6b00 2024-05-16T22:27:45.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.112+0000 7f9ec660c640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f9ec00b58e0 con 0x7f9ea8005250 2024-05-16T22:27:45.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.112+0000 7f9ebf7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ec01e58c0 0x7f9ec00b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:45.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.112+0000 7f9ebf7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ec01e58c0 0x7f9ec00b65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44272/0 (socket says 172.21.15.44:44272) 2024-05-16T22:27:45.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.113+0000 7f9ebf7fe640 1 -- 172.21.15.44:0/2213218639 learned_addr learned my addr 172.21.15.44:0/2213218639 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:45.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.113+0000 7f9ebffff640 1 --2- 172.21.15.44:0/2213218639 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9ea8005250 0x7f9ec014aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:45.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.113+0000 7f9ec4ba9640 1 --2- 172.21.15.44:0/2213218639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ec00b6b00 0x7f9ec00b6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:45.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.113+0000 7f9ebf7fe640 1 -- 172.21.15.44:0/2213218639 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9ea8005250 msgr2=0x7f9ec014aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:45.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.113+0000 7f9ebf7fe640 1 --2- 172.21.15.44:0/2213218639 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9ea8005250 0x7f9ec014aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:45.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.113+0000 7f9ebf7fe640 1 -- 172.21.15.44:0/2213218639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ec00b6b00 msgr2=0x7f9ec00b6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:45.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.113+0000 7f9ebf7fe640 1 --2- 172.21.15.44:0/2213218639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ec00b6b00 0x7f9ec00b6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:45.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.113+0000 7f9ebf7fe640 1 -- 172.21.15.44:0/2213218639 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ec014afd0 con 0x7f9ec01e58c0 2024-05-16T22:27:45.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.113+0000 7f9ebf7fe640 1 --2- 172.21.15.44:0/2213218639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ec01e58c0 0x7f9ec00b65c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9eb40072f0 tx=0x7f9eb40076f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:45.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.113+0000 7f9ebcff9640 1 -- 172.21.15.44:0/2213218639 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb400f9c0 con 0x7f9ec01e58c0 2024-05-16T22:27:45.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.113+0000 7f9ebcff9640 1 -- 172.21.15.44:0/2213218639 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9eb4018070 con 0x7f9ec01e58c0 2024-05-16T22:27:45.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.113+0000 7f9ec660c640 1 -- 172.21.15.44:0/2213218639 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ec00a0190 con 0x7f9ec01e58c0 2024-05-16T22:27:45.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.113+0000 7f9ebcff9640 1 -- 172.21.15.44:0/2213218639 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb400fdc0 con 0x7f9ec01e58c0 2024-05-16T22:27:45.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.113+0000 7f9ec660c640 1 -- 172.21.15.44:0/2213218639 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ec009bc80 con 0x7f9ec01e58c0 2024-05-16T22:27:45.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.114+0000 7f9ec660c640 1 -- 172.21.15.44:0/2213218639 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ec00747e0 con 0x7f9ec01e58c0 2024-05-16T22:27:45.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.115+0000 7f9ebcff9640 1 -- 172.21.15.44:0/2213218639 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9eb401d460 con 0x7f9ec01e58c0 2024-05-16T22:27:45.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.115+0000 7f9ebcff9640 1 --2- 172.21.15.44:0/2213218639 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f9eac076300 0x7f9eac078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:45.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.115+0000 7f9ebcff9640 1 -- 172.21.15.44:0/2213218639 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9eb40974b0 con 0x7f9ec01e58c0 2024-05-16T22:27:45.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.116+0000 7f9ebffff640 1 --2- 172.21.15.44:0/2213218639 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f9eac076300 0x7f9eac078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:45.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.116+0000 7f9ebffff640 1 --2- 172.21.15.44:0/2213218639 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f9eac076300 0x7f9eac078810 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0009b40 tx=0x7f9eb0009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:45.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.120+0000 7f9ebcff9640 1 -- 172.21.15.44:0/2213218639 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9eb4060e10 con 0x7f9ec01e58c0 2024-05-16T22:27:45.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.327+0000 7f9ec660c640 1 -- 172.21.15.44:0/2213218639 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9ec00bce70 con 0x7f9ec01e58c0 2024-05-16T22:27:45.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.328+0000 7f9ebcff9640 1 -- 172.21.15.44:0/2213218639 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f9eb4060710 con 0x7f9ec01e58c0 2024-05-16T22:27:45.328 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2024-05-16T22:27:45.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.329+0000 7f9ec660c640 1 -- 172.21.15.44:0/2213218639 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f9eac076300 msgr2=0x7f9eac078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:45.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.329+0000 7f9ec660c640 1 --2- 172.21.15.44:0/2213218639 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f9eac076300 0x7f9eac078810 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0009b40 tx=0x7f9eb0009190 comp rx=0 tx=0).stop 2024-05-16T22:27:45.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.330+0000 7f9ec660c640 1 -- 172.21.15.44:0/2213218639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ec01e58c0 msgr2=0x7f9ec00b65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:45.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.330+0000 7f9ec660c640 1 --2- 172.21.15.44:0/2213218639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ec01e58c0 0x7f9ec00b65c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9eb40072f0 tx=0x7f9eb40076f0 comp rx=0 tx=0).stop 2024-05-16T22:27:45.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.330+0000 7f9ec660c640 1 -- 172.21.15.44:0/2213218639 shutdown_connections 2024-05-16T22:27:45.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.330+0000 7f9ec660c640 1 --2- 172.21.15.44:0/2213218639 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f9eac076300 0x7f9eac078810 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:45.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.330+0000 7f9ec660c640 1 --2- 172.21.15.44:0/2213218639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ec00b6b00 0x7f9ec00b6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:45.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.330+0000 7f9ec660c640 1 --2- 172.21.15.44:0/2213218639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ec01e58c0 0x7f9ec00b65c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:45.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.330+0000 7f9ec660c640 1 --2- 172.21.15.44:0/2213218639 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9ea8005250 0x7f9ec014aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:45.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.330+0000 7f9ec660c640 1 -- 172.21.15.44:0/2213218639 >> 172.21.15.44:0/2213218639 conn(0x7f9ec00a1ac0 msgr2=0x7f9ec006e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:45.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.330+0000 7f9ec660c640 1 -- 172.21.15.44:0/2213218639 shutdown_connections 2024-05-16T22:27:45.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.330+0000 7f9ec660c640 1 -- 172.21.15.44:0/2213218639 wait complete. 2024-05-16T22:27:45.341 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-16T22:27:45.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T22:27:45.341 DEBUG:teuthology.orchestra.run.smithi196:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-05-16T22:27:45.436 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi196.front.sepia.ceph.com 2024-05-16T22:27:45.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T22:27:45.436 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-16T22:27:45.493 INFO:tasks.cephfs.cephfs_test_case:[] 2024-05-16T22:27:45.494 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T22:27:45.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.606+0000 7f95e910d640 1 Processor -- start 2024-05-16T22:27:45.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.606+0000 7f95e910d640 1 -- start start 2024-05-16T22:27:45.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.607+0000 7f95e910d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f95e40bf050 0x7f95e4159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:45.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.607+0000 7f95e910d640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95e406e140 con 0x7f95e40bd6d0 2024-05-16T22:27:45.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.607+0000 7f95e910d640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95e40c36f0 con 0x7f95e4151fc0 2024-05-16T22:27:45.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.607+0000 7f95e910d640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f95e4152530 con 0x7f95e40bf050 2024-05-16T22:27:45.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.607+0000 7f95dbfff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f95e40bd6d0 0x7f95e40be940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:47184/0 (socket says 172.21.15.44:47184) 2024-05-16T22:27:45.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.607+0000 7f95dbfff640 1 -- 172.21.15.44:0/669345889 learned_addr learned my addr 172.21.15.44:0/669345889 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:27:45.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.607+0000 7f95e259c640 1 -- 172.21.15.44:0/669345889 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3597959416 0 0) 0x7f95cc001110 con 0x7f95e40bd6d0 2024-05-16T22:27:45.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.607+0000 7f95e359e640 1 --2- 172.21.15.44:0/669345889 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f95e40bf050 0x7f95e4159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:45.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.607+0000 7f95e259c640 1 -- 172.21.15.44:0/669345889 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95d0003520 con 0x7f95e40bd6d0 2024-05-16T22:27:45.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.608+0000 7f95e259c640 1 -- 172.21.15.44:0/669345889 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1172650827 0 0) 0x7f95d0003520 con 0x7f95e40bd6d0 2024-05-16T22:27:45.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.608+0000 7f95e259c640 1 -- 172.21.15.44:0/669345889 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f95e40bf050 msgr2=0x7f95e4159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:45.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.608+0000 7f95e259c640 1 --2- 172.21.15.44:0/669345889 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f95e40bf050 0x7f95e4159ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:45.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.608+0000 7f95e259c640 1 -- 172.21.15.44:0/669345889 >> v1:172.21.15.70:6789/0 conn(0x7f95e4151fc0 legacy=0x7f95e406da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:45.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.608+0000 7f95e259c640 1 -- 172.21.15.44:0/669345889 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95e4152810 con 0x7f95e40bd6d0 2024-05-16T22:27:45.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.608+0000 7f95e259c640 1 -- 172.21.15.44:0/669345889 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 568431863 0 0) 0x7f95cc0018c0 con 0x7f95e40bd6d0 2024-05-16T22:27:45.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.608+0000 7f95e259c640 1 -- 172.21.15.44:0/669345889 >> v1:172.21.15.44:6789/0 conn(0x7f95e40bd6d0 legacy=0x7f95e40be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:45.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.608+0000 7f95e259c640 1 --2- 172.21.15.44:0/669345889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95d0003a30 0x7f95d0003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:45.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.608+0000 7f95e259c640 1 --2- 172.21.15.44:0/669345889 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f95e40bf050 0x7f95d0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:45.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.608+0000 7f95e259c640 1 --2- 172.21.15.44:0/669345889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95d0004d40 0x7f95d00051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:45.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.608+0000 7f95e259c640 1 -- 172.21.15.44:0/669345889 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f95e4152530 con 0x7f95d0003a30 2024-05-16T22:27:45.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.608+0000 7f95e259c640 1 -- 172.21.15.44:0/669345889 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f95d000bc20 con 0x7f95d0004d40 2024-05-16T22:27:45.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.608+0000 7f95e259c640 1 -- 172.21.15.44:0/669345889 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f95d000be20 con 0x7f95e40bf050 2024-05-16T22:27:45.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.608+0000 7f95e2d9d640 1 --2- 172.21.15.44:0/669345889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95d0003a30 0x7f95d0003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:45.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.608+0000 7f95dbfff640 1 --2- 172.21.15.44:0/669345889 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f95e40bf050 0x7f95d0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:45.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.608+0000 7f95e359e640 1 --2- 172.21.15.44:0/669345889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95d0004d40 0x7f95d00051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:45.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.608+0000 7f95e2d9d640 1 -- 172.21.15.44:0/669345889 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f95e40bf050 msgr2=0x7f95d0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:45.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.608+0000 7f95e2d9d640 1 --2- 172.21.15.44:0/669345889 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f95e40bf050 0x7f95d0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:45.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.608+0000 7f95e2d9d640 1 -- 172.21.15.44:0/669345889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95d0004d40 msgr2=0x7f95d00051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:45.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.608+0000 7f95e2d9d640 1 --2- 172.21.15.44:0/669345889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95d0004d40 0x7f95d00051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:45.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.608+0000 7f95e2d9d640 1 -- 172.21.15.44:0/669345889 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95d0003520 con 0x7f95d0003a30 2024-05-16T22:27:45.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.608+0000 7f95dbfff640 1 --2- 172.21.15.44:0/669345889 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f95e40bf050 0x7f95d0004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:27:45.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.609+0000 7f95e2d9d640 1 --2- 172.21.15.44:0/669345889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95d0003a30 0x7f95d0003ea0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f95d4001790 tx=0x7f95d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0bc549615bc8b8c server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:45.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.609+0000 7f95e259c640 1 -- 172.21.15.44:0/669345889 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d40013b0 con 0x7f95d0003a30 2024-05-16T22:27:45.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.609+0000 7f95e259c640 1 -- 172.21.15.44:0/669345889 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95d40052d0 con 0x7f95d0003a30 2024-05-16T22:27:45.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.609+0000 7f95e259c640 1 -- 172.21.15.44:0/669345889 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d402aae0 con 0x7f95d0003a30 2024-05-16T22:27:45.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.610+0000 7f95e910d640 1 -- 172.21.15.44:0/669345889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95d0003a30 msgr2=0x7f95d0003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:45.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.610+0000 7f95e910d640 1 --2- 172.21.15.44:0/669345889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95d0003a30 0x7f95d0003ea0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f95d4001790 tx=0x7f95d0005830 comp rx=0 tx=0).stop 2024-05-16T22:27:45.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.610+0000 7f95e359e640 1 -- 172.21.15.44:0/669345889 reap_dead start 2024-05-16T22:27:45.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.610+0000 7f95e910d640 1 -- 172.21.15.44:0/669345889 shutdown_connections 2024-05-16T22:27:45.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.610+0000 7f95e910d640 1 -- 172.21.15.44:0/669345889 >> 172.21.15.44:0/669345889 conn(0x7f95e40c3d20 msgr2=0x7f95e40c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:45.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.610+0000 7f95e910d640 1 -- 172.21.15.44:0/669345889 shutdown_connections 2024-05-16T22:27:45.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.610+0000 7f95e910d640 1 -- 172.21.15.44:0/669345889 wait complete. 2024-05-16T22:27:45.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.612+0000 7f95e910d640 1 Processor -- start 2024-05-16T22:27:45.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.612+0000 7f95e910d640 1 -- start start 2024-05-16T22:27:45.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.613+0000 7f95e910d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f95e414ea50 0x7f95e40ba080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:45.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.613+0000 7f95e910d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95e41e8a70 0x7f95e41e8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:45.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.613+0000 7f95e910d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95e41e52e0 0x7f95e41e56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:45.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.613+0000 7f95e910d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f95e40a2ed0 con 0x7f95e41e8a70 2024-05-16T22:27:45.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.613+0000 7f95e910d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f95e40bdae0 con 0x7f95e41e52e0 2024-05-16T22:27:45.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.613+0000 7f95e910d640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f95e40a3050 con 0x7f95e414ea50 2024-05-16T22:27:45.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.613+0000 7f95dbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95e41e8a70 0x7f95e41e8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:45.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.613+0000 7f95dbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95e41e8a70 0x7f95e41e8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44290/0 (socket says 172.21.15.44:44290) 2024-05-16T22:27:45.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.613+0000 7f95dbfff640 1 -- 172.21.15.44:0/493380891 learned_addr learned my addr 172.21.15.44:0/493380891 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:45.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.613+0000 7f95e2d9d640 1 --2- 172.21.15.44:0/493380891 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f95e414ea50 0x7f95e40ba080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:45.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.613+0000 7f95e359e640 1 --2- 172.21.15.44:0/493380891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95e41e52e0 0x7f95e41e56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:45.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.613+0000 7f95dbfff640 1 -- 172.21.15.44:0/493380891 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f95e414ea50 msgr2=0x7f95e40ba080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:45.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.613+0000 7f95dbfff640 1 --2- 172.21.15.44:0/493380891 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f95e414ea50 0x7f95e40ba080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:45.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.613+0000 7f95dbfff640 1 -- 172.21.15.44:0/493380891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95e41e52e0 msgr2=0x7f95e41e56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:45.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.613+0000 7f95dbfff640 1 --2- 172.21.15.44:0/493380891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95e41e52e0 0x7f95e41e56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:45.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.613+0000 7f95dbfff640 1 -- 172.21.15.44:0/493380891 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95e40ba5c0 con 0x7f95e41e8a70 2024-05-16T22:27:45.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.613+0000 7f95dbfff640 1 --2- 172.21.15.44:0/493380891 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95e41e8a70 0x7f95e41e8e80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f95cc000fb0 tx=0x7f95cc0074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:45.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.613+0000 7f95db7fe640 1 -- 172.21.15.44:0/493380891 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95cc00c860 con 0x7f95e41e8a70 2024-05-16T22:27:45.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.613+0000 7f95db7fe640 1 -- 172.21.15.44:0/493380891 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95cc018070 con 0x7f95e41e8a70 2024-05-16T22:27:45.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.613+0000 7f95e910d640 1 -- 172.21.15.44:0/493380891 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95e414ef70 con 0x7f95e41e8a70 2024-05-16T22:27:45.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.614+0000 7f95db7fe640 1 -- 172.21.15.44:0/493380891 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95cc00cc40 con 0x7f95e41e8a70 2024-05-16T22:27:45.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.614+0000 7f95e910d640 1 -- 172.21.15.44:0/493380891 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95e41e8550 con 0x7f95e41e8a70 2024-05-16T22:27:45.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.614+0000 7f95e910d640 1 -- 172.21.15.44:0/493380891 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95e4050940 con 0x7f95e41e8a70 2024-05-16T22:27:45.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.615+0000 7f95db7fe640 1 -- 172.21.15.44:0/493380891 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f95cc01d460 con 0x7f95e41e8a70 2024-05-16T22:27:45.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.616+0000 7f95db7fe640 1 --2- 172.21.15.44:0/493380891 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f95c40762d0 0x7f95c40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:45.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.616+0000 7f95db7fe640 1 -- 172.21.15.44:0/493380891 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f95cc097780 con 0x7f95e41e8a70 2024-05-16T22:27:45.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.616+0000 7f95e2d9d640 1 --2- 172.21.15.44:0/493380891 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f95c40762d0 0x7f95c40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:45.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.616+0000 7f95e2d9d640 1 --2- 172.21.15.44:0/493380891 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f95c40762d0 0x7f95c40787e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f95d4032000 tx=0x7f95d402e000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:45.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.620+0000 7f95db7fe640 1 -- 172.21.15.44:0/493380891 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f95e406e140 con 0x7f95e41e8a70 2024-05-16T22:27:45.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.855+0000 7f95e910d640 1 -- 172.21.15.44:0/493380891 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f95e406eb40 con 0x7f95e41e8a70 2024-05-16T22:27:45.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.855+0000 7f95db7fe640 1 -- 172.21.15.44:0/493380891 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+4351 (secure 0 0 0) 0x7f95cc060a90 con 0x7f95e41e8a70 2024-05-16T22:27:45.856 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:27:45.856 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2940970977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2940970977},{"type":"v1","addr":"172.21.15.44:6833","nonce":2940970977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1653435882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1653435882},{"type":"v1","addr":"172.21.15.70:6835","nonce":1653435882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T22:27:25.548066+0000","modified":"2024-05-16T22:27:28.554539+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/3060763624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3060763624},{"type":"v1","addr":"172.21.15.44:6835","nonce":3060763624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-05-16T22:27:45.856 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 7 2024-05-16T22:27:45.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.857+0000 7f95e910d640 1 -- 172.21.15.44:0/493380891 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f95c40762d0 msgr2=0x7f95c40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:45.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.857+0000 7f95e910d640 1 --2- 172.21.15.44:0/493380891 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f95c40762d0 0x7f95c40787e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f95d4032000 tx=0x7f95d402e000 comp rx=0 tx=0).stop 2024-05-16T22:27:45.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.857+0000 7f95e910d640 1 -- 172.21.15.44:0/493380891 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95e41e8a70 msgr2=0x7f95e41e8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:45.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.857+0000 7f95e910d640 1 --2- 172.21.15.44:0/493380891 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95e41e8a70 0x7f95e41e8e80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f95cc000fb0 tx=0x7f95cc0074f0 comp rx=0 tx=0).stop 2024-05-16T22:27:45.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.857+0000 7f95e910d640 1 -- 172.21.15.44:0/493380891 shutdown_connections 2024-05-16T22:27:45.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.857+0000 7f95e910d640 1 --2- 172.21.15.44:0/493380891 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f95c40762d0 0x7f95c40787e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:45.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.857+0000 7f95e910d640 1 --2- 172.21.15.44:0/493380891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95e41e52e0 0x7f95e41e56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:45.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.857+0000 7f95e910d640 1 --2- 172.21.15.44:0/493380891 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95e41e8a70 0x7f95e41e8e80 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:45.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.857+0000 7f95e910d640 1 --2- 172.21.15.44:0/493380891 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f95e414ea50 0x7f95e40ba080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:45.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.857+0000 7f95e910d640 1 -- 172.21.15.44:0/493380891 >> 172.21.15.44:0/493380891 conn(0x7f95e40c3d20 msgr2=0x7f95e40c17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:45.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.857+0000 7f95e910d640 1 -- 172.21.15.44:0/493380891 shutdown_connections 2024-05-16T22:27:45.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.857+0000 7f95e910d640 1 -- 172.21.15.44:0/493380891 wait complete. 2024-05-16T22:27:45.869 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T22:27:45.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.979+0000 7f3f3cd08640 1 Processor -- start 2024-05-16T22:27:45.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.979+0000 7f3f3cd08640 1 -- start start 2024-05-16T22:27:45.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.980+0000 7f3f3cd08640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3f38151fc0 0x7f3f380bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:45.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.980+0000 7f3f3cd08640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3f3806da30 0x7f3f380be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:45.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.980+0000 7f3f3cd08640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f380c36f0 con 0x7f3f3806de40 2024-05-16T22:27:45.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.980+0000 7f3f3cd08640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f3f380bdc10 con 0x7f3f38151fc0 2024-05-16T22:27:45.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.980+0000 7f3f3cd08640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f3f38152530 con 0x7f3f3806da30 2024-05-16T22:27:45.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.980+0000 7f3f3659c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3f38151fc0 0x7f3f380bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:45.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.980+0000 7f3f3659c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3f38151fc0 0x7f3f380bd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44304/0 (socket says 172.21.15.44:44304) 2024-05-16T22:27:45.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.980+0000 7f3f3659c640 1 -- 172.21.15.44:0/2200900116 learned_addr learned my addr 172.21.15.44:0/2200900116 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:45.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.981+0000 7f3f35d9b640 1 --2- 172.21.15.44:0/2200900116 >> v2:172.21.15.70:3300/0 conn(0x7f3f3806da30 0x7f3f380be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:45.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.981+0000 7f3f3659c640 1 -- 172.21.15.44:0/2200900116 >> v2:172.21.15.70:3300/0 conn(0x7f3f3806da30 msgr2=0x7f3f380be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:45.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.981+0000 7f3f3659c640 1 --2- 172.21.15.44:0/2200900116 >> v2:172.21.15.70:3300/0 conn(0x7f3f3806da30 0x7f3f380be940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:45.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.981+0000 7f3f3659c640 1 -- 172.21.15.44:0/2200900116 >> v1:172.21.15.70:6789/0 conn(0x7f3f3806de40 legacy=0x7f3f3814e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:45.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.981+0000 7f3f3659c640 1 -- 172.21.15.44:0/2200900116 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f38152810 con 0x7f3f38151fc0 2024-05-16T22:27:45.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.981+0000 7f3f35d9b640 1 --2- 172.21.15.44:0/2200900116 >> v2:172.21.15.70:3300/0 conn(0x7f3f3806da30 0x7f3f380be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:27:45.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.981+0000 7f3f3659c640 1 --2- 172.21.15.44:0/2200900116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f38151fc0 0x7f3f380bd6d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3f380c3290 tx=0x7f3f3002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16ad3dc534b04481 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:45.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.982+0000 7f3f3559a640 1 -- 172.21.15.44:0/2200900116 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f30037070 con 0x7f3f38151fc0 2024-05-16T22:27:45.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.982+0000 7f3f3559a640 1 -- 172.21.15.44:0/2200900116 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f30032440 con 0x7f3f38151fc0 2024-05-16T22:27:45.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.982+0000 7f3f3559a640 1 -- 172.21.15.44:0/2200900116 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f30032810 con 0x7f3f38151fc0 2024-05-16T22:27:45.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.982+0000 7f3f3cd08640 1 -- 172.21.15.44:0/2200900116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f38151fc0 msgr2=0x7f3f380bd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:45.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.982+0000 7f3f3cd08640 1 --2- 172.21.15.44:0/2200900116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f38151fc0 0x7f3f380bd6d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3f380c3290 tx=0x7f3f3002a1e0 comp rx=0 tx=0).stop 2024-05-16T22:27:45.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.982+0000 7f3f3cd08640 1 -- 172.21.15.44:0/2200900116 shutdown_connections 2024-05-16T22:27:45.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.982+0000 7f3f3cd08640 1 --2- 172.21.15.44:0/2200900116 >> v2:172.21.15.70:3300/0 conn(0x7f3f3806da30 0x7f3f380be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:45.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.982+0000 7f3f3cd08640 1 --2- 172.21.15.44:0/2200900116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f38151fc0 0x7f3f380bd6d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:45.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.982+0000 7f3f3cd08640 1 -- 172.21.15.44:0/2200900116 >> 172.21.15.44:0/2200900116 conn(0x7f3f380c3d20 msgr2=0x7f3f380c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:45.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.982+0000 7f3f3cd08640 1 -- 172.21.15.44:0/2200900116 shutdown_connections 2024-05-16T22:27:45.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.983+0000 7f3f3cd08640 1 -- 172.21.15.44:0/2200900116 wait complete. 2024-05-16T22:27:45.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.984+0000 7f3f3cd08640 1 Processor -- start 2024-05-16T22:27:45.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.984+0000 7f3f3cd08640 1 -- start start 2024-05-16T22:27:45.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.985+0000 7f3f3cd08640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f3806da30 0x7f3f3814b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:45.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.985+0000 7f3f3cd08640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f3806de40 0x7f3f380b9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:45.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.985+0000 7f3f3cd08640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3f38151fc0 0x7f3f381e7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:45.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.985+0000 7f3f3cd08640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3f380a3050 con 0x7f3f3806de40 2024-05-16T22:27:45.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.985+0000 7f3f3cd08640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3f380a2ed0 con 0x7f3f3806da30 2024-05-16T22:27:45.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.985+0000 7f3f3cd08640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f3f380bee80 con 0x7f3f38151fc0 2024-05-16T22:27:45.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.985+0000 7f3f35d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f3806de40 0x7f3f380b9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:45.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.985+0000 7f3f35d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f3806de40 0x7f3f380b9370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44312/0 (socket says 172.21.15.44:44312) 2024-05-16T22:27:45.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.985+0000 7f3f35d9b640 1 -- 172.21.15.44:0/1342205994 learned_addr learned my addr 172.21.15.44:0/1342205994 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:45.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.986+0000 7f3f3659c640 1 --2- 172.21.15.44:0/1342205994 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f3806da30 0x7f3f3814b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:45.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.986+0000 7f3f36d9d640 1 --2- 172.21.15.44:0/1342205994 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3f38151fc0 0x7f3f381e7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:45.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.986+0000 7f3f35d9b640 1 -- 172.21.15.44:0/1342205994 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3f38151fc0 msgr2=0x7f3f381e7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:45.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.986+0000 7f3f35d9b640 1 --2- 172.21.15.44:0/1342205994 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3f38151fc0 0x7f3f381e7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:45.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.986+0000 7f3f35d9b640 1 -- 172.21.15.44:0/1342205994 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f3806da30 msgr2=0x7f3f3814b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:45.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.986+0000 7f3f35d9b640 1 --2- 172.21.15.44:0/1342205994 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f3806da30 0x7f3f3814b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:45.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.986+0000 7f3f35d9b640 1 -- 172.21.15.44:0/1342205994 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f3814bb30 con 0x7f3f3806de40 2024-05-16T22:27:45.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.986+0000 7f3f3659c640 1 --2- 172.21.15.44:0/1342205994 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f3806da30 0x7f3f3814b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:27:45.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.986+0000 7f3f35d9b640 1 --2- 172.21.15.44:0/1342205994 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f3806de40 0x7f3f380b9370 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3f2000d800 tx=0x7f3f2000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:45.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.986+0000 7f3f2effd640 1 -- 172.21.15.44:0/1342205994 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f20004030 con 0x7f3f3806de40 2024-05-16T22:27:45.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.986+0000 7f3f2effd640 1 -- 172.21.15.44:0/1342205994 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f200041d0 con 0x7f3f3806de40 2024-05-16T22:27:45.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.986+0000 7f3f3cd08640 1 -- 172.21.15.44:0/1342205994 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f380b98b0 con 0x7f3f3806de40 2024-05-16T22:27:45.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.986+0000 7f3f2effd640 1 -- 172.21.15.44:0/1342205994 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f200096a0 con 0x7f3f3806de40 2024-05-16T22:27:45.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.986+0000 7f3f3cd08640 1 -- 172.21.15.44:0/1342205994 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f380ba2a0 con 0x7f3f3806de40 2024-05-16T22:27:45.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.987+0000 7f3f3cd08640 1 -- 172.21.15.44:0/1342205994 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f38050940 con 0x7f3f3806de40 2024-05-16T22:27:45.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.988+0000 7f3f2effd640 1 -- 172.21.15.44:0/1342205994 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3f20009840 con 0x7f3f3806de40 2024-05-16T22:27:45.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.988+0000 7f3f2effd640 1 --2- 172.21.15.44:0/1342205994 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f3f18076300 0x7f3f18078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:45.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.988+0000 7f3f2effd640 1 -- 172.21.15.44:0/1342205994 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3f20097930 con 0x7f3f3806de40 2024-05-16T22:27:45.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.989+0000 7f3f3659c640 1 --2- 172.21.15.44:0/1342205994 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f3f18076300 0x7f3f18078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:45.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.989+0000 7f3f3659c640 1 --2- 172.21.15.44:0/1342205994 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f3f18076300 0x7f3f18078810 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3f30034000 tx=0x7f3f3002e000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:45.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:45.993+0000 7f3f2effd640 1 -- 172.21.15.44:0/1342205994 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3f380b98b0 con 0x7f3f3806de40 2024-05-16T22:27:46.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.220+0000 7f3f3cd08640 1 -- 172.21.15.44:0/1342205994 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3f3806eb40 con 0x7f3f3806de40 2024-05-16T22:27:46.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.224+0000 7f3f2effd640 1 -- 172.21.15.44:0/1342205994 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+4351 (secure 0 0 0) 0x7f3f20061160 con 0x7f3f3806de40 2024-05-16T22:27:46.224 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:27:46.224 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2940970977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2940970977},{"type":"v1","addr":"172.21.15.44:6833","nonce":2940970977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1653435882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1653435882},{"type":"v1","addr":"172.21.15.70:6835","nonce":1653435882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T22:27:25.548066+0000","modified":"2024-05-16T22:27:28.554539+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/3060763624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3060763624},{"type":"v1","addr":"172.21.15.44:6835","nonce":3060763624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-05-16T22:27:46.225 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 7 2024-05-16T22:27:46.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.226+0000 7f3f3cd08640 1 -- 172.21.15.44:0/1342205994 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f3f18076300 msgr2=0x7f3f18078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:46.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.226+0000 7f3f3cd08640 1 --2- 172.21.15.44:0/1342205994 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f3f18076300 0x7f3f18078810 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3f30034000 tx=0x7f3f3002e000 comp rx=0 tx=0).stop 2024-05-16T22:27:46.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.226+0000 7f3f3cd08640 1 -- 172.21.15.44:0/1342205994 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f3806de40 msgr2=0x7f3f380b9370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:46.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.226+0000 7f3f3cd08640 1 --2- 172.21.15.44:0/1342205994 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f3806de40 0x7f3f380b9370 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3f2000d800 tx=0x7f3f2000dcc0 comp rx=0 tx=0).stop 2024-05-16T22:27:46.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.226+0000 7f3f3cd08640 1 -- 172.21.15.44:0/1342205994 shutdown_connections 2024-05-16T22:27:46.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.226+0000 7f3f3cd08640 1 --2- 172.21.15.44:0/1342205994 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f3f18076300 0x7f3f18078810 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:46.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.226+0000 7f3f3cd08640 1 --2- 172.21.15.44:0/1342205994 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3f38151fc0 0x7f3f381e7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:46.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.226+0000 7f3f3cd08640 1 --2- 172.21.15.44:0/1342205994 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f3806de40 0x7f3f380b9370 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:46.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.226+0000 7f3f3cd08640 1 --2- 172.21.15.44:0/1342205994 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f3806da30 0x7f3f3814b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:46.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.226+0000 7f3f3cd08640 1 -- 172.21.15.44:0/1342205994 >> 172.21.15.44:0/1342205994 conn(0x7f3f380c3d20 msgr2=0x7f3f380a4b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:46.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.226+0000 7f3f3cd08640 1 -- 172.21.15.44:0/1342205994 shutdown_connections 2024-05-16T22:27:46.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.226+0000 7f3f3cd08640 1 -- 172.21.15.44:0/1342205994 wait complete. 2024-05-16T22:27:46.237 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-16T22:27:46.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.348+0000 7f1b55e4c640 1 Processor -- start 2024-05-16T22:27:46.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.348+0000 7f1b55e4c640 1 -- start start 2024-05-16T22:27:46.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.349+0000 7f1b55e4c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1b500b4aa0 0x7f1b500b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:46.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.349+0000 7f1b55e4c640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b5006fed0 con 0x7f1b5014f240 2024-05-16T22:27:46.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.349+0000 7f1b55e4c640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b500bb0e0 con 0x7f1b5014e720 2024-05-16T22:27:46.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.349+0000 7f1b55e4c640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f1b50071f40 con 0x7f1b500b4aa0 2024-05-16T22:27:46.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.350+0000 7f1b4ffff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f1b5014f240 0x7f1b5006f7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:47188/0 (socket says 172.21.15.44:47188) 2024-05-16T22:27:46.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.350+0000 7f1b4ffff640 1 -- 172.21.15.44:0/3877914087 learned_addr learned my addr 172.21.15.44:0/3877914087 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:27:46.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.350+0000 7f1b4f7fe640 1 --2- 172.21.15.44:0/3877914087 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1b500b4aa0 0x7f1b500b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:46.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.350+0000 7f1b4e7fc640 1 -- 172.21.15.44:0/3877914087 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 952100973 0 0) 0x7f1b48001490 con 0x7f1b5014f240 2024-05-16T22:27:46.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.350+0000 7f1b4e7fc640 1 -- 172.21.15.44:0/3877914087 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b38003520 con 0x7f1b5014f240 2024-05-16T22:27:46.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.350+0000 7f1b4e7fc640 1 -- 172.21.15.44:0/3877914087 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2903390880 0 0) 0x7f1b500bb0e0 con 0x7f1b5014e720 2024-05-16T22:27:46.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.350+0000 7f1b4e7fc640 1 -- 172.21.15.44:0/3877914087 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b48001490 con 0x7f1b5014e720 2024-05-16T22:27:46.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.350+0000 7f1b4f7fe640 1 -- 172.21.15.44:0/3877914087 >> v1:172.21.15.70:6789/0 conn(0x7f1b5014e720 legacy=0x7f1b5014eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:46.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.350+0000 7f1b4f7fe640 1 -- 172.21.15.44:0/3877914087 >> v1:172.21.15.44:6789/0 conn(0x7f1b5014f240 legacy=0x7f1b5006f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:46.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.350+0000 7f1b4f7fe640 1 -- 172.21.15.44:0/3877914087 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b500bab60 con 0x7f1b500b4aa0 2024-05-16T22:27:46.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.351+0000 7f1b4f7fe640 1 --2- 172.21.15.44:0/3877914087 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1b500b4aa0 0x7f1b500b4eb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1b4000a970 tx=0x7f1b4002a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b19c3803c7d50088 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:46.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.351+0000 7f1b4e7fc640 1 -- 172.21.15.44:0/3877914087 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4000b040 con 0x7f1b500b4aa0 2024-05-16T22:27:46.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.351+0000 7f1b4e7fc640 1 -- 172.21.15.44:0/3877914087 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b4002f710 con 0x7f1b500b4aa0 2024-05-16T22:27:46.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.351+0000 7f1b4e7fc640 1 -- 172.21.15.44:0/3877914087 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4002fac0 con 0x7f1b500b4aa0 2024-05-16T22:27:46.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.352+0000 7f1b55e4c640 1 -- 172.21.15.44:0/3877914087 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1b500b4aa0 msgr2=0x7f1b500b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:46.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.352+0000 7f1b55e4c640 1 --2- 172.21.15.44:0/3877914087 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1b500b4aa0 0x7f1b500b4eb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1b4000a970 tx=0x7f1b4002a430 comp rx=0 tx=0).stop 2024-05-16T22:27:46.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.352+0000 7f1b55e4c640 1 -- 172.21.15.44:0/3877914087 shutdown_connections 2024-05-16T22:27:46.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.352+0000 7f1b55e4c640 1 --2- 172.21.15.44:0/3877914087 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1b500b4aa0 0x7f1b500b4eb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:46.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.352+0000 7f1b55e4c640 1 -- 172.21.15.44:0/3877914087 >> 172.21.15.44:0/3877914087 conn(0x7f1b500a1ac0 msgr2=0x7f1b500bbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:46.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.352+0000 7f1b55e4c640 1 -- 172.21.15.44:0/3877914087 shutdown_connections 2024-05-16T22:27:46.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.352+0000 7f1b55e4c640 1 -- 172.21.15.44:0/3877914087 wait complete. 2024-05-16T22:27:46.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.353+0000 7f1b55e4c640 1 Processor -- start 2024-05-16T22:27:46.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.353+0000 7f1b55e4c640 1 -- start start 2024-05-16T22:27:46.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.354+0000 7f1b55e4c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1b500b4aa0 0x7f1b500bdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:46.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.354+0000 7f1b55e4c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b5014e720 0x7f1b501426b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:46.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.354+0000 7f1b55e4c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b5014f240 0x7f1b500a2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:46.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.354+0000 7f1b55e4c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1b500b9ee0 con 0x7f1b5014f240 2024-05-16T22:27:46.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.354+0000 7f1b55e4c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1b500ba060 con 0x7f1b5014e720 2024-05-16T22:27:46.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.354+0000 7f1b55e4c640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f1b500b4500 con 0x7f1b500b4aa0 2024-05-16T22:27:46.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.355+0000 7f1b4ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b5014f240 0x7f1b500a2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:46.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.355+0000 7f1b4ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b5014f240 0x7f1b500a2840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44314/0 (socket says 172.21.15.44:44314) 2024-05-16T22:27:46.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.355+0000 7f1b4ffff640 1 -- 172.21.15.44:0/230748281 learned_addr learned my addr 172.21.15.44:0/230748281 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:46.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.355+0000 7f1b4f7fe640 1 --2- 172.21.15.44:0/230748281 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1b500b4aa0 0x7f1b500bdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:46.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.355+0000 7f1b4effd640 1 --2- 172.21.15.44:0/230748281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b5014e720 0x7f1b501426b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:46.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.355+0000 7f1b4ffff640 1 -- 172.21.15.44:0/230748281 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1b500b4aa0 msgr2=0x7f1b500bdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:46.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.355+0000 7f1b4ffff640 1 --2- 172.21.15.44:0/230748281 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1b500b4aa0 0x7f1b500bdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:46.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.355+0000 7f1b4ffff640 1 -- 172.21.15.44:0/230748281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b5014e720 msgr2=0x7f1b501426b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:46.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.355+0000 7f1b4ffff640 1 --2- 172.21.15.44:0/230748281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b5014e720 0x7f1b501426b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:46.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.355+0000 7f1b4ffff640 1 -- 172.21.15.44:0/230748281 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b500be510 con 0x7f1b5014f240 2024-05-16T22:27:46.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.355+0000 7f1b4ffff640 1 --2- 172.21.15.44:0/230748281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b5014f240 0x7f1b500a2840 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1b48001ed0 tx=0x7f1b4800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:46.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.355+0000 7f1b37fff640 1 -- 172.21.15.44:0/230748281 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b48012400 con 0x7f1b5014f240 2024-05-16T22:27:46.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.355+0000 7f1b37fff640 1 -- 172.21.15.44:0/230748281 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b480125a0 con 0x7f1b5014f240 2024-05-16T22:27:46.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.355+0000 7f1b55e4c640 1 -- 172.21.15.44:0/230748281 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b50142bf0 con 0x7f1b5014f240 2024-05-16T22:27:46.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.355+0000 7f1b37fff640 1 -- 172.21.15.44:0/230748281 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b48012990 con 0x7f1b5014f240 2024-05-16T22:27:46.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.355+0000 7f1b55e4c640 1 -- 172.21.15.44:0/230748281 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b50141360 con 0x7f1b5014f240 2024-05-16T22:27:46.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.356+0000 7f1b55e4c640 1 -- 172.21.15.44:0/230748281 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b500a4a70 con 0x7f1b5014f240 2024-05-16T22:27:46.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.357+0000 7f1b37fff640 1 -- 172.21.15.44:0/230748281 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1b48012b30 con 0x7f1b5014f240 2024-05-16T22:27:46.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.358+0000 7f1b37fff640 1 --2- 172.21.15.44:0/230748281 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f1b3c0762d0 0x7f1b3c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:46.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.358+0000 7f1b4f7fe640 1 --2- 172.21.15.44:0/230748281 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f1b3c0762d0 0x7f1b3c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:46.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.358+0000 7f1b37fff640 1 -- 172.21.15.44:0/230748281 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1b48097e70 con 0x7f1b5014f240 2024-05-16T22:27:46.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.358+0000 7f1b4f7fe640 1 --2- 172.21.15.44:0/230748281 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f1b3c0762d0 0x7f1b3c0787e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1b40034000 tx=0x7f1b4002f000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:46.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.362+0000 7f1b37fff640 1 -- 172.21.15.44:0/230748281 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1b50142bf0 con 0x7f1b5014f240 2024-05-16T22:27:46.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.552+0000 7f1b55e4c640 1 -- 172.21.15.44:0/230748281 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1b50050970 con 0x7f1b5014f240 2024-05-16T22:27:46.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.553+0000 7f1b37fff640 1 -- 172.21.15.44:0/230748281 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16569 (secure 0 0 0) 0x7f1b5006fed0 con 0x7f1b5014f240 2024-05-16T22:27:46.554 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:27:46.554 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":21,"fsid":"572ab7cc-b103-4548-ae8f-c6614d57f0c8","created":"2024-05-16T22:27:02.216874+0000","modified":"2024-05-16T22:27:27.151884+0000","last_up_change":"2024-05-16T22:27:13.693953+0000","last_in_change":"2024-05-16T22:27:04.455119+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-16T22:27:14.562409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-16T22:27:23.458618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-16T22:27:24.495231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a7003e89-c706-4562-9f25-670bb35ae108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6825","nonce":1074109859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6827","nonce":1074109859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6831","nonce":1074109859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6829","nonce":1074109859}]},"public_addr":"172.21.15.44:6825/1074109859","cluster_addr":"172.21.15.44:6827/1074109859","heartbeat_back_addr":"172.21.15.44:6831/1074109859","heartbeat_front_addr":"172.21.15.44:6829/1074109859","state":["exists","up"]},{"osd":1,"uuid":"a4d5169d-8327-4494-9c7c-58db21b00636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6817","nonce":2909429972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6819","nonce":2909429972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6823","nonce":2909429972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6821","nonce":2909429972}]},"public_addr":"172.21.15.44:6817/2909429972","cluster_addr":"172.21.15.44:6819/2909429972","heartbeat_back_addr":"172.21.15.44:6823/2909429972","heartbeat_front_addr":"172.21.15.44:6821/2909429972","state":["exists","up"]},{"osd":2,"uuid":"d4a834f8-83a5-400f-9814-eb0a25124df4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6801","nonce":2908194156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6803","nonce":2908194156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6807","nonce":2908194156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6805","nonce":2908194156}]},"public_addr":"172.21.15.44:6801/2908194156","cluster_addr":"172.21.15.44:6803/2908194156","heartbeat_back_addr":"172.21.15.44:6807/2908194156","heartbeat_front_addr":"172.21.15.44:6805/2908194156","state":["exists","up"]},{"osd":3,"uuid":"b9d24a56-ad43-4674-a395-5ec24d135ae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6809","nonce":2168695793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6811","nonce":2168695793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6815","nonce":2168695793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6813","nonce":2168695793}]},"public_addr":"172.21.15.44:6809/2168695793","cluster_addr":"172.21.15.44:6811/2168695793","heartbeat_back_addr":"172.21.15.44:6815/2168695793","heartbeat_front_addr":"172.21.15.44:6813/2168695793","state":["exists","up"]},{"osd":4,"uuid":"9bd94af5-3e17-4cbe-995a-8f837a66c653","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6823","nonce":1540297751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6825","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6827","nonce":1540297751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6831","nonce":1540297751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6829","nonce":1540297751}]},"public_addr":"172.21.15.70:6823/1540297751","cluster_addr":"172.21.15.70:6827/1540297751","heartbeat_back_addr":"172.21.15.70:6831/1540297751","heartbeat_front_addr":"172.21.15.70:6829/1540297751","state":["exists","up"]},{"osd":5,"uuid":"a5b0cfa5-b259-48bd-98b6-96b44f5ebabd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6804","nonce":4218901987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6808","nonce":4218901987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6815","nonce":4218901987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6812","nonce":4218901987}]},"public_addr":"172.21.15.70:6804/4218901987","cluster_addr":"172.21.15.70:6808/4218901987","heartbeat_back_addr":"172.21.15.70:6815/4218901987","heartbeat_front_addr":"172.21.15.70:6812/4218901987","state":["exists","up"]},{"osd":6,"uuid":"0b6af6df-1358-4fc6-a62c-ba57e02914ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6801","nonce":2389556489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6805","nonce":2389556489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6813","nonce":2389556489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6807","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6809","nonce":2389556489}]},"public_addr":"172.21.15.70:6801/2389556489","cluster_addr":"172.21.15.70:6805/2389556489","heartbeat_back_addr":"172.21.15.70:6813/2389556489","heartbeat_front_addr":"172.21.15.70:6809/2389556489","state":["exists","up"]},{"osd":7,"uuid":"eb1a2c5d-42cf-47d0-9e03-b9d26944a589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6817","nonce":3619691281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6819","nonce":3619691281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6826","nonce":3619691281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6822","nonce":3619691281}]},"public_addr":"172.21.15.70:6817/3619691281","cluster_addr":"172.21.15.70:6819/3619691281","heartbeat_back_addr":"172.21.15.70:6826/3619691281","heartbeat_front_addr":"172.21.15.70:6822/3619691281","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.652256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.613348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.528454+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.625204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.678845+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.680829+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.556200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.647030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T22:27:46.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.555+0000 7f1b55e4c640 1 -- 172.21.15.44:0/230748281 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f1b3c0762d0 msgr2=0x7f1b3c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:46.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.555+0000 7f1b55e4c640 1 --2- 172.21.15.44:0/230748281 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f1b3c0762d0 0x7f1b3c0787e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1b40034000 tx=0x7f1b4002f000 comp rx=0 tx=0).stop 2024-05-16T22:27:46.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.555+0000 7f1b55e4c640 1 -- 172.21.15.44:0/230748281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b5014f240 msgr2=0x7f1b500a2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:46.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.555+0000 7f1b55e4c640 1 --2- 172.21.15.44:0/230748281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b5014f240 0x7f1b500a2840 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1b48001ed0 tx=0x7f1b4800a430 comp rx=0 tx=0).stop 2024-05-16T22:27:46.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.555+0000 7f1b55e4c640 1 -- 172.21.15.44:0/230748281 shutdown_connections 2024-05-16T22:27:46.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.556+0000 7f1b55e4c640 1 --2- 172.21.15.44:0/230748281 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f1b3c0762d0 0x7f1b3c0787e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:46.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.556+0000 7f1b55e4c640 1 --2- 172.21.15.44:0/230748281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b5014f240 0x7f1b500a2840 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:46.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.556+0000 7f1b55e4c640 1 --2- 172.21.15.44:0/230748281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b5014e720 0x7f1b501426b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:46.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.556+0000 7f1b55e4c640 1 --2- 172.21.15.44:0/230748281 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1b500b4aa0 0x7f1b500bdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:46.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.556+0000 7f1b55e4c640 1 -- 172.21.15.44:0/230748281 >> 172.21.15.44:0/230748281 conn(0x7f1b500a1ac0 msgr2=0x7f1b5014eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:46.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.556+0000 7f1b55e4c640 1 -- 172.21.15.44:0/230748281 shutdown_connections 2024-05-16T22:27:46.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.556+0000 7f1b55e4c640 1 -- 172.21.15.44:0/230748281 wait complete. 2024-05-16T22:27:46.567 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-16T22:27:46.568 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T22:27:46.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.678+0000 7fde889dc640 1 Processor -- start 2024-05-16T22:27:46.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.678+0000 7fde889dc640 1 -- start start 2024-05-16T22:27:46.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.679+0000 7fde889dc640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fde840b99c0 0x7fde840ba240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:46.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.679+0000 7fde889dc640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde8414e9b0 con 0x7fde840b8a20 2024-05-16T22:27:46.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.680+0000 7fde889dc640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde8414ec90 con 0x7fde8414e440 2024-05-16T22:27:46.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.680+0000 7fde889dc640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fde8414ef70 con 0x7fde840b99c0 2024-05-16T22:27:46.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.680+0000 7fde82d9d640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fde840b8a20 0x7fde840b8e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:47192/0 (socket says 172.21.15.44:47192) 2024-05-16T22:27:46.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.680+0000 7fde82d9d640 1 -- 172.21.15.44:0/1740932541 learned_addr learned my addr 172.21.15.44:0/1740932541 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:27:46.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.680+0000 7fde8159a640 1 -- 172.21.15.44:0/1740932541 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1483087442 0 0) 0x7fde8414e9b0 con 0x7fde840b8a20 2024-05-16T22:27:46.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.680+0000 7fde8159a640 1 -- 172.21.15.44:0/1740932541 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde6c003520 con 0x7fde840b8a20 2024-05-16T22:27:46.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.680+0000 7fde81d9b640 1 --2- 172.21.15.44:0/1740932541 >> v2:172.21.15.70:3300/0 conn(0x7fde840b99c0 0x7fde840ba240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:46.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.680+0000 7fde8159a640 1 -- 172.21.15.44:0/1740932541 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 24896908 0 0) 0x7fde6c003520 con 0x7fde840b8a20 2024-05-16T22:27:46.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.680+0000 7fde8159a640 1 -- 172.21.15.44:0/1740932541 >> v2:172.21.15.70:3300/0 conn(0x7fde840b99c0 msgr2=0x7fde840ba240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:46.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.680+0000 7fde8159a640 1 --2- 172.21.15.44:0/1740932541 >> v2:172.21.15.70:3300/0 conn(0x7fde840b99c0 0x7fde840ba240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:46.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.680+0000 7fde8159a640 1 -- 172.21.15.44:0/1740932541 >> v1:172.21.15.70:6789/0 conn(0x7fde8414e440 legacy=0x7fde840bd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:46.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.680+0000 7fde8159a640 1 -- 172.21.15.44:0/1740932541 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde8414f250 con 0x7fde840b8a20 2024-05-16T22:27:46.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.680+0000 7fde8159a640 1 -- 172.21.15.44:0/1740932541 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 568431863 0 0) 0x7fde7c001a90 con 0x7fde840b8a20 2024-05-16T22:27:46.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.680+0000 7fde8159a640 1 -- 172.21.15.44:0/1740932541 >> v1:172.21.15.44:6789/0 conn(0x7fde840b8a20 legacy=0x7fde840b8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:46.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.680+0000 7fde8159a640 1 --2- 172.21.15.44:0/1740932541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde6c003a50 0x7fde6c003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:46.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.680+0000 7fde8159a640 1 --2- 172.21.15.44:0/1740932541 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fde6c004800 0x7fde6c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:46.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.680+0000 7fde8159a640 1 --2- 172.21.15.44:0/1740932541 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde6c005250 0x7fde6c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:46.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.680+0000 7fde8159a640 1 -- 172.21.15.44:0/1740932541 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fde8414ef70 con 0x7fde6c005250 2024-05-16T22:27:46.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.680+0000 7fde8159a640 1 -- 172.21.15.44:0/1740932541 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fde6c00c1e0 con 0x7fde6c003a50 2024-05-16T22:27:46.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.680+0000 7fde8159a640 1 -- 172.21.15.44:0/1740932541 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fde6c00c3e0 con 0x7fde6c004800 2024-05-16T22:27:46.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.680+0000 7fde8259c640 1 --2- 172.21.15.44:0/1740932541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde6c003a50 0x7fde6c003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:46.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.680+0000 7fde82d9d640 1 --2- 172.21.15.44:0/1740932541 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde6c005250 0x7fde6c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:46.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.680+0000 7fde81d9b640 1 --2- 172.21.15.44:0/1740932541 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fde6c004800 0x7fde6c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:46.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.681+0000 7fde82d9d640 1 -- 172.21.15.44:0/1740932541 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fde6c004800 msgr2=0x7fde6c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:46.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.681+0000 7fde82d9d640 1 --2- 172.21.15.44:0/1740932541 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fde6c004800 0x7fde6c004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:46.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.681+0000 7fde82d9d640 1 -- 172.21.15.44:0/1740932541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde6c003a50 msgr2=0x7fde6c003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:46.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.681+0000 7fde82d9d640 1 --2- 172.21.15.44:0/1740932541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde6c003a50 0x7fde6c003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:46.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.681+0000 7fde82d9d640 1 -- 172.21.15.44:0/1740932541 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde6c003520 con 0x7fde6c005250 2024-05-16T22:27:46.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.681+0000 7fde8259c640 1 --2- 172.21.15.44:0/1740932541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde6c003a50 0x7fde6c003ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:27:46.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.681+0000 7fde82d9d640 1 -- 172.21.15.44:0/1740932541 reap_dead start 2024-05-16T22:27:46.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.681+0000 7fde82d9d640 1 --2- 172.21.15.44:0/1740932541 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde6c005250 0x7fde6c00b9c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fde8414e8e0 tx=0x7fde6c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a946ddc6b1fb69b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:46.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.682+0000 7fde8159a640 1 -- 172.21.15.44:0/1740932541 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde740013b0 con 0x7fde6c005250 2024-05-16T22:27:46.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.682+0000 7fde8159a640 1 -- 172.21.15.44:0/1740932541 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde7c02f070 con 0x7fde6c005250 2024-05-16T22:27:46.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.682+0000 7fde8159a640 1 -- 172.21.15.44:0/1740932541 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7c00a480 con 0x7fde6c005250 2024-05-16T22:27:46.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.682+0000 7fde889dc640 1 -- 172.21.15.44:0/1740932541 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde6c005250 msgr2=0x7fde6c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:46.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.682+0000 7fde889dc640 1 --2- 172.21.15.44:0/1740932541 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde6c005250 0x7fde6c00b9c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fde8414e8e0 tx=0x7fde6c005830 comp rx=0 tx=0).stop 2024-05-16T22:27:46.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.682+0000 7fde889dc640 1 -- 172.21.15.44:0/1740932541 shutdown_connections 2024-05-16T22:27:46.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.682+0000 7fde889dc640 1 --2- 172.21.15.44:0/1740932541 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde6c005250 0x7fde6c00b9c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:46.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.682+0000 7fde889dc640 1 -- 172.21.15.44:0/1740932541 >> 172.21.15.44:0/1740932541 conn(0x7fde840c0390 msgr2=0x7fde840c07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:46.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.682+0000 7fde889dc640 1 -- 172.21.15.44:0/1740932541 shutdown_connections 2024-05-16T22:27:46.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.682+0000 7fde889dc640 1 -- 172.21.15.44:0/1740932541 wait complete. 2024-05-16T22:27:46.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.684+0000 7fde889dc640 1 Processor -- start 2024-05-16T22:27:46.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.684+0000 7fde889dc640 1 -- start start 2024-05-16T22:27:46.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.685+0000 7fde889dc640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fde6c005250 0x7fde841d7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:46.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.685+0000 7fde889dc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde8414b8e0 0x7fde841497c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:46.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.685+0000 7fde889dc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde841e4400 0x7fde841e4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:46.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.685+0000 7fde889dc640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fde840b8fb0 con 0x7fde841e4400 2024-05-16T22:27:46.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.685+0000 7fde889dc640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fde840b8e30 con 0x7fde8414b8e0 2024-05-16T22:27:46.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.685+0000 7fde889dc640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fde840b9130 con 0x7fde6c005250 2024-05-16T22:27:46.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.685+0000 7fde82d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde841e4400 0x7fde841e4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:46.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.685+0000 7fde82d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde841e4400 0x7fde841e4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44334/0 (socket says 172.21.15.44:44334) 2024-05-16T22:27:46.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.685+0000 7fde82d9d640 1 -- 172.21.15.44:0/3831317595 learned_addr learned my addr 172.21.15.44:0/3831317595 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:46.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.685+0000 7fde81d9b640 1 --2- 172.21.15.44:0/3831317595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde8414b8e0 0x7fde841497c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:46.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.685+0000 7fde8259c640 1 --2- 172.21.15.44:0/3831317595 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fde6c005250 0x7fde841d7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:46.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.686+0000 7fde82d9d640 1 -- 172.21.15.44:0/3831317595 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fde6c005250 msgr2=0x7fde841d7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:46.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.686+0000 7fde82d9d640 1 --2- 172.21.15.44:0/3831317595 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fde6c005250 0x7fde841d7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:46.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.686+0000 7fde82d9d640 1 -- 172.21.15.44:0/3831317595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde8414b8e0 msgr2=0x7fde841497c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:46.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.686+0000 7fde82d9d640 1 --2- 172.21.15.44:0/3831317595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde8414b8e0 0x7fde841497c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:46.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.686+0000 7fde82d9d640 1 -- 172.21.15.44:0/3831317595 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde84149030 con 0x7fde841e4400 2024-05-16T22:27:46.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.686+0000 7fde82d9d640 1 --2- 172.21.15.44:0/3831317595 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde841e4400 0x7fde841e4810 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fde7c005c20 tx=0x7fde8414ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:46.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.686+0000 7fde72ffd640 1 -- 172.21.15.44:0/3831317595 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7c001fc0 con 0x7fde841e4400 2024-05-16T22:27:46.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.686+0000 7fde72ffd640 1 -- 172.21.15.44:0/3831317595 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde7c00a460 con 0x7fde841e4400 2024-05-16T22:27:46.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.686+0000 7fde889dc640 1 -- 172.21.15.44:0/3831317595 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde841d8200 con 0x7fde841e4400 2024-05-16T22:27:46.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.686+0000 7fde72ffd640 1 -- 172.21.15.44:0/3831317595 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7c034470 con 0x7fde841e4400 2024-05-16T22:27:46.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.686+0000 7fde889dc640 1 -- 172.21.15.44:0/3831317595 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde84149d00 con 0x7fde841e4400 2024-05-16T22:27:46.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.687+0000 7fde889dc640 1 -- 172.21.15.44:0/3831317595 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde8414acc0 con 0x7fde841e4400 2024-05-16T22:27:46.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.688+0000 7fde72ffd640 1 -- 172.21.15.44:0/3831317595 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fde7c034610 con 0x7fde841e4400 2024-05-16T22:27:46.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.688+0000 7fde72ffd640 1 --2- 172.21.15.44:0/3831317595 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fde640762d0 0x7fde640787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:46.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.688+0000 7fde72ffd640 1 -- 172.21.15.44:0/3831317595 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fde7c0b6cd0 con 0x7fde841e4400 2024-05-16T22:27:46.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.688+0000 7fde8259c640 1 --2- 172.21.15.44:0/3831317595 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fde640762d0 0x7fde640787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:46.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.689+0000 7fde8259c640 1 --2- 172.21.15.44:0/3831317595 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fde640762d0 0x7fde640787e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fde840a9720 tx=0x7fde74009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:46.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.693+0000 7fde72ffd640 1 -- 172.21.15.44:0/3831317595 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fde8414acc0 con 0x7fde841e4400 2024-05-16T22:27:46.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.921+0000 7fde889dc640 1 -- 172.21.15.44:0/3831317595 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fde84050940 con 0x7fde841e4400 2024-05-16T22:27:46.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.922+0000 7fde72ffd640 1 -- 172.21.15.44:0/3831317595 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+4351 (secure 0 0 0) 0x7fde7c047070 con 0x7fde841e4400 2024-05-16T22:27:46.922 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:27:46.923 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2940970977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2940970977},{"type":"v1","addr":"172.21.15.44:6833","nonce":2940970977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1653435882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1653435882},{"type":"v1","addr":"172.21.15.70:6835","nonce":1653435882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T22:27:25.548066+0000","modified":"2024-05-16T22:27:28.554539+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/3060763624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3060763624},{"type":"v1","addr":"172.21.15.44:6835","nonce":3060763624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-05-16T22:27:46.923 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 7 2024-05-16T22:27:46.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.924+0000 7fde889dc640 1 -- 172.21.15.44:0/3831317595 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fde640762d0 msgr2=0x7fde640787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:46.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.924+0000 7fde889dc640 1 --2- 172.21.15.44:0/3831317595 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fde640762d0 0x7fde640787e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fde840a9720 tx=0x7fde74009040 comp rx=0 tx=0).stop 2024-05-16T22:27:46.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.924+0000 7fde889dc640 1 -- 172.21.15.44:0/3831317595 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde841e4400 msgr2=0x7fde841e4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:46.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.924+0000 7fde889dc640 1 --2- 172.21.15.44:0/3831317595 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde841e4400 0x7fde841e4810 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fde7c005c20 tx=0x7fde8414ee60 comp rx=0 tx=0).stop 2024-05-16T22:27:46.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.924+0000 7fde889dc640 1 -- 172.21.15.44:0/3831317595 shutdown_connections 2024-05-16T22:27:46.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.924+0000 7fde889dc640 1 --2- 172.21.15.44:0/3831317595 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fde640762d0 0x7fde640787e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:46.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.924+0000 7fde889dc640 1 --2- 172.21.15.44:0/3831317595 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde841e4400 0x7fde841e4810 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:46.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.924+0000 7fde889dc640 1 --2- 172.21.15.44:0/3831317595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde8414b8e0 0x7fde841497c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:46.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.924+0000 7fde889dc640 1 --2- 172.21.15.44:0/3831317595 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fde6c005250 0x7fde841d7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:46.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.924+0000 7fde889dc640 1 -- 172.21.15.44:0/3831317595 >> 172.21.15.44:0/3831317595 conn(0x7fde840c0390 msgr2=0x7fde84068600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:46.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.924+0000 7fde889dc640 1 -- 172.21.15.44:0/3831317595 shutdown_connections 2024-05-16T22:27:46.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:46.924+0000 7fde889dc640 1 -- 172.21.15.44:0/3831317595 wait complete. 2024-05-16T22:27:46.936 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T22:27:47.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.047+0000 7f8bb752e640 1 Processor -- start 2024-05-16T22:27:47.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.047+0000 7f8bb752e640 1 -- start start 2024-05-16T22:27:47.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.048+0000 7f8bb752e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8bb0151fc0 0x7f8bb00bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:47.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.048+0000 7f8bb752e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8bb006da30 0x7f8bb00be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:47.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.048+0000 7f8bb752e640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bb00c36f0 con 0x7f8bb006de40 2024-05-16T22:27:47.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.048+0000 7f8bb752e640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f8bb00bdc10 con 0x7f8bb006da30 2024-05-16T22:27:47.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.048+0000 7f8bb752e640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f8bb0152530 con 0x7f8bb0151fc0 2024-05-16T22:27:47.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.049+0000 7f8bb4ac9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8bb006da30 0x7f8bb00be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:47.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.049+0000 7f8bb5acb640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f8bb006de40 0x7f8bb014e570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:47194/0 (socket says 172.21.15.44:47194) 2024-05-16T22:27:47.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.049+0000 7f8bb5acb640 1 -- 172.21.15.44:0/1556353274 learned_addr learned my addr 172.21.15.44:0/1556353274 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:27:47.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.049+0000 7f8bb52ca640 1 --2- 172.21.15.44:0/1556353274 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8bb0151fc0 0x7f8bb00bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:47.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.049+0000 7f8bb4ac9640 1 -- 172.21.15.44:0/1556353274 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8bb0151fc0 msgr2=0x7f8bb00bd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:47.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.049+0000 7f8bb4ac9640 1 --2- 172.21.15.44:0/1556353274 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8bb0151fc0 0x7f8bb00bd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:47.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.049+0000 7f8bb4ac9640 1 -- 172.21.15.44:0/1556353274 >> v1:172.21.15.44:6789/0 conn(0x7f8bb006de40 legacy=0x7f8bb014e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:47.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.049+0000 7f8bb4ac9640 1 -- 172.21.15.44:0/1556353274 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb0152810 con 0x7f8bb006da30 2024-05-16T22:27:47.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.049+0000 7f8baffff640 1 -- 172.21.15.44:0/1556353274 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3884033675 0 0) 0x7f8bb00c36f0 con 0x7f8bb006de40 2024-05-16T22:27:47.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.050+0000 7f8bb4ac9640 1 --2- 172.21.15.44:0/1556353274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8bb006da30 0x7f8bb00be940 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8ba40097a0 tx=0x7f8ba402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ca9201c74528ed9 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:47.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.050+0000 7f8baffff640 1 -- 172.21.15.44:0/1556353274 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba4037070 con 0x7f8bb006da30 2024-05-16T22:27:47.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.050+0000 7f8baffff640 1 -- 172.21.15.44:0/1556353274 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ba4032440 con 0x7f8bb006da30 2024-05-16T22:27:47.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.050+0000 7f8baffff640 1 -- 172.21.15.44:0/1556353274 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba4032810 con 0x7f8bb006da30 2024-05-16T22:27:47.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.050+0000 7f8bb752e640 1 -- 172.21.15.44:0/1556353274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8bb006da30 msgr2=0x7f8bb00be940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:47.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.050+0000 7f8bb752e640 1 --2- 172.21.15.44:0/1556353274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8bb006da30 0x7f8bb00be940 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8ba40097a0 tx=0x7f8ba402a180 comp rx=0 tx=0).stop 2024-05-16T22:27:47.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.050+0000 7f8bb752e640 1 -- 172.21.15.44:0/1556353274 shutdown_connections 2024-05-16T22:27:47.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.050+0000 7f8bb752e640 1 --2- 172.21.15.44:0/1556353274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8bb006da30 0x7f8bb00be940 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:47.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.050+0000 7f8bb752e640 1 --2- 172.21.15.44:0/1556353274 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8bb0151fc0 0x7f8bb00bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:47.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.050+0000 7f8bb752e640 1 -- 172.21.15.44:0/1556353274 >> 172.21.15.44:0/1556353274 conn(0x7f8bb00c3d20 msgr2=0x7f8bb00c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:47.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.051+0000 7f8bb752e640 1 -- 172.21.15.44:0/1556353274 shutdown_connections 2024-05-16T22:27:47.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.051+0000 7f8bb752e640 1 -- 172.21.15.44:0/1556353274 wait complete. 2024-05-16T22:27:47.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.052+0000 7f8bb752e640 1 Processor -- start 2024-05-16T22:27:47.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.052+0000 7f8bb752e640 1 -- start start 2024-05-16T22:27:47.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.053+0000 7f8bb752e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8bb006da30 0x7f8bb01d9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:47.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.053+0000 7f8bb752e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8bb006de40 0x7f8bb01d8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:47.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.053+0000 7f8bb752e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8bb0151fc0 0x7f8bb00a1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:47.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.053+0000 7f8bb752e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb00a3050 con 0x7f8bb006de40 2024-05-16T22:27:47.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.053+0000 7f8bb752e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb00a2ed0 con 0x7f8bb006da30 2024-05-16T22:27:47.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.053+0000 7f8bb752e640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f8bb00bee80 con 0x7f8bb0151fc0 2024-05-16T22:27:47.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.053+0000 7f8bb4ac9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8bb006de40 0x7f8bb01d8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:47.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.053+0000 7f8bb4ac9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8bb006de40 0x7f8bb01d8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44348/0 (socket says 172.21.15.44:44348) 2024-05-16T22:27:47.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.053+0000 7f8bb4ac9640 1 -- 172.21.15.44:0/2651833698 learned_addr learned my addr 172.21.15.44:0/2651833698 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:47.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.054+0000 7f8bb52ca640 1 --2- 172.21.15.44:0/2651833698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8bb006da30 0x7f8bb01d9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:47.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.054+0000 7f8bb4ac9640 1 -- 172.21.15.44:0/2651833698 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8bb0151fc0 msgr2=0x7f8bb00a1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:47.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.054+0000 7f8bb4ac9640 1 --2- 172.21.15.44:0/2651833698 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8bb0151fc0 0x7f8bb00a1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:47.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.054+0000 7f8bb4ac9640 1 -- 172.21.15.44:0/2651833698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8bb006da30 msgr2=0x7f8bb01d9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:47.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.054+0000 7f8bb4ac9640 1 --2- 172.21.15.44:0/2651833698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8bb006da30 0x7f8bb01d9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:47.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.054+0000 7f8bb4ac9640 1 -- 172.21.15.44:0/2651833698 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb01d9fa0 con 0x7f8bb006de40 2024-05-16T22:27:47.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.054+0000 7f8bb52ca640 1 --2- 172.21.15.44:0/2651833698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8bb006da30 0x7f8bb01d9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T22:27:47.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.054+0000 7f8bb4ac9640 1 --2- 172.21.15.44:0/2651833698 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8bb006de40 0x7f8bb01d8660 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8ba40098c0 tx=0x7f8ba40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:47.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.054+0000 7f8badffb640 1 -- 172.21.15.44:0/2651833698 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba4037040 con 0x7f8bb006de40 2024-05-16T22:27:47.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.054+0000 7f8badffb640 1 -- 172.21.15.44:0/2651833698 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ba4030500 con 0x7f8bb006de40 2024-05-16T22:27:47.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.054+0000 7f8bb752e640 1 -- 172.21.15.44:0/2651833698 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bb01e81a0 con 0x7f8bb006de40 2024-05-16T22:27:47.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.054+0000 7f8badffb640 1 -- 172.21.15.44:0/2651833698 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba40308d0 con 0x7f8bb006de40 2024-05-16T22:27:47.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.054+0000 7f8bb752e640 1 -- 172.21.15.44:0/2651833698 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bb01e8760 con 0x7f8bb006de40 2024-05-16T22:27:47.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.055+0000 7f8bb752e640 1 -- 172.21.15.44:0/2651833698 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bb00c11b0 con 0x7f8bb006de40 2024-05-16T22:27:47.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.056+0000 7f8badffb640 1 -- 172.21.15.44:0/2651833698 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8ba4044020 con 0x7f8bb006de40 2024-05-16T22:27:47.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.056+0000 7f8badffb640 1 --2- 172.21.15.44:0/2651833698 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f8b9c0762d0 0x7f8b9c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:47.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.057+0000 7f8badffb640 1 -- 172.21.15.44:0/2651833698 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8ba40b7920 con 0x7f8bb006de40 2024-05-16T22:27:47.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.057+0000 7f8bb52ca640 1 --2- 172.21.15.44:0/2651833698 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f8b9c0762d0 0x7f8b9c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:47.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.057+0000 7f8bb52ca640 1 --2- 172.21.15.44:0/2651833698 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f8b9c0762d0 0x7f8b9c0787e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8009a20 tx=0x7f8ba8008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:47.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.061+0000 7f8badffb640 1 -- 172.21.15.44:0/2651833698 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8bb00c11b0 con 0x7f8bb006de40 2024-05-16T22:27:47.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.294+0000 7f8bb752e640 1 -- 172.21.15.44:0/2651833698 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8bb00bb180 con 0x7f8bb006de40 2024-05-16T22:27:47.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.294+0000 7f8badffb640 1 -- 172.21.15.44:0/2651833698 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+4351 (secure 0 0 0) 0x7f8bb00bb180 con 0x7f8bb006de40 2024-05-16T22:27:47.295 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:27:47.295 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2940970977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2940970977},{"type":"v1","addr":"172.21.15.44:6833","nonce":2940970977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1653435882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1653435882},{"type":"v1","addr":"172.21.15.70:6835","nonce":1653435882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T22:27:25.548066+0000","modified":"2024-05-16T22:27:28.554539+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/3060763624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3060763624},{"type":"v1","addr":"172.21.15.44:6835","nonce":3060763624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-05-16T22:27:47.295 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 7 2024-05-16T22:27:47.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.296+0000 7f8bb752e640 1 -- 172.21.15.44:0/2651833698 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f8b9c0762d0 msgr2=0x7f8b9c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:47.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.296+0000 7f8bb752e640 1 --2- 172.21.15.44:0/2651833698 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f8b9c0762d0 0x7f8b9c0787e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8009a20 tx=0x7f8ba8008040 comp rx=0 tx=0).stop 2024-05-16T22:27:47.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.296+0000 7f8bb752e640 1 -- 172.21.15.44:0/2651833698 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8bb006de40 msgr2=0x7f8bb01d8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:47.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.296+0000 7f8bb752e640 1 --2- 172.21.15.44:0/2651833698 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8bb006de40 0x7f8bb01d8660 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8ba40098c0 tx=0x7f8ba40046c0 comp rx=0 tx=0).stop 2024-05-16T22:27:47.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.297+0000 7f8bb752e640 1 -- 172.21.15.44:0/2651833698 shutdown_connections 2024-05-16T22:27:47.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.297+0000 7f8bb752e640 1 --2- 172.21.15.44:0/2651833698 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f8b9c0762d0 0x7f8b9c0787e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:47.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.297+0000 7f8bb752e640 1 --2- 172.21.15.44:0/2651833698 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8bb0151fc0 0x7f8bb00a1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:47.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.297+0000 7f8bb752e640 1 --2- 172.21.15.44:0/2651833698 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8bb006de40 0x7f8bb01d8660 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:47.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.297+0000 7f8bb752e640 1 --2- 172.21.15.44:0/2651833698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8bb006da30 0x7f8bb01d9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:47.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.297+0000 7f8bb752e640 1 -- 172.21.15.44:0/2651833698 >> 172.21.15.44:0/2651833698 conn(0x7f8bb00c3d20 msgr2=0x7f8bb00c0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:47.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.297+0000 7f8bb752e640 1 -- 172.21.15.44:0/2651833698 shutdown_connections 2024-05-16T22:27:47.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.297+0000 7f8bb752e640 1 -- 172.21.15.44:0/2651833698 wait complete. 2024-05-16T22:27:47.308 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-16T22:27:47.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.418+0000 7f48d8451640 1 Processor -- start 2024-05-16T22:27:47.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.418+0000 7f48d8451640 1 -- start start 2024-05-16T22:27:47.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.420+0000 7f48d8451640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f48d00bf050 0x7f48d0159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:47.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.420+0000 7f48d8451640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48d006e140 con 0x7f48d0151fc0 2024-05-16T22:27:47.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.420+0000 7f48d8451640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48d00c36f0 con 0x7f48d00bd6d0 2024-05-16T22:27:47.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.420+0000 7f48d8451640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f48d0152530 con 0x7f48d00bf050 2024-05-16T22:27:47.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.420+0000 7f48d61ed640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f48d0151fc0 0x7f48d006da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:47196/0 (socket says 172.21.15.44:47196) 2024-05-16T22:27:47.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.420+0000 7f48d61ed640 1 -- 172.21.15.44:0/3237048566 learned_addr learned my addr 172.21.15.44:0/3237048566 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:27:47.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.420+0000 7f48d51eb640 1 -- 172.21.15.44:0/3237048566 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 609489484 0 0) 0x7f48c8001110 con 0x7f48d0151fc0 2024-05-16T22:27:47.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.420+0000 7f48d69ee640 1 --2- 172.21.15.44:0/3237048566 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f48d00bf050 0x7f48d0159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:47.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.420+0000 7f48d51eb640 1 -- 172.21.15.44:0/3237048566 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48bc003520 con 0x7f48d0151fc0 2024-05-16T22:27:47.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.420+0000 7f48d51eb640 1 -- 172.21.15.44:0/3237048566 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2615899398 0 0) 0x7f48d00c36f0 con 0x7f48d00bd6d0 2024-05-16T22:27:47.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.420+0000 7f48d51eb640 1 -- 172.21.15.44:0/3237048566 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48c8001110 con 0x7f48d00bd6d0 2024-05-16T22:27:47.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.420+0000 7f48d51eb640 1 -- 172.21.15.44:0/3237048566 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1868471943 0 0) 0x7f48bc003520 con 0x7f48d0151fc0 2024-05-16T22:27:47.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.420+0000 7f48d51eb640 1 -- 172.21.15.44:0/3237048566 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f48d00bf050 msgr2=0x7f48d0159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:47.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.420+0000 7f48d51eb640 1 --2- 172.21.15.44:0/3237048566 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f48d00bf050 0x7f48d0159ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:47.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.420+0000 7f48d51eb640 1 -- 172.21.15.44:0/3237048566 >> v1:172.21.15.70:6789/0 conn(0x7f48d00bd6d0 legacy=0x7f48d00be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:47.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.420+0000 7f48d51eb640 1 -- 172.21.15.44:0/3237048566 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d0152810 con 0x7f48d0151fc0 2024-05-16T22:27:47.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.420+0000 7f48d51eb640 1 -- 172.21.15.44:0/3237048566 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 568431863 0 0) 0x7f48c80018c0 con 0x7f48d0151fc0 2024-05-16T22:27:47.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.420+0000 7f48d51eb640 1 -- 172.21.15.44:0/3237048566 >> v1:172.21.15.44:6789/0 conn(0x7f48d0151fc0 legacy=0x7f48d006da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:47.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.420+0000 7f48d51eb640 1 --2- 172.21.15.44:0/3237048566 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48bc003c10 0x7f48bc004060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:47.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.420+0000 7f48d51eb640 1 --2- 172.21.15.44:0/3237048566 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48bc004800 0x7f48bc004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:47.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.420+0000 7f48d51eb640 1 --2- 172.21.15.44:0/3237048566 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f48d00bf050 0x7f48bc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:47.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.420+0000 7f48d51eb640 1 -- 172.21.15.44:0/3237048566 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f48d0152530 con 0x7f48bc004800 2024-05-16T22:27:47.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.420+0000 7f48d51eb640 1 -- 172.21.15.44:0/3237048566 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f48bc005560 con 0x7f48bc003c10 2024-05-16T22:27:47.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.420+0000 7f48d51eb640 1 -- 172.21.15.44:0/3237048566 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f48bc00bf00 con 0x7f48d00bf050 2024-05-16T22:27:47.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.421+0000 7f48d59ec640 1 --2- 172.21.15.44:0/3237048566 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48bc004800 0x7f48bc004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:47.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.421+0000 7f48d61ed640 1 --2- 172.21.15.44:0/3237048566 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48bc003c10 0x7f48bc004060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:47.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.421+0000 7f48d69ee640 1 --2- 172.21.15.44:0/3237048566 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f48d00bf050 0x7f48bc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:47.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.421+0000 7f48d59ec640 1 -- 172.21.15.44:0/3237048566 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f48d00bf050 msgr2=0x7f48bc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:47.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.421+0000 7f48d59ec640 1 --2- 172.21.15.44:0/3237048566 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f48d00bf050 0x7f48bc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:47.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.421+0000 7f48d59ec640 1 -- 172.21.15.44:0/3237048566 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48bc003c10 msgr2=0x7f48bc004060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:47.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.421+0000 7f48d59ec640 1 --2- 172.21.15.44:0/3237048566 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48bc003c10 0x7f48bc004060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:47.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.421+0000 7f48d59ec640 1 -- 172.21.15.44:0/3237048566 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48bc003520 con 0x7f48bc004800 2024-05-16T22:27:47.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.422+0000 7f48d59ec640 1 --2- 172.21.15.44:0/3237048566 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48bc004800 0x7f48bc004c10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f48d006e3d0 tx=0x7f48bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=620c64a02f14a311 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:47.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.422+0000 7f48d51eb640 1 -- 172.21.15.44:0/3237048566 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c0001520 con 0x7f48bc004800 2024-05-16T22:27:47.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.422+0000 7f48d51eb640 1 -- 172.21.15.44:0/3237048566 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48c00052f0 con 0x7f48bc004800 2024-05-16T22:27:47.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.422+0000 7f48d51eb640 1 -- 172.21.15.44:0/3237048566 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c002acc0 con 0x7f48bc004800 2024-05-16T22:27:47.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.422+0000 7f48d8451640 1 -- 172.21.15.44:0/3237048566 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48bc004800 msgr2=0x7f48bc004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:47.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.422+0000 7f48d8451640 1 --2- 172.21.15.44:0/3237048566 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48bc004800 0x7f48bc004c10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f48d006e3d0 tx=0x7f48bc005830 comp rx=0 tx=0).stop 2024-05-16T22:27:47.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.422+0000 7f48d69ee640 1 -- 172.21.15.44:0/3237048566 reap_dead start 2024-05-16T22:27:47.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.423+0000 7f48d8451640 1 -- 172.21.15.44:0/3237048566 shutdown_connections 2024-05-16T22:27:47.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.423+0000 7f48d8451640 1 -- 172.21.15.44:0/3237048566 >> 172.21.15.44:0/3237048566 conn(0x7f48d00c3d20 msgr2=0x7f48d00c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:47.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.423+0000 7f48d8451640 1 -- 172.21.15.44:0/3237048566 shutdown_connections 2024-05-16T22:27:47.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.423+0000 7f48d8451640 1 -- 172.21.15.44:0/3237048566 wait complete. 2024-05-16T22:27:47.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.424+0000 7f48d8451640 1 Processor -- start 2024-05-16T22:27:47.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.424+0000 7f48d8451640 1 -- start start 2024-05-16T22:27:47.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.425+0000 7f48d8451640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f48bc004800 0x7f48d00b8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:47.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.425+0000 7f48d8451640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48d01e7c30 0x7f48d00b7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:47.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.425+0000 7f48d8451640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48d00b99d0 0x7f48d00b5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:47.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.425+0000 7f48d8451640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f48d00a2ed0 con 0x7f48d01e7c30 2024-05-16T22:27:47.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.425+0000 7f48d8451640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f48d00bdae0 con 0x7f48d00b99d0 2024-05-16T22:27:47.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.425+0000 7f48d8451640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f48d00a3050 con 0x7f48bc004800 2024-05-16T22:27:47.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.425+0000 7f48d59ec640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48d01e7c30 0x7f48d00b7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:47.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.425+0000 7f48d59ec640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48d01e7c30 0x7f48d00b7d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44376/0 (socket says 172.21.15.44:44376) 2024-05-16T22:27:47.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.425+0000 7f48d59ec640 1 -- 172.21.15.44:0/2351335200 learned_addr learned my addr 172.21.15.44:0/2351335200 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:47.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.426+0000 7f48d69ee640 1 --2- 172.21.15.44:0/2351335200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48d00b99d0 0x7f48d00b5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:47.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.426+0000 7f48d61ed640 1 --2- 172.21.15.44:0/2351335200 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f48bc004800 0x7f48d00b8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:47.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.426+0000 7f48d59ec640 1 -- 172.21.15.44:0/2351335200 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f48bc004800 msgr2=0x7f48d00b8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:47.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.426+0000 7f48d59ec640 1 --2- 172.21.15.44:0/2351335200 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f48bc004800 0x7f48d00b8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:47.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.426+0000 7f48d59ec640 1 -- 172.21.15.44:0/2351335200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48d00b99d0 msgr2=0x7f48d00b5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:47.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.426+0000 7f48d59ec640 1 --2- 172.21.15.44:0/2351335200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48d00b99d0 0x7f48d00b5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:47.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.426+0000 7f48d59ec640 1 -- 172.21.15.44:0/2351335200 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d00b82c0 con 0x7f48d01e7c30 2024-05-16T22:27:47.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.426+0000 7f48d61ed640 1 --2- 172.21.15.44:0/2351335200 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f48bc004800 0x7f48d00b8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:27:47.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.426+0000 7f48d59ec640 1 --2- 172.21.15.44:0/2351335200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48d01e7c30 0x7f48d00b7d80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f48c0005040 tx=0x7f48c00012f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:47.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.426+0000 7f48c6ffd640 1 -- 172.21.15.44:0/2351335200 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c0001520 con 0x7f48d01e7c30 2024-05-16T22:27:47.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.426+0000 7f48c6ffd640 1 -- 172.21.15.44:0/2351335200 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48c00054a0 con 0x7f48d01e7c30 2024-05-16T22:27:47.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.426+0000 7f48c6ffd640 1 -- 172.21.15.44:0/2351335200 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c00067d0 con 0x7f48d01e7c30 2024-05-16T22:27:47.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.426+0000 7f48d8451640 1 -- 172.21.15.44:0/2351335200 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48d00b8920 con 0x7f48d01e7c30 2024-05-16T22:27:47.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.426+0000 7f48d8451640 1 -- 172.21.15.44:0/2351335200 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48d014b660 con 0x7f48d01e7c30 2024-05-16T22:27:47.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.427+0000 7f48d8451640 1 -- 172.21.15.44:0/2351335200 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48d014bf20 con 0x7f48d01e7c30 2024-05-16T22:27:47.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.428+0000 7f48c6ffd640 1 -- 172.21.15.44:0/2351335200 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f48c0006970 con 0x7f48d01e7c30 2024-05-16T22:27:47.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.428+0000 7f48c6ffd640 1 --2- 172.21.15.44:0/2351335200 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f48b4076300 0x7f48b4078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:47.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.429+0000 7f48c6ffd640 1 -- 172.21.15.44:0/2351335200 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f48c00b6c80 con 0x7f48d01e7c30 2024-05-16T22:27:47.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.429+0000 7f48d61ed640 1 --2- 172.21.15.44:0/2351335200 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f48b4076300 0x7f48b4078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:47.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.429+0000 7f48d61ed640 1 --2- 172.21.15.44:0/2351335200 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f48b4076300 0x7f48b4078810 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f48c8001860 tx=0x7f48c8009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:47.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.433+0000 7f48c6ffd640 1 -- 172.21.15.44:0/2351335200 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f48c0080530 con 0x7f48d01e7c30 2024-05-16T22:27:47.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.626+0000 7f48d8451640 1 -- 172.21.15.44:0/2351335200 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f48d00ba460 con 0x7f48d01e7c30 2024-05-16T22:27:47.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.627+0000 7f48c6ffd640 1 -- 172.21.15.44:0/2351335200 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16569 (secure 0 0 0) 0x7f48c007fe30 con 0x7f48d01e7c30 2024-05-16T22:27:47.628 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:27:47.628 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":21,"fsid":"572ab7cc-b103-4548-ae8f-c6614d57f0c8","created":"2024-05-16T22:27:02.216874+0000","modified":"2024-05-16T22:27:27.151884+0000","last_up_change":"2024-05-16T22:27:13.693953+0000","last_in_change":"2024-05-16T22:27:04.455119+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-16T22:27:14.562409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-16T22:27:23.458618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-16T22:27:24.495231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a7003e89-c706-4562-9f25-670bb35ae108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6825","nonce":1074109859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6827","nonce":1074109859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6831","nonce":1074109859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6829","nonce":1074109859}]},"public_addr":"172.21.15.44:6825/1074109859","cluster_addr":"172.21.15.44:6827/1074109859","heartbeat_back_addr":"172.21.15.44:6831/1074109859","heartbeat_front_addr":"172.21.15.44:6829/1074109859","state":["exists","up"]},{"osd":1,"uuid":"a4d5169d-8327-4494-9c7c-58db21b00636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6817","nonce":2909429972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6819","nonce":2909429972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6823","nonce":2909429972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6821","nonce":2909429972}]},"public_addr":"172.21.15.44:6817/2909429972","cluster_addr":"172.21.15.44:6819/2909429972","heartbeat_back_addr":"172.21.15.44:6823/2909429972","heartbeat_front_addr":"172.21.15.44:6821/2909429972","state":["exists","up"]},{"osd":2,"uuid":"d4a834f8-83a5-400f-9814-eb0a25124df4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6801","nonce":2908194156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6803","nonce":2908194156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6807","nonce":2908194156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6805","nonce":2908194156}]},"public_addr":"172.21.15.44:6801/2908194156","cluster_addr":"172.21.15.44:6803/2908194156","heartbeat_back_addr":"172.21.15.44:6807/2908194156","heartbeat_front_addr":"172.21.15.44:6805/2908194156","state":["exists","up"]},{"osd":3,"uuid":"b9d24a56-ad43-4674-a395-5ec24d135ae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6809","nonce":2168695793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6811","nonce":2168695793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6815","nonce":2168695793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6813","nonce":2168695793}]},"public_addr":"172.21.15.44:6809/2168695793","cluster_addr":"172.21.15.44:6811/2168695793","heartbeat_back_addr":"172.21.15.44:6815/2168695793","heartbeat_front_addr":"172.21.15.44:6813/2168695793","state":["exists","up"]},{"osd":4,"uuid":"9bd94af5-3e17-4cbe-995a-8f837a66c653","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6823","nonce":1540297751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6825","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6827","nonce":1540297751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6831","nonce":1540297751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6829","nonce":1540297751}]},"public_addr":"172.21.15.70:6823/1540297751","cluster_addr":"172.21.15.70:6827/1540297751","heartbeat_back_addr":"172.21.15.70:6831/1540297751","heartbeat_front_addr":"172.21.15.70:6829/1540297751","state":["exists","up"]},{"osd":5,"uuid":"a5b0cfa5-b259-48bd-98b6-96b44f5ebabd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6804","nonce":4218901987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6808","nonce":4218901987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6815","nonce":4218901987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6812","nonce":4218901987}]},"public_addr":"172.21.15.70:6804/4218901987","cluster_addr":"172.21.15.70:6808/4218901987","heartbeat_back_addr":"172.21.15.70:6815/4218901987","heartbeat_front_addr":"172.21.15.70:6812/4218901987","state":["exists","up"]},{"osd":6,"uuid":"0b6af6df-1358-4fc6-a62c-ba57e02914ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6801","nonce":2389556489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6805","nonce":2389556489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6813","nonce":2389556489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6807","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6809","nonce":2389556489}]},"public_addr":"172.21.15.70:6801/2389556489","cluster_addr":"172.21.15.70:6805/2389556489","heartbeat_back_addr":"172.21.15.70:6813/2389556489","heartbeat_front_addr":"172.21.15.70:6809/2389556489","state":["exists","up"]},{"osd":7,"uuid":"eb1a2c5d-42cf-47d0-9e03-b9d26944a589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6817","nonce":3619691281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6819","nonce":3619691281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6826","nonce":3619691281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6822","nonce":3619691281}]},"public_addr":"172.21.15.70:6817/3619691281","cluster_addr":"172.21.15.70:6819/3619691281","heartbeat_back_addr":"172.21.15.70:6826/3619691281","heartbeat_front_addr":"172.21.15.70:6822/3619691281","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.652256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.613348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.528454+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.625204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.678845+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.680829+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.556200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.647030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T22:27:47.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.629+0000 7f48d8451640 1 -- 172.21.15.44:0/2351335200 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f48b4076300 msgr2=0x7f48b4078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:47.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.629+0000 7f48d8451640 1 --2- 172.21.15.44:0/2351335200 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f48b4076300 0x7f48b4078810 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f48c8001860 tx=0x7f48c8009040 comp rx=0 tx=0).stop 2024-05-16T22:27:47.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.629+0000 7f48d8451640 1 -- 172.21.15.44:0/2351335200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48d01e7c30 msgr2=0x7f48d00b7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:47.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.629+0000 7f48d8451640 1 --2- 172.21.15.44:0/2351335200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48d01e7c30 0x7f48d00b7d80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f48c0005040 tx=0x7f48c00012f0 comp rx=0 tx=0).stop 2024-05-16T22:27:47.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.629+0000 7f48d8451640 1 -- 172.21.15.44:0/2351335200 shutdown_connections 2024-05-16T22:27:47.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.629+0000 7f48d8451640 1 --2- 172.21.15.44:0/2351335200 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f48b4076300 0x7f48b4078810 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:47.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.629+0000 7f48d8451640 1 --2- 172.21.15.44:0/2351335200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48d00b99d0 0x7f48d00b5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:47.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.629+0000 7f48d8451640 1 --2- 172.21.15.44:0/2351335200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48d01e7c30 0x7f48d00b7d80 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:47.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.629+0000 7f48d8451640 1 --2- 172.21.15.44:0/2351335200 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f48bc004800 0x7f48d00b8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:47.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.629+0000 7f48d8451640 1 -- 172.21.15.44:0/2351335200 >> 172.21.15.44:0/2351335200 conn(0x7f48d00c3d20 msgr2=0x7f48d00be940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:47.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.629+0000 7f48d8451640 1 -- 172.21.15.44:0/2351335200 shutdown_connections 2024-05-16T22:27:47.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.629+0000 7f48d8451640 1 -- 172.21.15.44:0/2351335200 wait complete. 2024-05-16T22:27:47.641 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-16T22:27:47.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.753+0000 7f527faf2640 1 Processor -- start 2024-05-16T22:27:47.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.753+0000 7f527faf2640 1 -- start start 2024-05-16T22:27:47.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.754+0000 7f527faf2640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52780bf9b0 0x7f52780bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:47.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.754+0000 7f527faf2640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52780c1390 con 0x7f527814e360 2024-05-16T22:27:47.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.754+0000 7f527faf2640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52780c0620 con 0x7f5278148770 2024-05-16T22:27:47.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.754+0000 7f527faf2640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f5278151e40 con 0x7f52780bf9b0 2024-05-16T22:27:47.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.755+0000 7f527d88e640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f527814e360 0x7f52781522d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:47206/0 (socket says 172.21.15.44:47206) 2024-05-16T22:27:47.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.755+0000 7f527d88e640 1 -- 172.21.15.44:0/4232535236 learned_addr learned my addr 172.21.15.44:0/4232535236 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:27:47.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.755+0000 7f527e08f640 1 --2- 172.21.15.44:0/4232535236 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52780bf9b0 0x7f52780bfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:47.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.755+0000 7f527c88c640 1 -- 172.21.15.44:0/4232535236 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2001037466 0 0) 0x7f5270001110 con 0x7f527814e360 2024-05-16T22:27:47.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.755+0000 7f527c88c640 1 -- 172.21.15.44:0/4232535236 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5260003520 con 0x7f527814e360 2024-05-16T22:27:47.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.755+0000 7f527c88c640 1 -- 172.21.15.44:0/4232535236 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1288457869 0 0) 0x7f52780c0620 con 0x7f5278148770 2024-05-16T22:27:47.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.755+0000 7f527c88c640 1 -- 172.21.15.44:0/4232535236 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5270001110 con 0x7f5278148770 2024-05-16T22:27:47.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.755+0000 7f527e08f640 1 -- 172.21.15.44:0/4232535236 >> v1:172.21.15.70:6789/0 conn(0x7f5278148770 legacy=0x7f52780c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:47.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.755+0000 7f527e08f640 1 -- 172.21.15.44:0/4232535236 >> v1:172.21.15.44:6789/0 conn(0x7f527814e360 legacy=0x7f52781522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:47.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.755+0000 7f527c88c640 1 -- 172.21.15.44:0/4232535236 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1347402601 0 0) 0x7f5260003520 con 0x7f527814e360 2024-05-16T22:27:47.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.755+0000 7f527e08f640 1 -- 172.21.15.44:0/4232535236 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5278151ad0 con 0x7f52780bf9b0 2024-05-16T22:27:47.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.756+0000 7f527e08f640 1 --2- 172.21.15.44:0/4232535236 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52780bf9b0 0x7f52780bfdc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5268009dc0 tx=0x7f526802a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cefe3374e9d323a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:47.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.756+0000 7f527c88c640 1 -- 172.21.15.44:0/4232535236 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52700018e0 con 0x7f52780bf9b0 2024-05-16T22:27:47.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.756+0000 7f527c88c640 1 -- 172.21.15.44:0/4232535236 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f526802ae50 con 0x7f52780bf9b0 2024-05-16T22:27:47.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.756+0000 7f527c88c640 1 -- 172.21.15.44:0/4232535236 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5268007740 con 0x7f52780bf9b0 2024-05-16T22:27:47.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.757+0000 7f527faf2640 1 -- 172.21.15.44:0/4232535236 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52780bf9b0 msgr2=0x7f52780bfdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:47.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.757+0000 7f527faf2640 1 --2- 172.21.15.44:0/4232535236 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52780bf9b0 0x7f52780bfdc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5268009dc0 tx=0x7f526802a6f0 comp rx=0 tx=0).stop 2024-05-16T22:27:47.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.757+0000 7f527faf2640 1 -- 172.21.15.44:0/4232535236 shutdown_connections 2024-05-16T22:27:47.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.757+0000 7f527faf2640 1 --2- 172.21.15.44:0/4232535236 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52780bf9b0 0x7f52780bfdc0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:47.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.757+0000 7f527faf2640 1 -- 172.21.15.44:0/4232535236 >> 172.21.15.44:0/4232535236 conn(0x7f52780c17c0 msgr2=0x7f52780c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:47.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.757+0000 7f527faf2640 1 -- 172.21.15.44:0/4232535236 shutdown_connections 2024-05-16T22:27:47.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.757+0000 7f527faf2640 1 -- 172.21.15.44:0/4232535236 wait complete. 2024-05-16T22:27:47.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.759+0000 7f527faf2640 1 Processor -- start 2024-05-16T22:27:47.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.759+0000 7f527faf2640 1 -- start start 2024-05-16T22:27:47.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.760+0000 7f527faf2640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52780bf9b0 0x7f527814f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:47.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.760+0000 7f527faf2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5278148770 0x7f5278071880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:47.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.760+0000 7f527faf2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f527814e360 0x7f5278071dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:47.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.760+0000 7f527faf2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5278159e50 con 0x7f5278148770 2024-05-16T22:27:47.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.760+0000 7f527faf2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5278159cd0 con 0x7f527814e360 2024-05-16T22:27:47.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.760+0000 7f527faf2640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f5278159fd0 con 0x7f52780bf9b0 2024-05-16T22:27:47.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.760+0000 7f527d08d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5278148770 0x7f5278071880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:47.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.760+0000 7f527d08d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5278148770 0x7f5278071880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44392/0 (socket says 172.21.15.44:44392) 2024-05-16T22:27:47.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.760+0000 7f527d08d640 1 -- 172.21.15.44:0/795681483 learned_addr learned my addr 172.21.15.44:0/795681483 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:47.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.760+0000 7f527d88e640 1 --2- 172.21.15.44:0/795681483 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52780bf9b0 0x7f527814f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:47.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.760+0000 7f527e08f640 1 --2- 172.21.15.44:0/795681483 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f527814e360 0x7f5278071dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:47.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.760+0000 7f527d08d640 1 -- 172.21.15.44:0/795681483 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52780bf9b0 msgr2=0x7f527814f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:47.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.760+0000 7f527d08d640 1 --2- 172.21.15.44:0/795681483 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52780bf9b0 0x7f527814f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:47.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.760+0000 7f527d08d640 1 -- 172.21.15.44:0/795681483 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f527814e360 msgr2=0x7f5278071dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:47.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.760+0000 7f527d08d640 1 --2- 172.21.15.44:0/795681483 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f527814e360 0x7f5278071dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:47.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.760+0000 7f527d08d640 1 -- 172.21.15.44:0/795681483 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5278151760 con 0x7f5278148770 2024-05-16T22:27:47.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.760+0000 7f527d08d640 1 --2- 172.21.15.44:0/795681483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5278148770 0x7f5278071880 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f526c00c430 tx=0x7f526c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:47.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.760+0000 7f52767fc640 1 -- 172.21.15.44:0/795681483 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526c017070 con 0x7f5278148770 2024-05-16T22:27:47.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.760+0000 7f52767fc640 1 -- 172.21.15.44:0/795681483 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f526c0052f0 con 0x7f5278148770 2024-05-16T22:27:47.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.760+0000 7f527faf2640 1 -- 172.21.15.44:0/795681483 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52781e4500 con 0x7f5278148770 2024-05-16T22:27:47.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.760+0000 7f52767fc640 1 -- 172.21.15.44:0/795681483 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526c003830 con 0x7f5278148770 2024-05-16T22:27:47.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.761+0000 7f527faf2640 1 -- 172.21.15.44:0/795681483 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52781e47a0 con 0x7f5278148770 2024-05-16T22:27:47.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.762+0000 7f527faf2640 1 -- 172.21.15.44:0/795681483 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5278050940 con 0x7f5278148770 2024-05-16T22:27:47.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.762+0000 7f52767fc640 1 -- 172.21.15.44:0/795681483 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f526c01a070 con 0x7f5278148770 2024-05-16T22:27:47.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.763+0000 7f52767fc640 1 --2- 172.21.15.44:0/795681483 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f52640762d0 0x7f52640787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:47.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.763+0000 7f52767fc640 1 -- 172.21.15.44:0/795681483 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f526c096a00 con 0x7f5278148770 2024-05-16T22:27:47.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.763+0000 7f527d88e640 1 --2- 172.21.15.44:0/795681483 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f52640762d0 0x7f52640787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:47.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.764+0000 7f527d88e640 1 --2- 172.21.15.44:0/795681483 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f52640762d0 0x7f52640787e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5270001eb0 tx=0x7f5270001940 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:47.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.768+0000 7f52767fc640 1 -- 172.21.15.44:0/795681483 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f526c05fc80 con 0x7f5278148770 2024-05-16T22:27:47.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:47.998+0000 7f527faf2640 1 -- 172.21.15.44:0/795681483 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f52780bf790 con 0x7f5278148770 2024-05-16T22:27:47.999 INFO:tasks.ceph.mon.a.smithi044.stderr:2024-05-16T22:27:47.999+0000 7facbfd75640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-16T22:27:48.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.000+0000 7f52767fc640 1 -- 172.21.15.44:0/795681483 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) ==== 161+0+0 (secure 0 0 0) 0x7f526c068350 con 0x7f5278148770 2024-05-16T22:27:48.000 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-16T22:27:48.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.002+0000 7f527faf2640 1 -- 172.21.15.44:0/795681483 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f52640762d0 msgr2=0x7f52640787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:48.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.002+0000 7f527faf2640 1 --2- 172.21.15.44:0/795681483 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f52640762d0 0x7f52640787e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5270001eb0 tx=0x7f5270001940 comp rx=0 tx=0).stop 2024-05-16T22:27:48.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.002+0000 7f527faf2640 1 -- 172.21.15.44:0/795681483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5278148770 msgr2=0x7f5278071880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:48.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.002+0000 7f527faf2640 1 --2- 172.21.15.44:0/795681483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5278148770 0x7f5278071880 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f526c00c430 tx=0x7f526c00c8f0 comp rx=0 tx=0).stop 2024-05-16T22:27:48.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.002+0000 7f527faf2640 1 -- 172.21.15.44:0/795681483 shutdown_connections 2024-05-16T22:27:48.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.002+0000 7f527faf2640 1 --2- 172.21.15.44:0/795681483 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f52640762d0 0x7f52640787e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:48.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.002+0000 7f527faf2640 1 --2- 172.21.15.44:0/795681483 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f527814e360 0x7f5278071dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:48.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.002+0000 7f527faf2640 1 --2- 172.21.15.44:0/795681483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5278148770 0x7f5278071880 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:48.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.002+0000 7f527faf2640 1 --2- 172.21.15.44:0/795681483 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52780bf9b0 0x7f527814f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:48.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.002+0000 7f527faf2640 1 -- 172.21.15.44:0/795681483 >> 172.21.15.44:0/795681483 conn(0x7f52780c17c0 msgr2=0x7f52780a4970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:48.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.002+0000 7f527faf2640 1 -- 172.21.15.44:0/795681483 shutdown_connections 2024-05-16T22:27:48.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.002+0000 7f527faf2640 1 -- 172.21.15.44:0/795681483 wait complete. 2024-05-16T22:27:48.006 INFO:tasks.ceph.mds.c.smithi044.stderr: -4912> 2024-05-16T22:27:31.138+0000 7f75e77fc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-16T22:27:48.014 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-16T22:27:48.062 INFO:tasks.ceph.mds.c.smithi044.stdout:starting mds.c at 2024-05-16T22:27:48.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.130+0000 7fef32aaf640 1 Processor -- start 2024-05-16T22:27:48.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.130+0000 7fef32aaf640 1 -- start start 2024-05-16T22:27:48.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.131+0000 7fef32aaf640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fef2c151fc0 0x7fef2c0bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:48.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.131+0000 7fef32aaf640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fef2c0bf050 0x7fef2c158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:48.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.131+0000 7fef32aaf640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef2c0c36f0 con 0x7fef2c06da30 2024-05-16T22:27:48.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.131+0000 7fef32aaf640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fef2c0bdc10 con 0x7fef2c0bf050 2024-05-16T22:27:48.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.131+0000 7fef32aaf640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fef2c152530 con 0x7fef2c151fc0 2024-05-16T22:27:48.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.131+0000 7fef3104c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fef2c0bf050 0x7fef2c158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:48.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.131+0000 7fef3104c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fef2c0bf050 0x7fef2c158e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44410/0 (socket says 172.21.15.44:44410) 2024-05-16T22:27:48.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.131+0000 7fef3104c640 1 -- 172.21.15.44:0/2696846805 learned_addr learned my addr 172.21.15.44:0/2696846805 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:48.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.132+0000 7fef3084b640 1 --2- 172.21.15.44:0/2696846805 >> v2:172.21.15.70:3300/0 conn(0x7fef2c151fc0 0x7fef2c0bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:48.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.132+0000 7fef3104c640 1 -- 172.21.15.44:0/2696846805 >> v2:172.21.15.70:3300/0 conn(0x7fef2c151fc0 msgr2=0x7fef2c0bd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:48.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.132+0000 7fef3104c640 1 --2- 172.21.15.44:0/2696846805 >> v2:172.21.15.70:3300/0 conn(0x7fef2c151fc0 0x7fef2c0bd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:48.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.132+0000 7fef3104c640 1 -- 172.21.15.44:0/2696846805 >> v1:172.21.15.70:6789/0 conn(0x7fef2c06da30 legacy=0x7fef2c0be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:48.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.132+0000 7fef3104c640 1 -- 172.21.15.44:0/2696846805 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef2c152810 con 0x7fef2c0bf050 2024-05-16T22:27:48.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.132+0000 7fef3084b640 1 --2- 172.21.15.44:0/2696846805 >> v2:172.21.15.70:3300/0 conn(0x7fef2c151fc0 0x7fef2c0bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T22:27:48.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.132+0000 7fef3104c640 1 --2- 172.21.15.44:0/2696846805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef2c0bf050 0x7fef2c158e90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fef2c0bf8f0 tx=0x7fef2402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebe1b4572e8a6a3d server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:48.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.132+0000 7fef2b7fe640 1 -- 172.21.15.44:0/2696846805 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef24036070 con 0x7fef2c0bf050 2024-05-16T22:27:48.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.133+0000 7fef2b7fe640 1 -- 172.21.15.44:0/2696846805 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef24031600 con 0x7fef2c0bf050 2024-05-16T22:27:48.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.133+0000 7fef2b7fe640 1 -- 172.21.15.44:0/2696846805 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef240319d0 con 0x7fef2c0bf050 2024-05-16T22:27:48.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.133+0000 7fef32aaf640 1 -- 172.21.15.44:0/2696846805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef2c0bf050 msgr2=0x7fef2c158e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:48.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.133+0000 7fef32aaf640 1 --2- 172.21.15.44:0/2696846805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef2c0bf050 0x7fef2c158e90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fef2c0bf8f0 tx=0x7fef2402a680 comp rx=0 tx=0).stop 2024-05-16T22:27:48.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.133+0000 7fef32aaf640 1 -- 172.21.15.44:0/2696846805 shutdown_connections 2024-05-16T22:27:48.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.133+0000 7fef32aaf640 1 --2- 172.21.15.44:0/2696846805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef2c0bf050 0x7fef2c158e90 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:48.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.133+0000 7fef32aaf640 1 --2- 172.21.15.44:0/2696846805 >> v2:172.21.15.70:3300/0 conn(0x7fef2c151fc0 0x7fef2c0bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:48.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.133+0000 7fef32aaf640 1 -- 172.21.15.44:0/2696846805 >> 172.21.15.44:0/2696846805 conn(0x7fef2c0c3d20 msgr2=0x7fef2c0c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:48.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.133+0000 7fef32aaf640 1 -- 172.21.15.44:0/2696846805 shutdown_connections 2024-05-16T22:27:48.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.133+0000 7fef32aaf640 1 -- 172.21.15.44:0/2696846805 wait complete. 2024-05-16T22:27:48.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.135+0000 7fef32aaf640 1 Processor -- start 2024-05-16T22:27:48.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.135+0000 7fef32aaf640 1 -- start start 2024-05-16T22:27:48.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.136+0000 7fef32aaf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef2c06da30 0x7fef2c1e5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:48.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.136+0000 7fef32aaf640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef2c0bf050 0x7fef2c0b9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:48.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.136+0000 7fef32aaf640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fef2c151fc0 0x7fef2c0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:48.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.136+0000 7fef32aaf640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fef2c0a3050 con 0x7fef2c0bf050 2024-05-16T22:27:48.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.136+0000 7fef32aaf640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fef2c0a2ed0 con 0x7fef2c06da30 2024-05-16T22:27:48.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.136+0000 7fef32aaf640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fef2c06de40 con 0x7fef2c151fc0 2024-05-16T22:27:48.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.136+0000 7fef2bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef2c0bf050 0x7fef2c0b9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:48.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.136+0000 7fef2bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef2c0bf050 0x7fef2c0b9b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44426/0 (socket says 172.21.15.44:44426) 2024-05-16T22:27:48.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.136+0000 7fef2bfff640 1 -- 172.21.15.44:0/959104265 learned_addr learned my addr 172.21.15.44:0/959104265 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:48.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.136+0000 7fef3084b640 1 --2- 172.21.15.44:0/959104265 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef2c06da30 0x7fef2c1e5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:48.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.136+0000 7fef3104c640 1 --2- 172.21.15.44:0/959104265 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fef2c151fc0 0x7fef2c0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:48.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.136+0000 7fef2bfff640 1 -- 172.21.15.44:0/959104265 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fef2c151fc0 msgr2=0x7fef2c0b8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:48.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.136+0000 7fef2bfff640 1 --2- 172.21.15.44:0/959104265 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fef2c151fc0 0x7fef2c0b8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:48.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.136+0000 7fef2bfff640 1 -- 172.21.15.44:0/959104265 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef2c06da30 msgr2=0x7fef2c1e5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:48.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.136+0000 7fef2bfff640 1 --2- 172.21.15.44:0/959104265 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef2c06da30 0x7fef2c1e5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:48.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.137+0000 7fef2bfff640 1 -- 172.21.15.44:0/959104265 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef2c1e5c40 con 0x7fef2c0bf050 2024-05-16T22:27:48.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.137+0000 7fef2bfff640 1 --2- 172.21.15.44:0/959104265 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef2c0bf050 0x7fef2c0b9b10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fef1c00b3e0 tx=0x7fef1c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:48.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.137+0000 7fef297fa640 1 -- 172.21.15.44:0/959104265 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef1c015020 con 0x7fef2c0bf050 2024-05-16T22:27:48.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.137+0000 7fef297fa640 1 -- 172.21.15.44:0/959104265 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef1c011830 con 0x7fef2c0bf050 2024-05-16T22:27:48.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.137+0000 7fef32aaf640 1 -- 172.21.15.44:0/959104265 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef2c1e4f40 con 0x7fef2c0bf050 2024-05-16T22:27:48.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.137+0000 7fef297fa640 1 -- 172.21.15.44:0/959104265 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef1c011c20 con 0x7fef2c0bf050 2024-05-16T22:27:48.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.137+0000 7fef32aaf640 1 -- 172.21.15.44:0/959104265 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef2c14e6d0 con 0x7fef2c0bf050 2024-05-16T22:27:48.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.138+0000 7fef32aaf640 1 -- 172.21.15.44:0/959104265 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef2c0bd8e0 con 0x7fef2c0bf050 2024-05-16T22:27:48.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.138+0000 7fef297fa640 1 -- 172.21.15.44:0/959104265 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fef1c018020 con 0x7fef2c0bf050 2024-05-16T22:27:48.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.139+0000 7fef297fa640 1 --2- 172.21.15.44:0/959104265 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fef0c0762d0 0x7fef0c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:48.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.139+0000 7fef297fa640 1 -- 172.21.15.44:0/959104265 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5795+0+0 (secure 0 0 0) 0x7fef1c0973a0 con 0x7fef2c0bf050 2024-05-16T22:27:48.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.139+0000 7fef3084b640 1 --2- 172.21.15.44:0/959104265 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fef0c0762d0 0x7fef0c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:48.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.140+0000 7fef3084b640 1 --2- 172.21.15.44:0/959104265 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fef0c0762d0 0x7fef0c0787e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fef1400aac0 tx=0x7fef14008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:48.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.144+0000 7fef297fa640 1 -- 172.21.15.44:0/959104265 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fef1c01f020 con 0x7fef2c0bf050 2024-05-16T22:27:48.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:48.377+0000 7fef32aaf640 1 -- 172.21.15.44:0/959104265 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fef2c14f2c0 con 0x7fef2c0bf050 2024-05-16T22:27:49.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.002+0000 7fef297fa640 1 -- 172.21.15.44:0/959104265 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) ==== 104+0+0 (secure 0 0 0) 0x7fef1c060650 con 0x7fef2c0bf050 2024-05-16T22:27:49.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.004+0000 7fef32aaf640 1 -- 172.21.15.44:0/959104265 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fef0c0762d0 msgr2=0x7fef0c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:49.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.004+0000 7fef32aaf640 1 --2- 172.21.15.44:0/959104265 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fef0c0762d0 0x7fef0c0787e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fef1400aac0 tx=0x7fef14008040 comp rx=0 tx=0).stop 2024-05-16T22:27:49.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.004+0000 7fef32aaf640 1 -- 172.21.15.44:0/959104265 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef2c0bf050 msgr2=0x7fef2c0b9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:49.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.004+0000 7fef32aaf640 1 --2- 172.21.15.44:0/959104265 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef2c0bf050 0x7fef2c0b9b10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fef1c00b3e0 tx=0x7fef1c00b8a0 comp rx=0 tx=0).stop 2024-05-16T22:27:49.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.004+0000 7fef32aaf640 1 -- 172.21.15.44:0/959104265 shutdown_connections 2024-05-16T22:27:49.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.004+0000 7fef32aaf640 1 --2- 172.21.15.44:0/959104265 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fef0c0762d0 0x7fef0c0787e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:49.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.004+0000 7fef32aaf640 1 --2- 172.21.15.44:0/959104265 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fef2c151fc0 0x7fef2c0b8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:49.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.004+0000 7fef32aaf640 1 --2- 172.21.15.44:0/959104265 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef2c0bf050 0x7fef2c0b9b10 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:49.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.004+0000 7fef32aaf640 1 --2- 172.21.15.44:0/959104265 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef2c06da30 0x7fef2c1e5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:49.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.004+0000 7fef32aaf640 1 -- 172.21.15.44:0/959104265 >> 172.21.15.44:0/959104265 conn(0x7fef2c0c3d20 msgr2=0x7fef2c0c09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:49.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.004+0000 7fef32aaf640 1 -- 172.21.15.44:0/959104265 shutdown_connections 2024-05-16T22:27:49.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.004+0000 7fef32aaf640 1 -- 172.21.15.44:0/959104265 wait complete. 2024-05-16T22:27:49.018 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-16T22:27:49.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.137+0000 7f00e5ca8640 1 Processor -- start 2024-05-16T22:27:49.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.137+0000 7f00e5ca8640 1 -- start start 2024-05-16T22:27:49.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.138+0000 7f00e5ca8640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f00e00bd6d0 0x7f00e00be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:49.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.138+0000 7f00e5ca8640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f00e00bee80 0x7f00e0158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:49.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.138+0000 7f00e5ca8640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00e006e140 con 0x7f00e0151fc0 2024-05-16T22:27:49.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.138+0000 7f00e5ca8640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f00e00c36f0 con 0x7f00e00bd6d0 2024-05-16T22:27:49.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.138+0000 7f00e5ca8640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f00e0152530 con 0x7f00e00bee80 2024-05-16T22:27:49.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.138+0000 7f00deffd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f00e00bd6d0 0x7f00e00be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:49.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.138+0000 7f00dffff640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f00e00bee80 0x7f00e0158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:49.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.138+0000 7f00df7fe640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f00e0151fc0 0x7f00e006da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.44:56874/0 (socket says 172.21.15.44:56874) 2024-05-16T22:27:49.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.138+0000 7f00df7fe640 1 -- 172.21.15.44:0/2463265437 learned_addr learned my addr 172.21.15.44:0/2463265437 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:27:49.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.138+0000 7f00deffd640 1 -- 172.21.15.44:0/2463265437 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f00e00bee80 msgr2=0x7f00e0158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:49.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.138+0000 7f00deffd640 1 --2- 172.21.15.44:0/2463265437 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f00e00bee80 0x7f00e0158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:49.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.138+0000 7f00deffd640 1 -- 172.21.15.44:0/2463265437 >> v1:172.21.15.70:6789/0 conn(0x7f00e0151fc0 legacy=0x7f00e006da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:49.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.138+0000 7f00deffd640 1 -- 172.21.15.44:0/2463265437 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00e0152810 con 0x7f00e00bd6d0 2024-05-16T22:27:49.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.138+0000 7f00dffff640 1 --2- 172.21.15.44:0/2463265437 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f00e00bee80 0x7f00e0158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:27:49.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.139+0000 7f00deffd640 1 --2- 172.21.15.44:0/2463265437 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00e00bd6d0 0x7f00e00be940 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f00d40097a0 tx=0x7f00d402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc390560563f61c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:49.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.139+0000 7f00de7fc640 1 -- 172.21.15.44:0/2463265437 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d4037070 con 0x7f00e00bd6d0 2024-05-16T22:27:49.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.139+0000 7f00de7fc640 1 -- 172.21.15.44:0/2463265437 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00d4032440 con 0x7f00e00bd6d0 2024-05-16T22:27:49.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.139+0000 7f00de7fc640 1 -- 172.21.15.44:0/2463265437 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d4032810 con 0x7f00e00bd6d0 2024-05-16T22:27:49.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.140+0000 7f00e5ca8640 1 -- 172.21.15.44:0/2463265437 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00e00bd6d0 msgr2=0x7f00e00be940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:49.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.140+0000 7f00e5ca8640 1 --2- 172.21.15.44:0/2463265437 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00e00bd6d0 0x7f00e00be940 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f00d40097a0 tx=0x7f00d402a180 comp rx=0 tx=0).stop 2024-05-16T22:27:49.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.140+0000 7f00e5ca8640 1 -- 172.21.15.44:0/2463265437 shutdown_connections 2024-05-16T22:27:49.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.140+0000 7f00e5ca8640 1 --2- 172.21.15.44:0/2463265437 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f00e00bee80 0x7f00e0158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:49.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.140+0000 7f00e5ca8640 1 --2- 172.21.15.44:0/2463265437 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00e00bd6d0 0x7f00e00be940 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:49.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.140+0000 7f00e5ca8640 1 -- 172.21.15.44:0/2463265437 >> 172.21.15.44:0/2463265437 conn(0x7f00e00c3d20 msgr2=0x7f00e00c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:49.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.140+0000 7f00e5ca8640 1 -- 172.21.15.44:0/2463265437 shutdown_connections 2024-05-16T22:27:49.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.140+0000 7f00e5ca8640 1 -- 172.21.15.44:0/2463265437 wait complete. 2024-05-16T22:27:49.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.142+0000 7f00e5ca8640 1 Processor -- start 2024-05-16T22:27:49.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.142+0000 7f00e5ca8640 1 -- start start 2024-05-16T22:27:49.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.143+0000 7f00e5ca8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00e00bd6d0 0x7f00e014eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:49.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.143+0000 7f00e5ca8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00e00bee80 0x7f00e014b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:49.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.143+0000 7f00e5ca8640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f00e0151fc0 0x7f00e014b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:49.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.143+0000 7f00e5ca8640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f00e00bdae0 con 0x7f00e00bee80 2024-05-16T22:27:49.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.143+0000 7f00e5ca8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f00e00c0070 con 0x7f00e00bd6d0 2024-05-16T22:27:49.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.143+0000 7f00e5ca8640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f00e00a2ed0 con 0x7f00e0151fc0 2024-05-16T22:27:49.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.143+0000 7f00deffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00e00bee80 0x7f00e014b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:49.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.143+0000 7f00deffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00e00bee80 0x7f00e014b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44432/0 (socket says 172.21.15.44:44432) 2024-05-16T22:27:49.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.143+0000 7f00deffd640 1 -- 172.21.15.44:0/3340834712 learned_addr learned my addr 172.21.15.44:0/3340834712 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:49.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.143+0000 7f00df7fe640 1 --2- 172.21.15.44:0/3340834712 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00e00bd6d0 0x7f00e014eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:49.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.143+0000 7f00dffff640 1 --2- 172.21.15.44:0/3340834712 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f00e0151fc0 0x7f00e014b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:49.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.143+0000 7f00deffd640 1 -- 172.21.15.44:0/3340834712 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f00e0151fc0 msgr2=0x7f00e014b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:49.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.143+0000 7f00deffd640 1 --2- 172.21.15.44:0/3340834712 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f00e0151fc0 0x7f00e014b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:49.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.143+0000 7f00deffd640 1 -- 172.21.15.44:0/3340834712 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00e00bd6d0 msgr2=0x7f00e014eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:49.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.143+0000 7f00deffd640 1 --2- 172.21.15.44:0/3340834712 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00e00bd6d0 0x7f00e014eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:49.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.143+0000 7f00deffd640 1 -- 172.21.15.44:0/3340834712 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00e014f060 con 0x7f00e00bee80 2024-05-16T22:27:49.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.144+0000 7f00deffd640 1 --2- 172.21.15.44:0/3340834712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00e00bee80 0x7f00e014b2f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f00d402a1c0 tx=0x7f00d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:49.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.144+0000 7f00c7fff640 1 -- 172.21.15.44:0/3340834712 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d4041020 con 0x7f00e00bee80 2024-05-16T22:27:49.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.144+0000 7f00c7fff640 1 -- 172.21.15.44:0/3340834712 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00d4030640 con 0x7f00e00bee80 2024-05-16T22:27:49.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.144+0000 7f00c7fff640 1 -- 172.21.15.44:0/3340834712 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d4037040 con 0x7f00e00bee80 2024-05-16T22:27:49.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.144+0000 7f00e5ca8640 1 -- 172.21.15.44:0/3340834712 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00e01e7ac0 con 0x7f00e00bee80 2024-05-16T22:27:49.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.144+0000 7f00e5ca8640 1 -- 172.21.15.44:0/3340834712 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00e01e8080 con 0x7f00e00bee80 2024-05-16T22:27:49.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.145+0000 7f00e5ca8640 1 -- 172.21.15.44:0/3340834712 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00e00b6a00 con 0x7f00e00bee80 2024-05-16T22:27:49.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.146+0000 7f00c7fff640 1 -- 172.21.15.44:0/3340834712 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f00d4044020 con 0x7f00e00bee80 2024-05-16T22:27:49.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.146+0000 7f00c7fff640 1 --2- 172.21.15.44:0/3340834712 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f00cc0762d0 0x7f00cc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:49.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.146+0000 7f00c7fff640 1 -- 172.21.15.44:0/3340834712 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5795+0+0 (secure 0 0 0) 0x7f00d40b7d50 con 0x7f00e00bee80 2024-05-16T22:27:49.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.146+0000 7f00df7fe640 1 --2- 172.21.15.44:0/3340834712 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f00cc0762d0 0x7f00cc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:49.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.147+0000 7f00df7fe640 1 --2- 172.21.15.44:0/3340834712 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f00cc0762d0 0x7f00cc0787e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f00d0000f60 tx=0x7f00d0009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:49.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.151+0000 7f00c7fff640 1 -- 172.21.15.44:0/3340834712 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f00d40bb030 con 0x7f00e00bee80 2024-05-16T22:27:49.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:49.348+0000 7f00e5ca8640 1 -- 172.21.15.44:0/3340834712 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f00e0050940 con 0x7f00e00bee80 2024-05-16T22:27:50.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.233+0000 7f00c7fff640 1 -- 172.21.15.44:0/3340834712 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) ==== 181+0+0 (secure 0 0 0) 0x7f00d404b030 con 0x7f00e00bee80 2024-05-16T22:27:50.234 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' removed 2024-05-16T22:27:50.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.237+0000 7f00e5ca8640 1 -- 172.21.15.44:0/3340834712 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f00cc0762d0 msgr2=0x7f00cc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:50.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.237+0000 7f00e5ca8640 1 --2- 172.21.15.44:0/3340834712 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f00cc0762d0 0x7f00cc0787e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f00d0000f60 tx=0x7f00d0009040 comp rx=0 tx=0).stop 2024-05-16T22:27:50.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.237+0000 7f00e5ca8640 1 -- 172.21.15.44:0/3340834712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00e00bee80 msgr2=0x7f00e014b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:50.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.237+0000 7f00e5ca8640 1 --2- 172.21.15.44:0/3340834712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00e00bee80 0x7f00e014b2f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f00d402a1c0 tx=0x7f00d40046c0 comp rx=0 tx=0).stop 2024-05-16T22:27:50.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.237+0000 7f00e5ca8640 1 -- 172.21.15.44:0/3340834712 shutdown_connections 2024-05-16T22:27:50.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.237+0000 7f00e5ca8640 1 --2- 172.21.15.44:0/3340834712 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f00cc0762d0 0x7f00cc0787e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:50.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.237+0000 7f00e5ca8640 1 --2- 172.21.15.44:0/3340834712 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f00e0151fc0 0x7f00e014b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:50.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.237+0000 7f00e5ca8640 1 --2- 172.21.15.44:0/3340834712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00e00bee80 0x7f00e014b2f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:50.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.237+0000 7f00e5ca8640 1 --2- 172.21.15.44:0/3340834712 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00e00bd6d0 0x7f00e014eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:50.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.237+0000 7f00e5ca8640 1 -- 172.21.15.44:0/3340834712 >> 172.21.15.44:0/3340834712 conn(0x7f00e00c3d20 msgr2=0x7f00e00bbdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:50.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.238+0000 7f00e5ca8640 1 -- 172.21.15.44:0/3340834712 shutdown_connections 2024-05-16T22:27:50.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.238+0000 7f00e5ca8640 1 -- 172.21.15.44:0/3340834712 wait complete. 2024-05-16T22:27:50.252 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-16T22:27:50.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.374+0000 7f7d4f46e640 1 Processor -- start 2024-05-16T22:27:50.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.374+0000 7f7d4f46e640 1 -- start start 2024-05-16T22:27:50.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.375+0000 7f7d4f46e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7d480bf050 0x7f7d48159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:50.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.375+0000 7f7d4f46e640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d4806e140 con 0x7f7d48151fc0 2024-05-16T22:27:50.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.375+0000 7f7d4f46e640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d480c36f0 con 0x7f7d480bd6d0 2024-05-16T22:27:50.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.375+0000 7f7d4f46e640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f7d48152530 con 0x7f7d480bf050 2024-05-16T22:27:50.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.375+0000 7f7d4d20a640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f7d48151fc0 0x7f7d4806da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:33824/0 (socket says 172.21.15.44:33824) 2024-05-16T22:27:50.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.375+0000 7f7d4d20a640 1 -- 172.21.15.44:0/3257772626 learned_addr learned my addr 172.21.15.44:0/3257772626 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:27:50.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.376+0000 7f7d3ffff640 1 -- 172.21.15.44:0/3257772626 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4113010790 0 0) 0x7f7d44001110 con 0x7f7d48151fc0 2024-05-16T22:27:50.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.376+0000 7f7d4da0b640 1 --2- 172.21.15.44:0/3257772626 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7d480bf050 0x7f7d48159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:50.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.376+0000 7f7d3ffff640 1 -- 172.21.15.44:0/3257772626 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d34003520 con 0x7f7d48151fc0 2024-05-16T22:27:50.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.376+0000 7f7d3ffff640 1 -- 172.21.15.44:0/3257772626 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1526755456 0 0) 0x7f7d34003520 con 0x7f7d48151fc0 2024-05-16T22:27:50.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.376+0000 7f7d3ffff640 1 -- 172.21.15.44:0/3257772626 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7d480bf050 msgr2=0x7f7d48159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:50.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.376+0000 7f7d3ffff640 1 --2- 172.21.15.44:0/3257772626 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7d480bf050 0x7f7d48159ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:50.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.376+0000 7f7d3ffff640 1 -- 172.21.15.44:0/3257772626 >> v1:172.21.15.70:6789/0 conn(0x7f7d480bd6d0 legacy=0x7f7d480be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:50.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.376+0000 7f7d3ffff640 1 -- 172.21.15.44:0/3257772626 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d48152810 con 0x7f7d48151fc0 2024-05-16T22:27:50.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.376+0000 7f7d3ffff640 1 -- 172.21.15.44:0/3257772626 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 568431863 0 0) 0x7f7d440018c0 con 0x7f7d48151fc0 2024-05-16T22:27:50.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.376+0000 7f7d3ffff640 1 -- 172.21.15.44:0/3257772626 >> v1:172.21.15.44:6789/0 conn(0x7f7d48151fc0 legacy=0x7f7d4806da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:50.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.376+0000 7f7d3ffff640 1 --2- 172.21.15.44:0/3257772626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d34003a30 0x7f7d34003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:50.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.376+0000 7f7d3ffff640 1 --2- 172.21.15.44:0/3257772626 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d34004800 0x7f7d34004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:50.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.376+0000 7f7d3ffff640 1 --2- 172.21.15.44:0/3257772626 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7d480bf050 0x7f7d3400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:50.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.376+0000 7f7d3ffff640 1 -- 172.21.15.44:0/3257772626 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7d48152530 con 0x7f7d34004800 2024-05-16T22:27:50.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.376+0000 7f7d3ffff640 1 -- 172.21.15.44:0/3257772626 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7d34005590 con 0x7f7d34003a30 2024-05-16T22:27:50.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.376+0000 7f7d3ffff640 1 -- 172.21.15.44:0/3257772626 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f7d3400bf00 con 0x7f7d480bf050 2024-05-16T22:27:50.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.376+0000 7f7d4ca09640 1 --2- 172.21.15.44:0/3257772626 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d34004800 0x7f7d34004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:50.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.376+0000 7f7d4d20a640 1 --2- 172.21.15.44:0/3257772626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d34003a30 0x7f7d34003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:50.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.376+0000 7f7d4da0b640 1 --2- 172.21.15.44:0/3257772626 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7d480bf050 0x7f7d3400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:50.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.376+0000 7f7d4ca09640 1 -- 172.21.15.44:0/3257772626 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7d480bf050 msgr2=0x7f7d3400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:50.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.376+0000 7f7d4ca09640 1 --2- 172.21.15.44:0/3257772626 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7d480bf050 0x7f7d3400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:50.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.376+0000 7f7d4ca09640 1 -- 172.21.15.44:0/3257772626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d34003a30 msgr2=0x7f7d34003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:50.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.376+0000 7f7d4ca09640 1 --2- 172.21.15.44:0/3257772626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d34003a30 0x7f7d34003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:50.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.376+0000 7f7d4ca09640 1 -- 172.21.15.44:0/3257772626 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d34003520 con 0x7f7d34004800 2024-05-16T22:27:50.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.377+0000 7f7d4ca09640 1 --2- 172.21.15.44:0/3257772626 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d34004800 0x7f7d34004c10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7d4806e3d0 tx=0x7f7d34005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3306bc69b25d2aa2 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:50.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.377+0000 7f7d3ffff640 1 -- 172.21.15.44:0/3257772626 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d380013b0 con 0x7f7d34004800 2024-05-16T22:27:50.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.377+0000 7f7d3ffff640 1 -- 172.21.15.44:0/3257772626 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d380052d0 con 0x7f7d34004800 2024-05-16T22:27:50.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.377+0000 7f7d3ffff640 1 -- 172.21.15.44:0/3257772626 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d3802aa60 con 0x7f7d34004800 2024-05-16T22:27:50.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.378+0000 7f7d4f46e640 1 -- 172.21.15.44:0/3257772626 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d34004800 msgr2=0x7f7d34004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:50.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.378+0000 7f7d4f46e640 1 --2- 172.21.15.44:0/3257772626 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d34004800 0x7f7d34004c10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7d4806e3d0 tx=0x7f7d34005830 comp rx=0 tx=0).stop 2024-05-16T22:27:50.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.378+0000 7f7d4da0b640 1 -- 172.21.15.44:0/3257772626 reap_dead start 2024-05-16T22:27:50.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.378+0000 7f7d4f46e640 1 -- 172.21.15.44:0/3257772626 shutdown_connections 2024-05-16T22:27:50.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.378+0000 7f7d4f46e640 1 -- 172.21.15.44:0/3257772626 >> 172.21.15.44:0/3257772626 conn(0x7f7d480c3d20 msgr2=0x7f7d480c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:50.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.378+0000 7f7d4f46e640 1 -- 172.21.15.44:0/3257772626 shutdown_connections 2024-05-16T22:27:50.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.378+0000 7f7d4f46e640 1 -- 172.21.15.44:0/3257772626 wait complete. 2024-05-16T22:27:50.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.380+0000 7f7d4f46e640 1 Processor -- start 2024-05-16T22:27:50.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.380+0000 7f7d4f46e640 1 -- start start 2024-05-16T22:27:50.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.381+0000 7f7d4f46e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d34004800 0x7f7d481e4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:50.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.381+0000 7f7d4f46e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d4814d180 0x7f7d4814b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:50.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.381+0000 7f7d4f46e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7d481e7ad0 0x7f7d481e7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:50.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.381+0000 7f7d4f46e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7d480a2ed0 con 0x7f7d34004800 2024-05-16T22:27:50.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.381+0000 7f7d4f46e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7d480bdae0 con 0x7f7d4814d180 2024-05-16T22:27:50.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.381+0000 7f7d4f46e640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f7d480a3050 con 0x7f7d481e7ad0 2024-05-16T22:27:50.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.381+0000 7f7d4d20a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d34004800 0x7f7d481e4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:50.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.381+0000 7f7d4d20a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d34004800 0x7f7d481e4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60030/0 (socket says 172.21.15.44:60030) 2024-05-16T22:27:50.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.381+0000 7f7d4d20a640 1 -- 172.21.15.44:0/2977996900 learned_addr learned my addr 172.21.15.44:0/2977996900 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:50.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.381+0000 7f7d4ca09640 1 --2- 172.21.15.44:0/2977996900 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d4814d180 0x7f7d4814b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:50.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.381+0000 7f7d4da0b640 1 --2- 172.21.15.44:0/2977996900 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7d481e7ad0 0x7f7d481e7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:50.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.381+0000 7f7d4d20a640 1 -- 172.21.15.44:0/2977996900 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7d481e7ad0 msgr2=0x7f7d481e7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:50.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.381+0000 7f7d4d20a640 1 --2- 172.21.15.44:0/2977996900 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7d481e7ad0 0x7f7d481e7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:50.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.381+0000 7f7d4d20a640 1 -- 172.21.15.44:0/2977996900 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d4814d180 msgr2=0x7f7d4814b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:50.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.381+0000 7f7d4d20a640 1 --2- 172.21.15.44:0/2977996900 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d4814d180 0x7f7d4814b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:50.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.381+0000 7f7d4d20a640 1 -- 172.21.15.44:0/2977996900 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d4814d930 con 0x7f7d34004800 2024-05-16T22:27:50.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.381+0000 7f7d4da0b640 1 --2- 172.21.15.44:0/2977996900 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7d481e7ad0 0x7f7d481e7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:27:50.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.381+0000 7f7d4d20a640 1 --2- 172.21.15.44:0/2977996900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d34004800 0x7f7d481e4500 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7d44001bf0 tx=0x7f7d44007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:50.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.382+0000 7f7d3dffb640 1 -- 172.21.15.44:0/2977996900 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4400f7b0 con 0x7f7d34004800 2024-05-16T22:27:50.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.382+0000 7f7d3dffb640 1 -- 172.21.15.44:0/2977996900 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d44018070 con 0x7f7d34004800 2024-05-16T22:27:50.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.382+0000 7f7d4f46e640 1 -- 172.21.15.44:0/2977996900 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d4814dc10 con 0x7f7d34004800 2024-05-16T22:27:50.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.382+0000 7f7d3dffb640 1 -- 172.21.15.44:0/2977996900 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4400fbb0 con 0x7f7d34004800 2024-05-16T22:27:50.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.382+0000 7f7d4f46e640 1 -- 172.21.15.44:0/2977996900 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d481e4c00 con 0x7f7d34004800 2024-05-16T22:27:50.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.383+0000 7f7d4f46e640 1 -- 172.21.15.44:0/2977996900 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d4814c1b0 con 0x7f7d34004800 2024-05-16T22:27:50.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.384+0000 7f7d3dffb640 1 -- 172.21.15.44:0/2977996900 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7d4400fd50 con 0x7f7d34004800 2024-05-16T22:27:50.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.384+0000 7f7d3dffb640 1 --2- 172.21.15.44:0/2977996900 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f7d2c0762d0 0x7f7d2c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:50.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.384+0000 7f7d3dffb640 1 -- 172.21.15.44:0/2977996900 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5357+0+0 (secure 0 0 0) 0x7f7d44097430 con 0x7f7d34004800 2024-05-16T22:27:50.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.384+0000 7f7d4ca09640 1 --2- 172.21.15.44:0/2977996900 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f7d2c0762d0 0x7f7d2c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:50.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.385+0000 7f7d4ca09640 1 --2- 172.21.15.44:0/2977996900 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f7d2c0762d0 0x7f7d2c0787e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7d38032000 tx=0x7f7d3802e000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:50.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.389+0000 7f7d3dffb640 1 -- 172.21.15.44:0/2977996900 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7d4806e140 con 0x7f7d34004800 2024-05-16T22:27:50.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:50.580+0000 7f7d4f46e640 1 -- 172.21.15.44:0/2977996900 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7d48050940 con 0x7f7d34004800 2024-05-16T22:27:51.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.245+0000 7f7d3dffb640 1 -- 172.21.15.44:0/2977996900 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) ==== 169+0+0 (secure 0 0 0) 0x7f7d44060e60 con 0x7f7d34004800 2024-05-16T22:27:51.246 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' removed 2024-05-16T22:27:51.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.249+0000 7f7d4f46e640 1 -- 172.21.15.44:0/2977996900 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f7d2c0762d0 msgr2=0x7f7d2c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:51.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.249+0000 7f7d4f46e640 1 --2- 172.21.15.44:0/2977996900 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f7d2c0762d0 0x7f7d2c0787e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7d38032000 tx=0x7f7d3802e000 comp rx=0 tx=0).stop 2024-05-16T22:27:51.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.249+0000 7f7d4f46e640 1 -- 172.21.15.44:0/2977996900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d34004800 msgr2=0x7f7d481e4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:51.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.249+0000 7f7d4f46e640 1 --2- 172.21.15.44:0/2977996900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d34004800 0x7f7d481e4500 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7d44001bf0 tx=0x7f7d44007430 comp rx=0 tx=0).stop 2024-05-16T22:27:51.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.249+0000 7f7d4f46e640 1 -- 172.21.15.44:0/2977996900 shutdown_connections 2024-05-16T22:27:51.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.249+0000 7f7d4f46e640 1 --2- 172.21.15.44:0/2977996900 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f7d2c0762d0 0x7f7d2c0787e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:51.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.249+0000 7f7d4f46e640 1 --2- 172.21.15.44:0/2977996900 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7d481e7ad0 0x7f7d481e7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:51.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.249+0000 7f7d4f46e640 1 --2- 172.21.15.44:0/2977996900 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d4814d180 0x7f7d4814b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:51.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.249+0000 7f7d4f46e640 1 --2- 172.21.15.44:0/2977996900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d34004800 0x7f7d481e4500 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:51.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.249+0000 7f7d4f46e640 1 -- 172.21.15.44:0/2977996900 >> 172.21.15.44:0/2977996900 conn(0x7f7d480c3d20 msgr2=0x7f7d480c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:51.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.249+0000 7f7d4f46e640 1 -- 172.21.15.44:0/2977996900 shutdown_connections 2024-05-16T22:27:51.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.250+0000 7f7d4f46e640 1 -- 172.21.15.44:0/2977996900 wait complete. 2024-05-16T22:27:51.264 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-16T22:27:51.264 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-16T22:27:51.264 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-16T22:27:51.264 INFO:teuthology.orchestra.run:waiting for 300 2024-05-16T22:27:51.264 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-16T22:27:51.265 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-16T22:27:51.265 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-16T22:27:51.265 INFO:teuthology.orchestra.run:waiting for 300 2024-05-16T22:27:51.265 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-16T22:27:51.265 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-16T22:27:51.265 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-16T22:27:51.265 INFO:teuthology.orchestra.run:waiting for 300 2024-05-16T22:27:51.275 INFO:tasks.ceph.mds.a:Stopped 2024-05-16T22:27:51.275 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-16T22:27:51.276 INFO:tasks.ceph.mds.b:Stopped 2024-05-16T22:27:51.276 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-16T22:27:51.279 INFO:tasks.ceph.mds.c:Stopped 2024-05-16T22:27:51.279 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-16T22:27:51.319 INFO:tasks.ceph.mds.b:Started 2024-05-16T22:27:51.319 DEBUG:teuthology.parallel:result is None 2024-05-16T22:27:51.321 INFO:tasks.ceph.mds.a:Started 2024-05-16T22:27:51.321 DEBUG:teuthology.parallel:result is None 2024-05-16T22:27:51.323 INFO:tasks.ceph.mds.c:Started 2024-05-16T22:27:51.323 DEBUG:teuthology.parallel:result is None 2024-05-16T22:27:51.323 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-16T22:27:51.406 INFO:tasks.ceph.mds.b.smithi070.stdout:starting mds.b at 2024-05-16T22:27:51.416 INFO:tasks.ceph.mds.a.smithi044.stdout:starting mds.a at 2024-05-16T22:27:51.427 INFO:tasks.ceph.mds.c.smithi044.stdout:starting mds.c at 2024-05-16T22:27:51.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.447+0000 7f283b39d640 1 Processor -- start 2024-05-16T22:27:51.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.447+0000 7f283b39d640 1 -- start start 2024-05-16T22:27:51.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.449+0000 7f283b39d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2834145f90 0x7f28341463a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:51.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.449+0000 7f283b39d640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f283414c170 con 0x7f28340bc1c0 2024-05-16T22:27:51.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.449+0000 7f283b39d640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28340c10f0 con 0x7f2834070c70 2024-05-16T22:27:51.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.449+0000 7f283b39d640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f283414c4a0 con 0x7f2834145f90 2024-05-16T22:27:51.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.449+0000 7f2839139640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f28340bc1c0 0x7f283414c930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:33836/0 (socket says 172.21.15.44:33836) 2024-05-16T22:27:51.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.449+0000 7f2839139640 1 -- 172.21.15.44:0/3306668859 learned_addr learned my addr 172.21.15.44:0/3306668859 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:27:51.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.449+0000 7f2838938640 1 --2- 172.21.15.44:0/3306668859 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2834145f90 0x7f28341463a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:51.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.449+0000 7f282bfff640 1 -- 172.21.15.44:0/3306668859 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 508829714 0 0) 0x7f283414c170 con 0x7f28340bc1c0 2024-05-16T22:27:51.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.449+0000 7f282bfff640 1 -- 172.21.15.44:0/3306668859 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2820003520 con 0x7f28340bc1c0 2024-05-16T22:27:51.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.449+0000 7f282bfff640 1 -- 172.21.15.44:0/3306668859 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1815693959 0 0) 0x7f28340c10f0 con 0x7f2834070c70 2024-05-16T22:27:51.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.449+0000 7f2838938640 1 -- 172.21.15.44:0/3306668859 >> v1:172.21.15.70:6789/0 conn(0x7f2834070c70 legacy=0x7f2834071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:51.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.449+0000 7f2838938640 1 -- 172.21.15.44:0/3306668859 >> v1:172.21.15.44:6789/0 conn(0x7f28340bc1c0 legacy=0x7f283414c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:51.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.449+0000 7f2838938640 1 -- 172.21.15.44:0/3306668859 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28340c13d0 con 0x7f2834145f90 2024-05-16T22:27:51.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.450+0000 7f2838938640 1 --2- 172.21.15.44:0/3306668859 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2834145f90 0x7f28341463a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f28240097d0 tx=0x7f282402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e97d69c12b62166d server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:51.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.450+0000 7f282bfff640 1 -- 172.21.15.44:0/3306668859 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2824037070 con 0x7f2834145f90 2024-05-16T22:27:51.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.450+0000 7f282bfff640 1 -- 172.21.15.44:0/3306668859 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2824032440 con 0x7f2834145f90 2024-05-16T22:27:51.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.450+0000 7f282bfff640 1 -- 172.21.15.44:0/3306668859 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28240327f0 con 0x7f2834145f90 2024-05-16T22:27:51.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.451+0000 7f283b39d640 1 -- 172.21.15.44:0/3306668859 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2834145f90 msgr2=0x7f28341463a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:51.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.451+0000 7f283b39d640 1 --2- 172.21.15.44:0/3306668859 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2834145f90 0x7f28341463a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f28240097d0 tx=0x7f282402a210 comp rx=0 tx=0).stop 2024-05-16T22:27:51.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.451+0000 7f283b39d640 1 -- 172.21.15.44:0/3306668859 shutdown_connections 2024-05-16T22:27:51.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.451+0000 7f283b39d640 1 --2- 172.21.15.44:0/3306668859 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2834145f90 0x7f28341463a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:51.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.451+0000 7f283b39d640 1 -- 172.21.15.44:0/3306668859 >> 172.21.15.44:0/3306668859 conn(0x7f28340c1750 msgr2=0x7f28340c1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:51.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.451+0000 7f283b39d640 1 -- 172.21.15.44:0/3306668859 shutdown_connections 2024-05-16T22:27:51.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.451+0000 7f283b39d640 1 -- 172.21.15.44:0/3306668859 wait complete. 2024-05-16T22:27:51.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.453+0000 7f283b39d640 1 Processor -- start 2024-05-16T22:27:51.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.453+0000 7f283b39d640 1 -- start start 2024-05-16T22:27:51.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.454+0000 7f283b39d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2834070c70 0x7f2834141a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:51.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.454+0000 7f283b39d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28340bc1c0 0x7f28341378d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:51.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.454+0000 7f283b39d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2834145f90 0x7f2834137e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:51.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.454+0000 7f283b39d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f28340bd660 con 0x7f2834070c70 2024-05-16T22:27:51.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.454+0000 7f283b39d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2834071790 con 0x7f28340bc1c0 2024-05-16T22:27:51.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.454+0000 7f283b39d640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f28340bd7e0 con 0x7f2834145f90 2024-05-16T22:27:51.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.454+0000 7f2839139640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2834070c70 0x7f2834141a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:51.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.454+0000 7f2839139640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2834070c70 0x7f2834141a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60066/0 (socket says 172.21.15.44:60066) 2024-05-16T22:27:51.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.454+0000 7f2839139640 1 -- 172.21.15.44:0/2187219377 learned_addr learned my addr 172.21.15.44:0/2187219377 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:51.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.454+0000 7f2838938640 1 --2- 172.21.15.44:0/2187219377 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28340bc1c0 0x7f28341378d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:51.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.454+0000 7f283993a640 1 --2- 172.21.15.44:0/2187219377 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2834145f90 0x7f2834137e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:51.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.454+0000 7f2839139640 1 -- 172.21.15.44:0/2187219377 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2834145f90 msgr2=0x7f2834137e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:51.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.454+0000 7f2839139640 1 --2- 172.21.15.44:0/2187219377 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2834145f90 0x7f2834137e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:51.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.454+0000 7f2839139640 1 -- 172.21.15.44:0/2187219377 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28340bc1c0 msgr2=0x7f28341378d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:51.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.454+0000 7f2839139640 1 --2- 172.21.15.44:0/2187219377 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28340bc1c0 0x7f28341378d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:51.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.454+0000 7f2839139640 1 -- 172.21.15.44:0/2187219377 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2834141fc0 con 0x7f2834070c70 2024-05-16T22:27:51.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.454+0000 7f2838938640 1 --2- 172.21.15.44:0/2187219377 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28340bc1c0 0x7f28341378d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:27:51.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.454+0000 7f2839139640 1 --2- 172.21.15.44:0/2187219377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2834070c70 0x7f2834141a80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f283000c430 tx=0x7f283000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:51.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.455+0000 7f2829ffb640 1 -- 172.21.15.44:0/2187219377 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2830017070 con 0x7f2834070c70 2024-05-16T22:27:51.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.455+0000 7f283b39d640 1 -- 172.21.15.44:0/2187219377 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28341d64d0 con 0x7f2834070c70 2024-05-16T22:27:51.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.455+0000 7f2829ffb640 1 -- 172.21.15.44:0/2187219377 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2830005ce0 con 0x7f2834070c70 2024-05-16T22:27:51.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.455+0000 7f2829ffb640 1 -- 172.21.15.44:0/2187219377 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28300072d0 con 0x7f2834070c70 2024-05-16T22:27:52.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.455+0000 7f283b39d640 1 -- 172.21.15.44:0/2187219377 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f283414c050 con 0x7f2834070c70 2024-05-16T22:27:52.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.456+0000 7f283b39d640 1 -- 172.21.15.44:0/2187219377 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2834071080 con 0x7f2834070c70 2024-05-16T22:27:52.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.456+0000 7f2829ffb640 1 -- 172.21.15.44:0/2187219377 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2830007470 con 0x7f2834070c70 2024-05-16T22:27:52.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.457+0000 7f2829ffb640 1 --2- 172.21.15.44:0/2187219377 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f28180762d0 0x7f28180787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:52.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.457+0000 7f2829ffb640 1 -- 172.21.15.44:0/2187219377 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 4943+0+0 (secure 0 0 0) 0x7f2830096530 con 0x7f2834070c70 2024-05-16T22:27:52.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.457+0000 7f2838938640 1 --2- 172.21.15.44:0/2187219377 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f28180762d0 0x7f28180787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:52.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.457+0000 7f2838938640 1 --2- 172.21.15.44:0/2187219377 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f28180762d0 0x7f28180787e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2824034000 tx=0x7f282402e000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:52.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.461+0000 7f2829ffb640 1 -- 172.21.15.44:0/2187219377 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f283005fac0 con 0x7f2834070c70 2024-05-16T22:27:52.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:51.667+0000 7f283b39d640 1 -- 172.21.15.44:0/2187219377 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f2834050940 con 0x7f2834070c70 2024-05-16T22:27:52.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.255+0000 7f2829ffb640 1 -- 172.21.15.44:0/2187219377 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v26) ==== 97+0+0 (secure 0 0 0) 0x7f2830063dc0 con 0x7f2834070c70 2024-05-16T22:27:52.264 INFO:teuthology.orchestra.run.smithi044.stderr: removed all blocklist entries 2024-05-16T22:27:52.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.258+0000 7f283b39d640 1 -- 172.21.15.44:0/2187219377 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f28180762d0 msgr2=0x7f28180787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:52.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.258+0000 7f283b39d640 1 --2- 172.21.15.44:0/2187219377 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f28180762d0 0x7f28180787e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2824034000 tx=0x7f282402e000 comp rx=0 tx=0).stop 2024-05-16T22:27:52.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.258+0000 7f283b39d640 1 -- 172.21.15.44:0/2187219377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2834070c70 msgr2=0x7f2834141a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:52.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.258+0000 7f283b39d640 1 --2- 172.21.15.44:0/2187219377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2834070c70 0x7f2834141a80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f283000c430 tx=0x7f283000c8f0 comp rx=0 tx=0).stop 2024-05-16T22:27:52.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.258+0000 7f283b39d640 1 -- 172.21.15.44:0/2187219377 shutdown_connections 2024-05-16T22:27:52.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.258+0000 7f283b39d640 1 --2- 172.21.15.44:0/2187219377 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f28180762d0 0x7f28180787e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:52.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.258+0000 7f283b39d640 1 --2- 172.21.15.44:0/2187219377 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2834145f90 0x7f2834137e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:52.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.258+0000 7f283b39d640 1 --2- 172.21.15.44:0/2187219377 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28340bc1c0 0x7f28341378d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:52.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.258+0000 7f283b39d640 1 --2- 172.21.15.44:0/2187219377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2834070c70 0x7f2834141a80 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:52.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.259+0000 7f283b39d640 1 -- 172.21.15.44:0/2187219377 >> 172.21.15.44:0/2187219377 conn(0x7f28340c1750 msgr2=0x7f2834144a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:52.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.259+0000 7f283b39d640 1 -- 172.21.15.44:0/2187219377 shutdown_connections 2024-05-16T22:27:52.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.259+0000 7f283b39d640 1 -- 172.21.15.44:0/2187219377 wait complete. 2024-05-16T22:27:52.413 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-16T22:27:52.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.540+0000 7f04b33ce640 1 Processor -- start 2024-05-16T22:27:52.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.540+0000 7f04b33ce640 1 -- start start 2024-05-16T22:27:52.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.541+0000 7f04b33ce640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f04ac0be230 0x7f04ac06dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:52.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.541+0000 7f04b33ce640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f04ac0bd510 0x7f04ac0bd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:52.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.541+0000 7f04b33ce640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f04ac14ebd0 0x7f04ac14efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:52.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.541+0000 7f04b33ce640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f04ac14c230 con 0x7f04ac0bd510 2024-05-16T22:27:52.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.541+0000 7f04b33ce640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f04ac0bea40 con 0x7f04ac0be230 2024-05-16T22:27:52.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.541+0000 7f04b33ce640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f04ac06e0f0 con 0x7f04ac14ebd0 2024-05-16T22:27:52.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.541+0000 7f04b0969640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f04ac0bd510 0x7f04ac0bd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:52.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.541+0000 7f04b0969640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f04ac0bd510 0x7f04ac0bd920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60076/0 (socket says 172.21.15.44:60076) 2024-05-16T22:27:52.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.541+0000 7f04b0969640 1 -- 172.21.15.44:0/264290079 learned_addr learned my addr 172.21.15.44:0/264290079 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:52.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.541+0000 7f04b196b640 1 --2- 172.21.15.44:0/264290079 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f04ac14ebd0 0x7f04ac14efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:52.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.541+0000 7f04b116a640 1 --2- 172.21.15.44:0/264290079 >> v2:172.21.15.70:3300/0 conn(0x7f04ac0be230 0x7f04ac06dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:52.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.541+0000 7f04b0969640 1 -- 172.21.15.44:0/264290079 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f04ac14ebd0 msgr2=0x7f04ac14efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:52.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.541+0000 7f04b0969640 1 --2- 172.21.15.44:0/264290079 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f04ac14ebd0 0x7f04ac14efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:52.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.541+0000 7f04b0969640 1 -- 172.21.15.44:0/264290079 >> v2:172.21.15.70:3300/0 conn(0x7f04ac0be230 msgr2=0x7f04ac06dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:27:52.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.541+0000 7f04b0969640 1 --2- 172.21.15.44:0/264290079 >> v2:172.21.15.70:3300/0 conn(0x7f04ac0be230 0x7f04ac06dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:52.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.541+0000 7f04b0969640 1 -- 172.21.15.44:0/264290079 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04ac0becb0 con 0x7f04ac0bd510 2024-05-16T22:27:52.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.542+0000 7f04b0969640 1 --2- 172.21.15.44:0/264290079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04ac0bd510 0x7f04ac0bd920 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f04ac08d400 tx=0x7f049c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cde69b72863d4cf server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:52.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.542+0000 7f04a3fff640 1 -- 172.21.15.44:0/264290079 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f049c037070 con 0x7f04ac0bd510 2024-05-16T22:27:52.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.542+0000 7f04a3fff640 1 -- 172.21.15.44:0/264290079 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f049c032440 con 0x7f04ac0bd510 2024-05-16T22:27:52.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.542+0000 7f04a3fff640 1 -- 172.21.15.44:0/264290079 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f049c032810 con 0x7f04ac0bd510 2024-05-16T22:27:52.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.543+0000 7f04b33ce640 1 -- 172.21.15.44:0/264290079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04ac0bd510 msgr2=0x7f04ac0bd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:52.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.543+0000 7f04b33ce640 1 --2- 172.21.15.44:0/264290079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04ac0bd510 0x7f04ac0bd920 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f04ac08d400 tx=0x7f049c02a1e0 comp rx=0 tx=0).stop 2024-05-16T22:27:52.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.543+0000 7f04b33ce640 1 -- 172.21.15.44:0/264290079 shutdown_connections 2024-05-16T22:27:52.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.543+0000 7f04b33ce640 1 --2- 172.21.15.44:0/264290079 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f04ac14ebd0 0x7f04ac14efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:52.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.543+0000 7f04b33ce640 1 --2- 172.21.15.44:0/264290079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04ac0bd510 0x7f04ac0bd920 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:52.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.543+0000 7f04b33ce640 1 --2- 172.21.15.44:0/264290079 >> v2:172.21.15.70:3300/0 conn(0x7f04ac0be230 0x7f04ac06dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:52.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.543+0000 7f04b33ce640 1 -- 172.21.15.44:0/264290079 >> 172.21.15.44:0/264290079 conn(0x7f04ac0c3cd0 msgr2=0x7f04ac0c40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:27:52.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.543+0000 7f04b33ce640 1 -- 172.21.15.44:0/264290079 shutdown_connections 2024-05-16T22:27:52.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.543+0000 7f04b33ce640 1 -- 172.21.15.44:0/264290079 wait complete. 2024-05-16T22:27:52.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.545+0000 7f04b33ce640 1 Processor -- start 2024-05-16T22:27:53.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.545+0000 7f04b33ce640 1 -- start start 2024-05-16T22:27:53.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.546+0000 7f04b33ce640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04ac0bd510 0x7f04ac0bc880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:53.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.546+0000 7f04b33ce640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f04ac0be230 0x7f04ac0a73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:53.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.546+0000 7f04b33ce640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04ac14ebd0 0x7f04ac14aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:53.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.546+0000 7f04b33ce640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f04ac06ea70 con 0x7f04ac0bd510 2024-05-16T22:27:53.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.546+0000 7f04b33ce640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f04ac14f520 con 0x7f04ac14ebd0 2024-05-16T22:27:53.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.546+0000 7f04b33ce640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f04ac0be640 con 0x7f04ac0be230 2024-05-16T22:27:53.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.546+0000 7f04b116a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04ac0bd510 0x7f04ac0bc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:53.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.546+0000 7f04b116a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04ac0bd510 0x7f04ac0bc880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60090/0 (socket says 172.21.15.44:60090) 2024-05-16T22:27:53.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.546+0000 7f04b116a640 1 -- 172.21.15.44:0/3832260042 learned_addr learned my addr 172.21.15.44:0/3832260042 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:27:53.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.546+0000 7f04b196b640 1 --2- 172.21.15.44:0/3832260042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04ac14ebd0 0x7f04ac14aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:53.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.546+0000 7f04b0969640 1 --2- 172.21.15.44:0/3832260042 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f04ac0be230 0x7f04ac0a73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:53.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.546+0000 7f04b116a640 1 -- 172.21.15.44:0/3832260042 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f04ac0be230 msgr2=0x7f04ac0a73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:53.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.546+0000 7f04b116a640 1 --2- 172.21.15.44:0/3832260042 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f04ac0be230 0x7f04ac0a73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:53.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.546+0000 7f04b116a640 1 -- 172.21.15.44:0/3832260042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04ac14ebd0 msgr2=0x7f04ac14aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:27:53.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.546+0000 7f04b116a640 1 --2- 172.21.15.44:0/3832260042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04ac14ebd0 0x7f04ac14aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:27:53.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.546+0000 7f04b116a640 1 -- 172.21.15.44:0/3832260042 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04ac0a7910 con 0x7f04ac0bd510 2024-05-16T22:27:53.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.546+0000 7f04b116a640 1 --2- 172.21.15.44:0/3832260042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04ac0bd510 0x7f04ac0bc880 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f04a800d830 tx=0x7f04a800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:53.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.546+0000 7f04a1ffb640 1 -- 172.21.15.44:0/3832260042 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a8018030 con 0x7f04ac0bd510 2024-05-16T22:27:53.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.546+0000 7f04a1ffb640 1 -- 172.21.15.44:0/3832260042 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04a800be10 con 0x7f04ac0bd510 2024-05-16T22:27:53.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.546+0000 7f04b33ce640 1 -- 172.21.15.44:0/3832260042 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04ac0a8620 con 0x7f04ac0bd510 2024-05-16T22:27:53.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.546+0000 7f04a1ffb640 1 -- 172.21.15.44:0/3832260042 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a80098b0 con 0x7f04ac0bd510 2024-05-16T22:27:53.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.547+0000 7f04b33ce640 1 -- 172.21.15.44:0/3832260042 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04ac0a8b20 con 0x7f04ac0bd510 2024-05-16T22:27:53.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.548+0000 7f04b33ce640 1 -- 172.21.15.44:0/3832260042 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04ac0c3610 con 0x7f04ac0bd510 2024-05-16T22:27:53.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.548+0000 7f04a1ffb640 1 -- 172.21.15.44:0/3832260042 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f04a801b070 con 0x7f04ac0bd510 2024-05-16T22:27:53.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.549+0000 7f04a1ffb640 1 --2- 172.21.15.44:0/3832260042 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0490076300 0x7f0490078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:27:53.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.549+0000 7f04a1ffb640 1 -- 172.21.15.44:0/3832260042 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f04a80973f0 con 0x7f04ac0bd510 2024-05-16T22:27:54.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.549+0000 7f04b0969640 1 --2- 172.21.15.44:0/3832260042 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0490076300 0x7f0490078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:27:54.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.550+0000 7f04b0969640 1 --2- 172.21.15.44:0/3832260042 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0490076300 0x7f0490078810 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f049c034000 tx=0x7f049c02e000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:27:54.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.554+0000 7f04a1ffb640 1 -- 172.21.15.44:0/3832260042 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f04a8061090 con 0x7f04ac0bd510 2024-05-16T22:27:54.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.817+0000 7f04b33ce640 1 -- 172.21.15.44:0/3832260042 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f04ac050940 con 0x7f04ac0bd510 2024-05-16T22:27:54.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.817+0000 7f04a1ffb640 1 -- 172.21.15.44:0/3832260042 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) ==== 80+0+5491 (secure 0 0 0) 0x7f04a8060990 con 0x7f04ac0bd510 2024-05-16T22:27:54.189 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:27:54.222 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-05-16T22:27:54.255 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_dump": [ 2024-05-16T22:27:54.288 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-05-16T22:27:54.322 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.a", 2024-05-16T22:27:54.356 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAWiEZmxekLORAA65NIhbDezFAP1GVT9W/2RA==", 2024-05-16T22:27:54.389 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-05-16T22:27:54.425 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-05-16T22:27:54.458 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-05-16T22:27:54.489 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-05-16T22:27:54.522 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-05-16T22:27:54.581 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-05-16T22:27:54.614 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-05-16T22:27:54.648 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-05-16T22:27:54.681 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.b", 2024-05-16T22:27:54.714 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAXiEZmurcoChAAJiwILq5JEI80q8OpClacbw==", 2024-05-16T22:27:54.747 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-05-16T22:27:54.781 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-05-16T22:27:54.814 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-05-16T22:27:54.848 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-05-16T22:27:54.881 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-05-16T22:27:54.914 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-05-16T22:27:54.948 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-05-16T22:27:54.981 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-05-16T22:27:55.014 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.c", 2024-05-16T22:27:55.048 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAXiEZmtUcJBRAASN/71ONwgQ6oUKwSgrptjw==", 2024-05-16T22:27:55.081 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-05-16T22:27:55.140 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-05-16T22:27:55.173 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-05-16T22:27:55.206 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-05-16T22:27:55.240 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-05-16T22:27:55.273 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-05-16T22:27:55.306 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-05-16T22:27:55.340 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-05-16T22:27:55.373 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.0", 2024-05-16T22:27:55.407 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAaiEZm+8xUJRAA9xLLdiQFRJCz2p87HaNmyA==", 2024-05-16T22:27:55.440 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-05-16T22:27:55.473 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-05-16T22:27:55.507 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-05-16T22:27:55.540 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-05-16T22:27:55.573 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-05-16T22:27:55.607 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-05-16T22:27:55.640 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-05-16T22:27:55.690 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.1", 2024-05-16T22:27:55.724 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAdiEZmmMAaJRAArJoDZU7bZnxdQigZzd0YVg==", 2024-05-16T22:27:55.757 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-05-16T22:27:55.790 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-05-16T22:27:55.824 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-05-16T22:27:55.857 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-05-16T22:27:55.890 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-05-16T22:27:55.924 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-05-16T22:27:55.965 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-05-16T22:27:55.999 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.2", 2024-05-16T22:27:56.032 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAgiEZmPjYbJBAAHAcCdSqGENz8izm4WRgL+A==", 2024-05-16T22:27:56.065 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-05-16T22:27:56.099 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-05-16T22:27:56.132 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-05-16T22:27:56.166 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-05-16T22:27:56.199 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-05-16T22:27:56.257 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-05-16T22:27:56.291 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-05-16T22:27:56.324 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.3", 2024-05-16T22:27:56.375 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAjiEZmEtkSJBAAyLOddh7tm2/aH5Kg1vEAyg==", 2024-05-16T22:27:56.408 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-05-16T22:27:56.441 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-05-16T22:27:56.496 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-05-16T22:27:56.532 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-05-16T22:27:56.566 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-05-16T22:27:56.599 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-05-16T22:27:56.633 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-05-16T22:27:56.666 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.4", 2024-05-16T22:27:56.699 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAniEZm1f01LBAAl7Okxq8NCE6pNDSpffrHNQ==", 2024-05-16T22:27:56.733 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-05-16T22:27:56.766 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-05-16T22:27:56.800 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-05-16T22:27:56.858 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-05-16T22:27:56.891 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-05-16T22:27:56.925 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-05-16T22:27:56.958 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-05-16T22:27:56.991 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.5", 2024-05-16T22:27:57.025 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAqiEZmL9yZKhAAHdy+cA/TusLioV8AuJLMzg==", 2024-05-16T22:27:57.058 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-05-16T22:27:57.100 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-05-16T22:27:57.133 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-05-16T22:27:57.166 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-05-16T22:27:57.200 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-05-16T22:27:57.233 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-05-16T22:27:57.267 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-05-16T22:27:57.300 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.6", 2024-05-16T22:27:57.333 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAtiEZm+r/pKBAA1P18UVMTaPbPfz0x+n+rcA==", 2024-05-16T22:27:57.367 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-05-16T22:27:57.417 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-05-16T22:27:57.450 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-05-16T22:27:57.483 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-05-16T22:27:57.517 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-05-16T22:27:57.550 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-05-16T22:27:57.584 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-05-16T22:27:57.617 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.7", 2024-05-16T22:27:57.650 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAwiEZm9IVUJxAAXMx+HxIIDuBtRZ8pRXMdEQ==", 2024-05-16T22:27:57.684 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-05-16T22:27:57.717 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-05-16T22:27:57.750 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-05-16T22:27:57.784 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-05-16T22:27:57.817 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-05-16T22:27:57.850 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-05-16T22:27:57.884 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-05-16T22:27:57.917 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.0", 2024-05-16T22:27:57.967 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAXiEZms3dqGBAAS4ISUkubc7YrigOk4RRlXA==", 2024-05-16T22:27:58.001 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-05-16T22:27:58.034 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-05-16T22:27:58.067 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2024-05-16T22:27:58.101 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2024-05-16T22:27:58.134 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2024-05-16T22:27:58.167 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-05-16T22:27:58.226 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-05-16T22:27:58.259 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-05-16T22:27:58.293 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.admin", 2024-05-16T22:27:58.326 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAWiEZmdP/sDhAAu46uG2l+oX+eDfx+Uc5+Bg==", 2024-05-16T22:27:58.359 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-05-16T22:27:58.393 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2024-05-16T22:27:58.426 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-05-16T22:27:58.459 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-05-16T22:27:58.493 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-05-16T22:27:58.551 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-05-16T22:27:58.584 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-05-16T22:27:58.618 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-05-16T22:27:58.651 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.bootstrap-mds", 2024-05-16T22:27:58.685 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQA2iEZmB+T2DBAAlQv8tsX25o4o/nQPRwy6ZQ==", 2024-05-16T22:27:58.718 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-05-16T22:27:58.751 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile bootstrap-mds" 2024-05-16T22:27:58.790 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-05-16T22:27:58.826 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-05-16T22:27:58.860 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-05-16T22:27:58.904 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.bootstrap-mgr", 2024-05-16T22:27:58.935 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQA2iEZm8+z2DBAADr7bOIP0OwS0CpuO3UcHJw==", 2024-05-16T22:27:58.968 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-05-16T22:27:59.010 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile bootstrap-mgr" 2024-05-16T22:27:59.043 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-05-16T22:27:59.077 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-05-16T22:27:59.135 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-05-16T22:27:59.169 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.bootstrap-osd", 2024-05-16T22:27:59.202 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQA2iEZmkfT2DBAAgUObA7u5bD1tqIbZeZ5aow==", 2024-05-16T22:27:59.235 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-05-16T22:27:59.268 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile bootstrap-osd" 2024-05-16T22:27:59.302 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-05-16T22:27:59.335 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-05-16T22:27:59.369 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-05-16T22:27:59.402 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.bootstrap-rbd", 2024-05-16T22:27:59.435 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQA2iEZm5/v2DBAAocjdDEtfn74Ud4Duhvq/fQ==", 2024-05-16T22:27:59.469 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-05-16T22:27:59.510 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile bootstrap-rbd" 2024-05-16T22:27:59.544 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-05-16T22:27:59.577 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-05-16T22:27:59.611 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-05-16T22:27:59.644 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-05-16T22:27:59.694 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQA2iEZmdQP3DBAAM4758AOsk4yhg3x19zxw3A==", 2024-05-16T22:27:59.727 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-05-16T22:27:59.761 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-05-16T22:27:59.794 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-05-16T22:27:59.827 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-05-16T22:27:59.861 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-05-16T22:27:59.894 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.bootstrap-rgw", 2024-05-16T22:27:59.927 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQA2iEZmNgv3DBAAoLIU5PM77or94o7RFrUAow==", 2024-05-16T22:27:59.961 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-05-16T22:28:00.047 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile bootstrap-rgw" 2024-05-16T22:28:00.078 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-05-16T22:28:00.111 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-05-16T22:28:00.184 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-05-16T22:28:00.219 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mgr.x", 2024-05-16T22:28:00.253 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAWiEZm7uNONRAAmiKGMr87L5iAlRVZjapvxQ==", 2024-05-16T22:28:00.286 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-05-16T22:28:00.336 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2024-05-16T22:28:00.370 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile mgr", 2024-05-16T22:28:00.403 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-05-16T22:28:00.436 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-05-16T22:28:00.470 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-05-16T22:28:00.503 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-05-16T22:28:00.536 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mgr.y", 2024-05-16T22:28:00.570 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAWiEZmUj4wMRAAsBAzNHvbKW0neWbAITTL1A==", 2024-05-16T22:28:00.603 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-05-16T22:28:00.636 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2024-05-16T22:28:00.670 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile mgr", 2024-05-16T22:28:00.703 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-05-16T22:28:00.737 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-05-16T22:28:00.770 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-05-16T22:28:00.803 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-05-16T22:28:00.837 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-05-16T22:28:00.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.819+0000 7f04b33ce640 1 -- 172.21.15.44:0/3832260042 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0490076300 msgr2=0x7f0490078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:00.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.819+0000 7f04b33ce640 1 --2- 172.21.15.44:0/3832260042 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0490076300 0x7f0490078810 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f049c034000 tx=0x7f049c02e000 comp rx=0 tx=0).stop 2024-05-16T22:28:00.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.819+0000 7f04b33ce640 1 -- 172.21.15.44:0/3832260042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04ac0bd510 msgr2=0x7f04ac0bc880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:00.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.819+0000 7f04b33ce640 1 --2- 172.21.15.44:0/3832260042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04ac0bd510 0x7f04ac0bc880 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f04a800d830 tx=0x7f04a800dcf0 comp rx=0 tx=0).stop 2024-05-16T22:28:01.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.819+0000 7f04b33ce640 1 -- 172.21.15.44:0/3832260042 shutdown_connections 2024-05-16T22:28:01.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.819+0000 7f04b33ce640 1 --2- 172.21.15.44:0/3832260042 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0490076300 0x7f0490078810 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:01.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.819+0000 7f04b33ce640 1 --2- 172.21.15.44:0/3832260042 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f04ac0be230 0x7f04ac0a73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:01.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.819+0000 7f04b33ce640 1 --2- 172.21.15.44:0/3832260042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04ac14ebd0 0x7f04ac14aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:01.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.819+0000 7f04b33ce640 1 --2- 172.21.15.44:0/3832260042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04ac0bd510 0x7f04ac0bc880 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:01.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.819+0000 7f04b33ce640 1 -- 172.21.15.44:0/3832260042 >> 172.21.15.44:0/3832260042 conn(0x7f04ac0c3cd0 msgr2=0x7f04ac1dacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:28:01.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.820+0000 7f04b33ce640 1 -- 172.21.15.44:0/3832260042 shutdown_connections 2024-05-16T22:28:01.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:27:52.820+0000 7f04b33ce640 1 -- 172.21.15.44:0/3832260042 wait complete. 2024-05-16T22:28:01.304 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-05-16T22:28:01.346 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:28:01.383 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:28:01.415 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:28:01.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.508+0000 7ffa75605640 1 Processor -- start 2024-05-16T22:28:01.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.509+0000 7ffa75605640 1 -- start start 2024-05-16T22:28:01.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.510+0000 7ffa75605640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ffa70148330 0x7ffa700be2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:01.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.510+0000 7ffa75605640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ffa7014e260 0x7ffa7014e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:01.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.510+0000 7ffa75605640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa701518d0 con 0x7ffa700bfaa0 2024-05-16T22:28:01.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.510+0000 7ffa75605640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7ffa70148740 con 0x7ffa7014e260 2024-05-16T22:28:01.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.510+0000 7ffa75605640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7ffa70151bb0 con 0x7ffa70148330 2024-05-16T22:28:01.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.510+0000 7ffa6e7fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ffa7014e260 0x7ffa7014e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:01.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.510+0000 7ffa6e7fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ffa7014e260 0x7ffa7014e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52270/0 (socket says 172.21.15.44:52270) 2024-05-16T22:28:01.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.510+0000 7ffa6e7fc640 1 -- 172.21.15.44:0/4233304313 learned_addr learned my addr 172.21.15.44:0/4233304313 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:28:01.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.510+0000 7ffa6effd640 1 --2- 172.21.15.44:0/4233304313 >> v2:172.21.15.70:3300/0 conn(0x7ffa70148330 0x7ffa700be2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:01.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.510+0000 7ffa6e7fc640 1 -- 172.21.15.44:0/4233304313 >> v2:172.21.15.70:3300/0 conn(0x7ffa70148330 msgr2=0x7ffa700be2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:28:01.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.510+0000 7ffa6e7fc640 1 --2- 172.21.15.44:0/4233304313 >> v2:172.21.15.70:3300/0 conn(0x7ffa70148330 0x7ffa700be2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:01.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.510+0000 7ffa6e7fc640 1 -- 172.21.15.44:0/4233304313 >> v1:172.21.15.70:6789/0 conn(0x7ffa700bfaa0 legacy=0x7ffa70070a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:01.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.510+0000 7ffa6e7fc640 1 -- 172.21.15.44:0/4233304313 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa70151e90 con 0x7ffa7014e260 2024-05-16T22:28:01.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.511+0000 7ffa6e7fc640 1 --2- 172.21.15.44:0/4233304313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa7014e260 0x7ffa7014e670 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ffa700a45b0 tx=0x7ffa5802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91e77d2921f88a0e server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:01.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.511+0000 7ffa6dffb640 1 -- 172.21.15.44:0/4233304313 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa58037070 con 0x7ffa7014e260 2024-05-16T22:28:01.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.511+0000 7ffa6dffb640 1 -- 172.21.15.44:0/4233304313 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa58032440 con 0x7ffa7014e260 2024-05-16T22:28:01.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.511+0000 7ffa6dffb640 1 -- 172.21.15.44:0/4233304313 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa58032810 con 0x7ffa7014e260 2024-05-16T22:28:01.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.512+0000 7ffa75605640 1 -- 172.21.15.44:0/4233304313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa7014e260 msgr2=0x7ffa7014e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:01.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.512+0000 7ffa75605640 1 --2- 172.21.15.44:0/4233304313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa7014e260 0x7ffa7014e670 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ffa700a45b0 tx=0x7ffa5802a270 comp rx=0 tx=0).stop 2024-05-16T22:28:01.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.512+0000 7ffa75605640 1 -- 172.21.15.44:0/4233304313 shutdown_connections 2024-05-16T22:28:01.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.512+0000 7ffa75605640 1 --2- 172.21.15.44:0/4233304313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa7014e260 0x7ffa7014e670 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:01.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.512+0000 7ffa75605640 1 --2- 172.21.15.44:0/4233304313 >> v2:172.21.15.70:3300/0 conn(0x7ffa70148330 0x7ffa700be2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:01.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.512+0000 7ffa75605640 1 -- 172.21.15.44:0/4233304313 >> 172.21.15.44:0/4233304313 conn(0x7ffa700c17c0 msgr2=0x7ffa700c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:28:01.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.512+0000 7ffa75605640 1 -- 172.21.15.44:0/4233304313 shutdown_connections 2024-05-16T22:28:01.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.512+0000 7ffa75605640 1 -- 172.21.15.44:0/4233304313 wait complete. 2024-05-16T22:28:01.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.514+0000 7ffa75605640 1 Processor -- start 2024-05-16T22:28:01.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.514+0000 7ffa75605640 1 -- start start 2024-05-16T22:28:01.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.515+0000 7ffa75605640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa700bfaa0 0x7ffa700a04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:01.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.515+0000 7ffa75605640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa70148330 0x7ffa701e8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:01.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.515+0000 7ffa75605640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa7014e260 0x7ffa70143990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:01.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.515+0000 7ffa75605640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ffa70152690 con 0x7ffa7014e260 2024-05-16T22:28:01.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.515+0000 7ffa75605640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ffa700c10b0 con 0x7ffa700bfaa0 2024-05-16T22:28:01.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.515+0000 7ffa75605640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7ffa700be800 con 0x7ffa70148330 2024-05-16T22:28:01.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.515+0000 7ffa6f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa7014e260 0x7ffa70143990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:01.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.515+0000 7ffa6f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa7014e260 0x7ffa70143990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52286/0 (socket says 172.21.15.44:52286) 2024-05-16T22:28:01.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.515+0000 7ffa6f7fe640 1 -- 172.21.15.44:0/1221540393 learned_addr learned my addr 172.21.15.44:0/1221540393 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:28:01.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.515+0000 7ffa6effd640 1 --2- 172.21.15.44:0/1221540393 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa700bfaa0 0x7ffa700a04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:01.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.515+0000 7ffa6e7fc640 1 --2- 172.21.15.44:0/1221540393 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa70148330 0x7ffa701e8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:01.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.515+0000 7ffa6f7fe640 1 -- 172.21.15.44:0/1221540393 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa70148330 msgr2=0x7ffa701e8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:01.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.515+0000 7ffa6f7fe640 1 --2- 172.21.15.44:0/1221540393 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa70148330 0x7ffa701e8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:01.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.515+0000 7ffa6f7fe640 1 -- 172.21.15.44:0/1221540393 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa700bfaa0 msgr2=0x7ffa700a04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:01.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.515+0000 7ffa6f7fe640 1 --2- 172.21.15.44:0/1221540393 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa700bfaa0 0x7ffa700a04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:01.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.515+0000 7ffa6f7fe640 1 -- 172.21.15.44:0/1221540393 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa700a0a20 con 0x7ffa7014e260 2024-05-16T22:28:01.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.515+0000 7ffa6f7fe640 1 --2- 172.21.15.44:0/1221540393 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa7014e260 0x7ffa70143990 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ffa6000c730 tx=0x7ffa6000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:01.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.516+0000 7ffa677fe640 1 -- 172.21.15.44:0/1221540393 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa60003b70 con 0x7ffa7014e260 2024-05-16T22:28:01.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.516+0000 7ffa677fe640 1 -- 172.21.15.44:0/1221540393 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa60003d10 con 0x7ffa7014e260 2024-05-16T22:28:01.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.516+0000 7ffa75605640 1 -- 172.21.15.44:0/1221540393 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa701e8960 con 0x7ffa7014e260 2024-05-16T22:28:01.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.516+0000 7ffa677fe640 1 -- 172.21.15.44:0/1221540393 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa6000aa70 con 0x7ffa7014e260 2024-05-16T22:28:01.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.516+0000 7ffa75605640 1 -- 172.21.15.44:0/1221540393 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa70150260 con 0x7ffa7014e260 2024-05-16T22:28:01.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.517+0000 7ffa75605640 1 -- 172.21.15.44:0/1221540393 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa70151580 con 0x7ffa7014e260 2024-05-16T22:28:01.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.517+0000 7ffa677fe640 1 -- 172.21.15.44:0/1221540393 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ffa6000ac10 con 0x7ffa7014e260 2024-05-16T22:28:01.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.518+0000 7ffa677fe640 1 --2- 172.21.15.44:0/1221540393 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7ffa50076300 0x7ffa50078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:01.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.518+0000 7ffa677fe640 1 -- 172.21.15.44:0/1221540393 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7ffa60096f90 con 0x7ffa7014e260 2024-05-16T22:28:01.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.518+0000 7ffa6effd640 1 --2- 172.21.15.44:0/1221540393 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7ffa50076300 0x7ffa50078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:01.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.519+0000 7ffa6effd640 1 --2- 172.21.15.44:0/1221540393 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7ffa50076300 0x7ffa50078810 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ffa70073fb0 tx=0x7ffa68008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:01.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.523+0000 7ffa677fe640 1 -- 172.21.15.44:0/1221540393 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ffa600605f0 con 0x7ffa7014e260 2024-05-16T22:28:01.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.792+0000 7ffa75605640 1 -- 172.21.15.44:0/1221540393 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7ffa700a1120 con 0x7ffa7014e260 2024-05-16T22:28:01.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.794+0000 7ffa677fe640 1 -- 172.21.15.44:0/1221540393 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7ffa600648f0 con 0x7ffa7014e260 2024-05-16T22:28:01.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.796+0000 7ffa75605640 1 -- 172.21.15.44:0/1221540393 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7ffa50076300 msgr2=0x7ffa50078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:01.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.796+0000 7ffa75605640 1 --2- 172.21.15.44:0/1221540393 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7ffa50076300 0x7ffa50078810 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ffa70073fb0 tx=0x7ffa68008040 comp rx=0 tx=0).stop 2024-05-16T22:28:01.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.796+0000 7ffa75605640 1 -- 172.21.15.44:0/1221540393 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa7014e260 msgr2=0x7ffa70143990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:01.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.796+0000 7ffa75605640 1 --2- 172.21.15.44:0/1221540393 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa7014e260 0x7ffa70143990 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ffa6000c730 tx=0x7ffa6000cbf0 comp rx=0 tx=0).stop 2024-05-16T22:28:01.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.796+0000 7ffa75605640 1 -- 172.21.15.44:0/1221540393 shutdown_connections 2024-05-16T22:28:01.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.796+0000 7ffa75605640 1 --2- 172.21.15.44:0/1221540393 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7ffa50076300 0x7ffa50078810 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:01.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.796+0000 7ffa75605640 1 --2- 172.21.15.44:0/1221540393 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa70148330 0x7ffa701e8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:01.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.796+0000 7ffa75605640 1 --2- 172.21.15.44:0/1221540393 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa7014e260 0x7ffa70143990 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:01.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.796+0000 7ffa75605640 1 --2- 172.21.15.44:0/1221540393 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa700bfaa0 0x7ffa700a04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:01.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.796+0000 7ffa75605640 1 -- 172.21.15.44:0/1221540393 >> 172.21.15.44:0/1221540393 conn(0x7ffa700c17c0 msgr2=0x7ffa70145db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:28:01.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.796+0000 7ffa75605640 1 -- 172.21.15.44:0/1221540393 shutdown_connections 2024-05-16T22:28:01.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:01.796+0000 7ffa75605640 1 -- 172.21.15.44:0/1221540393 wait complete. 2024-05-16T22:28:01.982 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-05-16T22:28:02.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.136+0000 7f4e506d1640 1 Processor -- start 2024-05-16T22:28:02.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.136+0000 7f4e506d1640 1 -- start start 2024-05-16T22:28:02.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.137+0000 7f4e506d1640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4e48151fc0 0x7f4e480bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:02.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.137+0000 7f4e506d1640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4e4806da30 0x7f4e480be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:02.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.137+0000 7f4e506d1640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4e4806de40 0x7f4e480bee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:02.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.137+0000 7f4e506d1640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f4e480bdc10 con 0x7f4e4806da30 2024-05-16T22:28:02.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.137+0000 7f4e506d1640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f4e480c36f0 con 0x7f4e4806de40 2024-05-16T22:28:02.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.137+0000 7f4e506d1640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f4e48152530 con 0x7f4e48151fc0 2024-05-16T22:28:02.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.137+0000 7f4e4dc6c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4e4806da30 0x7f4e480be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:02.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.137+0000 7f4e4dc6c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4e4806da30 0x7f4e480be940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52288/0 (socket says 172.21.15.44:52288) 2024-05-16T22:28:02.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.138+0000 7f4e4dc6c640 1 -- 172.21.15.44:0/1765209531 learned_addr learned my addr 172.21.15.44:0/1765209531 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:28:02.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.138+0000 7f4e4ec6e640 1 --2- 172.21.15.44:0/1765209531 >> v2:172.21.15.70:3300/0 conn(0x7f4e4806de40 0x7f4e480bee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:02.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.138+0000 7f4e4e46d640 1 --2- 172.21.15.44:0/1765209531 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4e48151fc0 0x7f4e480bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:02.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.138+0000 7f4e4dc6c640 1 -- 172.21.15.44:0/1765209531 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4e48151fc0 msgr2=0x7f4e480bd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:28:02.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.138+0000 7f4e4dc6c640 1 --2- 172.21.15.44:0/1765209531 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4e48151fc0 0x7f4e480bd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:02.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.138+0000 7f4e4dc6c640 1 -- 172.21.15.44:0/1765209531 >> v2:172.21.15.70:3300/0 conn(0x7f4e4806de40 msgr2=0x7f4e480bee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:28:02.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.138+0000 7f4e4dc6c640 1 --2- 172.21.15.44:0/1765209531 >> v2:172.21.15.70:3300/0 conn(0x7f4e4806de40 0x7f4e480bee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:02.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.138+0000 7f4e4dc6c640 1 -- 172.21.15.44:0/1765209531 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e48152810 con 0x7f4e4806da30 2024-05-16T22:28:02.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.138+0000 7f4e4ec6e640 1 --2- 172.21.15.44:0/1765209531 >> v2:172.21.15.70:3300/0 conn(0x7f4e4806de40 0x7f4e480bee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T22:28:02.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.138+0000 7f4e4dc6c640 1 --2- 172.21.15.44:0/1765209531 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e4806da30 0x7f4e480be940 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4e480b7360 tx=0x7f4e3802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a829e0b60a2e4da server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:02.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.139+0000 7f4e4d46b640 1 -- 172.21.15.44:0/1765209531 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e38037070 con 0x7f4e4806da30 2024-05-16T22:28:02.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.139+0000 7f4e4d46b640 1 -- 172.21.15.44:0/1765209531 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e38032440 con 0x7f4e4806da30 2024-05-16T22:28:02.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.139+0000 7f4e4d46b640 1 -- 172.21.15.44:0/1765209531 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e38032810 con 0x7f4e4806da30 2024-05-16T22:28:02.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.139+0000 7f4e506d1640 1 -- 172.21.15.44:0/1765209531 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e4806da30 msgr2=0x7f4e480be940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:02.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.139+0000 7f4e506d1640 1 --2- 172.21.15.44:0/1765209531 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e4806da30 0x7f4e480be940 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4e480b7360 tx=0x7f4e3802a1e0 comp rx=0 tx=0).stop 2024-05-16T22:28:03.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.139+0000 7f4e506d1640 1 -- 172.21.15.44:0/1765209531 shutdown_connections 2024-05-16T22:28:03.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.139+0000 7f4e506d1640 1 --2- 172.21.15.44:0/1765209531 >> v2:172.21.15.70:3300/0 conn(0x7f4e4806de40 0x7f4e480bee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:03.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.139+0000 7f4e506d1640 1 --2- 172.21.15.44:0/1765209531 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e4806da30 0x7f4e480be940 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:03.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.139+0000 7f4e506d1640 1 --2- 172.21.15.44:0/1765209531 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4e48151fc0 0x7f4e480bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:03.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.139+0000 7f4e506d1640 1 -- 172.21.15.44:0/1765209531 >> 172.21.15.44:0/1765209531 conn(0x7f4e480c3d20 msgr2=0x7f4e480c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:28:03.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.140+0000 7f4e506d1640 1 -- 172.21.15.44:0/1765209531 shutdown_connections 2024-05-16T22:28:03.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.140+0000 7f4e506d1640 1 -- 172.21.15.44:0/1765209531 wait complete. 2024-05-16T22:28:03.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.141+0000 7f4e506d1640 1 Processor -- start 2024-05-16T22:28:03.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.141+0000 7f4e506d1640 1 -- start start 2024-05-16T22:28:03.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.142+0000 7f4e506d1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e4806da30 0x7f4e481db030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:03.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.142+0000 7f4e506d1640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4e4806de40 0x7f4e480b86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:03.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.142+0000 7f4e506d1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e48151fc0 0x7f4e480baea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:03.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.142+0000 7f4e506d1640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4e480a3050 con 0x7f4e4806da30 2024-05-16T22:28:03.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.142+0000 7f4e506d1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4e480a2ed0 con 0x7f4e48151fc0 2024-05-16T22:28:03.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.142+0000 7f4e506d1640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f4e4814e570 con 0x7f4e4806de40 2024-05-16T22:28:03.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.142+0000 7f4e4e46d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e4806da30 0x7f4e481db030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:03.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.142+0000 7f4e4e46d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e4806da30 0x7f4e481db030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52290/0 (socket says 172.21.15.44:52290) 2024-05-16T22:28:03.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.142+0000 7f4e4e46d640 1 -- 172.21.15.44:0/4084058314 learned_addr learned my addr 172.21.15.44:0/4084058314 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:28:03.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.142+0000 7f4e4ec6e640 1 --2- 172.21.15.44:0/4084058314 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e48151fc0 0x7f4e480baea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:03.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.142+0000 7f4e4dc6c640 1 --2- 172.21.15.44:0/4084058314 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4e4806de40 0x7f4e480b86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:03.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.142+0000 7f4e4e46d640 1 -- 172.21.15.44:0/4084058314 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4e4806de40 msgr2=0x7f4e480b86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:03.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.142+0000 7f4e4e46d640 1 --2- 172.21.15.44:0/4084058314 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4e4806de40 0x7f4e480b86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:03.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.143+0000 7f4e4e46d640 1 -- 172.21.15.44:0/4084058314 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e48151fc0 msgr2=0x7f4e480baea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:03.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.143+0000 7f4e4e46d640 1 --2- 172.21.15.44:0/4084058314 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e48151fc0 0x7f4e480baea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:03.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.143+0000 7f4e4e46d640 1 -- 172.21.15.44:0/4084058314 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e481db570 con 0x7f4e4806da30 2024-05-16T22:28:03.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.143+0000 7f4e4e46d640 1 --2- 172.21.15.44:0/4084058314 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e4806da30 0x7f4e481db030 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4e4400c820 tx=0x7f4e4400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:03.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.143+0000 7f4e3effd640 1 -- 172.21.15.44:0/4084058314 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e44015070 con 0x7f4e4806da30 2024-05-16T22:28:03.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.143+0000 7f4e3effd640 1 -- 172.21.15.44:0/4084058314 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e44004020 con 0x7f4e4806da30 2024-05-16T22:28:04.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.143+0000 7f4e506d1640 1 -- 172.21.15.44:0/4084058314 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e480b8c20 con 0x7f4e4806da30 2024-05-16T22:28:04.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.143+0000 7f4e3effd640 1 -- 172.21.15.44:0/4084058314 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e440043f0 con 0x7f4e4806da30 2024-05-16T22:28:04.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.143+0000 7f4e506d1640 1 -- 172.21.15.44:0/4084058314 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e480b7710 con 0x7f4e4806da30 2024-05-16T22:28:04.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.144+0000 7f4e506d1640 1 -- 172.21.15.44:0/4084058314 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e48050940 con 0x7f4e4806da30 2024-05-16T22:28:04.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.145+0000 7f4e3effd640 1 -- 172.21.15.44:0/4084058314 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4e44007830 con 0x7f4e4806da30 2024-05-16T22:28:04.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.145+0000 7f4e3effd640 1 --2- 172.21.15.44:0/4084058314 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4e2c076300 0x7f4e2c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:04.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.145+0000 7f4e3effd640 1 -- 172.21.15.44:0/4084058314 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f4e44097090 con 0x7f4e4806da30 2024-05-16T22:28:04.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.146+0000 7f4e4dc6c640 1 --2- 172.21.15.44:0/4084058314 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4e2c076300 0x7f4e2c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:04.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.146+0000 7f4e4dc6c640 1 --2- 172.21.15.44:0/4084058314 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4e2c076300 0x7f4e2c078810 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4e38034000 tx=0x7f4e3802e000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:04.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.150+0000 7f4e3effd640 1 -- 172.21.15.44:0/4084058314 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4e44060cb0 con 0x7f4e4806da30 2024-05-16T22:28:04.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.422+0000 7f4e506d1640 1 -- 172.21.15.44:0/4084058314 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f4e4806eb40 con 0x7f4e4806da30 2024-05-16T22:28:04.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.425+0000 7f4e3effd640 1 -- 172.21.15.44:0/4084058314 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f4e440605b0 con 0x7f4e4806da30 2024-05-16T22:28:04.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.427+0000 7f4e506d1640 1 -- 172.21.15.44:0/4084058314 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4e2c076300 msgr2=0x7f4e2c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:04.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.427+0000 7f4e506d1640 1 --2- 172.21.15.44:0/4084058314 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4e2c076300 0x7f4e2c078810 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4e38034000 tx=0x7f4e3802e000 comp rx=0 tx=0).stop 2024-05-16T22:28:04.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.427+0000 7f4e506d1640 1 -- 172.21.15.44:0/4084058314 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e4806da30 msgr2=0x7f4e481db030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:04.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.427+0000 7f4e506d1640 1 --2- 172.21.15.44:0/4084058314 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e4806da30 0x7f4e481db030 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4e4400c820 tx=0x7f4e4400cce0 comp rx=0 tx=0).stop 2024-05-16T22:28:04.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.427+0000 7f4e506d1640 1 -- 172.21.15.44:0/4084058314 shutdown_connections 2024-05-16T22:28:04.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.427+0000 7f4e506d1640 1 --2- 172.21.15.44:0/4084058314 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4e2c076300 0x7f4e2c078810 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:04.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.427+0000 7f4e506d1640 1 --2- 172.21.15.44:0/4084058314 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4e4806de40 0x7f4e480b86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:04.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.427+0000 7f4e506d1640 1 --2- 172.21.15.44:0/4084058314 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e48151fc0 0x7f4e480baea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:04.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.427+0000 7f4e506d1640 1 --2- 172.21.15.44:0/4084058314 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e4806da30 0x7f4e481db030 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:04.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.427+0000 7f4e506d1640 1 -- 172.21.15.44:0/4084058314 >> 172.21.15.44:0/4084058314 conn(0x7f4e480c3d20 msgr2=0x7f4e480c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:28:04.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.427+0000 7f4e506d1640 1 -- 172.21.15.44:0/4084058314 shutdown_connections 2024-05-16T22:28:04.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:02.427+0000 7f4e506d1640 1 -- 172.21.15.44:0/4084058314 wait complete. 2024-05-16T22:28:04.866 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-05-16T22:28:05.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.027+0000 7fdfe0d9f640 1 Processor -- start 2024-05-16T22:28:05.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.027+0000 7fdfe0d9f640 1 -- start start 2024-05-16T22:28:05.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.028+0000 7fdfe0d9f640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fdfdc0be330 0x7fdfdc08d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:05.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.028+0000 7fdfe0d9f640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fdfdc0bd4d0 0x7fdfdc0c07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:05.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.028+0000 7fdfe0d9f640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfdc0bd8e0 con 0x7fdfdc14e900 2024-05-16T22:28:05.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.028+0000 7fdfe0d9f640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fdfdc14e470 con 0x7fdfdc0bd4d0 2024-05-16T22:28:05.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.028+0000 7fdfe0d9f640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fdfdc0beed0 con 0x7fdfdc0be330 2024-05-16T22:28:05.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.028+0000 7fdfdaffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fdfdc0bd4d0 0x7fdfdc0c07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:05.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.029+0000 7fdfdaffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fdfdc0bd4d0 0x7fdfdc0c07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52292/0 (socket says 172.21.15.44:52292) 2024-05-16T22:28:05.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.029+0000 7fdfdaffd640 1 -- 172.21.15.44:0/3606224488 learned_addr learned my addr 172.21.15.44:0/3606224488 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:28:05.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.029+0000 7fdfdb7fe640 1 --2- 172.21.15.44:0/3606224488 >> v2:172.21.15.70:3300/0 conn(0x7fdfdc0be330 0x7fdfdc08d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:05.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.029+0000 7fdfdaffd640 1 -- 172.21.15.44:0/3606224488 >> v2:172.21.15.70:3300/0 conn(0x7fdfdc0be330 msgr2=0x7fdfdc08d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:28:05.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.029+0000 7fdfdaffd640 1 --2- 172.21.15.44:0/3606224488 >> v2:172.21.15.70:3300/0 conn(0x7fdfdc0be330 0x7fdfdc08d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:05.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.029+0000 7fdfdaffd640 1 -- 172.21.15.44:0/3606224488 >> v1:172.21.15.70:6789/0 conn(0x7fdfdc14e900 legacy=0x7fdfdc14ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:05.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.029+0000 7fdfdaffd640 1 -- 172.21.15.44:0/3606224488 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfdc0be910 con 0x7fdfdc0bd4d0 2024-05-16T22:28:05.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.030+0000 7fdfdaffd640 1 --2- 172.21.15.44:0/3606224488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfdc0bd4d0 0x7fdfdc0c07a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc08da80 tx=0x7fdfd002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6081e8b1dfa1c30b server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:05.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.030+0000 7fdfda7fc640 1 -- 172.21.15.44:0/3606224488 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd0037070 con 0x7fdfdc0bd4d0 2024-05-16T22:28:05.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.030+0000 7fdfda7fc640 1 -- 172.21.15.44:0/3606224488 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfd002ae50 con 0x7fdfdc0bd4d0 2024-05-16T22:28:05.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.030+0000 7fdfda7fc640 1 -- 172.21.15.44:0/3606224488 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd0032860 con 0x7fdfdc0bd4d0 2024-05-16T22:28:05.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.030+0000 7fdfe0d9f640 1 -- 172.21.15.44:0/3606224488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfdc0bd4d0 msgr2=0x7fdfdc0c07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:05.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.030+0000 7fdfe0d9f640 1 --2- 172.21.15.44:0/3606224488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfdc0bd4d0 0x7fdfdc0c07a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc08da80 tx=0x7fdfd002a300 comp rx=0 tx=0).stop 2024-05-16T22:28:05.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.030+0000 7fdfe0d9f640 1 -- 172.21.15.44:0/3606224488 shutdown_connections 2024-05-16T22:28:05.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.031+0000 7fdfe0d9f640 1 --2- 172.21.15.44:0/3606224488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfdc0bd4d0 0x7fdfdc0c07a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:05.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.031+0000 7fdfe0d9f640 1 --2- 172.21.15.44:0/3606224488 >> v2:172.21.15.70:3300/0 conn(0x7fdfdc0be330 0x7fdfdc08d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:05.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.031+0000 7fdfe0d9f640 1 -- 172.21.15.44:0/3606224488 >> 172.21.15.44:0/3606224488 conn(0x7fdfdc0c3c40 msgr2=0x7fdfdc0c0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:28:05.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.031+0000 7fdfe0d9f640 1 -- 172.21.15.44:0/3606224488 shutdown_connections 2024-05-16T22:28:05.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.031+0000 7fdfe0d9f640 1 -- 172.21.15.44:0/3606224488 wait complete. 2024-05-16T22:28:06.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.032+0000 7fdfe0d9f640 1 Processor -- start 2024-05-16T22:28:06.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.032+0000 7fdfe0d9f640 1 -- start start 2024-05-16T22:28:06.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.033+0000 7fdfe0d9f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfdc0bd4d0 0x7fdfdc143c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:06.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.033+0000 7fdfe0d9f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdfdc0be330 0x7fdfdc144b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:06.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.033+0000 7fdfe0d9f640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdfdc14e900 0x7fdfdc0a6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:06.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.033+0000 7fdfe0d9f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdfdc0c0e60 con 0x7fdfdc0bd4d0 2024-05-16T22:28:06.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.033+0000 7fdfe0d9f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdfdc0c0ce0 con 0x7fdfdc0be330 2024-05-16T22:28:06.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.033+0000 7fdfe0d9f640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fdfdc158b70 con 0x7fdfdc14e900 2024-05-16T22:28:06.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.033+0000 7fdfdb7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfdc0bd4d0 0x7fdfdc143c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:06.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.033+0000 7fdfdb7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfdc0bd4d0 0x7fdfdc143c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52294/0 (socket says 172.21.15.44:52294) 2024-05-16T22:28:06.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.034+0000 7fdfdb7fe640 1 -- 172.21.15.44:0/1252631754 learned_addr learned my addr 172.21.15.44:0/1252631754 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:28:06.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.034+0000 7fdfdaffd640 1 --2- 172.21.15.44:0/1252631754 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdfdc0be330 0x7fdfdc144b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:06.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.034+0000 7fdfdbfff640 1 --2- 172.21.15.44:0/1252631754 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdfdc14e900 0x7fdfdc0a6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:06.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.034+0000 7fdfdb7fe640 1 -- 172.21.15.44:0/1252631754 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdfdc14e900 msgr2=0x7fdfdc0a6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:06.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.034+0000 7fdfdb7fe640 1 --2- 172.21.15.44:0/1252631754 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdfdc14e900 0x7fdfdc0a6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:06.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.034+0000 7fdfdb7fe640 1 -- 172.21.15.44:0/1252631754 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdfdc0be330 msgr2=0x7fdfdc144b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:06.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.034+0000 7fdfdb7fe640 1 --2- 172.21.15.44:0/1252631754 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdfdc0be330 0x7fdfdc144b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:06.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.034+0000 7fdfdb7fe640 1 -- 172.21.15.44:0/1252631754 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfdc0b5e10 con 0x7fdfdc0bd4d0 2024-05-16T22:28:06.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.034+0000 7fdfdaffd640 1 --2- 172.21.15.44:0/1252631754 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdfdc0be330 0x7fdfdc144b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:28:06.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.034+0000 7fdfdb7fe640 1 --2- 172.21.15.44:0/1252631754 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfdc0bd4d0 0x7fdfdc143c20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc00e870 tx=0x7fdfcc00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:06.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.034+0000 7fdfc3fff640 1 -- 172.21.15.44:0/1252631754 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc017070 con 0x7fdfdc0bd4d0 2024-05-16T22:28:06.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.034+0000 7fdfc3fff640 1 -- 172.21.15.44:0/1252631754 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfcc00c8e0 con 0x7fdfdc0bd4d0 2024-05-16T22:28:06.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.034+0000 7fdfe0d9f640 1 -- 172.21.15.44:0/1252631754 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfdc144160 con 0x7fdfdc0bd4d0 2024-05-16T22:28:07.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.034+0000 7fdfc3fff640 1 -- 172.21.15.44:0/1252631754 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc00ccd0 con 0x7fdfdc0bd4d0 2024-05-16T22:28:07.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.034+0000 7fdfe0d9f640 1 -- 172.21.15.44:0/1252631754 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfdc0a8450 con 0x7fdfdc0bd4d0 2024-05-16T22:28:07.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.035+0000 7fdfe0d9f640 1 -- 172.21.15.44:0/1252631754 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfdc050860 con 0x7fdfdc0bd4d0 2024-05-16T22:28:07.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.036+0000 7fdfc3fff640 1 -- 172.21.15.44:0/1252631754 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdfcc01a070 con 0x7fdfdc0bd4d0 2024-05-16T22:28:07.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.036+0000 7fdfc3fff640 1 --2- 172.21.15.44:0/1252631754 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fdfc80762d0 0x7fdfc80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:07.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.037+0000 7fdfc3fff640 1 -- 172.21.15.44:0/1252631754 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7fdfcc097190 con 0x7fdfdc0bd4d0 2024-05-16T22:28:07.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.037+0000 7fdfdaffd640 1 --2- 172.21.15.44:0/1252631754 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fdfc80762d0 0x7fdfc80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:07.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.037+0000 7fdfdaffd640 1 --2- 172.21.15.44:0/1252631754 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fdfc80762d0 0x7fdfc80787e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdfd0034000 tx=0x7fdfd002e000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:07.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.041+0000 7fdfc3fff640 1 -- 172.21.15.44:0/1252631754 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fdfdc0b5e10 con 0x7fdfdc0bd4d0 2024-05-16T22:28:07.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.310+0000 7fdfe0d9f640 1 -- 172.21.15.44:0/1252631754 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7fdfdc06e510 con 0x7fdfdc0bd4d0 2024-05-16T22:28:07.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.312+0000 7fdfc3fff640 1 -- 172.21.15.44:0/1252631754 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7fdfcc060e30 con 0x7fdfdc0bd4d0 2024-05-16T22:28:07.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.314+0000 7fdfe0d9f640 1 -- 172.21.15.44:0/1252631754 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fdfc80762d0 msgr2=0x7fdfc80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:07.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.314+0000 7fdfe0d9f640 1 --2- 172.21.15.44:0/1252631754 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fdfc80762d0 0x7fdfc80787e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdfd0034000 tx=0x7fdfd002e000 comp rx=0 tx=0).stop 2024-05-16T22:28:07.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.314+0000 7fdfe0d9f640 1 -- 172.21.15.44:0/1252631754 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfdc0bd4d0 msgr2=0x7fdfdc143c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:07.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.314+0000 7fdfe0d9f640 1 --2- 172.21.15.44:0/1252631754 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfdc0bd4d0 0x7fdfdc143c20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc00e870 tx=0x7fdfcc00ed30 comp rx=0 tx=0).stop 2024-05-16T22:28:07.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.314+0000 7fdfe0d9f640 1 -- 172.21.15.44:0/1252631754 shutdown_connections 2024-05-16T22:28:07.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.314+0000 7fdfe0d9f640 1 --2- 172.21.15.44:0/1252631754 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fdfc80762d0 0x7fdfc80787e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:07.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.314+0000 7fdfe0d9f640 1 --2- 172.21.15.44:0/1252631754 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdfdc14e900 0x7fdfdc0a6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:07.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.314+0000 7fdfe0d9f640 1 --2- 172.21.15.44:0/1252631754 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdfdc0be330 0x7fdfdc144b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:07.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.314+0000 7fdfe0d9f640 1 --2- 172.21.15.44:0/1252631754 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfdc0bd4d0 0x7fdfdc143c20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:07.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.314+0000 7fdfe0d9f640 1 -- 172.21.15.44:0/1252631754 >> 172.21.15.44:0/1252631754 conn(0x7fdfdc0c3c40 msgr2=0x7fdfdc14ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:28:07.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.314+0000 7fdfe0d9f640 1 -- 172.21.15.44:0/1252631754 shutdown_connections 2024-05-16T22:28:07.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:05.314+0000 7fdfe0d9f640 1 -- 172.21.15.44:0/1252631754 wait complete. 2024-05-16T22:28:07.869 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-05-16T22:28:08.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.029+0000 7f498155e640 1 Processor -- start 2024-05-16T22:28:08.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.029+0000 7f498155e640 1 -- start start 2024-05-16T22:28:08.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.031+0000 7f498155e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f497c0a0ba0 0x7f497c146380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:08.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.031+0000 7f498155e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f497c14c8e0 0x7f497c14ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:08.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.031+0000 7f498155e640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f497c071150 con 0x7f497c0bc1c0 2024-05-16T22:28:08.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.031+0000 7f498155e640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f497c14c450 con 0x7f497c0a0ba0 2024-05-16T22:28:08.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.031+0000 7f498155e640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f497c14c120 con 0x7f497c14c8e0 2024-05-16T22:28:08.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.031+0000 7f497a7fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f497c0a0ba0 0x7f497c146380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:08.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.031+0000 7f497a7fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f497c0a0ba0 0x7f497c146380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52308/0 (socket says 172.21.15.44:52308) 2024-05-16T22:28:08.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.031+0000 7f497a7fc640 1 -- 172.21.15.44:0/1467170349 learned_addr learned my addr 172.21.15.44:0/1467170349 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:28:08.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.031+0000 7f497b7fe640 1 --2- 172.21.15.44:0/1467170349 >> v2:172.21.15.70:3300/0 conn(0x7f497c14c8e0 0x7f497c14ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:08.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.031+0000 7f497a7fc640 1 -- 172.21.15.44:0/1467170349 >> v2:172.21.15.70:3300/0 conn(0x7f497c14c8e0 msgr2=0x7f497c14ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:28:08.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.031+0000 7f497a7fc640 1 --2- 172.21.15.44:0/1467170349 >> v2:172.21.15.70:3300/0 conn(0x7f497c14c8e0 0x7f497c14ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:08.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.031+0000 7f497a7fc640 1 -- 172.21.15.44:0/1467170349 >> v1:172.21.15.70:6789/0 conn(0x7f497c0bc1c0 legacy=0x7f497c070a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:08.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.031+0000 7f497a7fc640 1 -- 172.21.15.44:0/1467170349 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f497c071e40 con 0x7f497c0a0ba0 2024-05-16T22:28:08.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.032+0000 7f497a7fc640 1 --2- 172.21.15.44:0/1467170349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f497c0a0ba0 0x7f497c146380 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f497c14c5d0 tx=0x7f497002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f563cf9402168aa0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:08.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.032+0000 7f4979ffb640 1 -- 172.21.15.44:0/1467170349 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4970037070 con 0x7f497c0a0ba0 2024-05-16T22:28:08.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.032+0000 7f4979ffb640 1 -- 172.21.15.44:0/1467170349 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4970032440 con 0x7f497c0a0ba0 2024-05-16T22:28:08.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.032+0000 7f4979ffb640 1 -- 172.21.15.44:0/1467170349 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4970032810 con 0x7f497c0a0ba0 2024-05-16T22:28:08.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.033+0000 7f498155e640 1 -- 172.21.15.44:0/1467170349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f497c0a0ba0 msgr2=0x7f497c146380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:08.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.033+0000 7f498155e640 1 --2- 172.21.15.44:0/1467170349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f497c0a0ba0 0x7f497c146380 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f497c14c5d0 tx=0x7f497002a270 comp rx=0 tx=0).stop 2024-05-16T22:28:08.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.033+0000 7f498155e640 1 -- 172.21.15.44:0/1467170349 shutdown_connections 2024-05-16T22:28:08.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.033+0000 7f498155e640 1 --2- 172.21.15.44:0/1467170349 >> v2:172.21.15.70:3300/0 conn(0x7f497c14c8e0 0x7f497c14ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:08.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.033+0000 7f498155e640 1 --2- 172.21.15.44:0/1467170349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f497c0a0ba0 0x7f497c146380 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:08.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.033+0000 7f498155e640 1 -- 172.21.15.44:0/1467170349 >> 172.21.15.44:0/1467170349 conn(0x7f497c0c17c0 msgr2=0x7f497c0c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:28:08.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.033+0000 7f498155e640 1 -- 172.21.15.44:0/1467170349 shutdown_connections 2024-05-16T22:28:08.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.033+0000 7f498155e640 1 -- 172.21.15.44:0/1467170349 wait complete. 2024-05-16T22:28:09.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.034+0000 7f498155e640 1 Processor -- start 2024-05-16T22:28:09.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.035+0000 7f498155e640 1 -- start start 2024-05-16T22:28:09.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.036+0000 7f498155e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f497c0a0ba0 0x7f497c144ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:09.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.036+0000 7f498155e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f497c0bc1c0 0x7f497c13fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:09.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.036+0000 7f498155e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f497c14c8e0 0x7f497c1e55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:09.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.036+0000 7f498155e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f497c0a0fb0 con 0x7f497c0bc1c0 2024-05-16T22:28:09.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.036+0000 7f498155e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f497c0716b0 con 0x7f497c0a0ba0 2024-05-16T22:28:09.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.036+0000 7f498155e640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f497c0bd5f0 con 0x7f497c14c8e0 2024-05-16T22:28:09.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.036+0000 7f497a7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f497c0bc1c0 0x7f497c13fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:09.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.036+0000 7f497a7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f497c0bc1c0 0x7f497c13fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52314/0 (socket says 172.21.15.44:52314) 2024-05-16T22:28:09.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.036+0000 7f497a7fc640 1 -- 172.21.15.44:0/1058962282 learned_addr learned my addr 172.21.15.44:0/1058962282 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:28:09.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.036+0000 7f497b7fe640 1 --2- 172.21.15.44:0/1058962282 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f497c14c8e0 0x7f497c1e55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:09.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.036+0000 7f497affd640 1 --2- 172.21.15.44:0/1058962282 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f497c0a0ba0 0x7f497c144ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:09.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.036+0000 7f497a7fc640 1 -- 172.21.15.44:0/1058962282 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f497c14c8e0 msgr2=0x7f497c1e55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:09.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.036+0000 7f497a7fc640 1 --2- 172.21.15.44:0/1058962282 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f497c14c8e0 0x7f497c1e55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:09.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.036+0000 7f497a7fc640 1 -- 172.21.15.44:0/1058962282 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f497c0a0ba0 msgr2=0x7f497c144ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:09.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.036+0000 7f497a7fc640 1 --2- 172.21.15.44:0/1058962282 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f497c0a0ba0 0x7f497c144ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:09.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.036+0000 7f497a7fc640 1 -- 172.21.15.44:0/1058962282 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f497c145000 con 0x7f497c0bc1c0 2024-05-16T22:28:09.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.036+0000 7f497a7fc640 1 --2- 172.21.15.44:0/1058962282 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f497c0bc1c0 0x7f497c13fb10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f497002a2b0 tx=0x7f49700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:09.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.036+0000 7f49637fe640 1 -- 172.21.15.44:0/1058962282 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4970041030 con 0x7f497c0bc1c0 2024-05-16T22:28:09.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.036+0000 7f49637fe640 1 -- 172.21.15.44:0/1058962282 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4970030440 con 0x7f497c0bc1c0 2024-05-16T22:28:09.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.036+0000 7f498155e640 1 -- 172.21.15.44:0/1058962282 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f497c0a15e0 con 0x7f497c0bc1c0 2024-05-16T22:28:09.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.037+0000 7f49637fe640 1 -- 172.21.15.44:0/1058962282 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4970037040 con 0x7f497c0bc1c0 2024-05-16T22:28:09.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.037+0000 7f498155e640 1 -- 172.21.15.44:0/1058962282 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f497c0a1ba0 con 0x7f497c0bc1c0 2024-05-16T22:28:09.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.038+0000 7f498155e640 1 -- 172.21.15.44:0/1058962282 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f497c0a1de0 con 0x7f497c0bc1c0 2024-05-16T22:28:09.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.038+0000 7f49637fe640 1 -- 172.21.15.44:0/1058962282 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4970044070 con 0x7f497c0bc1c0 2024-05-16T22:28:09.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.039+0000 7f49637fe640 1 --2- 172.21.15.44:0/1058962282 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f49680762d0 0x7f49680787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:09.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.039+0000 7f49637fe640 1 -- 172.21.15.44:0/1058962282 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f49700b7960 con 0x7f497c0bc1c0 2024-05-16T22:28:09.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.039+0000 7f497affd640 1 --2- 172.21.15.44:0/1058962282 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f49680762d0 0x7f49680787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:10.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.040+0000 7f497affd640 1 --2- 172.21.15.44:0/1058962282 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f49680762d0 0x7f49680787e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4974001720 tx=0x7f4974009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:10.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.044+0000 7f49637fe640 1 -- 172.21.15.44:0/1058962282 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f497c0a1de0 con 0x7f497c0bc1c0 2024-05-16T22:28:10.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.311+0000 7f498155e640 1 -- 172.21.15.44:0/1058962282 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f497c0a5f40 con 0x7f497c0bc1c0 2024-05-16T22:28:10.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.313+0000 7f49637fe640 1 -- 172.21.15.44:0/1058962282 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f4970080f30 con 0x7f497c0bc1c0 2024-05-16T22:28:10.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.315+0000 7f498155e640 1 -- 172.21.15.44:0/1058962282 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f49680762d0 msgr2=0x7f49680787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:10.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.315+0000 7f498155e640 1 --2- 172.21.15.44:0/1058962282 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f49680762d0 0x7f49680787e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4974001720 tx=0x7f4974009040 comp rx=0 tx=0).stop 2024-05-16T22:28:10.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.315+0000 7f498155e640 1 -- 172.21.15.44:0/1058962282 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f497c0bc1c0 msgr2=0x7f497c13fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:10.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.315+0000 7f498155e640 1 --2- 172.21.15.44:0/1058962282 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f497c0bc1c0 0x7f497c13fb10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f497002a2b0 tx=0x7f49700046c0 comp rx=0 tx=0).stop 2024-05-16T22:28:10.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.315+0000 7f498155e640 1 -- 172.21.15.44:0/1058962282 shutdown_connections 2024-05-16T22:28:10.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.315+0000 7f498155e640 1 --2- 172.21.15.44:0/1058962282 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f49680762d0 0x7f49680787e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:10.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.315+0000 7f498155e640 1 --2- 172.21.15.44:0/1058962282 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f497c14c8e0 0x7f497c1e55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:10.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.315+0000 7f498155e640 1 --2- 172.21.15.44:0/1058962282 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f497c0bc1c0 0x7f497c13fb10 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:10.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.315+0000 7f498155e640 1 --2- 172.21.15.44:0/1058962282 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f497c0a0ba0 0x7f497c144ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:10.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.315+0000 7f498155e640 1 -- 172.21.15.44:0/1058962282 >> 172.21.15.44:0/1058962282 conn(0x7f497c0c17c0 msgr2=0x7f497c141270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:28:10.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.315+0000 7f498155e640 1 -- 172.21.15.44:0/1058962282 shutdown_connections 2024-05-16T22:28:10.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:08.315+0000 7f498155e640 1 -- 172.21.15.44:0/1058962282 wait complete. 2024-05-16T22:28:10.590 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-05-16T22:28:10.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.767+0000 7f746b68b640 1 Processor -- start 2024-05-16T22:28:10.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.767+0000 7f746b68b640 1 -- start start 2024-05-16T22:28:10.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.768+0000 7f746b68b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f74640be230 0x7f746406dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:10.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.768+0000 7f746b68b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f74640bd510 0x7f74640bd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:10.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.768+0000 7f746b68b640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74640bea40 con 0x7f746414ebd0 2024-05-16T22:28:10.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.768+0000 7f746b68b640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f746414c230 con 0x7f74640be230 2024-05-16T22:28:10.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.768+0000 7f746b68b640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f74640becb0 con 0x7f74640bd510 2024-05-16T22:28:11.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.769+0000 7f7469427640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f74640be230 0x7f746406dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:11.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.769+0000 7f7469427640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f74640be230 0x7f746406dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49866/0 (socket says 172.21.15.44:49866) 2024-05-16T22:28:11.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.769+0000 7f7469427640 1 -- 172.21.15.44:0/1699708818 learned_addr learned my addr 172.21.15.44:0/1699708818 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:28:11.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.769+0000 7f7469c28640 1 --1- 172.21.15.44:0/1699708818 >> v1:172.21.15.44:6789/0 conn(0x7f746414ebd0 0x7f746414efe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59406/0 (socket says 172.21.15.44:59406) 2024-05-16T22:28:11.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.769+0000 7f7468c26640 1 --2- 172.21.15.44:0/1699708818 >> v2:172.21.15.70:3300/0 conn(0x7f74640bd510 0x7f74640bd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:11.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.769+0000 7f7469427640 1 -- 172.21.15.44:0/1699708818 >> v2:172.21.15.70:3300/0 conn(0x7f74640bd510 msgr2=0x7f74640bd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:28:11.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.769+0000 7f7469427640 1 --2- 172.21.15.44:0/1699708818 >> v2:172.21.15.70:3300/0 conn(0x7f74640bd510 0x7f74640bd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:11.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.769+0000 7f7469427640 1 -- 172.21.15.44:0/1699708818 >> v1:172.21.15.44:6789/0 conn(0x7f746414ebd0 legacy=0x7f746414efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:11.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.769+0000 7f745bfff640 1 -- 172.21.15.44:0/1699708818 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1452758456 0 0) 0x7f74640bea40 con 0x7f746414ebd0 2024-05-16T22:28:11.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.769+0000 7f7469427640 1 -- 172.21.15.44:0/1699708818 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f746406e0f0 con 0x7f74640be230 2024-05-16T22:28:11.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.769+0000 7f7468c26640 1 --2- 172.21.15.44:0/1699708818 >> v2:172.21.15.70:3300/0 conn(0x7f74640bd510 0x7f74640bd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:28:11.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.770+0000 7f7469427640 1 --2- 172.21.15.44:0/1699708818 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74640be230 0x7f746406dbb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f746406d390 tx=0x7f746002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67be5f87e7ebe7f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:11.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.770+0000 7f745bfff640 1 -- 172.21.15.44:0/1699708818 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7460037070 con 0x7f74640be230 2024-05-16T22:28:11.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.770+0000 7f745bfff640 1 -- 172.21.15.44:0/1699708818 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7460032440 con 0x7f74640be230 2024-05-16T22:28:11.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.770+0000 7f745bfff640 1 -- 172.21.15.44:0/1699708818 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7460032810 con 0x7f74640be230 2024-05-16T22:28:11.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.771+0000 7f746b68b640 1 -- 172.21.15.44:0/1699708818 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74640be230 msgr2=0x7f746406dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:11.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.771+0000 7f746b68b640 1 --2- 172.21.15.44:0/1699708818 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74640be230 0x7f746406dbb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f746406d390 tx=0x7f746002a270 comp rx=0 tx=0).stop 2024-05-16T22:28:11.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.771+0000 7f746b68b640 1 -- 172.21.15.44:0/1699708818 shutdown_connections 2024-05-16T22:28:11.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.771+0000 7f746b68b640 1 --2- 172.21.15.44:0/1699708818 >> v2:172.21.15.70:3300/0 conn(0x7f74640bd510 0x7f74640bd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:11.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.771+0000 7f746b68b640 1 --2- 172.21.15.44:0/1699708818 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74640be230 0x7f746406dbb0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:11.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.771+0000 7f746b68b640 1 -- 172.21.15.44:0/1699708818 >> 172.21.15.44:0/1699708818 conn(0x7f74640c3cd0 msgr2=0x7f74640c40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:28:11.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.771+0000 7f746b68b640 1 -- 172.21.15.44:0/1699708818 shutdown_connections 2024-05-16T22:28:11.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.771+0000 7f746b68b640 1 -- 172.21.15.44:0/1699708818 wait complete. 2024-05-16T22:28:11.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.772+0000 7f746b68b640 1 Processor -- start 2024-05-16T22:28:12.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.772+0000 7f746b68b640 1 -- start start 2024-05-16T22:28:12.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.773+0000 7f746b68b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74640bd510 0x7f7464152480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:12.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.773+0000 7f746b68b640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f74640be230 0x7f74640b89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:12.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.773+0000 7f746b68b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f746414ebd0 0x7f74641e50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:12.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.773+0000 7f746b68b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f74640be640 con 0x7f746414ebd0 2024-05-16T22:28:12.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.773+0000 7f746b68b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f746406ea70 con 0x7f74640bd510 2024-05-16T22:28:12.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.773+0000 7f746b68b640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f746408d850 con 0x7f74640be230 2024-05-16T22:28:12.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.773+0000 7f7469c28640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f746414ebd0 0x7f74641e50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:12.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.774+0000 7f7469c28640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f746414ebd0 0x7f74641e50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49882/0 (socket says 172.21.15.44:49882) 2024-05-16T22:28:12.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.774+0000 7f7469c28640 1 -- 172.21.15.44:0/1184162101 learned_addr learned my addr 172.21.15.44:0/1184162101 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:28:12.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.774+0000 7f7468c26640 1 --2- 172.21.15.44:0/1184162101 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f74640be230 0x7f74640b89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:12.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.774+0000 7f7469427640 1 --2- 172.21.15.44:0/1184162101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74640bd510 0x7f7464152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:12.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.774+0000 7f7469c28640 1 -- 172.21.15.44:0/1184162101 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f74640be230 msgr2=0x7f74640b89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:12.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.774+0000 7f7469c28640 1 --2- 172.21.15.44:0/1184162101 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f74640be230 0x7f74640b89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:12.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.774+0000 7f7469c28640 1 -- 172.21.15.44:0/1184162101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74640bd510 msgr2=0x7f7464152480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:12.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.774+0000 7f7469c28640 1 --2- 172.21.15.44:0/1184162101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74640bd510 0x7f7464152480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:12.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.774+0000 7f7469c28640 1 -- 172.21.15.44:0/1184162101 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74641529c0 con 0x7f746414ebd0 2024-05-16T22:28:12.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.774+0000 7f7469427640 1 --2- 172.21.15.44:0/1184162101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74640bd510 0x7f7464152480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:28:12.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.774+0000 7f7469c28640 1 --2- 172.21.15.44:0/1184162101 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f746414ebd0 0x7f74641e50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f745c00c730 tx=0x7f745c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:12.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.774+0000 7f7459ffb640 1 -- 172.21.15.44:0/1184162101 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f745c018070 con 0x7f746414ebd0 2024-05-16T22:28:12.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.774+0000 7f7459ffb640 1 -- 172.21.15.44:0/1184162101 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f745c004d60 con 0x7f746414ebd0 2024-05-16T22:28:12.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.774+0000 7f746b68b640 1 -- 172.21.15.44:0/1184162101 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74640b8f00 con 0x7f746414ebd0 2024-05-16T22:28:12.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.774+0000 7f7459ffb640 1 -- 172.21.15.44:0/1184162101 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f745c00a880 con 0x7f746414ebd0 2024-05-16T22:28:12.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.774+0000 7f746b68b640 1 -- 172.21.15.44:0/1184162101 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74640a9050 con 0x7f746414ebd0 2024-05-16T22:28:12.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.776+0000 7f746b68b640 1 -- 172.21.15.44:0/1184162101 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74640b7dc0 con 0x7f746414ebd0 2024-05-16T22:28:12.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.776+0000 7f7459ffb640 1 -- 172.21.15.44:0/1184162101 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f745c01b070 con 0x7f746414ebd0 2024-05-16T22:28:12.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.777+0000 7f7459ffb640 1 --2- 172.21.15.44:0/1184162101 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f74480762d0 0x7f74480787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:13.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.777+0000 7f7459ffb640 1 -- 172.21.15.44:0/1184162101 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f745c096870 con 0x7f746414ebd0 2024-05-16T22:28:13.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.777+0000 7f7469427640 1 --2- 172.21.15.44:0/1184162101 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f74480762d0 0x7f74480787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:13.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.778+0000 7f7469427640 1 --2- 172.21.15.44:0/1184162101 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f74480762d0 0x7f74480787e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7460034000 tx=0x7f746002e000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:13.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:10.781+0000 7f7459ffb640 1 -- 172.21.15.44:0/1184162101 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f745c05fed0 con 0x7f746414ebd0 2024-05-16T22:28:13.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:11.046+0000 7f746b68b640 1 -- 172.21.15.44:0/1184162101 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f7464050940 con 0x7f746414ebd0 2024-05-16T22:28:13.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:11.048+0000 7f7459ffb640 1 -- 172.21.15.44:0/1184162101 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) ==== 97+0+0 (secure 0 0 0) 0x7f745c0641d0 con 0x7f746414ebd0 2024-05-16T22:28:13.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:11.050+0000 7f746b68b640 1 -- 172.21.15.44:0/1184162101 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f74480762d0 msgr2=0x7f74480787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:13.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:11.050+0000 7f746b68b640 1 --2- 172.21.15.44:0/1184162101 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f74480762d0 0x7f74480787e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7460034000 tx=0x7f746002e000 comp rx=0 tx=0).stop 2024-05-16T22:28:13.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:11.050+0000 7f746b68b640 1 -- 172.21.15.44:0/1184162101 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f746414ebd0 msgr2=0x7f74641e50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:13.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:11.050+0000 7f746b68b640 1 --2- 172.21.15.44:0/1184162101 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f746414ebd0 0x7f74641e50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f745c00c730 tx=0x7f745c00cbf0 comp rx=0 tx=0).stop 2024-05-16T22:28:13.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:11.050+0000 7f746b68b640 1 -- 172.21.15.44:0/1184162101 shutdown_connections 2024-05-16T22:28:13.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:11.050+0000 7f746b68b640 1 --2- 172.21.15.44:0/1184162101 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f74480762d0 0x7f74480787e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:13.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:11.050+0000 7f746b68b640 1 --2- 172.21.15.44:0/1184162101 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f74640be230 0x7f74640b89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:13.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:11.050+0000 7f746b68b640 1 --2- 172.21.15.44:0/1184162101 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f746414ebd0 0x7f74641e50d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:13.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:11.050+0000 7f746b68b640 1 --2- 172.21.15.44:0/1184162101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74640bd510 0x7f7464152480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:13.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:11.050+0000 7f746b68b640 1 -- 172.21.15.44:0/1184162101 >> 172.21.15.44:0/1184162101 conn(0x7f74640c3cd0 msgr2=0x7f74641d7af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:28:13.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:11.050+0000 7f746b68b640 1 -- 172.21.15.44:0/1184162101 shutdown_connections 2024-05-16T22:28:13.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:11.050+0000 7f746b68b640 1 -- 172.21.15.44:0/1184162101 wait complete. 2024-05-16T22:28:13.626 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-05-16T22:28:13.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.787+0000 7f8fe4572640 1 Processor -- start 2024-05-16T22:28:13.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.787+0000 7f8fe4572640 1 -- start start 2024-05-16T22:28:13.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.788+0000 7f8fe4572640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8fdc14e530 0x7f8fdc0ba320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:13.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.788+0000 7f8fe4572640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8fdc0b8d70 0x7f8fdc0b9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:13.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.788+0000 7f8fe4572640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fdc0ba860 con 0x7f8fdc0bd440 2024-05-16T22:28:14.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.788+0000 7f8fe4572640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f8fdc0b88e0 con 0x7f8fdc0b8d70 2024-05-16T22:28:14.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.788+0000 7f8fe4572640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f8fdc14ece0 con 0x7f8fdc14e530 2024-05-16T22:28:14.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.788+0000 7f8fe2b0f640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8fdc0b8d70 0x7f8fdc0b9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:14.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.788+0000 7f8fe2b0f640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8fdc0b8d70 0x7f8fdc0b9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49884/0 (socket says 172.21.15.44:49884) 2024-05-16T22:28:14.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.788+0000 7f8fe2b0f640 1 -- 172.21.15.44:0/2942979890 learned_addr learned my addr 172.21.15.44:0/2942979890 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:28:14.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.788+0000 7f8fe1b0d640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f8fdc0bd440 0x7f8fdc0bd850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59412/0 (socket says 172.21.15.44:59412) 2024-05-16T22:28:14.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.788+0000 7f8fe230e640 1 --2- 172.21.15.44:0/2942979890 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8fdc14e530 0x7f8fdc0ba320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:14.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.789+0000 7f8fe2b0f640 1 -- 172.21.15.44:0/2942979890 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8fdc14e530 msgr2=0x7f8fdc0ba320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:28:14.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.789+0000 7f8fe2b0f640 1 --2- 172.21.15.44:0/2942979890 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8fdc14e530 0x7f8fdc0ba320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:14.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.789+0000 7f8fe2b0f640 1 -- 172.21.15.44:0/2942979890 >> v1:172.21.15.44:6789/0 conn(0x7f8fdc0bd440 legacy=0x7f8fdc0bd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:14.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.789+0000 7f8fe2b0f640 1 -- 172.21.15.44:0/2942979890 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fdc14efc0 con 0x7f8fdc0b8d70 2024-05-16T22:28:14.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.789+0000 7f8fe130c640 1 -- 172.21.15.44:0/2942979890 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2039266151 0 0) 0x7f8fdc0ba860 con 0x7f8fdc0bd440 2024-05-16T22:28:14.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.789+0000 7f8fe2b0f640 1 --2- 172.21.15.44:0/2942979890 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fdc0b8d70 0x7f8fdc0b9180 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4009e50 tx=0x7f8fd402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ce9f6f715036ff3 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:14.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.789+0000 7f8fe130c640 1 -- 172.21.15.44:0/2942979890 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd4036070 con 0x7f8fdc0b8d70 2024-05-16T22:28:14.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.789+0000 7f8fe130c640 1 -- 172.21.15.44:0/2942979890 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fd4031600 con 0x7f8fdc0b8d70 2024-05-16T22:28:14.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.790+0000 7f8fe130c640 1 -- 172.21.15.44:0/2942979890 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd40319d0 con 0x7f8fdc0b8d70 2024-05-16T22:28:14.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.790+0000 7f8fe4572640 1 -- 172.21.15.44:0/2942979890 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fdc0b8d70 msgr2=0x7f8fdc0b9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:14.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.790+0000 7f8fe4572640 1 --2- 172.21.15.44:0/2942979890 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fdc0b8d70 0x7f8fdc0b9180 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4009e50 tx=0x7f8fd402a710 comp rx=0 tx=0).stop 2024-05-16T22:28:14.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.790+0000 7f8fe4572640 1 -- 172.21.15.44:0/2942979890 shutdown_connections 2024-05-16T22:28:14.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.790+0000 7f8fe4572640 1 --2- 172.21.15.44:0/2942979890 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fdc0b8d70 0x7f8fdc0b9180 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:14.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.790+0000 7f8fe4572640 1 --2- 172.21.15.44:0/2942979890 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8fdc14e530 0x7f8fdc0ba320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:14.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.790+0000 7f8fe4572640 1 -- 172.21.15.44:0/2942979890 >> 172.21.15.44:0/2942979890 conn(0x7f8fdc0c0570 msgr2=0x7f8fdc0c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:28:14.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.790+0000 7f8fe4572640 1 -- 172.21.15.44:0/2942979890 shutdown_connections 2024-05-16T22:28:14.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.790+0000 7f8fe4572640 1 -- 172.21.15.44:0/2942979890 wait complete. 2024-05-16T22:28:14.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.792+0000 7f8fe4572640 1 Processor -- start 2024-05-16T22:28:14.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.792+0000 7f8fe4572640 1 -- start start 2024-05-16T22:28:14.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.793+0000 7f8fe4572640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8fdc0b8d70 0x7f8fdc13eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:14.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.793+0000 7f8fe4572640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fdc0bd440 0x7f8fdc140810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:14.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.793+0000 7f8fe4572640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fdc14e530 0x7f8fdc143100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:15.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.793+0000 7f8fe4572640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8fdc0b96c0 con 0x7f8fdc0bd440 2024-05-16T22:28:15.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.793+0000 7f8fe4572640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8fdc0bbb70 con 0x7f8fdc14e530 2024-05-16T22:28:15.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.793+0000 7f8fe4572640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f8fdc14e940 con 0x7f8fdc0b8d70 2024-05-16T22:28:15.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.793+0000 7f8fe1b0d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fdc0bd440 0x7f8fdc140810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:15.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.793+0000 7f8fe1b0d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fdc0bd440 0x7f8fdc140810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49886/0 (socket says 172.21.15.44:49886) 2024-05-16T22:28:15.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.793+0000 7f8fe1b0d640 1 -- 172.21.15.44:0/2202242326 learned_addr learned my addr 172.21.15.44:0/2202242326 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:28:15.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.793+0000 7f8fe230e640 1 --2- 172.21.15.44:0/2202242326 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8fdc0b8d70 0x7f8fdc13eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:15.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.793+0000 7f8fe2b0f640 1 --2- 172.21.15.44:0/2202242326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fdc14e530 0x7f8fdc143100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:15.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.793+0000 7f8fe1b0d640 1 -- 172.21.15.44:0/2202242326 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8fdc0b8d70 msgr2=0x7f8fdc13eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:15.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.793+0000 7f8fe1b0d640 1 --2- 172.21.15.44:0/2202242326 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8fdc0b8d70 0x7f8fdc13eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:15.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.793+0000 7f8fe1b0d640 1 -- 172.21.15.44:0/2202242326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fdc14e530 msgr2=0x7f8fdc143100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:15.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.793+0000 7f8fe1b0d640 1 --2- 172.21.15.44:0/2202242326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fdc14e530 0x7f8fdc143100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:15.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.793+0000 7f8fe1b0d640 1 -- 172.21.15.44:0/2202242326 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fdc13f3e0 con 0x7f8fdc0bd440 2024-05-16T22:28:15.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.793+0000 7f8fe2b0f640 1 --2- 172.21.15.44:0/2202242326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fdc14e530 0x7f8fdc143100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:28:15.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.793+0000 7f8fe230e640 1 --2- 172.21.15.44:0/2202242326 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8fdc0b8d70 0x7f8fdc13eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:28:15.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.794+0000 7f8fe1b0d640 1 --2- 172.21.15.44:0/2202242326 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fdc0bd440 0x7f8fdc140810 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc00c3e0 tx=0x7f8fcc00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:15.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.794+0000 7f8fd2ffd640 1 -- 172.21.15.44:0/2202242326 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc0074e0 con 0x7f8fdc0bd440 2024-05-16T22:28:15.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.794+0000 7f8fd2ffd640 1 -- 172.21.15.44:0/2202242326 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fcc0047e0 con 0x7f8fdc0bd440 2024-05-16T22:28:15.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.794+0000 7f8fe4572640 1 -- 172.21.15.44:0/2202242326 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fdc1e3f30 con 0x7f8fdc0bd440 2024-05-16T22:28:15.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.794+0000 7f8fd2ffd640 1 -- 172.21.15.44:0/2202242326 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc004bd0 con 0x7f8fdc0bd440 2024-05-16T22:28:15.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.794+0000 7f8fe4572640 1 -- 172.21.15.44:0/2202242326 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fdc1e44f0 con 0x7f8fdc0bd440 2024-05-16T22:28:15.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.795+0000 7f8fe4572640 1 -- 172.21.15.44:0/2202242326 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fdc050940 con 0x7f8fdc0bd440 2024-05-16T22:28:15.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.796+0000 7f8fd2ffd640 1 -- 172.21.15.44:0/2202242326 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8fcc011070 con 0x7f8fdc0bd440 2024-05-16T22:28:15.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.796+0000 7f8fd2ffd640 1 --2- 172.21.15.44:0/2202242326 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f8fc0076300 0x7f8fc0078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:15.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.796+0000 7f8fd2ffd640 1 -- 172.21.15.44:0/2202242326 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f8fcc096d70 con 0x7f8fdc0bd440 2024-05-16T22:28:15.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.797+0000 7f8fe230e640 1 --2- 172.21.15.44:0/2202242326 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f8fc0076300 0x7f8fc0078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:15.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.797+0000 7f8fe230e640 1 --2- 172.21.15.44:0/2202242326 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f8fc0076300 0x7f8fc0078810 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8fd8009ae0 tx=0x7f8fd8008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:16.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:13.801+0000 7f8fd2ffd640 1 -- 172.21.15.44:0/2202242326 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8fcc060ab0 con 0x7f8fdc0bd440 2024-05-16T22:28:16.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:14.069+0000 7f8fe4572640 1 -- 172.21.15.44:0/2202242326 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f8fdc0a9330 con 0x7f8fdc0bd440 2024-05-16T22:28:16.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:14.073+0000 7f8fd2ffd640 1 -- 172.21.15.44:0/2202242326 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7f8fcc0603b0 con 0x7f8fdc0bd440 2024-05-16T22:28:16.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:14.076+0000 7f8fe4572640 1 -- 172.21.15.44:0/2202242326 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f8fc0076300 msgr2=0x7f8fc0078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:16.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:14.076+0000 7f8fe4572640 1 --2- 172.21.15.44:0/2202242326 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f8fc0076300 0x7f8fc0078810 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8fd8009ae0 tx=0x7f8fd8008040 comp rx=0 tx=0).stop 2024-05-16T22:28:16.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:14.076+0000 7f8fe4572640 1 -- 172.21.15.44:0/2202242326 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fdc0bd440 msgr2=0x7f8fdc140810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:16.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:14.076+0000 7f8fe4572640 1 --2- 172.21.15.44:0/2202242326 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fdc0bd440 0x7f8fdc140810 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc00c3e0 tx=0x7f8fcc00c8a0 comp rx=0 tx=0).stop 2024-05-16T22:28:16.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:14.076+0000 7f8fe4572640 1 -- 172.21.15.44:0/2202242326 shutdown_connections 2024-05-16T22:28:16.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:14.076+0000 7f8fe4572640 1 --2- 172.21.15.44:0/2202242326 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f8fc0076300 0x7f8fc0078810 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:16.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:14.076+0000 7f8fe4572640 1 --2- 172.21.15.44:0/2202242326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fdc14e530 0x7f8fdc143100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:16.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:14.076+0000 7f8fe4572640 1 --2- 172.21.15.44:0/2202242326 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fdc0bd440 0x7f8fdc140810 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:16.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:14.076+0000 7f8fe4572640 1 --2- 172.21.15.44:0/2202242326 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8fdc0b8d70 0x7f8fdc13eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:16.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:14.076+0000 7f8fe4572640 1 -- 172.21.15.44:0/2202242326 >> 172.21.15.44:0/2202242326 conn(0x7f8fdc0c0570 msgr2=0x7f8fdc0c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:28:16.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:14.076+0000 7f8fe4572640 1 -- 172.21.15.44:0/2202242326 shutdown_connections 2024-05-16T22:28:16.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:14.076+0000 7f8fe4572640 1 -- 172.21.15.44:0/2202242326 wait complete. 2024-05-16T22:28:16.536 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-16T22:28:16.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.703+0000 7f85dab34640 1 Processor -- start 2024-05-16T22:28:16.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.703+0000 7f85dab34640 1 -- start start 2024-05-16T22:28:16.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.704+0000 7f85dab34640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85d414e360 0x7f85d41522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:16.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.704+0000 7f85dab34640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f85d40bf9b0 0x7f85d40bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:16.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.704+0000 7f85dab34640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85d40c1390 con 0x7f85d4148770 2024-05-16T22:28:17.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.704+0000 7f85dab34640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f85d4151e40 con 0x7f85d40bf9b0 2024-05-16T22:28:17.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.704+0000 7f85dab34640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f85d40c0620 con 0x7f85d414e360 2024-05-16T22:28:17.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.704+0000 7f85d90d1640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f85d40bf9b0 0x7f85d40bfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:17.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.704+0000 7f85cbfff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f85d4148770 0x7f85d40c0c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59418/0 (socket says 172.21.15.44:59418) 2024-05-16T22:28:17.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.704+0000 7f85cbfff640 1 -- 172.21.15.44:0/2230586098 learned_addr learned my addr 172.21.15.44:0/2230586098 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:28:17.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.705+0000 7f85d88d0640 1 --2- 172.21.15.44:0/2230586098 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85d414e360 0x7f85d41522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:17.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.705+0000 7f85d90d1640 1 -- 172.21.15.44:0/2230586098 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85d414e360 msgr2=0x7f85d41522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:28:17.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.705+0000 7f85d90d1640 1 --2- 172.21.15.44:0/2230586098 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85d414e360 0x7f85d41522d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:17.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.705+0000 7f85d90d1640 1 -- 172.21.15.44:0/2230586098 >> v1:172.21.15.44:6789/0 conn(0x7f85d4148770 legacy=0x7f85d40c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:17.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.705+0000 7f85d90d1640 1 -- 172.21.15.44:0/2230586098 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85d4151ad0 con 0x7f85d40bf9b0 2024-05-16T22:28:17.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.705+0000 7f85cb7fe640 1 -- 172.21.15.44:0/2230586098 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3416054338 0 0) 0x7f85c4001110 con 0x7f85d4148770 2024-05-16T22:28:17.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.705+0000 7f85d88d0640 1 --2- 172.21.15.44:0/2230586098 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85d414e360 0x7f85d41522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T22:28:17.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.705+0000 7f85d90d1640 1 --2- 172.21.15.44:0/2230586098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85d40bf9b0 0x7f85d40bfdc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f85cc009dc0 tx=0x7f85cc02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d738ab75b6225f5d server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:17.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.706+0000 7f85cb7fe640 1 -- 172.21.15.44:0/2230586098 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85cc007740 con 0x7f85d40bf9b0 2024-05-16T22:28:17.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.706+0000 7f85cb7fe640 1 -- 172.21.15.44:0/2230586098 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85cc0078e0 con 0x7f85d40bf9b0 2024-05-16T22:28:17.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.706+0000 7f85cb7fe640 1 -- 172.21.15.44:0/2230586098 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85cc007cb0 con 0x7f85d40bf9b0 2024-05-16T22:28:17.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.706+0000 7f85dab34640 1 -- 172.21.15.44:0/2230586098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85d40bf9b0 msgr2=0x7f85d40bfdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:17.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.706+0000 7f85dab34640 1 --2- 172.21.15.44:0/2230586098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85d40bf9b0 0x7f85d40bfdc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f85cc009dc0 tx=0x7f85cc02a730 comp rx=0 tx=0).stop 2024-05-16T22:28:17.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.706+0000 7f85dab34640 1 -- 172.21.15.44:0/2230586098 shutdown_connections 2024-05-16T22:28:17.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.706+0000 7f85dab34640 1 --2- 172.21.15.44:0/2230586098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85d40bf9b0 0x7f85d40bfdc0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:17.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.706+0000 7f85dab34640 1 --2- 172.21.15.44:0/2230586098 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85d414e360 0x7f85d41522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:17.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.706+0000 7f85dab34640 1 -- 172.21.15.44:0/2230586098 >> 172.21.15.44:0/2230586098 conn(0x7f85d40c17c0 msgr2=0x7f85d40c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:28:17.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.706+0000 7f85dab34640 1 -- 172.21.15.44:0/2230586098 shutdown_connections 2024-05-16T22:28:17.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.706+0000 7f85dab34640 1 -- 172.21.15.44:0/2230586098 wait complete. 2024-05-16T22:28:17.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.708+0000 7f85dab34640 1 Processor -- start 2024-05-16T22:28:17.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.708+0000 7f85dab34640 1 -- start start 2024-05-16T22:28:17.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.709+0000 7f85dab34640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85d40bf9b0 0x7f85d406e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:18.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.709+0000 7f85dab34640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85d4148770 0x7f85d40b6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:18.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.709+0000 7f85dab34640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85d414e360 0x7f85d4141a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:18.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.709+0000 7f85dab34640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f85d4158cc0 con 0x7f85d414e360 2024-05-16T22:28:18.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.709+0000 7f85dab34640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f85d40c0300 con 0x7f85d4148770 2024-05-16T22:28:18.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.709+0000 7f85dab34640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f85d4158e40 con 0x7f85d40bf9b0 2024-05-16T22:28:18.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.709+0000 7f85d90d1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85d414e360 0x7f85d4141a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:18.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.709+0000 7f85d90d1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85d414e360 0x7f85d4141a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49890/0 (socket says 172.21.15.44:49890) 2024-05-16T22:28:18.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.709+0000 7f85d90d1640 1 -- 172.21.15.44:0/4286884169 learned_addr learned my addr 172.21.15.44:0/4286884169 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:28:18.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.710+0000 7f85d88d0640 1 --2- 172.21.15.44:0/4286884169 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85d40bf9b0 0x7f85d406e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:18.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.709+0000 7f85cbfff640 1 --2- 172.21.15.44:0/4286884169 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85d4148770 0x7f85d40b6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:18.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.710+0000 7f85d90d1640 1 -- 172.21.15.44:0/4286884169 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85d40bf9b0 msgr2=0x7f85d406e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:18.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.710+0000 7f85d90d1640 1 --2- 172.21.15.44:0/4286884169 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85d40bf9b0 0x7f85d406e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:18.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.710+0000 7f85d90d1640 1 -- 172.21.15.44:0/4286884169 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85d4148770 msgr2=0x7f85d40b6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:18.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.710+0000 7f85d90d1640 1 --2- 172.21.15.44:0/4286884169 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85d4148770 0x7f85d40b6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:18.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.710+0000 7f85d90d1640 1 -- 172.21.15.44:0/4286884169 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85d40b6ed0 con 0x7f85d414e360 2024-05-16T22:28:18.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.710+0000 7f85d88d0640 1 --2- 172.21.15.44:0/4286884169 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85d40bf9b0 0x7f85d406e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:28:18.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.710+0000 7f85d90d1640 1 --2- 172.21.15.44:0/4286884169 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85d414e360 0x7f85d4141a50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f85cc02ad20 tx=0x7f85cc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:18.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.710+0000 7f85c97fa640 1 -- 172.21.15.44:0/4286884169 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85cc03f070 con 0x7f85d414e360 2024-05-16T22:28:18.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.710+0000 7f85c97fa640 1 -- 172.21.15.44:0/4286884169 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85cc031bc0 con 0x7f85d414e360 2024-05-16T22:28:18.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.710+0000 7f85c97fa640 1 -- 172.21.15.44:0/4286884169 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85cc003990 con 0x7f85d414e360 2024-05-16T22:28:18.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.710+0000 7f85dab34640 1 -- 172.21.15.44:0/4286884169 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85d4143000 con 0x7f85d414e360 2024-05-16T22:28:18.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.710+0000 7f85dab34640 1 -- 172.21.15.44:0/4286884169 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85d41435c0 con 0x7f85d414e360 2024-05-16T22:28:18.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.711+0000 7f85dab34640 1 -- 172.21.15.44:0/4286884169 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85d414bca0 con 0x7f85d414e360 2024-05-16T22:28:18.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.712+0000 7f85c97fa640 1 -- 172.21.15.44:0/4286884169 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f85cc003b30 con 0x7f85d414e360 2024-05-16T22:28:18.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.713+0000 7f85c97fa640 1 --2- 172.21.15.44:0/4286884169 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f85c00762d0 0x7f85c00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:18.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.713+0000 7f85c97fa640 1 -- 172.21.15.44:0/4286884169 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f85cc0b8570 con 0x7f85d414e360 2024-05-16T22:28:18.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.713+0000 7f85d88d0640 1 --2- 172.21.15.44:0/4286884169 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f85c00762d0 0x7f85c00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:18.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.713+0000 7f85d88d0640 1 --2- 172.21.15.44:0/4286884169 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f85c00762d0 0x7f85c00787e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f85d000a990 tx=0x7f85d0008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:19.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.717+0000 7f85c97fa640 1 -- 172.21.15.44:0/4286884169 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f85cc081b30 con 0x7f85d414e360 2024-05-16T22:28:19.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.909+0000 7f85dab34640 1 -- 172.21.15.44:0/4286884169 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f85d4050940 con 0x7f85d414e360 2024-05-16T22:28:19.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.910+0000 7f85c97fa640 1 -- 172.21.15.44:0/4286884169 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v27) ==== 84+0+65 (secure 0 0 0) 0x7f85cc085e30 con 0x7f85d414e360 2024-05-16T22:28:19.113 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:28:19.146 INFO:teuthology.orchestra.run.smithi044.stdout:[ 2024-05-16T22:28:19.180 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-05-16T22:28:19.213 INFO:teuthology.orchestra.run.smithi044.stdout: "poolnum": 1, 2024-05-16T22:28:19.246 INFO:teuthology.orchestra.run.smithi044.stdout: "poolname": ".mgr" 2024-05-16T22:28:19.280 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-05-16T22:28:19.313 INFO:teuthology.orchestra.run.smithi044.stdout:] 2024-05-16T22:28:19.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.912+0000 7f85dab34640 1 -- 172.21.15.44:0/4286884169 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f85c00762d0 msgr2=0x7f85c00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:19.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.912+0000 7f85dab34640 1 --2- 172.21.15.44:0/4286884169 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f85c00762d0 0x7f85c00787e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f85d000a990 tx=0x7f85d0008040 comp rx=0 tx=0).stop 2024-05-16T22:28:19.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.912+0000 7f85dab34640 1 -- 172.21.15.44:0/4286884169 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85d414e360 msgr2=0x7f85d4141a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:19.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.912+0000 7f85dab34640 1 --2- 172.21.15.44:0/4286884169 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85d414e360 0x7f85d4141a50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f85cc02ad20 tx=0x7f85cc004a40 comp rx=0 tx=0).stop 2024-05-16T22:28:19.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.912+0000 7f85dab34640 1 -- 172.21.15.44:0/4286884169 shutdown_connections 2024-05-16T22:28:19.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.912+0000 7f85dab34640 1 --2- 172.21.15.44:0/4286884169 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f85c00762d0 0x7f85c00787e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:19.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.912+0000 7f85dab34640 1 --2- 172.21.15.44:0/4286884169 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85d414e360 0x7f85d4141a50 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:19.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.912+0000 7f85dab34640 1 --2- 172.21.15.44:0/4286884169 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85d4148770 0x7f85d40b6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:19.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.912+0000 7f85dab34640 1 --2- 172.21.15.44:0/4286884169 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85d40bf9b0 0x7f85d406e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:19.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.912+0000 7f85dab34640 1 -- 172.21.15.44:0/4286884169 >> 172.21.15.44:0/4286884169 conn(0x7f85d40c17c0 msgr2=0x7f85d41406f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:28:19.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.912+0000 7f85dab34640 1 -- 172.21.15.44:0/4286884169 shutdown_connections 2024-05-16T22:28:19.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:16.912+0000 7f85dab34640 1 -- 172.21.15.44:0/4286884169 wait complete. 2024-05-16T22:28:19.772 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-16T22:28:19.805 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-16T22:28:19.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.969+0000 7fd99c0e2640 1 Processor -- start 2024-05-16T22:28:20.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.970+0000 7fd99c0e2640 1 -- start start 2024-05-16T22:28:20.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.971+0000 7fd99c0e2640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd9940b4aa0 0x7fd9940b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:20.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.971+0000 7fd99c0e2640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd99414e720 0x7fd99414eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:20.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.971+0000 7fd99c0e2640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd99406fed0 con 0x7fd99414f070 2024-05-16T22:28:20.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.971+0000 7fd99c0e2640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fd994071f40 con 0x7fd99414e720 2024-05-16T22:28:20.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.971+0000 7fd99c0e2640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fd9940bbe50 con 0x7fd9940b4aa0 2024-05-16T22:28:20.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.971+0000 7fd99a67f640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fd99414f070 0x7fd99406e7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59512/0 (socket says 172.21.15.44:59512) 2024-05-16T22:28:20.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.971+0000 7fd99a67f640 1 -- 172.21.15.44:0/1675504609 learned_addr learned my addr 172.21.15.44:0/1675504609 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:28:20.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.971+0000 7fd999e7e640 1 --2- 172.21.15.44:0/1675504609 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd9940b4aa0 0x7fd9940b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:20.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.971+0000 7fd99967d640 1 --2- 172.21.15.44:0/1675504609 >> v2:172.21.15.70:3300/0 conn(0x7fd99414e720 0x7fd99414eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:20.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.971+0000 7fd998e7c640 1 -- 172.21.15.44:0/1675504609 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 864687314 0 0) 0x7fd984001490 con 0x7fd99414f070 2024-05-16T22:28:20.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.971+0000 7fd998e7c640 1 -- 172.21.15.44:0/1675504609 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd97c005730 con 0x7fd99414f070 2024-05-16T22:28:20.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.971+0000 7fd998e7c640 1 -- 172.21.15.44:0/1675504609 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 418871499 0 0) 0x7fd97c005730 con 0x7fd99414f070 2024-05-16T22:28:20.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.971+0000 7fd998e7c640 1 -- 172.21.15.44:0/1675504609 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd9940b4aa0 msgr2=0x7fd9940b4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:28:20.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.971+0000 7fd998e7c640 1 --2- 172.21.15.44:0/1675504609 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd9940b4aa0 0x7fd9940b4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:20.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.971+0000 7fd998e7c640 1 -- 172.21.15.44:0/1675504609 >> v2:172.21.15.70:3300/0 conn(0x7fd99414e720 msgr2=0x7fd99414eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:28:20.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.971+0000 7fd998e7c640 1 --2- 172.21.15.44:0/1675504609 >> v2:172.21.15.70:3300/0 conn(0x7fd99414e720 0x7fd99414eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:20.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.971+0000 7fd998e7c640 1 -- 172.21.15.44:0/1675504609 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9940bb0e0 con 0x7fd99414f070 2024-05-16T22:28:20.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.971+0000 7fd998e7c640 1 -- 172.21.15.44:0/1675504609 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 568431863 0 0) 0x7fd984001c40 con 0x7fd99414f070 2024-05-16T22:28:20.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.971+0000 7fd998e7c640 1 -- 172.21.15.44:0/1675504609 >> v1:172.21.15.44:6789/0 conn(0x7fd99414f070 legacy=0x7fd99406e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:20.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.971+0000 7fd998e7c640 1 --2- 172.21.15.44:0/1675504609 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd97c005c10 0x7fd97c006080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:20.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.971+0000 7fd998e7c640 1 --2- 172.21.15.44:0/1675504609 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd97c006a10 0x7fd97c006e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:20.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.971+0000 7fd998e7c640 1 --2- 172.21.15.44:0/1675504609 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd97c007360 0x7fd97c00dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:20.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.971+0000 7fd998e7c640 1 -- 172.21.15.44:0/1675504609 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd97c00e210 con 0x7fd97c006a10 2024-05-16T22:28:20.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.971+0000 7fd998e7c640 1 -- 172.21.15.44:0/1675504609 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd97c00e3c0 con 0x7fd97c007360 2024-05-16T22:28:20.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.971+0000 7fd998e7c640 1 -- 172.21.15.44:0/1675504609 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fd97c00e5c0 con 0x7fd97c005c10 2024-05-16T22:28:20.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.972+0000 7fd999e7e640 1 --2- 172.21.15.44:0/1675504609 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd9940b4aa0 0x7fd9940b4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:28:21.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.972+0000 7fd99967d640 1 --2- 172.21.15.44:0/1675504609 >> v2:172.21.15.70:3300/0 conn(0x7fd99414e720 0x7fd99414eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:28:21.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.972+0000 7fd99967d640 1 --2- 172.21.15.44:0/1675504609 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd97c006a10 0x7fd97c006e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:21.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.972+0000 7fd999e7e640 1 --2- 172.21.15.44:0/1675504609 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd97c005c10 0x7fd97c006080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:21.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.972+0000 7fd99a67f640 1 --2- 172.21.15.44:0/1675504609 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd97c007360 0x7fd97c00dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:21.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.972+0000 7fd99967d640 1 -- 172.21.15.44:0/1675504609 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd97c005c10 msgr2=0x7fd97c006080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:28:21.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.972+0000 7fd99967d640 1 --2- 172.21.15.44:0/1675504609 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd97c005c10 0x7fd97c006080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:21.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.972+0000 7fd99967d640 1 -- 172.21.15.44:0/1675504609 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd97c007360 msgr2=0x7fd97c00dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:28:21.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.972+0000 7fd99967d640 1 --2- 172.21.15.44:0/1675504609 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd97c007360 0x7fd97c00dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:21.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.972+0000 7fd99967d640 1 -- 172.21.15.44:0/1675504609 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd97c005730 con 0x7fd97c006a10 2024-05-16T22:28:21.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.973+0000 7fd99967d640 1 --2- 172.21.15.44:0/1675504609 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd97c006a10 0x7fd97c006e20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd988009c70 tx=0x7fd97c007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c9e774b7cdbd5fc server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:21.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.973+0000 7fd998e7c640 1 -- 172.21.15.44:0/1675504609 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd988009840 con 0x7fd97c006a10 2024-05-16T22:28:21.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.973+0000 7fd998e7c640 1 -- 172.21.15.44:0/1675504609 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd988004020 con 0x7fd97c006a10 2024-05-16T22:28:21.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.973+0000 7fd998e7c640 1 -- 172.21.15.44:0/1675504609 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9880043d0 con 0x7fd97c006a10 2024-05-16T22:28:21.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.973+0000 7fd99c0e2640 1 -- 172.21.15.44:0/1675504609 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd97c006a10 msgr2=0x7fd97c006e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:21.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.973+0000 7fd99c0e2640 1 --2- 172.21.15.44:0/1675504609 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd97c006a10 0x7fd97c006e20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd988009c70 tx=0x7fd97c007a40 comp rx=0 tx=0).stop 2024-05-16T22:28:21.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.974+0000 7fd99a67f640 1 -- 172.21.15.44:0/1675504609 reap_dead start 2024-05-16T22:28:21.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.974+0000 7fd99c0e2640 1 -- 172.21.15.44:0/1675504609 shutdown_connections 2024-05-16T22:28:21.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.974+0000 7fd99c0e2640 1 -- 172.21.15.44:0/1675504609 >> 172.21.15.44:0/1675504609 conn(0x7fd9940a1ac0 msgr2=0x7fd9940bbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:28:21.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.974+0000 7fd99c0e2640 1 -- 172.21.15.44:0/1675504609 shutdown_connections 2024-05-16T22:28:21.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.974+0000 7fd99c0e2640 1 -- 172.21.15.44:0/1675504609 wait complete. 2024-05-16T22:28:21.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.975+0000 7fd99c0e2640 1 Processor -- start 2024-05-16T22:28:21.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.975+0000 7fd99c0e2640 1 -- start start 2024-05-16T22:28:21.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.976+0000 7fd99c0e2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd97c006a10 0x7fd99409ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:21.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.976+0000 7fd99c0e2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9940a3140 0x7fd9941468c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:21.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.976+0000 7fd99c0e2640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd994146e00 0x7fd9941e76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:21.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.976+0000 7fd99c0e2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd99414f480 con 0x7fd97c006a10 2024-05-16T22:28:21.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.976+0000 7fd99c0e2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd9940bab60 con 0x7fd9940a3140 2024-05-16T22:28:21.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.976+0000 7fd99c0e2640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fd9940b9ee0 con 0x7fd994146e00 2024-05-16T22:28:22.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.976+0000 7fd999e7e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd97c006a10 0x7fd99409ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:22.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.976+0000 7fd999e7e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd97c006a10 0x7fd99409ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55620/0 (socket says 172.21.15.44:55620) 2024-05-16T22:28:22.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.976+0000 7fd999e7e640 1 -- 172.21.15.44:0/3031167855 learned_addr learned my addr 172.21.15.44:0/3031167855 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:28:22.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.977+0000 7fd99967d640 1 --2- 172.21.15.44:0/3031167855 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9940a3140 0x7fd9941468c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:22.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.977+0000 7fd99a67f640 1 --2- 172.21.15.44:0/3031167855 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd994146e00 0x7fd9941e76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:22.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.977+0000 7fd999e7e640 1 -- 172.21.15.44:0/3031167855 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd994146e00 msgr2=0x7fd9941e76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:22.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.977+0000 7fd999e7e640 1 --2- 172.21.15.44:0/3031167855 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd994146e00 0x7fd9941e76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:22.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.977+0000 7fd999e7e640 1 -- 172.21.15.44:0/3031167855 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9940a3140 msgr2=0x7fd9941468c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:22.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.977+0000 7fd999e7e640 1 --2- 172.21.15.44:0/3031167855 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9940a3140 0x7fd9941468c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:22.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.977+0000 7fd999e7e640 1 -- 172.21.15.44:0/3031167855 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9940a0470 con 0x7fd97c006a10 2024-05-16T22:28:22.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.977+0000 7fd999e7e640 1 --2- 172.21.15.44:0/3031167855 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd97c006a10 0x7fd99409ff30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd98c0118d0 tx=0x7fd98c011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:22.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.977+0000 7fd9927fc640 1 -- 172.21.15.44:0/3031167855 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd98c00fa70 con 0x7fd97c006a10 2024-05-16T22:28:22.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.977+0000 7fd9927fc640 1 -- 172.21.15.44:0/3031167855 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd98c00fc10 con 0x7fd97c006a10 2024-05-16T22:28:22.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.977+0000 7fd9927fc640 1 -- 172.21.15.44:0/3031167855 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd98c014440 con 0x7fd97c006a10 2024-05-16T22:28:22.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.977+0000 7fd99c0e2640 1 -- 172.21.15.44:0/3031167855 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9940bf220 con 0x7fd97c006a10 2024-05-16T22:28:22.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.977+0000 7fd99c0e2640 1 -- 172.21.15.44:0/3031167855 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9940bdd80 con 0x7fd97c006a10 2024-05-16T22:28:22.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.978+0000 7fd99c0e2640 1 -- 172.21.15.44:0/3031167855 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd994069c60 con 0x7fd97c006a10 2024-05-16T22:28:22.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.979+0000 7fd9927fc640 1 -- 172.21.15.44:0/3031167855 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd98c012040 con 0x7fd97c006a10 2024-05-16T22:28:22.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.980+0000 7fd9927fc640 1 --2- 172.21.15.44:0/3031167855 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd9800762d0 0x7fd9800787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:22.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.980+0000 7fd9927fc640 1 -- 172.21.15.44:0/3031167855 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7fd98c097790 con 0x7fd97c006a10 2024-05-16T22:28:22.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.980+0000 7fd99967d640 1 --2- 172.21.15.44:0/3031167855 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd9800762d0 0x7fd9800787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:22.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.980+0000 7fd99967d640 1 --2- 172.21.15.44:0/3031167855 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd9800762d0 0x7fd9800787e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd988032000 tx=0x7fd988008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:22.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:19.985+0000 7fd9927fc640 1 -- 172.21.15.44:0/3031167855 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd98c019030 con 0x7fd97c006a10 2024-05-16T22:28:22.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:20.177+0000 7fd99c0e2640 1 -- 172.21.15.44:0/3031167855 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fd994050940 con 0x7fd97c006a10 2024-05-16T22:28:22.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:21.093+0000 7fd9927fc640 1 -- 172.21.15.44:0/3031167855 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v28) ==== 138+0+0 (secure 0 0 0) 0x7fd98c060d60 con 0x7fd97c006a10 2024-05-16T22:28:22.958 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' created 2024-05-16T22:28:23.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:21.096+0000 7fd99c0e2640 1 -- 172.21.15.44:0/3031167855 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd9800762d0 msgr2=0x7fd9800787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:23.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:21.096+0000 7fd99c0e2640 1 --2- 172.21.15.44:0/3031167855 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd9800762d0 0x7fd9800787e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd988032000 tx=0x7fd988008030 comp rx=0 tx=0).stop 2024-05-16T22:28:23.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:21.096+0000 7fd99c0e2640 1 -- 172.21.15.44:0/3031167855 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd97c006a10 msgr2=0x7fd99409ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:23.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:21.096+0000 7fd99c0e2640 1 --2- 172.21.15.44:0/3031167855 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd97c006a10 0x7fd99409ff30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd98c0118d0 tx=0x7fd98c011d90 comp rx=0 tx=0).stop 2024-05-16T22:28:23.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:21.096+0000 7fd99c0e2640 1 -- 172.21.15.44:0/3031167855 shutdown_connections 2024-05-16T22:28:23.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:21.096+0000 7fd99c0e2640 1 --2- 172.21.15.44:0/3031167855 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd9800762d0 0x7fd9800787e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:23.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:21.096+0000 7fd99c0e2640 1 --2- 172.21.15.44:0/3031167855 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd994146e00 0x7fd9941e76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:23.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:21.096+0000 7fd99c0e2640 1 --2- 172.21.15.44:0/3031167855 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9940a3140 0x7fd9941468c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:23.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:21.096+0000 7fd99c0e2640 1 --2- 172.21.15.44:0/3031167855 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd97c006a10 0x7fd99409ff30 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:23.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:21.096+0000 7fd99c0e2640 1 -- 172.21.15.44:0/3031167855 >> 172.21.15.44:0/3031167855 conn(0x7fd9940a1ac0 msgr2=0x7fd994074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:28:23.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:21.096+0000 7fd99c0e2640 1 -- 172.21.15.44:0/3031167855 shutdown_connections 2024-05-16T22:28:23.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:21.096+0000 7fd99c0e2640 1 -- 172.21.15.44:0/3031167855 wait complete. 2024-05-16T22:28:23.434 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-16T22:28:23.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.601+0000 7f5a7babd640 1 Processor -- start 2024-05-16T22:28:23.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.602+0000 7f5a7babd640 1 -- start start 2024-05-16T22:28:23.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.603+0000 7f5a7babd640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5a74151fc0 0x7f5a740bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:23.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.603+0000 7f5a7babd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f5a7406da30 0x7f5a740be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:23.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.603+0000 7f5a7babd640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a740c36f0 con 0x7f5a7406de40 2024-05-16T22:28:23.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.603+0000 7f5a7babd640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f5a740bdc10 con 0x7f5a7406da30 2024-05-16T22:28:23.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.603+0000 7f5a7babd640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f5a74152530 con 0x7f5a74151fc0 2024-05-16T22:28:23.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.603+0000 7f5a7a05a640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f5a7406de40 0x7f5a7414e570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59526/0 (socket says 172.21.15.44:59526) 2024-05-16T22:28:23.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.603+0000 7f5a7a05a640 1 -- 172.21.15.44:0/2119347987 learned_addr learned my addr 172.21.15.44:0/2119347987 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:28:24.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.603+0000 7f5a79859640 1 --2- 172.21.15.44:0/2119347987 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5a74151fc0 0x7f5a740bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:24.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.603+0000 7f5a79058640 1 --2- 172.21.15.44:0/2119347987 >> v2:172.21.15.70:3300/0 conn(0x7f5a7406da30 0x7f5a740be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:24.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.603+0000 7f5a78857640 1 -- 172.21.15.44:0/2119347987 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1170241801 0 0) 0x7f5a740c36f0 con 0x7f5a7406de40 2024-05-16T22:28:24.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.603+0000 7f5a78857640 1 -- 172.21.15.44:0/2119347987 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a5c003520 con 0x7f5a7406de40 2024-05-16T22:28:24.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.603+0000 7f5a79859640 1 -- 172.21.15.44:0/2119347987 >> v2:172.21.15.70:3300/0 conn(0x7f5a7406da30 msgr2=0x7f5a740be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:28:24.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.603+0000 7f5a79859640 1 --2- 172.21.15.44:0/2119347987 >> v2:172.21.15.70:3300/0 conn(0x7f5a7406da30 0x7f5a740be940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:24.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.603+0000 7f5a79859640 1 -- 172.21.15.44:0/2119347987 >> v1:172.21.15.44:6789/0 conn(0x7f5a7406de40 legacy=0x7f5a7414e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:24.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.603+0000 7f5a79859640 1 -- 172.21.15.44:0/2119347987 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a74152810 con 0x7f5a74151fc0 2024-05-16T22:28:24.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.603+0000 7f5a79058640 1 --2- 172.21.15.44:0/2119347987 >> v2:172.21.15.70:3300/0 conn(0x7f5a7406da30 0x7f5a740be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:28:24.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.604+0000 7f5a79859640 1 --2- 172.21.15.44:0/2119347987 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5a74151fc0 0x7f5a740bd6d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c0097a0 tx=0x7f5a6c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a02ee61e4d660d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:24.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.604+0000 7f5a78857640 1 -- 172.21.15.44:0/2119347987 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c037070 con 0x7f5a74151fc0 2024-05-16T22:28:24.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.604+0000 7f5a78857640 1 -- 172.21.15.44:0/2119347987 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a6c032440 con 0x7f5a74151fc0 2024-05-16T22:28:24.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.604+0000 7f5a78857640 1 -- 172.21.15.44:0/2119347987 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c0327f0 con 0x7f5a74151fc0 2024-05-16T22:28:24.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.605+0000 7f5a7babd640 1 -- 172.21.15.44:0/2119347987 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5a74151fc0 msgr2=0x7f5a740bd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:24.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.605+0000 7f5a7babd640 1 --2- 172.21.15.44:0/2119347987 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5a74151fc0 0x7f5a740bd6d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c0097a0 tx=0x7f5a6c02a180 comp rx=0 tx=0).stop 2024-05-16T22:28:24.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.605+0000 7f5a7babd640 1 -- 172.21.15.44:0/2119347987 shutdown_connections 2024-05-16T22:28:24.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.605+0000 7f5a7babd640 1 --2- 172.21.15.44:0/2119347987 >> v2:172.21.15.70:3300/0 conn(0x7f5a7406da30 0x7f5a740be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:24.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.605+0000 7f5a7babd640 1 --2- 172.21.15.44:0/2119347987 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5a74151fc0 0x7f5a740bd6d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:24.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.605+0000 7f5a7babd640 1 -- 172.21.15.44:0/2119347987 >> 172.21.15.44:0/2119347987 conn(0x7f5a740c3d20 msgr2=0x7f5a740c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:28:24.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.605+0000 7f5a7babd640 1 -- 172.21.15.44:0/2119347987 shutdown_connections 2024-05-16T22:28:24.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.605+0000 7f5a7babd640 1 -- 172.21.15.44:0/2119347987 wait complete. 2024-05-16T22:28:24.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.607+0000 7f5a7babd640 1 Processor -- start 2024-05-16T22:28:24.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.607+0000 7f5a7babd640 1 -- start start 2024-05-16T22:28:24.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.608+0000 7f5a7babd640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5a7406da30 0x7f5a7414eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:24.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.608+0000 7f5a7babd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a7406de40 0x7f5a741e4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:24.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.608+0000 7f5a7babd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5a74151fc0 0x7f5a740b5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:24.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.608+0000 7f5a7babd640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5a740a3050 con 0x7f5a7406de40 2024-05-16T22:28:25.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.608+0000 7f5a7babd640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5a740a2ed0 con 0x7f5a74151fc0 2024-05-16T22:28:25.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.608+0000 7f5a7babd640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f5a740bee80 con 0x7f5a7406da30 2024-05-16T22:28:25.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.608+0000 7f5a79058640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a7406de40 0x7f5a741e4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:25.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.608+0000 7f5a79058640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a7406de40 0x7f5a741e4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55624/0 (socket says 172.21.15.44:55624) 2024-05-16T22:28:25.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.608+0000 7f5a79058640 1 -- 172.21.15.44:0/1763856215 learned_addr learned my addr 172.21.15.44:0/1763856215 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:28:25.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.608+0000 7f5a7a05a640 1 --2- 172.21.15.44:0/1763856215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5a74151fc0 0x7f5a740b5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:25.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.608+0000 7f5a79859640 1 --2- 172.21.15.44:0/1763856215 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5a7406da30 0x7f5a7414eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:25.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.608+0000 7f5a79058640 1 -- 172.21.15.44:0/1763856215 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5a7406da30 msgr2=0x7f5a7414eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:25.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.608+0000 7f5a79058640 1 --2- 172.21.15.44:0/1763856215 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5a7406da30 0x7f5a7414eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:25.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.608+0000 7f5a79058640 1 -- 172.21.15.44:0/1763856215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5a74151fc0 msgr2=0x7f5a740b5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:25.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.608+0000 7f5a79058640 1 --2- 172.21.15.44:0/1763856215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5a74151fc0 0x7f5a740b5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:25.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.608+0000 7f5a79058640 1 -- 172.21.15.44:0/1763856215 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a740b7b90 con 0x7f5a7406de40 2024-05-16T22:28:25.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.608+0000 7f5a79859640 1 --2- 172.21.15.44:0/1763856215 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5a7406da30 0x7f5a7414eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:28:25.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.609+0000 7f5a79058640 1 --2- 172.21.15.44:0/1763856215 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a7406de40 0x7f5a741e4d50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5a6800e990 tx=0x7f5a6800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:25.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.609+0000 7f5a727fc640 1 -- 172.21.15.44:0/1763856215 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a68017070 con 0x7f5a7406de40 2024-05-16T22:28:25.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.609+0000 7f5a727fc640 1 -- 172.21.15.44:0/1763856215 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a6800c9e0 con 0x7f5a7406de40 2024-05-16T22:28:25.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.609+0000 7f5a7babd640 1 -- 172.21.15.44:0/1763856215 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a7414f0d0 con 0x7f5a7406de40 2024-05-16T22:28:25.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.609+0000 7f5a727fc640 1 -- 172.21.15.44:0/1763856215 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6800cdb0 con 0x7f5a7406de40 2024-05-16T22:28:25.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.609+0000 7f5a7babd640 1 -- 172.21.15.44:0/1763856215 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a7414d6c0 con 0x7f5a7406de40 2024-05-16T22:28:25.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.610+0000 7f5a7babd640 1 -- 172.21.15.44:0/1763856215 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a740c11b0 con 0x7f5a7406de40 2024-05-16T22:28:25.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.610+0000 7f5a727fc640 1 -- 172.21.15.44:0/1763856215 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5a6801a070 con 0x7f5a7406de40 2024-05-16T22:28:25.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.611+0000 7f5a727fc640 1 --2- 172.21.15.44:0/1763856215 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f5a600762d0 0x7f5a600787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:25.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.611+0000 7f5a727fc640 1 -- 172.21.15.44:0/1763856215 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5227+0+0 (secure 0 0 0) 0x7f5a680973b0 con 0x7f5a7406de40 2024-05-16T22:28:25.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.611+0000 7f5a79859640 1 --2- 172.21.15.44:0/1763856215 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f5a600762d0 0x7f5a600787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:25.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.612+0000 7f5a79859640 1 --2- 172.21.15.44:0/1763856215 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f5a600762d0 0x7f5a600787e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c034000 tx=0x7f5a6c02e000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:25.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.616+0000 7f5a727fc640 1 -- 172.21.15.44:0/1763856215 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5a740c11b0 con 0x7f5a7406de40 2024-05-16T22:28:25.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:23.811+0000 7f5a7babd640 1 -- 172.21.15.44:0/1763856215 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f5a74050940 con 0x7f5a7406de40 2024-05-16T22:28:25.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:24.113+0000 7f5a727fc640 1 -- 172.21.15.44:0/1763856215 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v31) ==== 170+0+0 (secure 0 0 0) 0x7f5a68060de0 con 0x7f5a7406de40 2024-05-16T22:28:25.977 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' created 2024-05-16T22:28:26.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:24.116+0000 7f5a7babd640 1 -- 172.21.15.44:0/1763856215 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f5a600762d0 msgr2=0x7f5a600787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:26.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:24.116+0000 7f5a7babd640 1 --2- 172.21.15.44:0/1763856215 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f5a600762d0 0x7f5a600787e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c034000 tx=0x7f5a6c02e000 comp rx=0 tx=0).stop 2024-05-16T22:28:26.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:24.116+0000 7f5a7babd640 1 -- 172.21.15.44:0/1763856215 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a7406de40 msgr2=0x7f5a741e4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:26.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:24.116+0000 7f5a7babd640 1 --2- 172.21.15.44:0/1763856215 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a7406de40 0x7f5a741e4d50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5a6800e990 tx=0x7f5a6800ee50 comp rx=0 tx=0).stop 2024-05-16T22:28:26.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:24.116+0000 7f5a7babd640 1 -- 172.21.15.44:0/1763856215 shutdown_connections 2024-05-16T22:28:26.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:24.116+0000 7f5a7babd640 1 --2- 172.21.15.44:0/1763856215 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f5a600762d0 0x7f5a600787e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:26.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:24.116+0000 7f5a7babd640 1 --2- 172.21.15.44:0/1763856215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5a74151fc0 0x7f5a740b5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:26.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:24.116+0000 7f5a7babd640 1 --2- 172.21.15.44:0/1763856215 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a7406de40 0x7f5a741e4d50 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:26.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:24.116+0000 7f5a7babd640 1 --2- 172.21.15.44:0/1763856215 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5a7406da30 0x7f5a7414eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:26.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:24.116+0000 7f5a7babd640 1 -- 172.21.15.44:0/1763856215 >> 172.21.15.44:0/1763856215 conn(0x7f5a740c3d20 msgr2=0x7f5a740c0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:28:26.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:24.116+0000 7f5a7babd640 1 -- 172.21.15.44:0/1763856215 shutdown_connections 2024-05-16T22:28:26.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:24.116+0000 7f5a7babd640 1 -- 172.21.15.44:0/1763856215 wait complete. 2024-05-16T22:28:26.453 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-16T22:28:26.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.615+0000 7fc96eebd640 1 Processor -- start 2024-05-16T22:28:26.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.615+0000 7fc96eebd640 1 -- start start 2024-05-16T22:28:26.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.616+0000 7fc96eebd640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc968146270 0x7fc9680736a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:26.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.616+0000 7fc96eebd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc96806d6f0 0x7fc96814f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:26.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.616+0000 7fc96eebd640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc968073be0 con 0x7fc96806db00 2024-05-16T22:28:26.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.616+0000 7fc96eebd640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fc9680bbd40 con 0x7fc96806d6f0 2024-05-16T22:28:27.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.616+0000 7fc96eebd640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fc9680bc020 con 0x7fc968146270 2024-05-16T22:28:27.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.617+0000 7fc96cc59640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc968146270 0x7fc9680736a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:27.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.617+0000 7fc967fff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc96806d6f0 0x7fc96814f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:27.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.617+0000 7fc967fff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc96806d6f0 0x7fc96814f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.44:57866/0 (socket says 172.21.15.44:57866) 2024-05-16T22:28:27.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.617+0000 7fc96cc59640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc968146270 0x7fc9680736a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.44:57504/0 (socket says 172.21.15.44:57504) 2024-05-16T22:28:27.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.617+0000 7fc967fff640 1 -- 172.21.15.44:0/1599077388 learned_addr learned my addr 172.21.15.44:0/1599077388 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:28:27.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.617+0000 7fc96d45a640 1 --1- 172.21.15.44:0/1599077388 >> v1:172.21.15.70:6789/0 conn(0x7fc96806db00 0x7fc9680ba910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.44:41626/0 (socket says 172.21.15.44:41626) 2024-05-16T22:28:27.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.617+0000 7fc967fff640 1 -- 172.21.15.44:0/1599077388 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc968146270 msgr2=0x7fc9680736a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:28:27.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.617+0000 7fc967fff640 1 --2- 172.21.15.44:0/1599077388 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc968146270 0x7fc9680736a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:27.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.617+0000 7fc967fff640 1 -- 172.21.15.44:0/1599077388 >> v1:172.21.15.70:6789/0 conn(0x7fc96806db00 legacy=0x7fc9680ba910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:27.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.617+0000 7fc967fff640 1 -- 172.21.15.44:0/1599077388 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9680bc300 con 0x7fc96806d6f0 2024-05-16T22:28:27.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.617+0000 7fc96cc59640 1 --2- 172.21.15.44:0/1599077388 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc968146270 0x7fc9680736a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:28:27.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.618+0000 7fc967fff640 1 --2- 172.21.15.44:0/1599077388 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc96806d6f0 0x7fc96814f810 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc95c009870 tx=0x7fc95c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=891b89d0397d9e4e server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:27.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.618+0000 7fc9677fe640 1 -- 172.21.15.44:0/1599077388 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc95c037070 con 0x7fc96806d6f0 2024-05-16T22:28:27.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.618+0000 7fc9677fe640 1 -- 172.21.15.44:0/1599077388 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc95c032440 con 0x7fc96806d6f0 2024-05-16T22:28:27.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.618+0000 7fc9677fe640 1 -- 172.21.15.44:0/1599077388 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc95c032810 con 0x7fc96806d6f0 2024-05-16T22:28:27.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.619+0000 7fc96eebd640 1 -- 172.21.15.44:0/1599077388 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc96806d6f0 msgr2=0x7fc96814f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:27.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.619+0000 7fc96eebd640 1 --2- 172.21.15.44:0/1599077388 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc96806d6f0 0x7fc96814f810 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc95c009870 tx=0x7fc95c02a1c0 comp rx=0 tx=0).stop 2024-05-16T22:28:27.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.619+0000 7fc96eebd640 1 -- 172.21.15.44:0/1599077388 shutdown_connections 2024-05-16T22:28:27.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.619+0000 7fc96eebd640 1 --2- 172.21.15.44:0/1599077388 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc96806d6f0 0x7fc96814f810 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:27.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.619+0000 7fc96eebd640 1 --2- 172.21.15.44:0/1599077388 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc968146270 0x7fc9680736a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:27.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.619+0000 7fc96eebd640 1 -- 172.21.15.44:0/1599077388 >> 172.21.15.44:0/1599077388 conn(0x7fc96806f2c0 msgr2=0x7fc96806f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:28:27.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.619+0000 7fc96eebd640 1 -- 172.21.15.44:0/1599077388 shutdown_connections 2024-05-16T22:28:27.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.619+0000 7fc96eebd640 1 -- 172.21.15.44:0/1599077388 wait complete. 2024-05-16T22:28:27.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.620+0000 7fc96eebd640 1 Processor -- start 2024-05-16T22:28:27.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.620+0000 7fc96eebd640 1 -- start start 2024-05-16T22:28:28.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.622+0000 7fc96eebd640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc96806d6f0 0x7fc96814e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:28.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.622+0000 7fc96eebd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc96806db00 0x7fc968142ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:28.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.622+0000 7fc96eebd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc968146270 0x7fc968143410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:28.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.622+0000 7fc96eebd640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc9680729f0 con 0x7fc968146270 2024-05-16T22:28:28.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.622+0000 7fc96eebd640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc968072870 con 0x7fc96806db00 2024-05-16T22:28:28.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.622+0000 7fc96eebd640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fc96814fd50 con 0x7fc96806d6f0 2024-05-16T22:28:28.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.622+0000 7fc96d45a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc968146270 0x7fc968143410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:28.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.622+0000 7fc96cc59640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc96806d6f0 0x7fc96814e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:28.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.622+0000 7fc967fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc96806db00 0x7fc968142ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:28.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.622+0000 7fc967fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc96806db00 0x7fc968142ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.44:57874/0 (socket says 172.21.15.44:57874) 2024-05-16T22:28:28.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.622+0000 7fc96cc59640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc96806d6f0 0x7fc96814e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.44:57520/0 (socket says 172.21.15.44:57520) 2024-05-16T22:28:28.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.622+0000 7fc967fff640 1 -- 172.21.15.44:0/3570993911 learned_addr learned my addr 172.21.15.44:0/3570993911 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:28:28.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.622+0000 7fc96d45a640 1 --2- 172.21.15.44:0/3570993911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc968146270 0x7fc968143410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55638/0 (socket says 172.21.15.44:55638) 2024-05-16T22:28:28.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.622+0000 7fc967fff640 1 -- 172.21.15.44:0/3570993911 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc96806d6f0 msgr2=0x7fc96814e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:28.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.622+0000 7fc967fff640 1 --2- 172.21.15.44:0/3570993911 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc96806d6f0 0x7fc96814e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:28.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.622+0000 7fc967fff640 1 -- 172.21.15.44:0/3570993911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc968146270 msgr2=0x7fc968143410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:28.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.622+0000 7fc967fff640 1 --2- 172.21.15.44:0/3570993911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc968146270 0x7fc968143410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:28.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.622+0000 7fc967fff640 1 -- 172.21.15.44:0/3570993911 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc96814eb80 con 0x7fc96806db00 2024-05-16T22:28:28.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.622+0000 7fc96d45a640 1 --2- 172.21.15.44:0/3570993911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc968146270 0x7fc968143410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:28:28.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.622+0000 7fc967fff640 1 --2- 172.21.15.44:0/3570993911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc96806db00 0x7fc968142ed0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc95c000c00 tx=0x7fc95c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:28.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.623+0000 7fc9657fa640 1 -- 172.21.15.44:0/3570993911 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc95c037040 con 0x7fc96806db00 2024-05-16T22:28:28.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.623+0000 7fc9657fa640 1 -- 172.21.15.44:0/3570993911 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc95c042070 con 0x7fc96806db00 2024-05-16T22:28:28.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.623+0000 7fc96eebd640 1 -- 172.21.15.44:0/3570993911 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc96814cff0 con 0x7fc96806db00 2024-05-16T22:28:28.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.623+0000 7fc9657fa640 1 -- 172.21.15.44:0/3570993911 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc95c030860 con 0x7fc96806db00 2024-05-16T22:28:28.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.623+0000 7fc96eebd640 1 -- 172.21.15.44:0/3570993911 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9681e2040 con 0x7fc96806db00 2024-05-16T22:28:28.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.624+0000 7fc96eebd640 1 -- 172.21.15.44:0/3570993911 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9680747c0 con 0x7fc96806db00 2024-05-16T22:28:28.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.625+0000 7fc9657fa640 1 -- 172.21.15.44:0/3570993911 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc95c02ad10 con 0x7fc96806db00 2024-05-16T22:28:29.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.625+0000 7fc9657fa640 1 --2- 172.21.15.44:0/3570993911 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fc9540762d0 0x7fc9540787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:29.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.625+0000 7fc9657fa640 1 -- 172.21.15.44:0/3570993911 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5609+0+0 (secure 0 0 0) 0x7fc95c0b8390 con 0x7fc96806db00 2024-05-16T22:28:29.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.625+0000 7fc96cc59640 1 --2- 172.21.15.44:0/3570993911 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fc9540762d0 0x7fc9540787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:29.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.626+0000 7fc96cc59640 1 --2- 172.21.15.44:0/3570993911 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fc9540762d0 0x7fc9540787e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc958009560 tx=0x7fc958009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:29.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.630+0000 7fc9657fa640 1 -- 172.21.15.44:0/3570993911 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc96814cff0 con 0x7fc96806db00 2024-05-16T22:28:29.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:26.862+0000 7fc96eebd640 1 -- 172.21.15.44:0/3570993911 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fc968147340 con 0x7fc96806db00 2024-05-16T22:28:29.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:27.139+0000 7fc9657fa640 1 -- 172.21.15.44:0/3570993911 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) ==== 172+0+0 (secure 0 0 0) 0x7fc95c081900 con 0x7fc96806db00 2024-05-16T22:28:29.254 INFO:teuthology.orchestra.run.smithi044.stderr:new fs with metadata pool 4 and data pool 5 2024-05-16T22:28:29.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:27.147+0000 7fc96eebd640 1 -- 172.21.15.44:0/3570993911 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fc9540762d0 msgr2=0x7fc9540787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:29.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:27.147+0000 7fc96eebd640 1 --2- 172.21.15.44:0/3570993911 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fc9540762d0 0x7fc9540787e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc958009560 tx=0x7fc958009190 comp rx=0 tx=0).stop 2024-05-16T22:28:29.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:27.147+0000 7fc96eebd640 1 -- 172.21.15.44:0/3570993911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc96806db00 msgr2=0x7fc968142ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:29.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:27.147+0000 7fc96eebd640 1 --2- 172.21.15.44:0/3570993911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc96806db00 0x7fc968142ed0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc95c000c00 tx=0x7fc95c0046c0 comp rx=0 tx=0).stop 2024-05-16T22:28:29.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:27.149+0000 7fc96eebd640 1 -- 172.21.15.44:0/3570993911 shutdown_connections 2024-05-16T22:28:29.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:27.149+0000 7fc96eebd640 1 --2- 172.21.15.44:0/3570993911 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fc9540762d0 0x7fc9540787e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:29.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:27.149+0000 7fc96eebd640 1 --2- 172.21.15.44:0/3570993911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc968146270 0x7fc968143410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:29.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:27.149+0000 7fc96eebd640 1 --2- 172.21.15.44:0/3570993911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc96806db00 0x7fc968142ed0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:29.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:27.149+0000 7fc96eebd640 1 --2- 172.21.15.44:0/3570993911 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc96806d6f0 0x7fc96814e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:29.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:27.149+0000 7fc96eebd640 1 -- 172.21.15.44:0/3570993911 >> 172.21.15.44:0/3570993911 conn(0x7fc96806f2c0 msgr2=0x7fc9680a3c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:28:29.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:27.149+0000 7fc96eebd640 1 -- 172.21.15.44:0/3570993911 shutdown_connections 2024-05-16T22:28:29.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:27.149+0000 7fc96eebd640 1 -- 172.21.15.44:0/3570993911 wait complete. 2024-05-16T22:28:29.755 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-16T22:28:29.789 INFO:tasks.ceph.mds.c.smithi044.stderr:2024-05-16T22:28:28.260+0000 7f7806d0d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-16T22:28:29.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.975+0000 7f2f71f65640 1 Processor -- start 2024-05-16T22:28:30.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.975+0000 7f2f71f65640 1 -- start start 2024-05-16T22:28:30.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.976+0000 7f2f71f65640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2f6c0bd6d0 0x7f2f6c0be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:30.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.976+0000 7f2f71f65640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f6c06e140 con 0x7f2f6c0bee80 2024-05-16T22:28:30.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.976+0000 7f2f71f65640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f6c0c36f0 con 0x7f2f6c151fc0 2024-05-16T22:28:30.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.976+0000 7f2f71f65640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f2f6c152530 con 0x7f2f6c0bd6d0 2024-05-16T22:28:30.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.976+0000 7f2f6affd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2f6c0bd6d0 0x7f2f6c0be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:30.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.977+0000 7f2f6affd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2f6c0bd6d0 0x7f2f6c0be940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58578/0 (socket says 172.21.15.44:58578) 2024-05-16T22:28:30.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.977+0000 7f2f6affd640 1 -- 172.21.15.44:0/56168774 learned_addr learned my addr 172.21.15.44:0/56168774 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:28:30.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.977+0000 7f2f6bfff640 1 --1- 172.21.15.44:0/56168774 >> v1:172.21.15.44:6789/0 conn(0x7f2f6c0bee80 0x7f2f6c158e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:36392/0 (socket says 172.21.15.44:36392) 2024-05-16T22:28:30.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.977+0000 7f2f6affd640 1 -- 172.21.15.44:0/56168774 >> v1:172.21.15.70:6789/0 conn(0x7f2f6c151fc0 legacy=0x7f2f6c06da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:30.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.977+0000 7f2f6affd640 1 -- 172.21.15.44:0/56168774 >> v1:172.21.15.44:6789/0 conn(0x7f2f6c0bee80 legacy=0x7f2f6c158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:30.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.977+0000 7f2f6affd640 1 -- 172.21.15.44:0/56168774 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f6c152810 con 0x7f2f6c0bd6d0 2024-05-16T22:28:30.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.977+0000 7f2f6a7fc640 1 -- 172.21.15.44:0/56168774 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3611697107 0 0) 0x7f2f64001490 con 0x7f2f6c0bee80 2024-05-16T22:28:30.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.978+0000 7f2f6affd640 1 --2- 172.21.15.44:0/56168774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f6c0bd6d0 0x7f2f6c0be940 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2f60009870 tx=0x7f2f6002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c04dfa597da93e78 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:30.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.978+0000 7f2f6a7fc640 1 -- 172.21.15.44:0/56168774 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f60037070 con 0x7f2f6c0bd6d0 2024-05-16T22:28:30.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.978+0000 7f2f6a7fc640 1 -- 172.21.15.44:0/56168774 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f60032440 con 0x7f2f6c0bd6d0 2024-05-16T22:28:30.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.978+0000 7f2f6a7fc640 1 -- 172.21.15.44:0/56168774 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f60032810 con 0x7f2f6c0bd6d0 2024-05-16T22:28:30.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.978+0000 7f2f71f65640 1 -- 172.21.15.44:0/56168774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f6c0bd6d0 msgr2=0x7f2f6c0be940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:30.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.978+0000 7f2f71f65640 1 --2- 172.21.15.44:0/56168774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f6c0bd6d0 0x7f2f6c0be940 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2f60009870 tx=0x7f2f6002a270 comp rx=0 tx=0).stop 2024-05-16T22:28:30.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.979+0000 7f2f71f65640 1 -- 172.21.15.44:0/56168774 shutdown_connections 2024-05-16T22:28:30.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.979+0000 7f2f71f65640 1 --2- 172.21.15.44:0/56168774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f6c0bd6d0 0x7f2f6c0be940 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:30.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.979+0000 7f2f71f65640 1 -- 172.21.15.44:0/56168774 >> 172.21.15.44:0/56168774 conn(0x7f2f6c0c3d20 msgr2=0x7f2f6c0c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:28:30.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.979+0000 7f2f71f65640 1 -- 172.21.15.44:0/56168774 shutdown_connections 2024-05-16T22:28:30.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.979+0000 7f2f71f65640 1 -- 172.21.15.44:0/56168774 wait complete. 2024-05-16T22:28:30.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.980+0000 7f2f71f65640 1 Processor -- start 2024-05-16T22:28:30.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.980+0000 7f2f71f65640 1 -- start start 2024-05-16T22:28:30.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.981+0000 7f2f71f65640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2f6c0bd6d0 0x7f2f6c09d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:30.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.981+0000 7f2f71f65640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f6c0bee80 0x7f2f6c09ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:30.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.981+0000 7f2f71f65640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f6c151fc0 0x7f2f6c0a1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:30.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.981+0000 7f2f71f65640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2f6c0bdae0 con 0x7f2f6c151fc0 2024-05-16T22:28:30.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.981+0000 7f2f71f65640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2f6c0c0070 con 0x7f2f6c0bee80 2024-05-16T22:28:30.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.981+0000 7f2f71f65640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f2f6c0a2ed0 con 0x7f2f6c0bd6d0 2024-05-16T22:28:30.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.982+0000 7f2f6bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f6c151fc0 0x7f2f6c0a1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:30.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.982+0000 7f2f6bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f6c151fc0 0x7f2f6c0a1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58580/0 (socket says 172.21.15.44:58580) 2024-05-16T22:28:30.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.982+0000 7f2f6bfff640 1 -- 172.21.15.44:0/3812045708 learned_addr learned my addr 172.21.15.44:0/3812045708 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:28:30.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.982+0000 7f2f6affd640 1 --2- 172.21.15.44:0/3812045708 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f6c0bee80 0x7f2f6c09ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:30.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.982+0000 7f2f6b7fe640 1 --2- 172.21.15.44:0/3812045708 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2f6c0bd6d0 0x7f2f6c09d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:30.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.982+0000 7f2f6bfff640 1 -- 172.21.15.44:0/3812045708 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2f6c0bd6d0 msgr2=0x7f2f6c09d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:30.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.982+0000 7f2f6bfff640 1 --2- 172.21.15.44:0/3812045708 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2f6c0bd6d0 0x7f2f6c09d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:31.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.982+0000 7f2f6bfff640 1 -- 172.21.15.44:0/3812045708 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f6c0bee80 msgr2=0x7f2f6c09ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:31.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.982+0000 7f2f6bfff640 1 --2- 172.21.15.44:0/3812045708 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f6c0bee80 0x7f2f6c09ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:31.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.982+0000 7f2f6bfff640 1 -- 172.21.15.44:0/3812045708 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f6c14dfd0 con 0x7f2f6c151fc0 2024-05-16T22:28:31.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.982+0000 7f2f6b7fe640 1 --2- 172.21.15.44:0/3812045708 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2f6c0bd6d0 0x7f2f6c09d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T22:28:31.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.982+0000 7f2f6bfff640 1 --2- 172.21.15.44:0/3812045708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f6c151fc0 0x7f2f6c0a1df0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2f6400c730 tx=0x7f2f6400cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:31.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.982+0000 7f2f53fff640 1 -- 172.21.15.44:0/3812045708 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f64018070 con 0x7f2f6c151fc0 2024-05-16T22:28:31.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.982+0000 7f2f53fff640 1 -- 172.21.15.44:0/3812045708 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f64004d60 con 0x7f2f6c151fc0 2024-05-16T22:28:31.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.982+0000 7f2f53fff640 1 -- 172.21.15.44:0/3812045708 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f6400a880 con 0x7f2f6c151fc0 2024-05-16T22:28:31.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.982+0000 7f2f71f65640 1 -- 172.21.15.44:0/3812045708 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f6c09ded0 con 0x7f2f6c151fc0 2024-05-16T22:28:31.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.982+0000 7f2f71f65640 1 -- 172.21.15.44:0/3812045708 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f6c09f8d0 con 0x7f2f6c151fc0 2024-05-16T22:28:31.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.983+0000 7f2f71f65640 1 -- 172.21.15.44:0/3812045708 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f6c0c1050 con 0x7f2f6c151fc0 2024-05-16T22:28:31.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.984+0000 7f2f53fff640 1 -- 172.21.15.44:0/3812045708 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2f6400aa20 con 0x7f2f6c151fc0 2024-05-16T22:28:31.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.984+0000 7f2f53fff640 1 --2- 172.21.15.44:0/3812045708 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f2f580762d0 0x7f2f580787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:31.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.985+0000 7f2f53fff640 1 -- 172.21.15.44:0/3812045708 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f2f64096c10 con 0x7f2f6c151fc0 2024-05-16T22:28:31.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.985+0000 7f2f6b7fe640 1 --2- 172.21.15.44:0/3812045708 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f2f580762d0 0x7f2f580787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:31.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.985+0000 7f2f6b7fe640 1 --2- 172.21.15.44:0/3812045708 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f2f580762d0 0x7f2f580787e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c007fd0 tx=0x7f2f5c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:31.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:29.990+0000 7f2f53fff640 1 -- 172.21.15.44:0/3812045708 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2f6c0c1050 con 0x7f2f6c151fc0 2024-05-16T22:28:31.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:30.183+0000 7f2f71f65640 1 -- 172.21.15.44:0/3812045708 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2f6c09d530 con 0x7f2f6c151fc0 2024-05-16T22:28:31.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:30.185+0000 7f2f53fff640 1 -- 172.21.15.44:0/3812045708 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16633 (secure 0 0 0) 0x7f2f6c06e140 con 0x7f2f6c151fc0 2024-05-16T22:28:31.693 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:28:31.726 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":34,"fsid":"572ab7cc-b103-4548-ae8f-c6614d57f0c8","created":"2024-05-16T22:27:02.216874+0000","modified":"2024-05-16T22:28:26.864181+0000","last_up_change":"2024-05-16T22:27:13.693953+0000","last_in_change":"2024-05-16T22:27:04.455119+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-16T22:27:14.562409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-16T22:28:20.181977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-16T22:28:23.815306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a7003e89-c706-4562-9f25-670bb35ae108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6825","nonce":1074109859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6827","nonce":1074109859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6831","nonce":1074109859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6829","nonce":1074109859}]},"public_addr":"172.21.15.44:6825/1074109859","cluster_addr":"172.21.15.44:6827/1074109859","heartbeat_back_addr":"172.21.15.44:6831/1074109859","heartbeat_front_addr":"172.21.15.44:6829/1074109859","state":["exists","up"]},{"osd":1,"uuid":"a4d5169d-8327-4494-9c7c-58db21b00636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6817","nonce":2909429972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6819","nonce":2909429972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6823","nonce":2909429972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6821","nonce":2909429972}]},"public_addr":"172.21.15.44:6817/2909429972","cluster_addr":"172.21.15.44:6819/2909429972","heartbeat_back_addr":"172.21.15.44:6823/2909429972","heartbeat_front_addr":"172.21.15.44:6821/2909429972","state":["exists","up"]},{"osd":2,"uuid":"d4a834f8-83a5-400f-9814-eb0a25124df4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6801","nonce":2908194156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6803","nonce":2908194156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6807","nonce":2908194156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6805","nonce":2908194156}]},"public_addr":"172.21.15.44:6801/2908194156","cluster_addr":"172.21.15.44:6803/2908194156","heartbeat_back_addr":"172.21.15.44:6807/2908194156","heartbeat_front_addr":"172.21.15.44:6805/2908194156","state":["exists","up"]},{"osd":3,"uuid":"b9d24a56-ad43-4674-a395-5ec24d135ae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6809","nonce":2168695793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6811","nonce":2168695793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6815","nonce":2168695793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6813","nonce":2168695793}]},"public_addr":"172.21.15.44:6809/2168695793","cluster_addr":"172.21.15.44:6811/2168695793","heartbeat_back_addr":"172.21.15.44:6815/2168695793","heartbeat_front_addr":"172.21.15.44:6813/2168695793","state":["exists","up"]},{"osd":4,"uuid":"9bd94af5-3e17-4cbe-995a-8f837a66c653","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6823","nonce":1540297751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6825","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6827","nonce":1540297751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6831","nonce":1540297751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6829","nonce":1540297751}]},"public_addr":"172.21.15.70:6823/1540297751","cluster_addr":"172.21.15.70:6827/1540297751","heartbeat_back_addr":"172.21.15.70:6831/1540297751","heartbeat_front_addr":"172.21.15.70:6829/1540297751","state":["exists","up"]},{"osd":5,"uuid":"a5b0cfa5-b259-48bd-98b6-96b44f5ebabd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6804","nonce":4218901987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6808","nonce":4218901987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6815","nonce":4218901987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6812","nonce":4218901987}]},"public_addr":"172.21.15.70:6804/4218901987","cluster_addr":"172.21.15.70:6808/4218901987","heartbeat_back_addr":"172.21.15.70:6815/4218901987","heartbeat_front_addr":"172.21.15.70:6812/4218901987","state":["exists","up"]},{"osd":6,"uuid":"0b6af6df-1358-4fc6-a62c-ba57e02914ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6801","nonce":2389556489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6805","nonce":2389556489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6813","nonce":2389556489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6807","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6809","nonce":2389556489}]},"public_addr":"172.21.15.70:6801/2389556489","cluster_addr":"172.21.15.70:6805/2389556489","heartbeat_back_addr":"172.21.15.70:6813/2389556489","heartbeat_front_addr":"172.21.15.70:6809/2389556489","state":["exists","up"]},{"osd":7,"uuid":"eb1a2c5d-42cf-47d0-9e03-b9d26944a589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6817","nonce":3619691281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6819","nonce":3619691281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6826","nonce":3619691281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6822","nonce":3619691281}]},"public_addr":"172.21.15.70:6817/3619691281","cluster_addr":"172.21.15.70:6819/3619691281","heartbeat_back_addr":"172.21.15.70:6826/3619691281","heartbeat_front_addr":"172.21.15.70:6822/3619691281","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.652256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.613348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.528454+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.625204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.678845+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.680829+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.556200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.647030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T22:28:31.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:30.186+0000 7f2f71f65640 1 -- 172.21.15.44:0/3812045708 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f2f580762d0 msgr2=0x7f2f580787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:31.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:30.186+0000 7f2f71f65640 1 --2- 172.21.15.44:0/3812045708 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f2f580762d0 0x7f2f580787e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c007fd0 tx=0x7f2f5c009040 comp rx=0 tx=0).stop 2024-05-16T22:28:31.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:30.186+0000 7f2f71f65640 1 -- 172.21.15.44:0/3812045708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f6c151fc0 msgr2=0x7f2f6c0a1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:31.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:30.186+0000 7f2f71f65640 1 --2- 172.21.15.44:0/3812045708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f6c151fc0 0x7f2f6c0a1df0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2f6400c730 tx=0x7f2f6400cb30 comp rx=0 tx=0).stop 2024-05-16T22:28:31.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:30.187+0000 7f2f71f65640 1 -- 172.21.15.44:0/3812045708 shutdown_connections 2024-05-16T22:28:31.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:30.187+0000 7f2f71f65640 1 --2- 172.21.15.44:0/3812045708 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f2f580762d0 0x7f2f580787e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:32.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:30.187+0000 7f2f71f65640 1 --2- 172.21.15.44:0/3812045708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f6c151fc0 0x7f2f6c0a1df0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:32.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:30.187+0000 7f2f71f65640 1 --2- 172.21.15.44:0/3812045708 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f6c0bee80 0x7f2f6c09ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:32.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:30.187+0000 7f2f71f65640 1 --2- 172.21.15.44:0/3812045708 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2f6c0bd6d0 0x7f2f6c09d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:32.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:30.187+0000 7f2f71f65640 1 -- 172.21.15.44:0/3812045708 >> 172.21.15.44:0/3812045708 conn(0x7f2f6c0c3d20 msgr2=0x7f2f6c0c0940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:28:32.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:30.187+0000 7f2f71f65640 1 -- 172.21.15.44:0/3812045708 shutdown_connections 2024-05-16T22:28:32.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:30.187+0000 7f2f71f65640 1 -- 172.21.15.44:0/3812045708 wait complete. 2024-05-16T22:28:32.469 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-16T22:28:32.502 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:28:32.538 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:28:32.570 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:28:32.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.661+0000 7f037ffb2640 1 Processor -- start 2024-05-16T22:28:32.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.661+0000 7f037ffb2640 1 -- start start 2024-05-16T22:28:32.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.662+0000 7f037ffb2640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f037814e360 0x7f03781522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:32.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.662+0000 7f037ffb2640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f03780bf9b0 0x7f03780bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:32.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.662+0000 7f037ffb2640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03780c1390 con 0x7f0378148770 2024-05-16T22:28:32.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.662+0000 7f037ffb2640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f0378151e40 con 0x7f03780bf9b0 2024-05-16T22:28:32.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.662+0000 7f037ffb2640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f03780c0620 con 0x7f037814e360 2024-05-16T22:28:32.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.663+0000 7f037e54f640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f03780bf9b0 0x7f03780bfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:32.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.663+0000 7f037e54f640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f03780bf9b0 0x7f03780bfdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58596/0 (socket says 172.21.15.44:58596) 2024-05-16T22:28:33.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.663+0000 7f037e54f640 1 -- 172.21.15.44:0/940519351 learned_addr learned my addr 172.21.15.44:0/940519351 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:28:33.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.663+0000 7f037d54d640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f0378148770 0x7f03780c0c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:36398/0 (socket says 172.21.15.44:36398) 2024-05-16T22:28:33.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.663+0000 7f037dd4e640 1 --2- 172.21.15.44:0/940519351 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f037814e360 0x7f03781522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:33.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.663+0000 7f037e54f640 1 -- 172.21.15.44:0/940519351 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f037814e360 msgr2=0x7f03781522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:28:33.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.663+0000 7f037e54f640 1 --2- 172.21.15.44:0/940519351 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f037814e360 0x7f03781522d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:33.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.663+0000 7f037e54f640 1 -- 172.21.15.44:0/940519351 >> v1:172.21.15.44:6789/0 conn(0x7f0378148770 legacy=0x7f03780c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:33.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.663+0000 7f037cd4c640 1 -- 172.21.15.44:0/940519351 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1762987768 0 0) 0x7f0368001110 con 0x7f0378148770 2024-05-16T22:28:33.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.663+0000 7f037e54f640 1 -- 172.21.15.44:0/940519351 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0378151ad0 con 0x7f03780bf9b0 2024-05-16T22:28:33.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.664+0000 7f037e54f640 1 --2- 172.21.15.44:0/940519351 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03780bf9b0 0x7f03780bfdc0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0370009e80 tx=0x7f037002a7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0c00839fbbb2352 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:33.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.664+0000 7f037cd4c640 1 -- 172.21.15.44:0/940519351 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0370036070 con 0x7f03780bf9b0 2024-05-16T22:28:33.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.664+0000 7f037cd4c640 1 -- 172.21.15.44:0/940519351 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0370031600 con 0x7f03780bf9b0 2024-05-16T22:28:33.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.664+0000 7f037cd4c640 1 -- 172.21.15.44:0/940519351 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03700319d0 con 0x7f03780bf9b0 2024-05-16T22:28:33.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.665+0000 7f037ffb2640 1 -- 172.21.15.44:0/940519351 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03780bf9b0 msgr2=0x7f03780bfdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:33.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.665+0000 7f037ffb2640 1 --2- 172.21.15.44:0/940519351 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03780bf9b0 0x7f03780bfdc0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0370009e80 tx=0x7f037002a7f0 comp rx=0 tx=0).stop 2024-05-16T22:28:33.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.665+0000 7f037ffb2640 1 -- 172.21.15.44:0/940519351 shutdown_connections 2024-05-16T22:28:33.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.665+0000 7f037ffb2640 1 --2- 172.21.15.44:0/940519351 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03780bf9b0 0x7f03780bfdc0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:33.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.665+0000 7f037ffb2640 1 --2- 172.21.15.44:0/940519351 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f037814e360 0x7f03781522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:33.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.665+0000 7f037ffb2640 1 -- 172.21.15.44:0/940519351 >> 172.21.15.44:0/940519351 conn(0x7f03780c17c0 msgr2=0x7f03780c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:28:33.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.665+0000 7f037ffb2640 1 -- 172.21.15.44:0/940519351 shutdown_connections 2024-05-16T22:28:33.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.665+0000 7f037ffb2640 1 -- 172.21.15.44:0/940519351 wait complete. 2024-05-16T22:28:33.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.666+0000 7f037ffb2640 1 Processor -- start 2024-05-16T22:28:33.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.666+0000 7f037ffb2640 1 -- start start 2024-05-16T22:28:33.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.667+0000 7f037ffb2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03780bf9b0 0x7f03780a4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:33.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.667+0000 7f037ffb2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0378148770 0x7f03780a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:33.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.667+0000 7f037ffb2640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f037814e360 0x7f0378072300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:33.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.667+0000 7f037ffb2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0378158cc0 con 0x7f03780bf9b0 2024-05-16T22:28:33.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.667+0000 7f037ffb2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f03780c0300 con 0x7f0378148770 2024-05-16T22:28:34.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.667+0000 7f037ffb2640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f0378158e40 con 0x7f037814e360 2024-05-16T22:28:34.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.668+0000 7f037dd4e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03780bf9b0 0x7f03780a4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:34.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.668+0000 7f037dd4e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03780bf9b0 0x7f03780a4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58604/0 (socket says 172.21.15.44:58604) 2024-05-16T22:28:34.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.668+0000 7f037dd4e640 1 -- 172.21.15.44:0/1475246814 learned_addr learned my addr 172.21.15.44:0/1475246814 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:28:34.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.668+0000 7f037e54f640 1 --2- 172.21.15.44:0/1475246814 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f037814e360 0x7f0378072300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:34.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.668+0000 7f037d54d640 1 --2- 172.21.15.44:0/1475246814 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0378148770 0x7f03780a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:34.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.668+0000 7f037dd4e640 1 -- 172.21.15.44:0/1475246814 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f037814e360 msgr2=0x7f0378072300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:34.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.668+0000 7f037dd4e640 1 --2- 172.21.15.44:0/1475246814 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f037814e360 0x7f0378072300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:34.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.668+0000 7f037dd4e640 1 -- 172.21.15.44:0/1475246814 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0378148770 msgr2=0x7f03780a5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:34.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.668+0000 7f037dd4e640 1 --2- 172.21.15.44:0/1475246814 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0378148770 0x7f03780a5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:34.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.668+0000 7f037dd4e640 1 -- 172.21.15.44:0/1475246814 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0378143040 con 0x7f03780bf9b0 2024-05-16T22:28:34.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.668+0000 7f037d54d640 1 --2- 172.21.15.44:0/1475246814 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0378148770 0x7f03780a5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T22:28:34.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.668+0000 7f037dd4e640 1 --2- 172.21.15.44:0/1475246814 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03780bf9b0 0x7f03780a4f30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f037400e8a0 tx=0x7f037400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:34.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.668+0000 7f036e7fc640 1 -- 172.21.15.44:0/1475246814 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0374017070 con 0x7f03780bf9b0 2024-05-16T22:28:34.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.668+0000 7f036e7fc640 1 -- 172.21.15.44:0/1475246814 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f037400c940 con 0x7f03780bf9b0 2024-05-16T22:28:34.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.668+0000 7f037ffb2640 1 -- 172.21.15.44:0/1475246814 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03780a5c40 con 0x7f03780bf9b0 2024-05-16T22:28:34.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.668+0000 7f036e7fc640 1 -- 172.21.15.44:0/1475246814 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f037400cd30 con 0x7f03780bf9b0 2024-05-16T22:28:34.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.668+0000 7f037ffb2640 1 -- 172.21.15.44:0/1475246814 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f037806eae0 con 0x7f03780bf9b0 2024-05-16T22:28:34.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.669+0000 7f037ffb2640 1 -- 172.21.15.44:0/1475246814 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0378158a80 con 0x7f03780bf9b0 2024-05-16T22:28:34.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.670+0000 7f036e7fc640 1 -- 172.21.15.44:0/1475246814 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f037401a070 con 0x7f03780bf9b0 2024-05-16T22:28:34.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.671+0000 7f036e7fc640 1 --2- 172.21.15.44:0/1475246814 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f035c0762d0 0x7f035c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:34.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.671+0000 7f036e7fc640 1 -- 172.21.15.44:0/1475246814 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f03740975d0 con 0x7f03780bf9b0 2024-05-16T22:28:34.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.671+0000 7f037d54d640 1 --2- 172.21.15.44:0/1475246814 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f035c0762d0 0x7f035c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:34.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.671+0000 7f037d54d640 1 --2- 172.21.15.44:0/1475246814 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f035c0762d0 0x7f035c0787e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0368000f60 tx=0x7f0368009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:34.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.676+0000 7f036e7fc640 1 -- 172.21.15.44:0/1475246814 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0374060e90 con 0x7f03780bf9b0 2024-05-16T22:28:34.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.864+0000 7f037ffb2640 1 -- 172.21.15.44:0/1475246814 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0378050940 con 0x7f03780bf9b0 2024-05-16T22:28:34.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.865+0000 7f036e7fc640 1 -- 172.21.15.44:0/1475246814 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16633 (secure 0 0 0) 0x7f0374060790 con 0x7f03780bf9b0 2024-05-16T22:28:34.971 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:28:35.003 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":34,"fsid":"572ab7cc-b103-4548-ae8f-c6614d57f0c8","created":"2024-05-16T22:27:02.216874+0000","modified":"2024-05-16T22:28:26.864181+0000","last_up_change":"2024-05-16T22:27:13.693953+0000","last_in_change":"2024-05-16T22:27:04.455119+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-16T22:27:14.562409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-16T22:28:20.181977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-16T22:28:23.815306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a7003e89-c706-4562-9f25-670bb35ae108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6825","nonce":1074109859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6827","nonce":1074109859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6831","nonce":1074109859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6829","nonce":1074109859}]},"public_addr":"172.21.15.44:6825/1074109859","cluster_addr":"172.21.15.44:6827/1074109859","heartbeat_back_addr":"172.21.15.44:6831/1074109859","heartbeat_front_addr":"172.21.15.44:6829/1074109859","state":["exists","up"]},{"osd":1,"uuid":"a4d5169d-8327-4494-9c7c-58db21b00636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6817","nonce":2909429972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6819","nonce":2909429972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6823","nonce":2909429972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6821","nonce":2909429972}]},"public_addr":"172.21.15.44:6817/2909429972","cluster_addr":"172.21.15.44:6819/2909429972","heartbeat_back_addr":"172.21.15.44:6823/2909429972","heartbeat_front_addr":"172.21.15.44:6821/2909429972","state":["exists","up"]},{"osd":2,"uuid":"d4a834f8-83a5-400f-9814-eb0a25124df4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6801","nonce":2908194156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6803","nonce":2908194156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6807","nonce":2908194156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6805","nonce":2908194156}]},"public_addr":"172.21.15.44:6801/2908194156","cluster_addr":"172.21.15.44:6803/2908194156","heartbeat_back_addr":"172.21.15.44:6807/2908194156","heartbeat_front_addr":"172.21.15.44:6805/2908194156","state":["exists","up"]},{"osd":3,"uuid":"b9d24a56-ad43-4674-a395-5ec24d135ae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6809","nonce":2168695793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6811","nonce":2168695793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6815","nonce":2168695793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6813","nonce":2168695793}]},"public_addr":"172.21.15.44:6809/2168695793","cluster_addr":"172.21.15.44:6811/2168695793","heartbeat_back_addr":"172.21.15.44:6815/2168695793","heartbeat_front_addr":"172.21.15.44:6813/2168695793","state":["exists","up"]},{"osd":4,"uuid":"9bd94af5-3e17-4cbe-995a-8f837a66c653","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6823","nonce":1540297751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6825","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6827","nonce":1540297751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6831","nonce":1540297751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6829","nonce":1540297751}]},"public_addr":"172.21.15.70:6823/1540297751","cluster_addr":"172.21.15.70:6827/1540297751","heartbeat_back_addr":"172.21.15.70:6831/1540297751","heartbeat_front_addr":"172.21.15.70:6829/1540297751","state":["exists","up"]},{"osd":5,"uuid":"a5b0cfa5-b259-48bd-98b6-96b44f5ebabd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6804","nonce":4218901987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6808","nonce":4218901987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6815","nonce":4218901987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6812","nonce":4218901987}]},"public_addr":"172.21.15.70:6804/4218901987","cluster_addr":"172.21.15.70:6808/4218901987","heartbeat_back_addr":"172.21.15.70:6815/4218901987","heartbeat_front_addr":"172.21.15.70:6812/4218901987","state":["exists","up"]},{"osd":6,"uuid":"0b6af6df-1358-4fc6-a62c-ba57e02914ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6801","nonce":2389556489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6805","nonce":2389556489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6813","nonce":2389556489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6807","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6809","nonce":2389556489}]},"public_addr":"172.21.15.70:6801/2389556489","cluster_addr":"172.21.15.70:6805/2389556489","heartbeat_back_addr":"172.21.15.70:6813/2389556489","heartbeat_front_addr":"172.21.15.70:6809/2389556489","state":["exists","up"]},{"osd":7,"uuid":"eb1a2c5d-42cf-47d0-9e03-b9d26944a589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6817","nonce":3619691281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6819","nonce":3619691281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6826","nonce":3619691281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6822","nonce":3619691281}]},"public_addr":"172.21.15.70:6817/3619691281","cluster_addr":"172.21.15.70:6819/3619691281","heartbeat_back_addr":"172.21.15.70:6826/3619691281","heartbeat_front_addr":"172.21.15.70:6822/3619691281","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.652256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.613348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.528454+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.625204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.678845+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.680829+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.556200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.647030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T22:28:35.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.867+0000 7f037ffb2640 1 -- 172.21.15.44:0/1475246814 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f035c0762d0 msgr2=0x7f035c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:35.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.867+0000 7f037ffb2640 1 --2- 172.21.15.44:0/1475246814 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f035c0762d0 0x7f035c0787e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0368000f60 tx=0x7f0368009040 comp rx=0 tx=0).stop 2024-05-16T22:28:35.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.867+0000 7f037ffb2640 1 -- 172.21.15.44:0/1475246814 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03780bf9b0 msgr2=0x7f03780a4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:35.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.867+0000 7f037ffb2640 1 --2- 172.21.15.44:0/1475246814 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03780bf9b0 0x7f03780a4f30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f037400e8a0 tx=0x7f037400eca0 comp rx=0 tx=0).stop 2024-05-16T22:28:35.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.867+0000 7f037ffb2640 1 -- 172.21.15.44:0/1475246814 shutdown_connections 2024-05-16T22:28:35.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.867+0000 7f037ffb2640 1 --2- 172.21.15.44:0/1475246814 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f035c0762d0 0x7f035c0787e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:35.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.867+0000 7f037ffb2640 1 --2- 172.21.15.44:0/1475246814 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f037814e360 0x7f0378072300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:35.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.867+0000 7f037ffb2640 1 --2- 172.21.15.44:0/1475246814 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0378148770 0x7f03780a5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:35.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.867+0000 7f037ffb2640 1 --2- 172.21.15.44:0/1475246814 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03780bf9b0 0x7f03780a4f30 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:35.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.867+0000 7f037ffb2640 1 -- 172.21.15.44:0/1475246814 >> 172.21.15.44:0/1475246814 conn(0x7f03780c17c0 msgr2=0x7f03781407b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:28:35.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.867+0000 7f037ffb2640 1 -- 172.21.15.44:0/1475246814 shutdown_connections 2024-05-16T22:28:35.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:32.867+0000 7f037ffb2640 1 -- 172.21.15.44:0/1475246814 wait complete. 2024-05-16T22:28:35.571 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-16T22:28:35.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.733+0000 7f83ba365640 1 Processor -- start 2024-05-16T22:28:35.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.733+0000 7f83ba365640 1 -- start start 2024-05-16T22:28:35.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.735+0000 7f83ba365640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f83b4151fc0 0x7f83b40bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:35.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.735+0000 7f83ba365640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83b40c36f0 con 0x7f83b40bf050 2024-05-16T22:28:35.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.735+0000 7f83ba365640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83b4152530 con 0x7f83b406da30 2024-05-16T22:28:35.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.735+0000 7f83ba365640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f83b40bdc10 con 0x7f83b4151fc0 2024-05-16T22:28:35.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.735+0000 7f83b3fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f83b4151fc0 0x7f83b40bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:35.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.735+0000 7f83b8902640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f83b40bf050 0x7f83b4158e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:36410/0 (socket says 172.21.15.44:36410) 2024-05-16T22:28:36.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.735+0000 7f83b3fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f83b4151fc0 0x7f83b40bd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58610/0 (socket says 172.21.15.44:58610) 2024-05-16T22:28:36.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.735+0000 7f83b8902640 1 -- 172.21.15.44:0/1914577660 learned_addr learned my addr 172.21.15.44:0/1914577660 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:28:36.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.735+0000 7f83b3fff640 1 -- 172.21.15.44:0/1914577660 >> v1:172.21.15.70:6789/0 conn(0x7f83b406da30 legacy=0x7f83b40be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:36.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.735+0000 7f83b3fff640 1 -- 172.21.15.44:0/1914577660 >> v1:172.21.15.44:6789/0 conn(0x7f83b40bf050 legacy=0x7f83b4158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:36.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.735+0000 7f83b2ffd640 1 -- 172.21.15.44:0/1914577660 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3578483165 0 0) 0x7f83b40c36f0 con 0x7f83b40bf050 2024-05-16T22:28:36.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.735+0000 7f83b3fff640 1 -- 172.21.15.44:0/1914577660 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83b4152810 con 0x7f83b4151fc0 2024-05-16T22:28:36.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.736+0000 7f83b3fff640 1 --2- 172.21.15.44:0/1914577660 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83b4151fc0 0x7f83b40bd6d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f83a40097a0 tx=0x7f83a402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c63accb163c119fc server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:36.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.736+0000 7f83b2ffd640 1 -- 172.21.15.44:0/1914577660 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a4037070 con 0x7f83b4151fc0 2024-05-16T22:28:36.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.736+0000 7f83b2ffd640 1 -- 172.21.15.44:0/1914577660 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83a4032440 con 0x7f83b4151fc0 2024-05-16T22:28:36.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.736+0000 7f83b2ffd640 1 -- 172.21.15.44:0/1914577660 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a4032810 con 0x7f83b4151fc0 2024-05-16T22:28:36.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.737+0000 7f83ba365640 1 -- 172.21.15.44:0/1914577660 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83b4151fc0 msgr2=0x7f83b40bd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:36.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.737+0000 7f83ba365640 1 --2- 172.21.15.44:0/1914577660 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83b4151fc0 0x7f83b40bd6d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f83a40097a0 tx=0x7f83a402a230 comp rx=0 tx=0).stop 2024-05-16T22:28:36.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.737+0000 7f83ba365640 1 -- 172.21.15.44:0/1914577660 shutdown_connections 2024-05-16T22:28:36.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.737+0000 7f83ba365640 1 --2- 172.21.15.44:0/1914577660 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83b4151fc0 0x7f83b40bd6d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:36.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.737+0000 7f83ba365640 1 -- 172.21.15.44:0/1914577660 >> 172.21.15.44:0/1914577660 conn(0x7f83b40c3d20 msgr2=0x7f83b40c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:28:36.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.737+0000 7f83ba365640 1 -- 172.21.15.44:0/1914577660 shutdown_connections 2024-05-16T22:28:36.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.737+0000 7f83ba365640 1 -- 172.21.15.44:0/1914577660 wait complete. 2024-05-16T22:28:36.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.738+0000 7f83ba365640 1 Processor -- start 2024-05-16T22:28:36.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.739+0000 7f83ba365640 1 -- start start 2024-05-16T22:28:36.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.740+0000 7f83ba365640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f83b406da30 0x7f83b40b7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:36.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.740+0000 7f83ba365640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83b40bf050 0x7f83b41e7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:36.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.740+0000 7f83ba365640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83b4151fc0 0x7f83b414b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:36.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.740+0000 7f83ba365640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f83b40a3050 con 0x7f83b4151fc0 2024-05-16T22:28:36.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.740+0000 7f83ba365640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f83b40a2ed0 con 0x7f83b40bf050 2024-05-16T22:28:36.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.740+0000 7f83ba365640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f83b406de40 con 0x7f83b406da30 2024-05-16T22:28:36.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.740+0000 7f83b8902640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83b4151fc0 0x7f83b414b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:37.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.740+0000 7f83b8902640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83b4151fc0 0x7f83b414b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58616/0 (socket says 172.21.15.44:58616) 2024-05-16T22:28:37.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.740+0000 7f83b8902640 1 -- 172.21.15.44:0/157277990 learned_addr learned my addr 172.21.15.44:0/157277990 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:28:37.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.740+0000 7f83b3fff640 1 --2- 172.21.15.44:0/157277990 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f83b406da30 0x7f83b40b7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:37.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.740+0000 7f83b37fe640 1 --2- 172.21.15.44:0/157277990 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83b40bf050 0x7f83b41e7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:37.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.740+0000 7f83b8902640 1 -- 172.21.15.44:0/157277990 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f83b406da30 msgr2=0x7f83b40b7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:37.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.740+0000 7f83b8902640 1 --2- 172.21.15.44:0/157277990 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f83b406da30 0x7f83b40b7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:37.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.740+0000 7f83b8902640 1 -- 172.21.15.44:0/157277990 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83b40bf050 msgr2=0x7f83b41e7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:37.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.740+0000 7f83b8902640 1 --2- 172.21.15.44:0/157277990 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83b40bf050 0x7f83b41e7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:37.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.740+0000 7f83b8902640 1 -- 172.21.15.44:0/157277990 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83b40b7b50 con 0x7f83b4151fc0 2024-05-16T22:28:37.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.740+0000 7f83b8902640 1 --2- 172.21.15.44:0/157277990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83b4151fc0 0x7f83b414b610 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f83ac00caa0 tx=0x7f83ac00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:37.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.740+0000 7f83b0ff9640 1 -- 172.21.15.44:0/157277990 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83ac00aba0 con 0x7f83b4151fc0 2024-05-16T22:28:37.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.740+0000 7f83b0ff9640 1 -- 172.21.15.44:0/157277990 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83ac00ad40 con 0x7f83b4151fc0 2024-05-16T22:28:37.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.740+0000 7f83ba365640 1 -- 172.21.15.44:0/157277990 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83b41e8010 con 0x7f83b4151fc0 2024-05-16T22:28:37.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.740+0000 7f83b0ff9640 1 -- 172.21.15.44:0/157277990 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83ac012640 con 0x7f83b4151fc0 2024-05-16T22:28:37.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.741+0000 7f83ba365640 1 -- 172.21.15.44:0/157277990 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83b41e45e0 con 0x7f83b4151fc0 2024-05-16T22:28:37.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.741+0000 7f83ba365640 1 -- 172.21.15.44:0/157277990 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83b4050940 con 0x7f83b4151fc0 2024-05-16T22:28:37.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.742+0000 7f83b0ff9640 1 -- 172.21.15.44:0/157277990 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f83ac0127e0 con 0x7f83b4151fc0 2024-05-16T22:28:37.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.743+0000 7f83b0ff9640 1 --2- 172.21.15.44:0/157277990 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f8394076300 0x7f8394078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:37.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.743+0000 7f83b0ff9640 1 -- 172.21.15.44:0/157277990 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f83ac097a50 con 0x7f83b4151fc0 2024-05-16T22:28:37.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.743+0000 7f83b3fff640 1 --2- 172.21.15.44:0/157277990 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f8394076300 0x7f8394078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:37.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.743+0000 7f83b3fff640 1 --2- 172.21.15.44:0/157277990 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f8394076300 0x7f8394078810 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f83a4034000 tx=0x7f83a402e000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:37.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.747+0000 7f83b0ff9640 1 -- 172.21.15.44:0/157277990 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f83ac060cd0 con 0x7f83b4151fc0 2024-05-16T22:28:38.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:35.977+0000 7f83ba365640 1 -- 172.21.15.44:0/157277990 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f83b406eb40 con 0x7f83b4151fc0 2024-05-16T22:28:38.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:36.156+0000 7f83b0ff9640 1 -- 172.21.15.44:0/157277990 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) ==== 118+0+0 (secure 0 0 0) 0x7f83ac064fd0 con 0x7f83b4151fc0 2024-05-16T22:28:38.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:36.158+0000 7f83ba365640 1 -- 172.21.15.44:0/157277990 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f8394076300 msgr2=0x7f8394078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:38.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:36.158+0000 7f83ba365640 1 --2- 172.21.15.44:0/157277990 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f8394076300 0x7f8394078810 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f83a4034000 tx=0x7f83a402e000 comp rx=0 tx=0).stop 2024-05-16T22:28:38.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:36.158+0000 7f83ba365640 1 -- 172.21.15.44:0/157277990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83b4151fc0 msgr2=0x7f83b414b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:38.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:36.158+0000 7f83ba365640 1 --2- 172.21.15.44:0/157277990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83b4151fc0 0x7f83b414b610 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f83ac00caa0 tx=0x7f83ac00cf60 comp rx=0 tx=0).stop 2024-05-16T22:28:38.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:36.158+0000 7f83ba365640 1 -- 172.21.15.44:0/157277990 shutdown_connections 2024-05-16T22:28:38.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:36.158+0000 7f83ba365640 1 --2- 172.21.15.44:0/157277990 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f8394076300 0x7f8394078810 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:38.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:36.158+0000 7f83ba365640 1 --2- 172.21.15.44:0/157277990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83b4151fc0 0x7f83b414b610 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:38.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:36.158+0000 7f83ba365640 1 --2- 172.21.15.44:0/157277990 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83b40bf050 0x7f83b41e7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:38.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:36.158+0000 7f83ba365640 1 --2- 172.21.15.44:0/157277990 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f83b406da30 0x7f83b40b7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:38.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:36.158+0000 7f83ba365640 1 -- 172.21.15.44:0/157277990 >> 172.21.15.44:0/157277990 conn(0x7f83b40c3d20 msgr2=0x7f83b40c09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:28:38.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:36.158+0000 7f83ba365640 1 -- 172.21.15.44:0/157277990 shutdown_connections 2024-05-16T22:28:38.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:36.158+0000 7f83ba365640 1 -- 172.21.15.44:0/157277990 wait complete. 2024-05-16T22:28:38.532 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-16T22:28:38.565 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-16T22:28:38.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.728+0000 7fd423f4d640 1 Processor -- start 2024-05-16T22:28:38.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.728+0000 7fd423f4d640 1 -- start start 2024-05-16T22:28:38.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.729+0000 7fd423f4d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd41c074b00 0x7fd41c06c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:38.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.729+0000 7fd423f4d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd41c0be3f0 0x7fd41c14cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:38.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.729+0000 7fd423f4d640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd41c06ce00 con 0x7fd41c14fad0 2024-05-16T22:28:38.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.729+0000 7fd423f4d640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fd41c0bb470 con 0x7fd41c074b00 2024-05-16T22:28:38.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.729+0000 7fd423f4d640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fd41c0bb890 con 0x7fd41c0be3f0 2024-05-16T22:28:39.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.729+0000 7fd4214e8640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd41c0be3f0 0x7fd41c14cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:39.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.729+0000 7fd421ce9640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd41c074b00 0x7fd41c06c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:39.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.729+0000 7fd4214e8640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd41c0be3f0 0x7fd41c14cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.44:53130/0 (socket says 172.21.15.44:53130) 2024-05-16T22:28:39.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.729+0000 7fd4214e8640 1 -- 172.21.15.44:0/2549406202 learned_addr learned my addr 172.21.15.44:0/2549406202 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:28:39.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.730+0000 7fd420ce7640 1 -- 172.21.15.44:0/2549406202 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3756276176 0 0) 0x7fd41c06ce00 con 0x7fd41c14fad0 2024-05-16T22:28:39.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.730+0000 7fd420ce7640 1 -- 172.21.15.44:0/2549406202 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd408003520 con 0x7fd41c14fad0 2024-05-16T22:28:39.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.730+0000 7fd4214e8640 1 -- 172.21.15.44:0/2549406202 >> v2:172.21.15.70:3300/0 conn(0x7fd41c074b00 msgr2=0x7fd41c06c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:28:39.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.730+0000 7fd4214e8640 1 --2- 172.21.15.44:0/2549406202 >> v2:172.21.15.70:3300/0 conn(0x7fd41c074b00 0x7fd41c06c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:39.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.730+0000 7fd4214e8640 1 -- 172.21.15.44:0/2549406202 >> v1:172.21.15.70:6789/0 conn(0x7fd41c14fad0 legacy=0x7fd41c14fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:39.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.730+0000 7fd4214e8640 1 -- 172.21.15.44:0/2549406202 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd41c0bbb30 con 0x7fd41c0be3f0 2024-05-16T22:28:39.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.730+0000 7fd421ce9640 1 --2- 172.21.15.44:0/2549406202 >> v2:172.21.15.70:3300/0 conn(0x7fd41c074b00 0x7fd41c06c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:28:39.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.731+0000 7fd4214e8640 1 --2- 172.21.15.44:0/2549406202 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd41c0be3f0 0x7fd41c14cb20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd41c0bba60 tx=0x7fd40c02a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b67f2b67d44faa server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:39.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.731+0000 7fd420ce7640 1 -- 172.21.15.44:0/2549406202 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd40c037070 con 0x7fd41c0be3f0 2024-05-16T22:28:39.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.731+0000 7fd420ce7640 1 -- 172.21.15.44:0/2549406202 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd40c032440 con 0x7fd41c0be3f0 2024-05-16T22:28:39.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.731+0000 7fd420ce7640 1 -- 172.21.15.44:0/2549406202 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd40c0327f0 con 0x7fd41c0be3f0 2024-05-16T22:28:39.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.731+0000 7fd423f4d640 1 -- 172.21.15.44:0/2549406202 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd41c0be3f0 msgr2=0x7fd41c14cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:39.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.731+0000 7fd423f4d640 1 --2- 172.21.15.44:0/2549406202 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd41c0be3f0 0x7fd41c14cb20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd41c0bba60 tx=0x7fd40c02a1c0 comp rx=0 tx=0).stop 2024-05-16T22:28:39.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.732+0000 7fd423f4d640 1 -- 172.21.15.44:0/2549406202 shutdown_connections 2024-05-16T22:28:39.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.732+0000 7fd423f4d640 1 --2- 172.21.15.44:0/2549406202 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd41c0be3f0 0x7fd41c14cb20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:39.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.732+0000 7fd423f4d640 1 --2- 172.21.15.44:0/2549406202 >> v2:172.21.15.70:3300/0 conn(0x7fd41c074b00 0x7fd41c06c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:39.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.732+0000 7fd423f4d640 1 -- 172.21.15.44:0/2549406202 >> 172.21.15.44:0/2549406202 conn(0x7fd41c0bd0f0 msgr2=0x7fd41c0bd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:28:39.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.732+0000 7fd423f4d640 1 -- 172.21.15.44:0/2549406202 shutdown_connections 2024-05-16T22:28:39.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.732+0000 7fd423f4d640 1 -- 172.21.15.44:0/2549406202 wait complete. 2024-05-16T22:28:39.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.733+0000 7fd423f4d640 1 Processor -- start 2024-05-16T22:28:39.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.733+0000 7fd423f4d640 1 -- start start 2024-05-16T22:28:39.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.734+0000 7fd423f4d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd41c074b00 0x7fd41c1e2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:39.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.734+0000 7fd423f4d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd41c0be3f0 0x7fd41c148ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:40.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.734+0000 7fd423f4d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd41c14fad0 0x7fd41c1459b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:40.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.734+0000 7fd423f4d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd41c0bc3d0 con 0x7fd41c074b00 2024-05-16T22:28:40.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.734+0000 7fd423f4d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd41c0bc0f0 con 0x7fd41c14fad0 2024-05-16T22:28:40.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.734+0000 7fd423f4d640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fd41c14d060 con 0x7fd41c0be3f0 2024-05-16T22:28:40.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.734+0000 7fd421ce9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd41c074b00 0x7fd41c1e2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:40.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.734+0000 7fd421ce9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd41c074b00 0x7fd41c1e2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58626/0 (socket says 172.21.15.44:58626) 2024-05-16T22:28:40.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.734+0000 7fd421ce9640 1 -- 172.21.15.44:0/2436522127 learned_addr learned my addr 172.21.15.44:0/2436522127 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:28:40.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.735+0000 7fd4224ea640 1 --2- 172.21.15.44:0/2436522127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd41c14fad0 0x7fd41c1459b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:40.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.735+0000 7fd4214e8640 1 --2- 172.21.15.44:0/2436522127 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd41c0be3f0 0x7fd41c148ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:40.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.735+0000 7fd421ce9640 1 -- 172.21.15.44:0/2436522127 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd41c0be3f0 msgr2=0x7fd41c148ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:40.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.735+0000 7fd421ce9640 1 --2- 172.21.15.44:0/2436522127 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd41c0be3f0 0x7fd41c148ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:40.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.735+0000 7fd421ce9640 1 -- 172.21.15.44:0/2436522127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd41c14fad0 msgr2=0x7fd41c1459b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:40.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.735+0000 7fd421ce9640 1 --2- 172.21.15.44:0/2436522127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd41c14fad0 0x7fd41c1459b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:40.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.735+0000 7fd421ce9640 1 -- 172.21.15.44:0/2436522127 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd41c149220 con 0x7fd41c074b00 2024-05-16T22:28:40.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.735+0000 7fd4214e8640 1 --2- 172.21.15.44:0/2436522127 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd41c0be3f0 0x7fd41c148ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:28:40.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.735+0000 7fd421ce9640 1 --2- 172.21.15.44:0/2436522127 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd41c074b00 0x7fd41c1e2360 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd41800e990 tx=0x7fd41800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:40.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.735+0000 7fd4127fc640 1 -- 172.21.15.44:0/2436522127 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd418017070 con 0x7fd41c074b00 2024-05-16T22:28:40.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.735+0000 7fd4127fc640 1 -- 172.21.15.44:0/2436522127 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd41800c9e0 con 0x7fd41c074b00 2024-05-16T22:28:40.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.735+0000 7fd4127fc640 1 -- 172.21.15.44:0/2436522127 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd41800cdb0 con 0x7fd41c074b00 2024-05-16T22:28:40.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.735+0000 7fd423f4d640 1 -- 172.21.15.44:0/2436522127 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd41c1d6830 con 0x7fd41c074b00 2024-05-16T22:28:40.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.735+0000 7fd423f4d640 1 -- 172.21.15.44:0/2436522127 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd41c1d6ba0 con 0x7fd41c074b00 2024-05-16T22:28:40.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.736+0000 7fd423f4d640 1 -- 172.21.15.44:0/2436522127 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd41c050940 con 0x7fd41c074b00 2024-05-16T22:28:40.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.737+0000 7fd4127fc640 1 -- 172.21.15.44:0/2436522127 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd41801a070 con 0x7fd41c074b00 2024-05-16T22:28:40.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.737+0000 7fd4127fc640 1 --2- 172.21.15.44:0/2436522127 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd4000762d0 0x7fd4000787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:40.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.737+0000 7fd4127fc640 1 -- 172.21.15.44:0/2436522127 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fd418097430 con 0x7fd41c074b00 2024-05-16T22:28:40.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.738+0000 7fd4214e8640 1 --2- 172.21.15.44:0/2436522127 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd4000762d0 0x7fd4000787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:40.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.738+0000 7fd4214e8640 1 --2- 172.21.15.44:0/2436522127 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd4000762d0 0x7fd4000787e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd40c034000 tx=0x7fd40c02e000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:41.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.742+0000 7fd4127fc640 1 -- 172.21.15.44:0/2436522127 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd418060740 con 0x7fd41c074b00 2024-05-16T22:28:41.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:38.971+0000 7fd423f4d640 1 -- 172.21.15.44:0/2436522127 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fd41c0742e0 con 0x7fd41c074b00 2024-05-16T22:28:41.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:39.171+0000 7fd4127fc640 1 -- 172.21.15.44:0/2436522127 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7fd418064a40 con 0x7fd41c074b00 2024-05-16T22:28:41.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:39.174+0000 7fd423f4d640 1 -- 172.21.15.44:0/2436522127 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd4000762d0 msgr2=0x7fd4000787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:41.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:39.174+0000 7fd423f4d640 1 --2- 172.21.15.44:0/2436522127 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd4000762d0 0x7fd4000787e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd40c034000 tx=0x7fd40c02e000 comp rx=0 tx=0).stop 2024-05-16T22:28:41.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:39.174+0000 7fd423f4d640 1 -- 172.21.15.44:0/2436522127 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd41c074b00 msgr2=0x7fd41c1e2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:41.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:39.174+0000 7fd423f4d640 1 --2- 172.21.15.44:0/2436522127 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd41c074b00 0x7fd41c1e2360 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd41800e990 tx=0x7fd41800ee50 comp rx=0 tx=0).stop 2024-05-16T22:28:41.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:39.174+0000 7fd423f4d640 1 -- 172.21.15.44:0/2436522127 shutdown_connections 2024-05-16T22:28:41.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:39.174+0000 7fd423f4d640 1 --2- 172.21.15.44:0/2436522127 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd4000762d0 0x7fd4000787e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:41.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:39.174+0000 7fd423f4d640 1 --2- 172.21.15.44:0/2436522127 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd41c0be3f0 0x7fd41c148ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:41.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:39.174+0000 7fd423f4d640 1 --2- 172.21.15.44:0/2436522127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd41c14fad0 0x7fd41c1459b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:41.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:39.174+0000 7fd423f4d640 1 --2- 172.21.15.44:0/2436522127 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd41c074b00 0x7fd41c1e2360 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:41.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:39.174+0000 7fd423f4d640 1 -- 172.21.15.44:0/2436522127 >> 172.21.15.44:0/2436522127 conn(0x7fd41c0bd0f0 msgr2=0x7fd41c0be890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:28:41.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:39.175+0000 7fd423f4d640 1 -- 172.21.15.44:0/2436522127 shutdown_connections 2024-05-16T22:28:41.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:39.175+0000 7fd423f4d640 1 -- 172.21.15.44:0/2436522127 wait complete. 2024-05-16T22:28:41.542 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-16T22:28:41.576 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T22:28:41.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.735+0000 7fdcc29a8640 1 Processor -- start 2024-05-16T22:28:41.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.736+0000 7fdcc29a8640 1 -- start start 2024-05-16T22:28:41.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.737+0000 7fdcc29a8640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdcbc151fc0 0x7fdcbc0bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:41.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.737+0000 7fdcc29a8640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fdcbc0bf050 0x7fdcbc158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:41.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.737+0000 7fdcc29a8640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcbc0c36f0 con 0x7fdcbc06da30 2024-05-16T22:28:41.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.737+0000 7fdcc29a8640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fdcbc0bdc10 con 0x7fdcbc0bf050 2024-05-16T22:28:41.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.737+0000 7fdcc29a8640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fdcbc152530 con 0x7fdcbc151fc0 2024-05-16T22:28:42.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.737+0000 7fdcc0f45640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fdcbc0bf050 0x7fdcbc158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:42.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.737+0000 7fdcc0f45640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fdcbc0bf050 0x7fdcbc158e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60850/0 (socket says 172.21.15.44:60850) 2024-05-16T22:28:42.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.737+0000 7fdcc0f45640 1 -- 172.21.15.44:0/4288500175 learned_addr learned my addr 172.21.15.44:0/4288500175 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:28:42.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.737+0000 7fdcbbfff640 1 --2- 172.21.15.44:0/4288500175 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdcbc151fc0 0x7fdcbc0bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:42.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.737+0000 7fdcc0f45640 1 -- 172.21.15.44:0/4288500175 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdcbc151fc0 msgr2=0x7fdcbc0bd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:28:42.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.737+0000 7fdcc0f45640 1 --2- 172.21.15.44:0/4288500175 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdcbc151fc0 0x7fdcbc0bd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:42.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.737+0000 7fdcc0f45640 1 -- 172.21.15.44:0/4288500175 >> v1:172.21.15.70:6789/0 conn(0x7fdcbc06da30 legacy=0x7fdcbc0be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:43.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.737+0000 7fdcc0f45640 1 -- 172.21.15.44:0/4288500175 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcbc152810 con 0x7fdcbc0bf050 2024-05-16T22:28:43.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.738+0000 7fdcc0f45640 1 --2- 172.21.15.44:0/4288500175 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcbc0bf050 0x7fdcbc158e90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4009e50 tx=0x7fdcb402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d677b43d3ffca3f server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:43.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.738+0000 7fdcbaffd640 1 -- 172.21.15.44:0/4288500175 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb4036070 con 0x7fdcbc0bf050 2024-05-16T22:28:43.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.738+0000 7fdcbaffd640 1 -- 172.21.15.44:0/4288500175 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcb4031600 con 0x7fdcbc0bf050 2024-05-16T22:28:44.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.738+0000 7fdcbaffd640 1 -- 172.21.15.44:0/4288500175 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb40319d0 con 0x7fdcbc0bf050 2024-05-16T22:28:44.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.739+0000 7fdcc29a8640 1 -- 172.21.15.44:0/4288500175 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcbc0bf050 msgr2=0x7fdcbc158e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:44.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.739+0000 7fdcc29a8640 1 --2- 172.21.15.44:0/4288500175 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcbc0bf050 0x7fdcbc158e90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4009e50 tx=0x7fdcb402a680 comp rx=0 tx=0).stop 2024-05-16T22:28:44.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.739+0000 7fdcc29a8640 1 -- 172.21.15.44:0/4288500175 shutdown_connections 2024-05-16T22:28:44.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.739+0000 7fdcc29a8640 1 --2- 172.21.15.44:0/4288500175 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcbc0bf050 0x7fdcbc158e90 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:44.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.739+0000 7fdcc29a8640 1 --2- 172.21.15.44:0/4288500175 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdcbc151fc0 0x7fdcbc0bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:44.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.739+0000 7fdcc29a8640 1 -- 172.21.15.44:0/4288500175 >> 172.21.15.44:0/4288500175 conn(0x7fdcbc0c3d20 msgr2=0x7fdcbc0c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:28:44.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.739+0000 7fdcc29a8640 1 -- 172.21.15.44:0/4288500175 shutdown_connections 2024-05-16T22:28:44.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.739+0000 7fdcc29a8640 1 -- 172.21.15.44:0/4288500175 wait complete. 2024-05-16T22:28:44.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.740+0000 7fdcc29a8640 1 Processor -- start 2024-05-16T22:28:44.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.741+0000 7fdcc29a8640 1 -- start start 2024-05-16T22:28:44.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.742+0000 7fdcc29a8640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdcbc06da30 0x7fdcbc0b8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:44.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.742+0000 7fdcc29a8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcbc0bf050 0x7fdcbc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:44.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.742+0000 7fdcc29a8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcbc151fc0 0x7fdcbc0b5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:44.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.742+0000 7fdcc29a8640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdcbc0a3050 con 0x7fdcbc0bf050 2024-05-16T22:28:44.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.742+0000 7fdcc29a8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdcbc0a2ed0 con 0x7fdcbc151fc0 2024-05-16T22:28:44.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.742+0000 7fdcc29a8640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fdcbc06de40 con 0x7fdcbc06da30 2024-05-16T22:28:44.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.742+0000 7fdcbb7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcbc0bf050 0x7fdcbc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:44.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.742+0000 7fdcbb7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcbc0bf050 0x7fdcbc0b8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60856/0 (socket says 172.21.15.44:60856) 2024-05-16T22:28:44.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.742+0000 7fdcbb7fe640 1 -- 172.21.15.44:0/2463128501 learned_addr learned my addr 172.21.15.44:0/2463128501 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:28:44.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.742+0000 7fdcbbfff640 1 --2- 172.21.15.44:0/2463128501 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdcbc06da30 0x7fdcbc0b8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:44.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.742+0000 7fdcc0f45640 1 --2- 172.21.15.44:0/2463128501 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcbc151fc0 0x7fdcbc0b5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:44.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.742+0000 7fdcbb7fe640 1 -- 172.21.15.44:0/2463128501 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdcbc06da30 msgr2=0x7fdcbc0b8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:44.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.742+0000 7fdcbb7fe640 1 --2- 172.21.15.44:0/2463128501 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdcbc06da30 0x7fdcbc0b8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:44.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.742+0000 7fdcbb7fe640 1 -- 172.21.15.44:0/2463128501 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcbc151fc0 msgr2=0x7fdcbc0b5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:44.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.742+0000 7fdcbb7fe640 1 --2- 172.21.15.44:0/2463128501 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcbc151fc0 0x7fdcbc0b5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:45.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.742+0000 7fdcbb7fe640 1 -- 172.21.15.44:0/2463128501 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcbc0b8540 con 0x7fdcbc0bf050 2024-05-16T22:28:45.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.742+0000 7fdcbb7fe640 1 --2- 172.21.15.44:0/2463128501 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcbc0bf050 0x7fdcbc0b8a20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdcb000c3a0 tx=0x7fdcb000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:45.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.743+0000 7fdcb8ff9640 1 -- 172.21.15.44:0/2463128501 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb0017070 con 0x7fdcbc0bf050 2024-05-16T22:28:45.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.743+0000 7fdcb8ff9640 1 -- 172.21.15.44:0/2463128501 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcb00052d0 con 0x7fdcbc0bf050 2024-05-16T22:28:45.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.743+0000 7fdcc29a8640 1 -- 172.21.15.44:0/2463128501 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcbc0b8f60 con 0x7fdcbc0bf050 2024-05-16T22:28:45.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.743+0000 7fdcb8ff9640 1 -- 172.21.15.44:0/2463128501 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb0003830 con 0x7fdcbc0bf050 2024-05-16T22:28:45.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.743+0000 7fdcc29a8640 1 -- 172.21.15.44:0/2463128501 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcbc0a3ad0 con 0x7fdcbc0bf050 2024-05-16T22:28:45.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.744+0000 7fdcc29a8640 1 -- 172.21.15.44:0/2463128501 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcbc150a80 con 0x7fdcbc0bf050 2024-05-16T22:28:45.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.745+0000 7fdcb8ff9640 1 -- 172.21.15.44:0/2463128501 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdcb001a070 con 0x7fdcbc0bf050 2024-05-16T22:28:45.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.745+0000 7fdcb8ff9640 1 --2- 172.21.15.44:0/2463128501 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fdca8076300 0x7fdca8078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:45.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.745+0000 7fdcb8ff9640 1 -- 172.21.15.44:0/2463128501 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fdcb00968e0 con 0x7fdcbc0bf050 2024-05-16T22:28:45.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.745+0000 7fdcbbfff640 1 --2- 172.21.15.44:0/2463128501 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fdca8076300 0x7fdca8078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:45.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.746+0000 7fdcbbfff640 1 --2- 172.21.15.44:0/2463128501 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fdca8076300 0x7fdca8078810 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdcac009aa0 tx=0x7fdcac009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:45.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.750+0000 7fdcb8ff9640 1 -- 172.21.15.44:0/2463128501 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fdcbc150a80 con 0x7fdcbc0bf050 2024-05-16T22:28:45.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.981+0000 7fdcc29a8640 1 -- 172.21.15.44:0/2463128501 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdcbc050940 con 0x7fdcbc0bf050 2024-05-16T22:28:45.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.981+0000 7fdcb8ff9640 1 -- 172.21.15.44:0/2463128501 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+4357 (secure 0 0 0) 0x7fdcb0068230 con 0x7fdcbc0bf050 2024-05-16T22:28:45.561 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:28:45.594 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4657,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3963814730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3963814730},{"type":"v1","addr":"172.21.15.70:6835","nonce":3963814730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4672,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/3024807024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3024807024},{"type":"v1","addr":"172.21.15.44:6835","nonce":3024807024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T22:28:26.864128+0000","modified":"2024-05-16T22:28:38.972823+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4728},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4728":{"gid":4728,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.44:6834/2647971069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2647971069},{"type":"v1","addr":"172.21.15.44:6834","nonce":2647971069}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4728,"qdb_cluster":[4728]},"id":2}]} 2024-05-16T22:28:45.629 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 16 2024-05-16T22:28:45.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.983+0000 7fdcc29a8640 1 -- 172.21.15.44:0/2463128501 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fdca8076300 msgr2=0x7fdca8078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:45.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.983+0000 7fdcc29a8640 1 --2- 172.21.15.44:0/2463128501 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fdca8076300 0x7fdca8078810 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdcac009aa0 tx=0x7fdcac009190 comp rx=0 tx=0).stop 2024-05-16T22:28:45.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.983+0000 7fdcc29a8640 1 -- 172.21.15.44:0/2463128501 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcbc0bf050 msgr2=0x7fdcbc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:45.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.983+0000 7fdcc29a8640 1 --2- 172.21.15.44:0/2463128501 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcbc0bf050 0x7fdcbc0b8a20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdcb000c3a0 tx=0x7fdcb000c860 comp rx=0 tx=0).stop 2024-05-16T22:28:45.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.983+0000 7fdcc29a8640 1 -- 172.21.15.44:0/2463128501 shutdown_connections 2024-05-16T22:28:45.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.983+0000 7fdcc29a8640 1 --2- 172.21.15.44:0/2463128501 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fdca8076300 0x7fdca8078810 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:45.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.983+0000 7fdcc29a8640 1 --2- 172.21.15.44:0/2463128501 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcbc151fc0 0x7fdcbc0b5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:45.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.983+0000 7fdcc29a8640 1 --2- 172.21.15.44:0/2463128501 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcbc0bf050 0x7fdcbc0b8a20 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:45.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.983+0000 7fdcc29a8640 1 --2- 172.21.15.44:0/2463128501 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdcbc06da30 0x7fdcbc0b8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:46.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.983+0000 7fdcc29a8640 1 -- 172.21.15.44:0/2463128501 >> 172.21.15.44:0/2463128501 conn(0x7fdcbc0c3d20 msgr2=0x7fdcbc0c09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:28:46.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.983+0000 7fdcc29a8640 1 -- 172.21.15.44:0/2463128501 shutdown_connections 2024-05-16T22:28:46.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:41.983+0000 7fdcc29a8640 1 -- 172.21.15.44:0/2463128501 wait complete. 2024-05-16T22:28:46.112 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-16T22:28:46.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.273+0000 7f85495e3640 1 Processor -- start 2024-05-16T22:28:46.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.273+0000 7f85495e3640 1 -- start start 2024-05-16T22:28:46.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.274+0000 7f85495e3640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f8544151fc0 0x7f85440bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:46.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.274+0000 7f85495e3640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85440bf050 0x7f8544158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:46.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.274+0000 7f85495e3640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85440c36f0 con 0x7f854406da30 2024-05-16T22:28:46.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.274+0000 7f85495e3640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f85440bdc10 con 0x7f8544151fc0 2024-05-16T22:28:46.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.274+0000 7f85495e3640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f8544152530 con 0x7f85440bf050 2024-05-16T22:28:46.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.275+0000 7f85437fe640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85440bf050 0x7f8544158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:46.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.275+0000 7f8542ffd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f8544151fc0 0x7f85440bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:46.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.275+0000 7f85427fc640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f854406da30 0x7f85440be940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.44:51042/0 (socket says 172.21.15.44:51042) 2024-05-16T22:28:46.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.275+0000 7f85427fc640 1 -- 172.21.15.44:0/206478637 learned_addr learned my addr 172.21.15.44:0/206478637 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:28:46.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.275+0000 7f8541ffb640 1 -- 172.21.15.44:0/206478637 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1783799590 0 0) 0x7f85440c36f0 con 0x7f854406da30 2024-05-16T22:28:46.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.275+0000 7f8541ffb640 1 -- 172.21.15.44:0/206478637 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f852c003520 con 0x7f854406da30 2024-05-16T22:28:46.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.275+0000 7f85437fe640 1 -- 172.21.15.44:0/206478637 >> v2:172.21.15.70:3300/0 conn(0x7f8544151fc0 msgr2=0x7f85440bd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:28:46.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.275+0000 7f85437fe640 1 --2- 172.21.15.44:0/206478637 >> v2:172.21.15.70:3300/0 conn(0x7f8544151fc0 0x7f85440bd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:46.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.275+0000 7f85437fe640 1 -- 172.21.15.44:0/206478637 >> v1:172.21.15.70:6789/0 conn(0x7f854406da30 legacy=0x7f85440be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:46.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.275+0000 7f85437fe640 1 -- 172.21.15.44:0/206478637 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8544152810 con 0x7f85440bf050 2024-05-16T22:28:46.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.275+0000 7f8542ffd640 1 --2- 172.21.15.44:0/206478637 >> v2:172.21.15.70:3300/0 conn(0x7f8544151fc0 0x7f85440bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:28:46.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.276+0000 7f85437fe640 1 --2- 172.21.15.44:0/206478637 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85440bf050 0x7f8544158e90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f853c0097a0 tx=0x7f853c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55d602615315f354 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:46.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.276+0000 7f8541ffb640 1 -- 172.21.15.44:0/206478637 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853c037070 con 0x7f85440bf050 2024-05-16T22:28:47.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.276+0000 7f8541ffb640 1 -- 172.21.15.44:0/206478637 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f853c02ae50 con 0x7f85440bf050 2024-05-16T22:28:47.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.276+0000 7f8541ffb640 1 -- 172.21.15.44:0/206478637 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853c032660 con 0x7f85440bf050 2024-05-16T22:28:47.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.277+0000 7f85495e3640 1 -- 172.21.15.44:0/206478637 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85440bf050 msgr2=0x7f8544158e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:47.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.277+0000 7f85495e3640 1 --2- 172.21.15.44:0/206478637 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85440bf050 0x7f8544158e90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f853c0097a0 tx=0x7f853c02a100 comp rx=0 tx=0).stop 2024-05-16T22:28:47.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.277+0000 7f85495e3640 1 -- 172.21.15.44:0/206478637 shutdown_connections 2024-05-16T22:28:47.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.277+0000 7f85495e3640 1 --2- 172.21.15.44:0/206478637 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85440bf050 0x7f8544158e90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:47.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.277+0000 7f85495e3640 1 --2- 172.21.15.44:0/206478637 >> v2:172.21.15.70:3300/0 conn(0x7f8544151fc0 0x7f85440bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:47.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.277+0000 7f85495e3640 1 -- 172.21.15.44:0/206478637 >> 172.21.15.44:0/206478637 conn(0x7f85440c3d20 msgr2=0x7f85440c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:28:47.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.277+0000 7f85495e3640 1 -- 172.21.15.44:0/206478637 shutdown_connections 2024-05-16T22:28:47.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.277+0000 7f85495e3640 1 -- 172.21.15.44:0/206478637 wait complete. 2024-05-16T22:28:47.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.279+0000 7f85495e3640 1 Processor -- start 2024-05-16T22:28:47.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.279+0000 7f85495e3640 1 -- start start 2024-05-16T22:28:47.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.280+0000 7f85495e3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f854406da30 0x7f85440b8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:47.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.280+0000 7f85495e3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85440bf050 0x7f85440b7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:47.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.280+0000 7f85495e3640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8544151fc0 0x7f85441506e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:47.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.280+0000 7f85495e3640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f85440a3050 con 0x7f85440bf050 2024-05-16T22:28:47.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.280+0000 7f85495e3640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f85440a2ed0 con 0x7f854406da30 2024-05-16T22:28:47.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.280+0000 7f85495e3640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f854406de40 con 0x7f8544151fc0 2024-05-16T22:28:47.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.280+0000 7f85427fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85440bf050 0x7f85440b7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:47.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.280+0000 7f8542ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f854406da30 0x7f85440b8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:47.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.280+0000 7f8542ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f854406da30 0x7f85440b8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.44:35126/0 (socket says 172.21.15.44:35126) 2024-05-16T22:28:47.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.280+0000 7f8542ffd640 1 -- 172.21.15.44:0/603810107 learned_addr learned my addr 172.21.15.44:0/603810107 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:28:47.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.280+0000 7f85437fe640 1 --2- 172.21.15.44:0/603810107 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8544151fc0 0x7f85441506e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:47.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.280+0000 7f8542ffd640 1 -- 172.21.15.44:0/603810107 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8544151fc0 msgr2=0x7f85441506e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:47.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.280+0000 7f8542ffd640 1 --2- 172.21.15.44:0/603810107 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8544151fc0 0x7f85441506e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:47.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.280+0000 7f8542ffd640 1 -- 172.21.15.44:0/603810107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85440bf050 msgr2=0x7f85440b7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:47.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.280+0000 7f8542ffd640 1 --2- 172.21.15.44:0/603810107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85440bf050 0x7f85440b7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:47.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.280+0000 7f8542ffd640 1 -- 172.21.15.44:0/603810107 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85440b9230 con 0x7f854406da30 2024-05-16T22:28:47.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.280+0000 7f85427fc640 1 --2- 172.21.15.44:0/603810107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85440bf050 0x7f85440b7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:28:48.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.280+0000 7f8542ffd640 1 --2- 172.21.15.44:0/603810107 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f854406da30 0x7f85440b8cf0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f853400efc0 tx=0x7f853400c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:48.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.281+0000 7f852b7fe640 1 -- 172.21.15.44:0/603810107 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8534018020 con 0x7f854406da30 2024-05-16T22:28:48.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.281+0000 7f852b7fe640 1 -- 172.21.15.44:0/603810107 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8534014680 con 0x7f854406da30 2024-05-16T22:28:48.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.281+0000 7f85495e3640 1 -- 172.21.15.44:0/603810107 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85440b8030 con 0x7f854406da30 2024-05-16T22:28:48.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.281+0000 7f852b7fe640 1 -- 172.21.15.44:0/603810107 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8534014a50 con 0x7f854406da30 2024-05-16T22:28:48.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.281+0000 7f85495e3640 1 -- 172.21.15.44:0/603810107 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85441e4e40 con 0x7f854406da30 2024-05-16T22:28:48.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.282+0000 7f85495e3640 1 -- 172.21.15.44:0/603810107 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85440c10e0 con 0x7f854406da30 2024-05-16T22:28:48.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.283+0000 7f852b7fe640 1 -- 172.21.15.44:0/603810107 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8534005d10 con 0x7f854406da30 2024-05-16T22:28:48.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.283+0000 7f852b7fe640 1 --2- 172.21.15.44:0/603810107 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f8530076300 0x7f8530078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:48.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.283+0000 7f852b7fe640 1 -- 172.21.15.44:0/603810107 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f8534098990 con 0x7f854406da30 2024-05-16T22:28:48.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.283+0000 7f85427fc640 1 --2- 172.21.15.44:0/603810107 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f8530076300 0x7f8530078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:48.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.284+0000 7f85427fc640 1 --2- 172.21.15.44:0/603810107 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f8530076300 0x7f8530078810 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8538007a60 tx=0x7f85380079b0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:48.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.288+0000 7f852b7fe640 1 -- 172.21.15.44:0/603810107 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f85440c10e0 con 0x7f854406da30 2024-05-16T22:28:48.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.478+0000 7f85495e3640 1 -- 172.21.15.44:0/603810107 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8544050970 con 0x7f854406da30 2024-05-16T22:28:48.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.480+0000 7f852b7fe640 1 -- 172.21.15.44:0/603810107 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16633 (secure 0 0 0) 0x7f8534022030 con 0x7f854406da30 2024-05-16T22:28:48.581 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:28:48.614 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":34,"fsid":"572ab7cc-b103-4548-ae8f-c6614d57f0c8","created":"2024-05-16T22:27:02.216874+0000","modified":"2024-05-16T22:28:26.864181+0000","last_up_change":"2024-05-16T22:27:13.693953+0000","last_in_change":"2024-05-16T22:27:04.455119+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-16T22:27:14.562409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-16T22:28:20.181977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-16T22:28:23.815306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a7003e89-c706-4562-9f25-670bb35ae108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6825","nonce":1074109859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6827","nonce":1074109859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6831","nonce":1074109859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6829","nonce":1074109859}]},"public_addr":"172.21.15.44:6825/1074109859","cluster_addr":"172.21.15.44:6827/1074109859","heartbeat_back_addr":"172.21.15.44:6831/1074109859","heartbeat_front_addr":"172.21.15.44:6829/1074109859","state":["exists","up"]},{"osd":1,"uuid":"a4d5169d-8327-4494-9c7c-58db21b00636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6817","nonce":2909429972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6819","nonce":2909429972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6823","nonce":2909429972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6821","nonce":2909429972}]},"public_addr":"172.21.15.44:6817/2909429972","cluster_addr":"172.21.15.44:6819/2909429972","heartbeat_back_addr":"172.21.15.44:6823/2909429972","heartbeat_front_addr":"172.21.15.44:6821/2909429972","state":["exists","up"]},{"osd":2,"uuid":"d4a834f8-83a5-400f-9814-eb0a25124df4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6801","nonce":2908194156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6803","nonce":2908194156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6807","nonce":2908194156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6805","nonce":2908194156}]},"public_addr":"172.21.15.44:6801/2908194156","cluster_addr":"172.21.15.44:6803/2908194156","heartbeat_back_addr":"172.21.15.44:6807/2908194156","heartbeat_front_addr":"172.21.15.44:6805/2908194156","state":["exists","up"]},{"osd":3,"uuid":"b9d24a56-ad43-4674-a395-5ec24d135ae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6809","nonce":2168695793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6811","nonce":2168695793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6815","nonce":2168695793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6813","nonce":2168695793}]},"public_addr":"172.21.15.44:6809/2168695793","cluster_addr":"172.21.15.44:6811/2168695793","heartbeat_back_addr":"172.21.15.44:6815/2168695793","heartbeat_front_addr":"172.21.15.44:6813/2168695793","state":["exists","up"]},{"osd":4,"uuid":"9bd94af5-3e17-4cbe-995a-8f837a66c653","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6823","nonce":1540297751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6825","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6827","nonce":1540297751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6831","nonce":1540297751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6829","nonce":1540297751}]},"public_addr":"172.21.15.70:6823/1540297751","cluster_addr":"172.21.15.70:6827/1540297751","heartbeat_back_addr":"172.21.15.70:6831/1540297751","heartbeat_front_addr":"172.21.15.70:6829/1540297751","state":["exists","up"]},{"osd":5,"uuid":"a5b0cfa5-b259-48bd-98b6-96b44f5ebabd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6804","nonce":4218901987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6808","nonce":4218901987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6815","nonce":4218901987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6812","nonce":4218901987}]},"public_addr":"172.21.15.70:6804/4218901987","cluster_addr":"172.21.15.70:6808/4218901987","heartbeat_back_addr":"172.21.15.70:6815/4218901987","heartbeat_front_addr":"172.21.15.70:6812/4218901987","state":["exists","up"]},{"osd":6,"uuid":"0b6af6df-1358-4fc6-a62c-ba57e02914ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6801","nonce":2389556489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6805","nonce":2389556489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6813","nonce":2389556489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6807","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6809","nonce":2389556489}]},"public_addr":"172.21.15.70:6801/2389556489","cluster_addr":"172.21.15.70:6805/2389556489","heartbeat_back_addr":"172.21.15.70:6813/2389556489","heartbeat_front_addr":"172.21.15.70:6809/2389556489","state":["exists","up"]},{"osd":7,"uuid":"eb1a2c5d-42cf-47d0-9e03-b9d26944a589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6817","nonce":3619691281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6819","nonce":3619691281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6826","nonce":3619691281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6822","nonce":3619691281}]},"public_addr":"172.21.15.70:6817/3619691281","cluster_addr":"172.21.15.70:6819/3619691281","heartbeat_back_addr":"172.21.15.70:6826/3619691281","heartbeat_front_addr":"172.21.15.70:6822/3619691281","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.652256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.613348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.528454+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.625204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.678845+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.680829+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.556200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.647030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T22:28:48.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.482+0000 7f85495e3640 1 -- 172.21.15.44:0/603810107 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f8530076300 msgr2=0x7f8530078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:48.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.482+0000 7f85495e3640 1 --2- 172.21.15.44:0/603810107 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f8530076300 0x7f8530078810 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8538007a60 tx=0x7f85380079b0 comp rx=0 tx=0).stop 2024-05-16T22:28:48.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.482+0000 7f85495e3640 1 -- 172.21.15.44:0/603810107 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f854406da30 msgr2=0x7f85440b8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:48.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.482+0000 7f85495e3640 1 --2- 172.21.15.44:0/603810107 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f854406da30 0x7f85440b8cf0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f853400efc0 tx=0x7f853400c490 comp rx=0 tx=0).stop 2024-05-16T22:28:48.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.482+0000 7f85495e3640 1 -- 172.21.15.44:0/603810107 shutdown_connections 2024-05-16T22:28:48.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.482+0000 7f85495e3640 1 --2- 172.21.15.44:0/603810107 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f8530076300 0x7f8530078810 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:48.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.482+0000 7f85495e3640 1 --2- 172.21.15.44:0/603810107 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8544151fc0 0x7f85441506e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:48.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.482+0000 7f85495e3640 1 --2- 172.21.15.44:0/603810107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85440bf050 0x7f85440b7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:48.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.482+0000 7f85495e3640 1 --2- 172.21.15.44:0/603810107 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f854406da30 0x7f85440b8cf0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:49.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.482+0000 7f85495e3640 1 -- 172.21.15.44:0/603810107 >> 172.21.15.44:0/603810107 conn(0x7f85440c3d20 msgr2=0x7f85440c09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:28:49.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.482+0000 7f85495e3640 1 -- 172.21.15.44:0/603810107 shutdown_connections 2024-05-16T22:28:49.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:46.482+0000 7f85495e3640 1 -- 172.21.15.44:0/603810107 wait complete. 2024-05-16T22:28:49.123 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-16T22:28:49.156 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-16T22:28:49.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.312+0000 7f458cf86640 1 Processor -- start 2024-05-16T22:28:49.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.312+0000 7f458cf86640 1 -- start start 2024-05-16T22:28:49.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.313+0000 7f458cf86640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4588151fc0 0x7f45880bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:49.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.313+0000 7f458cf86640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f45880bf050 0x7f4588158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:49.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.313+0000 7f458cf86640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45880c36f0 con 0x7f458806da30 2024-05-16T22:28:49.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.313+0000 7f458cf86640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f45880bdc10 con 0x7f4588151fc0 2024-05-16T22:28:49.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.313+0000 7f458cf86640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f4588152530 con 0x7f45880bf050 2024-05-16T22:28:49.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.314+0000 7f4585d9b640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f458806da30 0x7f45880be940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:39546/0 (socket says 172.21.15.44:39546) 2024-05-16T22:28:49.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.314+0000 7f4585d9b640 1 -- 172.21.15.44:0/2113093842 learned_addr learned my addr 172.21.15.44:0/2113093842 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:28:49.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.314+0000 7f458659c640 1 --2- 172.21.15.44:0/2113093842 >> v2:172.21.15.70:3300/0 conn(0x7f4588151fc0 0x7f45880bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:49.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.314+0000 7f4586d9d640 1 --2- 172.21.15.44:0/2113093842 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f45880bf050 0x7f4588158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:49.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.314+0000 7f458559a640 1 -- 172.21.15.44:0/2113093842 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4128829003 0 0) 0x7f45880c36f0 con 0x7f458806da30 2024-05-16T22:28:49.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.314+0000 7f458559a640 1 -- 172.21.15.44:0/2113093842 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4574003520 con 0x7f458806da30 2024-05-16T22:28:49.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.314+0000 7f458559a640 1 -- 172.21.15.44:0/2113093842 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2013117215 0 0) 0x7f4574003520 con 0x7f458806da30 2024-05-16T22:28:49.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.314+0000 7f458659c640 1 -- 172.21.15.44:0/2113093842 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f45880bf050 msgr2=0x7f4588158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:28:49.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.314+0000 7f458659c640 1 --2- 172.21.15.44:0/2113093842 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f45880bf050 0x7f4588158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:49.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.314+0000 7f458659c640 1 -- 172.21.15.44:0/2113093842 >> v1:172.21.15.44:6789/0 conn(0x7f458806da30 legacy=0x7f45880be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:49.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.314+0000 7f458659c640 1 -- 172.21.15.44:0/2113093842 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4588152810 con 0x7f4588151fc0 2024-05-16T22:28:49.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.314+0000 7f4586d9d640 1 --2- 172.21.15.44:0/2113093842 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f45880bf050 0x7f4588158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:28:49.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.315+0000 7f458659c640 1 --2- 172.21.15.44:0/2113093842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4588151fc0 0x7f45880bd6d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f45800097a0 tx=0x7f458002a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6369e719ee0a967 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:50.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.315+0000 7f458559a640 1 -- 172.21.15.44:0/2113093842 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4580037070 con 0x7f4588151fc0 2024-05-16T22:28:50.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.315+0000 7f458559a640 1 -- 172.21.15.44:0/2113093842 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f458002ab10 con 0x7f4588151fc0 2024-05-16T22:28:50.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.315+0000 7f458559a640 1 -- 172.21.15.44:0/2113093842 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45700016f0 con 0x7f4588151fc0 2024-05-16T22:28:50.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.316+0000 7f458cf86640 1 -- 172.21.15.44:0/2113093842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4588151fc0 msgr2=0x7f45880bd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:50.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.316+0000 7f458cf86640 1 --2- 172.21.15.44:0/2113093842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4588151fc0 0x7f45880bd6d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f45800097a0 tx=0x7f458002a080 comp rx=0 tx=0).stop 2024-05-16T22:28:50.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.316+0000 7f458cf86640 1 -- 172.21.15.44:0/2113093842 shutdown_connections 2024-05-16T22:28:50.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.316+0000 7f458cf86640 1 --2- 172.21.15.44:0/2113093842 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f45880bf050 0x7f4588158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:50.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.316+0000 7f458cf86640 1 --2- 172.21.15.44:0/2113093842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4588151fc0 0x7f45880bd6d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:50.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.316+0000 7f458cf86640 1 -- 172.21.15.44:0/2113093842 >> 172.21.15.44:0/2113093842 conn(0x7f45880c3d20 msgr2=0x7f45880c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:28:50.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.316+0000 7f458cf86640 1 -- 172.21.15.44:0/2113093842 shutdown_connections 2024-05-16T22:28:50.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.316+0000 7f458cf86640 1 -- 172.21.15.44:0/2113093842 wait complete. 2024-05-16T22:28:50.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.318+0000 7f458cf86640 1 Processor -- start 2024-05-16T22:28:50.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.318+0000 7f458cf86640 1 -- start start 2024-05-16T22:28:50.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.319+0000 7f458cf86640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f458806da30 0x7f45881e47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:50.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.319+0000 7f458cf86640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f45880bf050 0x7f45880a2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:50.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.319+0000 7f458cf86640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4588151fc0 0x7f458814b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:50.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.319+0000 7f458cf86640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f45880a3050 con 0x7f45880bf050 2024-05-16T22:28:50.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.319+0000 7f458cf86640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f45880a2ed0 con 0x7f4588151fc0 2024-05-16T22:28:50.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.319+0000 7f458cf86640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f458806de40 con 0x7f458806da30 2024-05-16T22:28:50.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.319+0000 7f4585d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f45880bf050 0x7f45880a2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:50.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.319+0000 7f4585d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f45880bf050 0x7f45880a2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60870/0 (socket says 172.21.15.44:60870) 2024-05-16T22:28:50.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.319+0000 7f4585d9b640 1 -- 172.21.15.44:0/1721294029 learned_addr learned my addr 172.21.15.44:0/1721294029 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:28:50.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.319+0000 7f458659c640 1 --2- 172.21.15.44:0/1721294029 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f458806da30 0x7f45881e47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:50.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.319+0000 7f4586d9d640 1 --2- 172.21.15.44:0/1721294029 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4588151fc0 0x7f458814b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:50.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.319+0000 7f4585d9b640 1 -- 172.21.15.44:0/1721294029 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f458806da30 msgr2=0x7f45881e47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:50.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.319+0000 7f4585d9b640 1 --2- 172.21.15.44:0/1721294029 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f458806da30 0x7f45881e47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:50.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.319+0000 7f4585d9b640 1 -- 172.21.15.44:0/1721294029 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4588151fc0 msgr2=0x7f458814b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:50.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.319+0000 7f4585d9b640 1 --2- 172.21.15.44:0/1721294029 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4588151fc0 0x7f458814b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:51.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.319+0000 7f4585d9b640 1 -- 172.21.15.44:0/1721294029 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45881e4d10 con 0x7f45880bf050 2024-05-16T22:28:51.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.320+0000 7f4585d9b640 1 --2- 172.21.15.44:0/1721294029 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f45880bf050 0x7f45880a2340 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f457000c530 tx=0x7f457000c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:51.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.320+0000 7f457effd640 1 -- 172.21.15.44:0/1721294029 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4570017070 con 0x7f45880bf050 2024-05-16T22:28:51.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.320+0000 7f457effd640 1 -- 172.21.15.44:0/1721294029 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4570005ce0 con 0x7f45880bf050 2024-05-16T22:28:51.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.320+0000 7f457effd640 1 -- 172.21.15.44:0/1721294029 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45700072f0 con 0x7f45880bf050 2024-05-16T22:28:51.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.320+0000 7f458cf86640 1 -- 172.21.15.44:0/1721294029 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45881e42f0 con 0x7f45880bf050 2024-05-16T22:28:51.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.320+0000 7f458cf86640 1 -- 172.21.15.44:0/1721294029 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45880ba520 con 0x7f45880bf050 2024-05-16T22:28:51.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.321+0000 7f458cf86640 1 -- 172.21.15.44:0/1721294029 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4588151d30 con 0x7f45880bf050 2024-05-16T22:28:51.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.322+0000 7f457effd640 1 -- 172.21.15.44:0/1721294029 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f457001a070 con 0x7f45880bf050 2024-05-16T22:28:51.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.322+0000 7f457effd640 1 --2- 172.21.15.44:0/1721294029 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f45680762d0 0x7f45680787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:51.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.322+0000 7f457effd640 1 -- 172.21.15.44:0/1721294029 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f4570096940 con 0x7f45880bf050 2024-05-16T22:28:51.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.322+0000 7f458659c640 1 --2- 172.21.15.44:0/1721294029 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f45680762d0 0x7f45680787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:51.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.323+0000 7f458659c640 1 --2- 172.21.15.44:0/1721294029 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f45680762d0 0x7f45680787e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4580034000 tx=0x7f458002e000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:51.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.327+0000 7f457effd640 1 -- 172.21.15.44:0/1721294029 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f457005fbb0 con 0x7f45880bf050 2024-05-16T22:28:51.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.513+0000 7f458cf86640 1 -- 172.21.15.44:0/1721294029 --> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f45881e44c0 con 0x7f45680762d0 2024-05-16T22:28:51.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.520+0000 7f457effd640 1 -- 172.21.15.44:0/1721294029 <== mgr.4114 v2:172.21.15.70:6832/4049588098 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251820 (secure 0 0 0) 0x7f45881e44c0 con 0x7f45680762d0 2024-05-16T22:28:51.605 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:28:51.637 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-05-16T22:28:51.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.523+0000 7f458cf86640 1 -- 172.21.15.44:0/1721294029 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f45680762d0 msgr2=0x7f45680787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:51.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.523+0000 7f458cf86640 1 --2- 172.21.15.44:0/1721294029 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f45680762d0 0x7f45680787e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4580034000 tx=0x7f458002e000 comp rx=0 tx=0).stop 2024-05-16T22:28:51.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.523+0000 7f458cf86640 1 -- 172.21.15.44:0/1721294029 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f45880bf050 msgr2=0x7f45880a2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:51.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.523+0000 7f458cf86640 1 --2- 172.21.15.44:0/1721294029 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f45880bf050 0x7f45880a2340 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f457000c530 tx=0x7f457000c930 comp rx=0 tx=0).stop 2024-05-16T22:28:51.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.523+0000 7f458cf86640 1 -- 172.21.15.44:0/1721294029 shutdown_connections 2024-05-16T22:28:51.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.523+0000 7f458cf86640 1 --2- 172.21.15.44:0/1721294029 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f45680762d0 0x7f45680787e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:51.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.523+0000 7f458cf86640 1 --2- 172.21.15.44:0/1721294029 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4588151fc0 0x7f458814b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:51.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.523+0000 7f458cf86640 1 --2- 172.21.15.44:0/1721294029 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f45880bf050 0x7f45880a2340 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:51.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.523+0000 7f458cf86640 1 --2- 172.21.15.44:0/1721294029 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f458806da30 0x7f45881e47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:51.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.523+0000 7f458cf86640 1 -- 172.21.15.44:0/1721294029 >> 172.21.15.44:0/1721294029 conn(0x7f45880c3d20 msgr2=0x7f45880c09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:28:52.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.523+0000 7f458cf86640 1 -- 172.21.15.44:0/1721294029 shutdown_connections 2024-05-16T22:28:52.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:49.523+0000 7f458cf86640 1 -- 172.21.15.44:0/1721294029 wait complete. 2024-05-16T22:28:52.086 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2024-05-16T22:28:48.566282+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237040,"kb_used_data":4232,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737680,"statfs":{"total":773094113280,"available":772851384320,"internally_reserved":0,"allocated":4333568,"data_stored":2388228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003699"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.146970+0000","last_change":"2024-05-16T22:28:25.133922+0000","last_active":"2024-05-16T22:28:27.146970+0000","last_peered":"2024-05-16T22:28:27.146970+0000","last_clean":"2024-05-16T22:28:27.146970+0000","last_became_active":"2024-05-16T22:28:25.133614+0000","last_became_peered":"2024-05-16T22:28:25.133614+0000","last_unstale":"2024-05-16T22:28:27.146970+0000","last_undegraded":"2024-05-16T22:28:27.146970+0000","last_fullsized":"2024-05-16T22:28:27.146970+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:30:28.275470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.135885+0000","last_change":"2024-05-16T22:28:25.132180+0000","last_active":"2024-05-16T22:28:27.135885+0000","last_peered":"2024-05-16T22:28:27.135885+0000","last_clean":"2024-05-16T22:28:27.135885+0000","last_became_active":"2024-05-16T22:28:25.131840+0000","last_became_peered":"2024-05-16T22:28:25.131840+0000","last_unstale":"2024-05-16T22:28:27.135885+0000","last_undegraded":"2024-05-16T22:28:27.135885+0000","last_fullsized":"2024-05-16T22:28:27.135885+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:01:04.890716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.147507+0000","last_change":"2024-05-16T22:28:25.145313+0000","last_active":"2024-05-16T22:28:27.147507+0000","last_peered":"2024-05-16T22:28:27.147507+0000","last_clean":"2024-05-16T22:28:27.147507+0000","last_became_active":"2024-05-16T22:28:25.145018+0000","last_became_peered":"2024-05-16T22:28:25.145018+0000","last_unstale":"2024-05-16T22:28:27.147507+0000","last_undegraded":"2024-05-16T22:28:27.147507+0000","last_fullsized":"2024-05-16T22:28:27.147507+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:04:53.410394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.146228+0000","last_change":"2024-05-16T22:28:25.140103+0000","last_active":"2024-05-16T22:28:27.146228+0000","last_peered":"2024-05-16T22:28:27.146228+0000","last_clean":"2024-05-16T22:28:27.146228+0000","last_became_active":"2024-05-16T22:28:25.139693+0000","last_became_peered":"2024-05-16T22:28:25.139693+0000","last_unstale":"2024-05-16T22:28:27.146228+0000","last_undegraded":"2024-05-16T22:28:27.146228+0000","last_fullsized":"2024-05-16T22:28:27.146228+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:22:47.810153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.149954+0000","last_change":"2024-05-16T22:28:25.139319+0000","last_active":"2024-05-16T22:28:27.149954+0000","last_peered":"2024-05-16T22:28:27.149954+0000","last_clean":"2024-05-16T22:28:27.149954+0000","last_became_active":"2024-05-16T22:28:25.138050+0000","last_became_peered":"2024-05-16T22:28:25.138050+0000","last_unstale":"2024-05-16T22:28:27.149954+0000","last_undegraded":"2024-05-16T22:28:27.149954+0000","last_fullsized":"2024-05-16T22:28:27.149954+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:15:12.398211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.135678+0000","last_change":"2024-05-16T22:28:25.135924+0000","last_active":"2024-05-16T22:28:27.135678+0000","last_peered":"2024-05-16T22:28:27.135678+0000","last_clean":"2024-05-16T22:28:27.135678+0000","last_became_active":"2024-05-16T22:28:25.133351+0000","last_became_peered":"2024-05-16T22:28:25.133351+0000","last_unstale":"2024-05-16T22:28:27.135678+0000","last_undegraded":"2024-05-16T22:28:27.135678+0000","last_fullsized":"2024-05-16T22:28:27.135678+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:13:11.271883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.136093+0000","last_change":"2024-05-16T22:28:25.135384+0000","last_active":"2024-05-16T22:28:27.136093+0000","last_peered":"2024-05-16T22:28:27.136093+0000","last_clean":"2024-05-16T22:28:27.136093+0000","last_became_active":"2024-05-16T22:28:25.135086+0000","last_became_peered":"2024-05-16T22:28:25.135086+0000","last_unstale":"2024-05-16T22:28:27.136093+0000","last_undegraded":"2024-05-16T22:28:27.136093+0000","last_fullsized":"2024-05-16T22:28:27.136093+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:13:11.271883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.135682+0000","last_change":"2024-05-16T22:28:25.141069+0000","last_active":"2024-05-16T22:28:27.135682+0000","last_peered":"2024-05-16T22:28:27.135682+0000","last_clean":"2024-05-16T22:28:27.135682+0000","last_became_active":"2024-05-16T22:28:25.140719+0000","last_became_peered":"2024-05-16T22:28:25.140719+0000","last_unstale":"2024-05-16T22:28:27.135682+0000","last_undegraded":"2024-05-16T22:28:27.135682+0000","last_fullsized":"2024-05-16T22:28:27.135682+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:17:44.297474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.149715+0000","last_change":"2024-05-16T22:28:25.142859+0000","last_active":"2024-05-16T22:28:27.149715+0000","last_peered":"2024-05-16T22:28:27.149715+0000","last_clean":"2024-05-16T22:28:27.149715+0000","last_became_active":"2024-05-16T22:28:25.142576+0000","last_became_peered":"2024-05-16T22:28:25.142576+0000","last_unstale":"2024-05-16T22:28:27.149715+0000","last_undegraded":"2024-05-16T22:28:27.149715+0000","last_fullsized":"2024-05-16T22:28:27.149715+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:30:56.649366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.145532+0000","last_change":"2024-05-16T22:28:25.144818+0000","last_active":"2024-05-16T22:28:27.145532+0000","last_peered":"2024-05-16T22:28:27.145532+0000","last_clean":"2024-05-16T22:28:27.145532+0000","last_became_active":"2024-05-16T22:28:25.144459+0000","last_became_peered":"2024-05-16T22:28:25.144459+0000","last_unstale":"2024-05-16T22:28:27.145532+0000","last_undegraded":"2024-05-16T22:28:27.145532+0000","last_fullsized":"2024-05-16T22:28:27.145532+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:15:30.489744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.136436+0000","last_change":"2024-05-16T22:28:25.144429+0000","last_active":"2024-05-16T22:28:27.136436+0000","last_peered":"2024-05-16T22:28:27.136436+0000","last_clean":"2024-05-16T22:28:27.136436+0000","last_became_active":"2024-05-16T22:28:25.143998+0000","last_became_peered":"2024-05-16T22:28:25.143998+0000","last_unstale":"2024-05-16T22:28:27.136436+0000","last_undegraded":"2024-05-16T22:28:27.136436+0000","last_fullsized":"2024-05-16T22:28:27.136436+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:01:04.890716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.147047+0000","last_change":"2024-05-16T22:28:25.145927+0000","last_active":"2024-05-16T22:28:27.147047+0000","last_peered":"2024-05-16T22:28:27.147047+0000","last_clean":"2024-05-16T22:28:27.147047+0000","last_became_active":"2024-05-16T22:28:25.145626+0000","last_became_peered":"2024-05-16T22:28:25.145626+0000","last_unstale":"2024-05-16T22:28:27.147047+0000","last_undegraded":"2024-05-16T22:28:27.147047+0000","last_fullsized":"2024-05-16T22:28:27.147047+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:51:27.918280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.149750+0000","last_change":"2024-05-16T22:28:25.138083+0000","last_active":"2024-05-16T22:28:27.149750+0000","last_peered":"2024-05-16T22:28:27.149750+0000","last_clean":"2024-05-16T22:28:27.149750+0000","last_became_active":"2024-05-16T22:28:25.137738+0000","last_became_peered":"2024-05-16T22:28:25.137738+0000","last_unstale":"2024-05-16T22:28:27.149750+0000","last_undegraded":"2024-05-16T22:28:27.149750+0000","last_fullsized":"2024-05-16T22:28:27.149750+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:27:43.408332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.135515+0000","last_change":"2024-05-16T22:28:25.129793+0000","last_active":"2024-05-16T22:28:27.135515+0000","last_peered":"2024-05-16T22:28:27.135515+0000","last_clean":"2024-05-16T22:28:27.135515+0000","last_became_active":"2024-05-16T22:28:25.129458+0000","last_became_peered":"2024-05-16T22:28:25.129458+0000","last_unstale":"2024-05-16T22:28:27.135515+0000","last_undegraded":"2024-05-16T22:28:27.135515+0000","last_fullsized":"2024-05-16T22:28:27.135515+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:55:39.126558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.147279+0000","last_change":"2024-05-16T22:28:25.136981+0000","last_active":"2024-05-16T22:28:27.147279+0000","last_peered":"2024-05-16T22:28:27.147279+0000","last_clean":"2024-05-16T22:28:27.147279+0000","last_became_active":"2024-05-16T22:28:25.136671+0000","last_became_peered":"2024-05-16T22:28:25.136671+0000","last_unstale":"2024-05-16T22:28:27.147279+0000","last_undegraded":"2024-05-16T22:28:27.147279+0000","last_fullsized":"2024-05-16T22:28:27.147279+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:13:11.271883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.136141+0000","last_change":"2024-05-16T22:28:25.140801+0000","last_active":"2024-05-16T22:28:27.136141+0000","last_peered":"2024-05-16T22:28:27.136141+0000","last_clean":"2024-05-16T22:28:27.136141+0000","last_became_active":"2024-05-16T22:28:25.140188+0000","last_became_peered":"2024-05-16T22:28:25.140188+0000","last_unstale":"2024-05-16T22:28:27.136141+0000","last_undegraded":"2024-05-16T22:28:27.136141+0000","last_fullsized":"2024-05-16T22:28:27.136141+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:56:35.412674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.136649+0000","last_change":"2024-05-16T22:28:25.136128+0000","last_active":"2024-05-16T22:28:27.136649+0000","last_peered":"2024-05-16T22:28:27.136649+0000","last_clean":"2024-05-16T22:28:27.136649+0000","last_became_active":"2024-05-16T22:28:25.135816+0000","last_became_peered":"2024-05-16T22:28:25.135816+0000","last_unstale":"2024-05-16T22:28:27.136649+0000","last_undegraded":"2024-05-16T22:28:27.136649+0000","last_fullsized":"2024-05-16T22:28:27.136649+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:10:01.075196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.136100+0000","last_change":"2024-05-16T22:28:25.141692+0000","last_active":"2024-05-16T22:28:27.136100+0000","last_peered":"2024-05-16T22:28:27.136100+0000","last_clean":"2024-05-16T22:28:27.136100+0000","last_became_active":"2024-05-16T22:28:25.141358+0000","last_became_peered":"2024-05-16T22:28:25.141358+0000","last_unstale":"2024-05-16T22:28:27.136100+0000","last_undegraded":"2024-05-16T22:28:27.136100+0000","last_fullsized":"2024-05-16T22:28:27.136100+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:15:36.673232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.135670+0000","last_change":"2024-05-16T22:28:25.145342+0000","last_active":"2024-05-16T22:28:27.135670+0000","last_peered":"2024-05-16T22:28:27.135670+0000","last_clean":"2024-05-16T22:28:27.135670+0000","last_became_active":"2024-05-16T22:28:25.144979+0000","last_became_peered":"2024-05-16T22:28:25.144979+0000","last_unstale":"2024-05-16T22:28:27.135670+0000","last_undegraded":"2024-05-16T22:28:27.135670+0000","last_fullsized":"2024-05-16T22:28:27.135670+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:10:40.802675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.149696+0000","last_change":"2024-05-16T22:28:25.139441+0000","last_active":"2024-05-16T22:28:27.149696+0000","last_peered":"2024-05-16T22:28:27.149696+0000","last_clean":"2024-05-16T22:28:27.149696+0000","last_became_active":"2024-05-16T22:28:25.139107+0000","last_became_peered":"2024-05-16T22:28:25.139107+0000","last_unstale":"2024-05-16T22:28:27.149696+0000","last_undegraded":"2024-05-16T22:28:27.149696+0000","last_fullsized":"2024-05-16T22:28:27.149696+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:02:58.855363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.146509+0000","last_change":"2024-05-16T22:28:25.133279+0000","last_active":"2024-05-16T22:28:27.146509+0000","last_peered":"2024-05-16T22:28:27.146509+0000","last_clean":"2024-05-16T22:28:27.146509+0000","last_became_active":"2024-05-16T22:28:25.132924+0000","last_became_peered":"2024-05-16T22:28:25.132924+0000","last_unstale":"2024-05-16T22:28:27.146509+0000","last_undegraded":"2024-05-16T22:28:27.146509+0000","last_fullsized":"2024-05-16T22:28:27.146509+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:14:13.566727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.146660+0000","last_change":"2024-05-16T22:28:25.132955+0000","last_active":"2024-05-16T22:28:27.146660+0000","last_peered":"2024-05-16T22:28:27.146660+0000","last_clean":"2024-05-16T22:28:27.146660+0000","last_became_active":"2024-05-16T22:28:25.132508+0000","last_became_peered":"2024-05-16T22:28:25.132508+0000","last_unstale":"2024-05-16T22:28:27.146660+0000","last_undegraded":"2024-05-16T22:28:27.146660+0000","last_fullsized":"2024-05-16T22:28:27.146660+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:19:16.198221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.147461+0000","last_change":"2024-05-16T22:28:25.138421+0000","last_active":"2024-05-16T22:28:27.147461+0000","last_peered":"2024-05-16T22:28:27.147461+0000","last_clean":"2024-05-16T22:28:27.147461+0000","last_became_active":"2024-05-16T22:28:25.137691+0000","last_became_peered":"2024-05-16T22:28:25.137691+0000","last_unstale":"2024-05-16T22:28:27.147461+0000","last_undegraded":"2024-05-16T22:28:27.147461+0000","last_fullsized":"2024-05-16T22:28:27.147461+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:10:14.918313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.147193+0000","last_change":"2024-05-16T22:28:25.140241+0000","last_active":"2024-05-16T22:28:27.147193+0000","last_peered":"2024-05-16T22:28:27.147193+0000","last_clean":"2024-05-16T22:28:27.147193+0000","last_became_active":"2024-05-16T22:28:25.139933+0000","last_became_peered":"2024-05-16T22:28:25.139933+0000","last_unstale":"2024-05-16T22:28:27.147193+0000","last_undegraded":"2024-05-16T22:28:27.147193+0000","last_fullsized":"2024-05-16T22:28:27.147193+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:07:42.837164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.146525+0000","last_change":"2024-05-16T22:28:25.139344+0000","last_active":"2024-05-16T22:28:27.146525+0000","last_peered":"2024-05-16T22:28:27.146525+0000","last_clean":"2024-05-16T22:28:27.146525+0000","last_became_active":"2024-05-16T22:28:25.138885+0000","last_became_peered":"2024-05-16T22:28:25.138885+0000","last_unstale":"2024-05-16T22:28:27.146525+0000","last_undegraded":"2024-05-16T22:28:27.146525+0000","last_fullsized":"2024-05-16T22:28:27.146525+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:51:27.918280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.136114+0000","last_change":"2024-05-16T22:28:25.132924+0000","last_active":"2024-05-16T22:28:27.136114+0000","last_peered":"2024-05-16T22:28:27.136114+0000","last_clean":"2024-05-16T22:28:27.136114+0000","last_became_active":"2024-05-16T22:28:25.132601+0000","last_became_peered":"2024-05-16T22:28:25.132601+0000","last_unstale":"2024-05-16T22:28:27.136114+0000","last_undegraded":"2024-05-16T22:28:27.136114+0000","last_fullsized":"2024-05-16T22:28:27.136114+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:45:01.717370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.146277+0000","last_change":"2024-05-16T22:28:25.143854+0000","last_active":"2024-05-16T22:28:27.146277+0000","last_peered":"2024-05-16T22:28:27.146277+0000","last_clean":"2024-05-16T22:28:27.146277+0000","last_became_active":"2024-05-16T22:28:25.143521+0000","last_became_peered":"2024-05-16T22:28:25.143521+0000","last_unstale":"2024-05-16T22:28:27.146277+0000","last_undegraded":"2024-05-16T22:28:27.146277+0000","last_fullsized":"2024-05-16T22:28:27.146277+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:17:44.297474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.147474+0000","last_change":"2024-05-16T22:28:25.137918+0000","last_active":"2024-05-16T22:28:27.147474+0000","last_peered":"2024-05-16T22:28:27.147474+0000","last_clean":"2024-05-16T22:28:27.147474+0000","last_became_active":"2024-05-16T22:28:25.137610+0000","last_became_peered":"2024-05-16T22:28:25.137610+0000","last_unstale":"2024-05-16T22:28:27.147474+0000","last_undegraded":"2024-05-16T22:28:27.147474+0000","last_fullsized":"2024-05-16T22:28:27.147474+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:56:35.412674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.148039+0000","last_change":"2024-05-16T22:28:25.134027+0000","last_active":"2024-05-16T22:28:27.148039+0000","last_peered":"2024-05-16T22:28:27.148039+0000","last_clean":"2024-05-16T22:28:27.148039+0000","last_became_active":"2024-05-16T22:28:25.133675+0000","last_became_peered":"2024-05-16T22:28:25.133675+0000","last_unstale":"2024-05-16T22:28:27.148039+0000","last_undegraded":"2024-05-16T22:28:27.148039+0000","last_fullsized":"2024-05-16T22:28:27.148039+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:07:25.724126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.135950+0000","last_change":"2024-05-16T22:28:25.133367+0000","last_active":"2024-05-16T22:28:27.135950+0000","last_peered":"2024-05-16T22:28:27.135950+0000","last_clean":"2024-05-16T22:28:27.135950+0000","last_became_active":"2024-05-16T22:28:25.132750+0000","last_became_peered":"2024-05-16T22:28:25.132750+0000","last_unstale":"2024-05-16T22:28:27.135950+0000","last_undegraded":"2024-05-16T22:28:27.135950+0000","last_fullsized":"2024-05-16T22:28:27.135950+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:07:42.837164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.146185+0000","last_change":"2024-05-16T22:28:25.139732+0000","last_active":"2024-05-16T22:28:27.146185+0000","last_peered":"2024-05-16T22:28:27.146185+0000","last_clean":"2024-05-16T22:28:27.146185+0000","last_became_active":"2024-05-16T22:28:25.139417+0000","last_became_peered":"2024-05-16T22:28:25.139417+0000","last_unstale":"2024-05-16T22:28:27.146185+0000","last_undegraded":"2024-05-16T22:28:27.146185+0000","last_fullsized":"2024-05-16T22:28:27.146185+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:03:24.749982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.135692+0000","last_change":"2024-05-16T22:28:25.134493+0000","last_active":"2024-05-16T22:28:27.135692+0000","last_peered":"2024-05-16T22:28:27.135692+0000","last_clean":"2024-05-16T22:28:27.135692+0000","last_became_active":"2024-05-16T22:28:25.133628+0000","last_became_peered":"2024-05-16T22:28:25.133628+0000","last_unstale":"2024-05-16T22:28:27.135692+0000","last_undegraded":"2024-05-16T22:28:27.135692+0000","last_fullsized":"2024-05-16T22:28:27.135692+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:52:19.687304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.148036+0000","last_change":"2024-05-16T22:28:25.138102+0000","last_active":"2024-05-16T22:28:27.148036+0000","last_peered":"2024-05-16T22:28:27.148036+0000","last_clean":"2024-05-16T22:28:27.148036+0000","last_became_active":"2024-05-16T22:28:25.137703+0000","last_became_peered":"2024-05-16T22:28:25.137703+0000","last_unstale":"2024-05-16T22:28:27.148036+0000","last_undegraded":"2024-05-16T22:28:27.148036+0000","last_fullsized":"2024-05-16T22:28:27.148036+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:07:25.724126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.153034+0000","last_change":"2024-05-16T22:28:22.106753+0000","last_active":"2024-05-16T22:28:27.153034+0000","last_peered":"2024-05-16T22:28:27.153034+0000","last_clean":"2024-05-16T22:28:27.153034+0000","last_became_active":"2024-05-16T22:28:22.106441+0000","last_became_peered":"2024-05-16T22:28:22.106441+0000","last_unstale":"2024-05-16T22:28:27.153034+0000","last_undegraded":"2024-05-16T22:28:27.153034+0000","last_fullsized":"2024-05-16T22:28:27.153034+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:14:10.547488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.146457+0000","last_change":"2024-05-16T22:28:25.135818+0000","last_active":"2024-05-16T22:28:27.146457+0000","last_peered":"2024-05-16T22:28:27.146457+0000","last_clean":"2024-05-16T22:28:27.146457+0000","last_became_active":"2024-05-16T22:28:25.135509+0000","last_became_peered":"2024-05-16T22:28:25.135509+0000","last_unstale":"2024-05-16T22:28:27.146457+0000","last_undegraded":"2024-05-16T22:28:27.146457+0000","last_fullsized":"2024-05-16T22:28:27.146457+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:42:55.890324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.148220+0000","last_change":"2024-05-16T22:28:22.360464+0000","last_active":"2024-05-16T22:28:27.148220+0000","last_peered":"2024-05-16T22:28:27.148220+0000","last_clean":"2024-05-16T22:28:27.148220+0000","last_became_active":"2024-05-16T22:28:22.360059+0000","last_became_peered":"2024-05-16T22:28:22.360059+0000","last_unstale":"2024-05-16T22:28:27.148220+0000","last_undegraded":"2024-05-16T22:28:27.148220+0000","last_fullsized":"2024-05-16T22:28:27.148220+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:32:08.459699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.147118+0000","last_change":"2024-05-16T22:28:25.133445+0000","last_active":"2024-05-16T22:28:27.147118+0000","last_peered":"2024-05-16T22:28:27.147118+0000","last_clean":"2024-05-16T22:28:27.147118+0000","last_became_active":"2024-05-16T22:28:25.130250+0000","last_became_peered":"2024-05-16T22:28:25.130250+0000","last_unstale":"2024-05-16T22:28:27.147118+0000","last_undegraded":"2024-05-16T22:28:27.147118+0000","last_fullsized":"2024-05-16T22:28:27.147118+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:10:58.932522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.151165+0000","last_change":"2024-05-16T22:28:22.110905+0000","last_active":"2024-05-16T22:28:27.151165+0000","last_peered":"2024-05-16T22:28:27.151165+0000","last_clean":"2024-05-16T22:28:27.151165+0000","last_became_active":"2024-05-16T22:28:22.110563+0000","last_became_peered":"2024-05-16T22:28:22.110563+0000","last_unstale":"2024-05-16T22:28:27.151165+0000","last_undegraded":"2024-05-16T22:28:27.151165+0000","last_fullsized":"2024-05-16T22:28:27.151165+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:09:58.055956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.146341+0000","last_change":"2024-05-16T22:28:25.144239+0000","last_active":"2024-05-16T22:28:27.146341+0000","last_peered":"2024-05-16T22:28:27.146341+0000","last_clean":"2024-05-16T22:28:27.146341+0000","last_became_active":"2024-05-16T22:28:25.143880+0000","last_became_peered":"2024-05-16T22:28:25.143880+0000","last_unstale":"2024-05-16T22:28:27.146341+0000","last_undegraded":"2024-05-16T22:28:27.146341+0000","last_fullsized":"2024-05-16T22:28:27.146341+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:55:39.126558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.154198+0000","last_change":"2024-05-16T22:28:22.108864+0000","last_active":"2024-05-16T22:28:27.154198+0000","last_peered":"2024-05-16T22:28:27.154198+0000","last_clean":"2024-05-16T22:28:27.154198+0000","last_became_active":"2024-05-16T22:28:22.108340+0000","last_became_peered":"2024-05-16T22:28:22.108340+0000","last_unstale":"2024-05-16T22:28:27.154198+0000","last_undegraded":"2024-05-16T22:28:27.154198+0000","last_fullsized":"2024-05-16T22:28:27.154198+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:02:04.709374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.136003+0000","last_change":"2024-05-16T22:28:25.133079+0000","last_active":"2024-05-16T22:28:27.136003+0000","last_peered":"2024-05-16T22:28:27.136003+0000","last_clean":"2024-05-16T22:28:27.136003+0000","last_became_active":"2024-05-16T22:28:25.132406+0000","last_became_peered":"2024-05-16T22:28:25.132406+0000","last_unstale":"2024-05-16T22:28:27.136003+0000","last_undegraded":"2024-05-16T22:28:27.136003+0000","last_fullsized":"2024-05-16T22:28:27.136003+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:10:40.802675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.147099+0000","last_change":"2024-05-16T22:28:22.113682+0000","last_active":"2024-05-16T22:28:27.147099+0000","last_peered":"2024-05-16T22:28:27.147099+0000","last_clean":"2024-05-16T22:28:27.147099+0000","last_became_active":"2024-05-16T22:28:22.113347+0000","last_became_peered":"2024-05-16T22:28:22.113347+0000","last_unstale":"2024-05-16T22:28:27.147099+0000","last_undegraded":"2024-05-16T22:28:27.147099+0000","last_fullsized":"2024-05-16T22:28:27.147099+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:10:11.899074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.146174+0000","last_change":"2024-05-16T22:28:25.136162+0000","last_active":"2024-05-16T22:28:27.146174+0000","last_peered":"2024-05-16T22:28:27.146174+0000","last_clean":"2024-05-16T22:28:27.146174+0000","last_became_active":"2024-05-16T22:28:25.135037+0000","last_became_peered":"2024-05-16T22:28:25.135037+0000","last_unstale":"2024-05-16T22:28:27.146174+0000","last_undegraded":"2024-05-16T22:28:27.146174+0000","last_fullsized":"2024-05-16T22:28:27.146174+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:52:19.687304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.146465+0000","last_change":"2024-05-16T22:28:22.113590+0000","last_active":"2024-05-16T22:28:27.146465+0000","last_peered":"2024-05-16T22:28:27.146465+0000","last_clean":"2024-05-16T22:28:27.146465+0000","last_became_active":"2024-05-16T22:28:22.113334+0000","last_became_peered":"2024-05-16T22:28:22.113334+0000","last_unstale":"2024-05-16T22:28:27.146465+0000","last_undegraded":"2024-05-16T22:28:27.146465+0000","last_fullsized":"2024-05-16T22:28:27.146465+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:28:23.827905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.145602+0000","last_change":"2024-05-16T22:28:25.131093+0000","last_active":"2024-05-16T22:28:27.145602+0000","last_peered":"2024-05-16T22:28:27.145602+0000","last_clean":"2024-05-16T22:28:27.145602+0000","last_became_active":"2024-05-16T22:28:25.130738+0000","last_became_peered":"2024-05-16T22:28:25.130738+0000","last_unstale":"2024-05-16T22:28:27.145602+0000","last_undegraded":"2024-05-16T22:28:27.145602+0000","last_fullsized":"2024-05-16T22:28:27.145602+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:31:04.601858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.135463+0000","last_change":"2024-05-16T22:28:22.112253+0000","last_active":"2024-05-16T22:28:27.135463+0000","last_peered":"2024-05-16T22:28:27.135463+0000","last_clean":"2024-05-16T22:28:27.135463+0000","last_became_active":"2024-05-16T22:28:22.111906+0000","last_became_peered":"2024-05-16T22:28:22.111906+0000","last_unstale":"2024-05-16T22:28:27.135463+0000","last_undegraded":"2024-05-16T22:28:27.135463+0000","last_fullsized":"2024-05-16T22:28:27.135463+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:51:24.899040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.145447+0000","last_change":"2024-05-16T22:28:25.139184+0000","last_active":"2024-05-16T22:28:27.145447+0000","last_peered":"2024-05-16T22:28:27.145447+0000","last_clean":"2024-05-16T22:28:27.145447+0000","last_became_active":"2024-05-16T22:28:25.138810+0000","last_became_peered":"2024-05-16T22:28:25.138810+0000","last_unstale":"2024-05-16T22:28:27.145447+0000","last_undegraded":"2024-05-16T22:28:27.145447+0000","last_fullsized":"2024-05-16T22:28:27.145447+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:32:11.478939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.145865+0000","last_change":"2024-05-16T22:28:22.104994+0000","last_active":"2024-05-16T22:28:27.145865+0000","last_peered":"2024-05-16T22:28:27.145865+0000","last_clean":"2024-05-16T22:28:27.145865+0000","last_became_active":"2024-05-16T22:28:22.104619+0000","last_became_peered":"2024-05-16T22:28:22.104619+0000","last_unstale":"2024-05-16T22:28:27.145865+0000","last_undegraded":"2024-05-16T22:28:27.145865+0000","last_fullsized":"2024-05-16T22:28:27.145865+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:42:52.871084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.146652+0000","last_change":"2024-05-16T22:28:25.144872+0000","last_active":"2024-05-16T22:28:27.146652+0000","last_peered":"2024-05-16T22:28:27.146652+0000","last_clean":"2024-05-16T22:28:27.146652+0000","last_became_active":"2024-05-16T22:28:25.144477+0000","last_became_peered":"2024-05-16T22:28:25.144477+0000","last_unstale":"2024-05-16T22:28:27.146652+0000","last_undegraded":"2024-05-16T22:28:27.146652+0000","last_fullsized":"2024-05-16T22:28:27.146652+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:55:39.126558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.135785+0000","last_change":"2024-05-16T22:28:22.360598+0000","last_active":"2024-05-16T22:28:27.135785+0000","last_peered":"2024-05-16T22:28:27.135785+0000","last_clean":"2024-05-16T22:28:27.135785+0000","last_became_active":"2024-05-16T22:28:22.360235+0000","last_became_peered":"2024-05-16T22:28:22.360235+0000","last_unstale":"2024-05-16T22:28:27.135785+0000","last_undegraded":"2024-05-16T22:28:27.135785+0000","last_fullsized":"2024-05-16T22:28:27.135785+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:56:32.393435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.135586+0000","last_change":"2024-05-16T22:28:25.141509+0000","last_active":"2024-05-16T22:28:27.135586+0000","last_peered":"2024-05-16T22:28:27.135586+0000","last_clean":"2024-05-16T22:28:27.135586+0000","last_became_active":"2024-05-16T22:28:25.140644+0000","last_became_peered":"2024-05-16T22:28:25.140644+0000","last_unstale":"2024-05-16T22:28:27.135586+0000","last_undegraded":"2024-05-16T22:28:27.135586+0000","last_fullsized":"2024-05-16T22:28:27.135586+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:07:42.837164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.148505+0000","last_change":"2024-05-16T22:28:22.112113+0000","last_active":"2024-05-16T22:28:27.148505+0000","last_peered":"2024-05-16T22:28:27.148505+0000","last_clean":"2024-05-16T22:28:27.148505+0000","last_became_active":"2024-05-16T22:28:22.111768+0000","last_became_peered":"2024-05-16T22:28:22.111768+0000","last_unstale":"2024-05-16T22:28:27.148505+0000","last_undegraded":"2024-05-16T22:28:27.148505+0000","last_fullsized":"2024-05-16T22:28:27.148505+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:30:53.630126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.135872+0000","last_change":"2024-05-16T22:28:25.134837+0000","last_active":"2024-05-16T22:28:27.135872+0000","last_peered":"2024-05-16T22:28:27.135872+0000","last_clean":"2024-05-16T22:28:27.135872+0000","last_became_active":"2024-05-16T22:28:25.132388+0000","last_became_peered":"2024-05-16T22:28:25.132388+0000","last_unstale":"2024-05-16T22:28:27.135872+0000","last_undegraded":"2024-05-16T22:28:27.135872+0000","last_fullsized":"2024-05-16T22:28:27.135872+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:04:53.410394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.152241+0000","last_change":"2024-05-16T22:28:22.360327+0000","last_active":"2024-05-16T22:28:27.152241+0000","last_peered":"2024-05-16T22:28:27.152241+0000","last_clean":"2024-05-16T22:28:27.152241+0000","last_became_active":"2024-05-16T22:28:22.359963+0000","last_became_peered":"2024-05-16T22:28:22.359963+0000","last_unstale":"2024-05-16T22:28:27.152241+0000","last_undegraded":"2024-05-16T22:28:27.152241+0000","last_fullsized":"2024-05-16T22:28:27.152241+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:07:30.885205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.148341+0000","last_change":"2024-05-16T22:28:25.145369+0000","last_active":"2024-05-16T22:28:27.148341+0000","last_peered":"2024-05-16T22:28:27.148341+0000","last_clean":"2024-05-16T22:28:27.148341+0000","last_became_active":"2024-05-16T22:28:25.145061+0000","last_became_peered":"2024-05-16T22:28:25.145061+0000","last_unstale":"2024-05-16T22:28:27.148341+0000","last_undegraded":"2024-05-16T22:28:27.148341+0000","last_fullsized":"2024-05-16T22:28:27.148341+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:15:36.673232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.154406+0000","last_change":"2024-05-16T22:28:22.111243+0000","last_active":"2024-05-16T22:28:27.154406+0000","last_peered":"2024-05-16T22:28:27.154406+0000","last_clean":"2024-05-16T22:28:27.154406+0000","last_became_active":"2024-05-16T22:28:22.110905+0000","last_became_peered":"2024-05-16T22:28:22.110905+0000","last_unstale":"2024-05-16T22:28:27.154406+0000","last_undegraded":"2024-05-16T22:28:27.154406+0000","last_fullsized":"2024-05-16T22:28:27.154406+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:07:30.885205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.145997+0000","last_change":"2024-05-16T22:28:25.140367+0000","last_active":"2024-05-16T22:28:27.145997+0000","last_peered":"2024-05-16T22:28:27.145997+0000","last_clean":"2024-05-16T22:28:27.145997+0000","last_became_active":"2024-05-16T22:28:25.140017+0000","last_became_peered":"2024-05-16T22:28:25.140017+0000","last_unstale":"2024-05-16T22:28:27.145997+0000","last_undegraded":"2024-05-16T22:28:27.145997+0000","last_fullsized":"2024-05-16T22:28:27.145997+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:23:28.509629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.151214+0000","last_change":"2024-05-16T22:28:22.105649+0000","last_active":"2024-05-16T22:28:27.151214+0000","last_peered":"2024-05-16T22:28:27.151214+0000","last_clean":"2024-05-16T22:28:27.151214+0000","last_became_active":"2024-05-16T22:28:22.105327+0000","last_became_peered":"2024-05-16T22:28:22.105327+0000","last_unstale":"2024-05-16T22:28:27.151214+0000","last_undegraded":"2024-05-16T22:28:27.151214+0000","last_fullsized":"2024-05-16T22:28:27.151214+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:32:13.089792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.135432+0000","last_change":"2024-05-16T22:28:25.134449+0000","last_active":"2024-05-16T22:28:27.135432+0000","last_peered":"2024-05-16T22:28:27.135432+0000","last_clean":"2024-05-16T22:28:27.135432+0000","last_became_active":"2024-05-16T22:28:25.134128+0000","last_became_peered":"2024-05-16T22:28:25.134128+0000","last_unstale":"2024-05-16T22:28:27.135432+0000","last_undegraded":"2024-05-16T22:28:27.135432+0000","last_fullsized":"2024-05-16T22:28:27.135432+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:52:19.687304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.146238+0000","last_change":"2024-05-16T22:28:22.107768+0000","last_active":"2024-05-16T22:28:27.146238+0000","last_peered":"2024-05-16T22:28:27.146238+0000","last_clean":"2024-05-16T22:28:27.146238+0000","last_became_active":"2024-05-16T22:28:22.107378+0000","last_became_peered":"2024-05-16T22:28:22.107378+0000","last_unstale":"2024-05-16T22:28:27.146238+0000","last_undegraded":"2024-05-16T22:28:27.146238+0000","last_fullsized":"2024-05-16T22:28:27.146238+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:52:16.668065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.135908+0000","last_change":"2024-05-16T22:28:25.134758+0000","last_active":"2024-05-16T22:28:27.135908+0000","last_peered":"2024-05-16T22:28:27.135908+0000","last_clean":"2024-05-16T22:28:27.135908+0000","last_became_active":"2024-05-16T22:28:25.134005+0000","last_became_peered":"2024-05-16T22:28:25.134005+0000","last_unstale":"2024-05-16T22:28:27.135908+0000","last_undegraded":"2024-05-16T22:28:27.135908+0000","last_fullsized":"2024-05-16T22:28:27.135908+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:51:27.918280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.135042+0000","last_change":"2024-05-16T22:28:22.360850+0000","last_active":"2024-05-16T22:28:27.135042+0000","last_peered":"2024-05-16T22:28:27.135042+0000","last_clean":"2024-05-16T22:28:27.135042+0000","last_became_active":"2024-05-16T22:28:22.360072+0000","last_became_peered":"2024-05-16T22:28:22.360072+0000","last_unstale":"2024-05-16T22:28:27.135042+0000","last_undegraded":"2024-05-16T22:28:27.135042+0000","last_fullsized":"2024-05-16T22:28:27.135042+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:12:46.825158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.146420+0000","last_change":"2024-05-16T22:28:25.131230+0000","last_active":"2024-05-16T22:28:27.146420+0000","last_peered":"2024-05-16T22:28:27.146420+0000","last_clean":"2024-05-16T22:28:27.146420+0000","last_became_active":"2024-05-16T22:28:25.130877+0000","last_became_peered":"2024-05-16T22:28:25.130877+0000","last_unstale":"2024-05-16T22:28:27.146420+0000","last_undegraded":"2024-05-16T22:28:27.146420+0000","last_fullsized":"2024-05-16T22:28:27.146420+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:28:26.847144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.151487+0000","last_change":"2024-05-16T22:28:22.111596+0000","last_active":"2024-05-16T22:28:27.151487+0000","last_peered":"2024-05-16T22:28:27.151487+0000","last_clean":"2024-05-16T22:28:27.151487+0000","last_became_active":"2024-05-16T22:28:22.110350+0000","last_became_peered":"2024-05-16T22:28:22.110350+0000","last_unstale":"2024-05-16T22:28:27.151487+0000","last_undegraded":"2024-05-16T22:28:27.151487+0000","last_fullsized":"2024-05-16T22:28:27.151487+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:17:41.278235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.149422+0000","last_change":"2024-05-16T22:28:25.133928+0000","last_active":"2024-05-16T22:28:27.149422+0000","last_peered":"2024-05-16T22:28:27.149422+0000","last_clean":"2024-05-16T22:28:27.149422+0000","last_became_active":"2024-05-16T22:28:25.133589+0000","last_became_peered":"2024-05-16T22:28:25.133589+0000","last_unstale":"2024-05-16T22:28:27.149422+0000","last_undegraded":"2024-05-16T22:28:27.149422+0000","last_fullsized":"2024-05-16T22:28:27.149422+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:32:11.478939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.146975+0000","last_change":"2024-05-16T22:28:22.113552+0000","last_active":"2024-05-16T22:28:27.146975+0000","last_peered":"2024-05-16T22:28:27.146975+0000","last_clean":"2024-05-16T22:28:27.146975+0000","last_became_active":"2024-05-16T22:28:22.113199+0000","last_became_peered":"2024-05-16T22:28:22.113199+0000","last_unstale":"2024-05-16T22:28:27.146975+0000","last_undegraded":"2024-05-16T22:28:27.146975+0000","last_fullsized":"2024-05-16T22:28:27.146975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:07:39.817925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.147539+0000","last_change":"2024-05-16T22:28:25.139252+0000","last_active":"2024-05-16T22:28:27.147539+0000","last_peered":"2024-05-16T22:28:27.147539+0000","last_clean":"2024-05-16T22:28:27.147539+0000","last_became_active":"2024-05-16T22:28:25.138961+0000","last_became_peered":"2024-05-16T22:28:25.138961+0000","last_unstale":"2024-05-16T22:28:27.147539+0000","last_undegraded":"2024-05-16T22:28:27.147539+0000","last_fullsized":"2024-05-16T22:28:27.147539+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:01:04.890716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.151928+0000","last_change":"2024-05-16T22:28:22.104921+0000","last_active":"2024-05-16T22:28:27.151928+0000","last_peered":"2024-05-16T22:28:27.151928+0000","last_clean":"2024-05-16T22:28:27.151928+0000","last_became_active":"2024-05-16T22:28:22.104579+0000","last_became_peered":"2024-05-16T22:28:22.104579+0000","last_unstale":"2024-05-16T22:28:27.151928+0000","last_undegraded":"2024-05-16T22:28:27.151928+0000","last_fullsized":"2024-05-16T22:28:27.151928+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:15:27.470505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.145683+0000","last_change":"2024-05-16T22:28:25.138216+0000","last_active":"2024-05-16T22:28:27.145683+0000","last_peered":"2024-05-16T22:28:27.145683+0000","last_clean":"2024-05-16T22:28:27.145683+0000","last_became_active":"2024-05-16T22:28:25.137897+0000","last_became_peered":"2024-05-16T22:28:25.137897+0000","last_unstale":"2024-05-16T22:28:27.145683+0000","last_undegraded":"2024-05-16T22:28:27.145683+0000","last_fullsized":"2024-05-16T22:28:27.145683+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:30:56.649366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.149824+0000","last_change":"2024-05-16T22:28:22.103517+0000","last_active":"2024-05-16T22:28:27.149824+0000","last_peered":"2024-05-16T22:28:27.149824+0000","last_clean":"2024-05-16T22:28:27.149824+0000","last_became_active":"2024-05-16T22:28:22.102808+0000","last_became_peered":"2024-05-16T22:28:22.102808+0000","last_unstale":"2024-05-16T22:28:27.149824+0000","last_undegraded":"2024-05-16T22:28:27.149824+0000","last_fullsized":"2024-05-16T22:28:27.149824+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:23:25.490389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.149822+0000","last_change":"2024-05-16T22:28:25.141247+0000","last_active":"2024-05-16T22:28:27.149822+0000","last_peered":"2024-05-16T22:28:27.149822+0000","last_clean":"2024-05-16T22:28:27.149822+0000","last_became_active":"2024-05-16T22:28:25.140922+0000","last_became_peered":"2024-05-16T22:28:25.140922+0000","last_unstale":"2024-05-16T22:28:27.149822+0000","last_undegraded":"2024-05-16T22:28:27.149822+0000","last_fullsized":"2024-05-16T22:28:27.149822+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:33:18.560884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.148989+0000","last_change":"2024-05-16T22:28:22.111941+0000","last_active":"2024-05-16T22:28:27.148989+0000","last_peered":"2024-05-16T22:28:27.148989+0000","last_clean":"2024-05-16T22:28:27.148989+0000","last_became_active":"2024-05-16T22:28:22.111633+0000","last_became_peered":"2024-05-16T22:28:22.111633+0000","last_unstale":"2024-05-16T22:28:27.148989+0000","last_undegraded":"2024-05-16T22:28:27.148989+0000","last_fullsized":"2024-05-16T22:28:27.148989+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:34:27.123768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.149592+0000","last_change":"2024-05-16T22:28:25.134854+0000","last_active":"2024-05-16T22:28:27.149592+0000","last_peered":"2024-05-16T22:28:27.149592+0000","last_clean":"2024-05-16T22:28:27.149592+0000","last_became_active":"2024-05-16T22:28:25.134458+0000","last_became_peered":"2024-05-16T22:28:25.134458+0000","last_unstale":"2024-05-16T22:28:27.149592+0000","last_undegraded":"2024-05-16T22:28:27.149592+0000","last_fullsized":"2024-05-16T22:28:27.149592+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:25:43.462461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.154181+0000","last_change":"2024-05-16T22:28:22.110116+0000","last_active":"2024-05-16T22:28:27.154181+0000","last_peered":"2024-05-16T22:28:27.154181+0000","last_clean":"2024-05-16T22:28:27.154181+0000","last_became_active":"2024-05-16T22:28:22.109761+0000","last_became_peered":"2024-05-16T22:28:22.109761+0000","last_unstale":"2024-05-16T22:28:27.154181+0000","last_undegraded":"2024-05-16T22:28:27.154181+0000","last_fullsized":"2024-05-16T22:28:27.154181+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:23:25.490389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.150005+0000","last_change":"2024-05-16T22:28:25.133539+0000","last_active":"2024-05-16T22:28:27.150005+0000","last_peered":"2024-05-16T22:28:27.150005+0000","last_clean":"2024-05-16T22:28:27.150005+0000","last_became_active":"2024-05-16T22:28:25.133206+0000","last_became_peered":"2024-05-16T22:28:25.133206+0000","last_unstale":"2024-05-16T22:28:27.150005+0000","last_undegraded":"2024-05-16T22:28:27.150005+0000","last_fullsized":"2024-05-16T22:28:27.150005+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:01:15.424193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.146164+0000","last_change":"2024-05-16T22:28:22.108925+0000","last_active":"2024-05-16T22:28:27.146164+0000","last_peered":"2024-05-16T22:28:27.146164+0000","last_clean":"2024-05-16T22:28:27.146164+0000","last_became_active":"2024-05-16T22:28:22.108596+0000","last_became_peered":"2024-05-16T22:28:22.108596+0000","last_unstale":"2024-05-16T22:28:27.146164+0000","last_undegraded":"2024-05-16T22:28:27.146164+0000","last_fullsized":"2024-05-16T22:28:27.146164+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:18:37.142117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.148998+0000","last_change":"2024-05-16T22:28:25.132733+0000","last_active":"2024-05-16T22:28:27.148998+0000","last_peered":"2024-05-16T22:28:27.148998+0000","last_clean":"2024-05-16T22:28:27.148998+0000","last_became_active":"2024-05-16T22:28:25.132391+0000","last_became_peered":"2024-05-16T22:28:25.132391+0000","last_unstale":"2024-05-16T22:28:27.148998+0000","last_undegraded":"2024-05-16T22:28:27.148998+0000","last_fullsized":"2024-05-16T22:28:27.148998+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:24:50.614166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.146290+0000","last_change":"2024-05-16T22:28:22.108404+0000","last_active":"2024-05-16T22:28:27.146290+0000","last_peered":"2024-05-16T22:28:27.146290+0000","last_clean":"2024-05-16T22:28:27.146290+0000","last_became_active":"2024-05-16T22:28:22.108070+0000","last_became_peered":"2024-05-16T22:28:22.108070+0000","last_unstale":"2024-05-16T22:28:27.146290+0000","last_undegraded":"2024-05-16T22:28:27.146290+0000","last_fullsized":"2024-05-16T22:28:27.146290+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:18:37.142117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.135789+0000","last_change":"2024-05-16T22:28:25.134609+0000","last_active":"2024-05-16T22:28:27.135789+0000","last_peered":"2024-05-16T22:28:27.135789+0000","last_clean":"2024-05-16T22:28:27.135789+0000","last_became_active":"2024-05-16T22:28:25.134275+0000","last_became_peered":"2024-05-16T22:28:25.134275+0000","last_unstale":"2024-05-16T22:28:27.135789+0000","last_undegraded":"2024-05-16T22:28:27.135789+0000","last_fullsized":"2024-05-16T22:28:27.135789+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:55:39.126558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.146782+0000","last_change":"2024-05-16T22:28:22.360743+0000","last_active":"2024-05-16T22:28:27.146782+0000","last_peered":"2024-05-16T22:28:27.146782+0000","last_clean":"2024-05-16T22:28:27.146782+0000","last_became_active":"2024-05-16T22:28:22.360219+0000","last_became_peered":"2024-05-16T22:28:22.360219+0000","last_unstale":"2024-05-16T22:28:27.146782+0000","last_undegraded":"2024-05-16T22:28:27.146782+0000","last_fullsized":"2024-05-16T22:28:27.146782+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:10:37.783435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.149362+0000","last_change":"2024-05-16T22:28:25.143383+0000","last_active":"2024-05-16T22:28:27.149362+0000","last_peered":"2024-05-16T22:28:27.149362+0000","last_clean":"2024-05-16T22:28:27.149362+0000","last_became_active":"2024-05-16T22:28:25.143000+0000","last_became_peered":"2024-05-16T22:28:25.143000+0000","last_unstale":"2024-05-16T22:28:27.149362+0000","last_undegraded":"2024-05-16T22:28:27.149362+0000","last_fullsized":"2024-05-16T22:28:27.149362+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:19:41.138517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.151499+0000","last_change":"2024-05-16T22:28:22.110457+0000","last_active":"2024-05-16T22:28:27.151499+0000","last_peered":"2024-05-16T22:28:27.151499+0000","last_clean":"2024-05-16T22:28:27.151499+0000","last_became_active":"2024-05-16T22:28:22.110026+0000","last_became_peered":"2024-05-16T22:28:22.110026+0000","last_unstale":"2024-05-16T22:28:27.151499+0000","last_undegraded":"2024-05-16T22:28:27.151499+0000","last_fullsized":"2024-05-16T22:28:27.151499+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:10:37.783435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.147728+0000","last_change":"2024-05-16T22:28:25.141835+0000","last_active":"2024-05-16T22:28:27.147728+0000","last_peered":"2024-05-16T22:28:27.147728+0000","last_clean":"2024-05-16T22:28:27.147728+0000","last_became_active":"2024-05-16T22:28:25.141435+0000","last_became_peered":"2024-05-16T22:28:25.141435+0000","last_unstale":"2024-05-16T22:28:27.147728+0000","last_undegraded":"2024-05-16T22:28:27.147728+0000","last_fullsized":"2024-05-16T22:28:27.147728+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:10:01.075196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"34'1","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.148382+0000","last_change":"2024-05-16T22:28:22.108917+0000","last_active":"2024-05-16T22:28:27.148382+0000","last_peered":"2024-05-16T22:28:27.148382+0000","last_clean":"2024-05-16T22:28:27.148382+0000","last_became_active":"2024-05-16T22:28:22.108557+0000","last_became_peered":"2024-05-16T22:28:22.108557+0000","last_unstale":"2024-05-16T22:28:27.148382+0000","last_undegraded":"2024-05-16T22:28:27.148382+0000","last_fullsized":"2024-05-16T22:28:27.148382+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:15:27.470505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.147745+0000","last_change":"2024-05-16T22:28:25.140626+0000","last_active":"2024-05-16T22:28:27.147745+0000","last_peered":"2024-05-16T22:28:27.147745+0000","last_clean":"2024-05-16T22:28:27.147745+0000","last_became_active":"2024-05-16T22:28:25.140298+0000","last_became_peered":"2024-05-16T22:28:25.140298+0000","last_unstale":"2024-05-16T22:28:27.147745+0000","last_undegraded":"2024-05-16T22:28:27.147745+0000","last_fullsized":"2024-05-16T22:28:27.147745+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:10:58.932522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.146042+0000","last_change":"2024-05-16T22:28:22.107827+0000","last_active":"2024-05-16T22:28:27.146042+0000","last_peered":"2024-05-16T22:28:27.146042+0000","last_clean":"2024-05-16T22:28:27.146042+0000","last_became_active":"2024-05-16T22:28:22.107458+0000","last_became_peered":"2024-05-16T22:28:22.107458+0000","last_unstale":"2024-05-16T22:28:27.146042+0000","last_undegraded":"2024-05-16T22:28:27.146042+0000","last_fullsized":"2024-05-16T22:28:27.146042+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:12:46.825158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.145800+0000","last_change":"2024-05-16T22:28:25.132368+0000","last_active":"2024-05-16T22:28:27.145800+0000","last_peered":"2024-05-16T22:28:27.145800+0000","last_clean":"2024-05-16T22:28:27.145800+0000","last_became_active":"2024-05-16T22:28:25.132025+0000","last_became_peered":"2024-05-16T22:28:25.132025+0000","last_unstale":"2024-05-16T22:28:27.145800+0000","last_undegraded":"2024-05-16T22:28:27.145800+0000","last_fullsized":"2024-05-16T22:28:27.145800+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:41:49.770349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.148174+0000","last_change":"2024-05-16T22:28:22.107462+0000","last_active":"2024-05-16T22:28:27.148174+0000","last_peered":"2024-05-16T22:28:27.148174+0000","last_clean":"2024-05-16T22:28:27.148174+0000","last_became_active":"2024-05-16T22:28:22.107067+0000","last_became_peered":"2024-05-16T22:28:22.107067+0000","last_unstale":"2024-05-16T22:28:27.148174+0000","last_undegraded":"2024-05-16T22:28:27.148174+0000","last_fullsized":"2024-05-16T22:28:27.148174+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:34:27.123768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.147840+0000","last_change":"2024-05-16T22:28:25.131916+0000","last_active":"2024-05-16T22:28:27.147840+0000","last_peered":"2024-05-16T22:28:27.147840+0000","last_clean":"2024-05-16T22:28:27.147840+0000","last_became_active":"2024-05-16T22:28:25.131503+0000","last_became_peered":"2024-05-16T22:28:25.131503+0000","last_unstale":"2024-05-16T22:28:27.147840+0000","last_undegraded":"2024-05-16T22:28:27.147840+0000","last_fullsized":"2024-05-16T22:28:27.147840+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:32:16.109032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.146148+0000","last_change":"2024-05-16T22:28:22.106472+0000","last_active":"2024-05-16T22:28:27.146148+0000","last_peered":"2024-05-16T22:28:27.146148+0000","last_clean":"2024-05-16T22:28:27.146148+0000","last_became_active":"2024-05-16T22:28:22.106105+0000","last_became_peered":"2024-05-16T22:28:22.106105+0000","last_unstale":"2024-05-16T22:28:27.146148+0000","last_undegraded":"2024-05-16T22:28:27.146148+0000","last_fullsized":"2024-05-16T22:28:27.146148+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:05:28.377682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.135154+0000","last_change":"2024-05-16T22:28:25.136424+0000","last_active":"2024-05-16T22:28:27.135154+0000","last_peered":"2024-05-16T22:28:27.135154+0000","last_clean":"2024-05-16T22:28:27.135154+0000","last_became_active":"2024-05-16T22:28:25.136018+0000","last_became_peered":"2024-05-16T22:28:25.136018+0000","last_unstale":"2024-05-16T22:28:27.135154+0000","last_undegraded":"2024-05-16T22:28:27.135154+0000","last_fullsized":"2024-05-16T22:28:27.135154+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:05:31.396921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.146500+0000","last_change":"2024-05-16T22:28:22.106541+0000","last_active":"2024-05-16T22:28:27.146500+0000","last_peered":"2024-05-16T22:28:27.146500+0000","last_clean":"2024-05-16T22:28:27.146500+0000","last_became_active":"2024-05-16T22:28:22.106188+0000","last_became_peered":"2024-05-16T22:28:22.106188+0000","last_unstale":"2024-05-16T22:28:27.146500+0000","last_undegraded":"2024-05-16T22:28:27.146500+0000","last_fullsized":"2024-05-16T22:28:27.146500+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:30:25.256231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.146305+0000","last_change":"2024-05-16T22:28:25.134738+0000","last_active":"2024-05-16T22:28:27.146305+0000","last_peered":"2024-05-16T22:28:27.146305+0000","last_clean":"2024-05-16T22:28:27.146305+0000","last_became_active":"2024-05-16T22:28:25.134288+0000","last_became_peered":"2024-05-16T22:28:25.134288+0000","last_unstale":"2024-05-16T22:28:27.146305+0000","last_undegraded":"2024-05-16T22:28:27.146305+0000","last_fullsized":"2024-05-16T22:28:27.146305+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:03:24.749982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.135139+0000","last_change":"2024-05-16T22:28:22.360846+0000","last_active":"2024-05-16T22:28:27.135139+0000","last_peered":"2024-05-16T22:28:27.135139+0000","last_clean":"2024-05-16T22:28:27.135139+0000","last_became_active":"2024-05-16T22:28:22.360345+0000","last_became_peered":"2024-05-16T22:28:22.360345+0000","last_unstale":"2024-05-16T22:28:27.135139+0000","last_undegraded":"2024-05-16T22:28:27.135139+0000","last_fullsized":"2024-05-16T22:28:27.135139+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:22:44.790913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.136328+0000","last_change":"2024-05-16T22:28:25.139698+0000","last_active":"2024-05-16T22:28:27.136328+0000","last_peered":"2024-05-16T22:28:27.136328+0000","last_clean":"2024-05-16T22:28:27.136328+0000","last_became_active":"2024-05-16T22:28:25.139387+0000","last_became_peered":"2024-05-16T22:28:25.139387+0000","last_unstale":"2024-05-16T22:28:27.136328+0000","last_undegraded":"2024-05-16T22:28:27.136328+0000","last_fullsized":"2024-05-16T22:28:27.136328+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:04:53.410394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.145845+0000","last_change":"2024-05-16T22:28:22.108557+0000","last_active":"2024-05-16T22:28:27.145845+0000","last_peered":"2024-05-16T22:28:27.145845+0000","last_clean":"2024-05-16T22:28:27.145845+0000","last_became_active":"2024-05-16T22:28:22.108226+0000","last_became_peered":"2024-05-16T22:28:22.108226+0000","last_unstale":"2024-05-16T22:28:27.145845+0000","last_undegraded":"2024-05-16T22:28:27.145845+0000","last_fullsized":"2024-05-16T22:28:27.145845+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:31:01.582618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":134,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.136058+0000","last_change":"2024-05-16T22:27:15.950850+0000","last_active":"2024-05-16T22:28:27.136058+0000","last_peered":"2024-05-16T22:28:27.136058+0000","last_clean":"2024-05-16T22:28:27.136058+0000","last_became_active":"2024-05-16T22:27:15.949553+0000","last_became_peered":"2024-05-16T22:27:15.949553+0000","last_unstale":"2024-05-16T22:28:27.136058+0000","last_undegraded":"2024-05-16T22:28:27.136058+0000","last_fullsized":"2024-05-16T22:28:27.136058+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:14.702385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:14.702385+0000","last_clean_scrub_stamp":"2024-05-16T22:27:14.702385+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:46:07.495562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542166,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":983040,"data_stored":740792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":393216,"data_stored":150950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":393216,"data_stored":151006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":393216,"data_stored":150438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":151968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":389120,"data_stored":150404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":151968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":978944,"data_stored":740702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-16T22:28:52.134 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-16T22:28:52.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.295+0000 7f28aab08640 1 Processor -- start 2024-05-16T22:28:52.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.295+0000 7f28aab08640 1 -- start start 2024-05-16T22:28:52.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.296+0000 7f28aab08640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f28a4151fc0 0x7f28a40bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:52.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.296+0000 7f28aab08640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28a40c36f0 con 0x7f28a40bf050 2024-05-16T22:28:52.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.296+0000 7f28aab08640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28a4152530 con 0x7f28a406da30 2024-05-16T22:28:52.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.296+0000 7f28aab08640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f28a40bdc10 con 0x7f28a4151fc0 2024-05-16T22:28:52.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.296+0000 7f28a90a5640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f28a40bf050 0x7f28a4158e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46436/0 (socket says 172.21.15.44:46436) 2024-05-16T22:28:52.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.296+0000 7f28a90a5640 1 -- 172.21.15.44:0/3366880406 learned_addr learned my addr 172.21.15.44:0/3366880406 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:28:52.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.297+0000 7f28a88a4640 1 --2- 172.21.15.44:0/3366880406 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f28a4151fc0 0x7f28a40bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:52.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.297+0000 7f28a37fe640 1 -- 172.21.15.44:0/3366880406 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 425762099 0 0) 0x7f28a40c36f0 con 0x7f28a40bf050 2024-05-16T22:28:52.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.297+0000 7f28a37fe640 1 -- 172.21.15.44:0/3366880406 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f288c003520 con 0x7f28a40bf050 2024-05-16T22:28:52.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.297+0000 7f28a37fe640 1 -- 172.21.15.44:0/3366880406 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2171773365 0 0) 0x7f28a4152530 con 0x7f28a406da30 2024-05-16T22:28:52.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.297+0000 7f28a37fe640 1 -- 172.21.15.44:0/3366880406 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28a40c36f0 con 0x7f28a406da30 2024-05-16T22:28:52.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.297+0000 7f28a37fe640 1 -- 172.21.15.44:0/3366880406 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4077263814 0 0) 0x7f288c003520 con 0x7f28a40bf050 2024-05-16T22:28:52.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.297+0000 7f28a37fe640 1 -- 172.21.15.44:0/3366880406 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f28a4151fc0 msgr2=0x7f28a40bd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:28:52.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.297+0000 7f28a37fe640 1 --2- 172.21.15.44:0/3366880406 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f28a4151fc0 0x7f28a40bd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:52.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.297+0000 7f28a37fe640 1 -- 172.21.15.44:0/3366880406 >> v1:172.21.15.70:6789/0 conn(0x7f28a406da30 legacy=0x7f28a40be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:53.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.297+0000 7f28a37fe640 1 -- 172.21.15.44:0/3366880406 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28a4152810 con 0x7f28a40bf050 2024-05-16T22:28:53.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.297+0000 7f28a37fe640 1 -- 172.21.15.44:0/3366880406 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 568431863 0 0) 0x7f289c001a70 con 0x7f28a40bf050 2024-05-16T22:28:53.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.297+0000 7f28a88a4640 1 --2- 172.21.15.44:0/3366880406 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f28a4151fc0 0x7f28a40bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:28:53.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.297+0000 7f28a37fe640 1 -- 172.21.15.44:0/3366880406 >> v1:172.21.15.44:6789/0 conn(0x7f28a40bf050 legacy=0x7f28a4158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:53.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.297+0000 7f28a37fe640 1 --2- 172.21.15.44:0/3366880406 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f288c003c60 0x7f288c0040b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:53.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.297+0000 7f28a37fe640 1 --2- 172.21.15.44:0/3366880406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f288c004800 0x7f288c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:53.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.297+0000 7f28a37fe640 1 --2- 172.21.15.44:0/3366880406 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f28a4151fc0 0x7f288c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:53.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.297+0000 7f28a37fe640 1 -- 172.21.15.44:0/3366880406 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f28a40bdc10 con 0x7f288c003c60 2024-05-16T22:28:53.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.297+0000 7f28a37fe640 1 -- 172.21.15.44:0/3366880406 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f288c005580 con 0x7f288c004800 2024-05-16T22:28:53.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.297+0000 7f28a37fe640 1 -- 172.21.15.44:0/3366880406 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f288c00bf00 con 0x7f28a4151fc0 2024-05-16T22:28:53.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.297+0000 7f28a88a4640 1 --2- 172.21.15.44:0/3366880406 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f288c003c60 0x7f288c0040b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:53.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.297+0000 7f28a3fff640 1 --2- 172.21.15.44:0/3366880406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f288c004800 0x7f288c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:53.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.297+0000 7f28a90a5640 1 --2- 172.21.15.44:0/3366880406 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f28a4151fc0 0x7f288c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:53.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.298+0000 7f28a88a4640 1 -- 172.21.15.44:0/3366880406 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f28a4151fc0 msgr2=0x7f288c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:28:53.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.298+0000 7f28a88a4640 1 --2- 172.21.15.44:0/3366880406 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f28a4151fc0 0x7f288c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:53.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.298+0000 7f28a88a4640 1 -- 172.21.15.44:0/3366880406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f288c004800 msgr2=0x7f288c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:28:53.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.298+0000 7f28a88a4640 1 --2- 172.21.15.44:0/3366880406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f288c004800 0x7f288c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:53.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.298+0000 7f28a88a4640 1 -- 172.21.15.44:0/3366880406 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f288c003520 con 0x7f288c003c60 2024-05-16T22:28:53.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.298+0000 7f28a88a4640 1 --2- 172.21.15.44:0/3366880406 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f288c003c60 0x7f288c0040b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2894009cc0 tx=0x7f288c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95ad5f3afbdbe22 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:53.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.298+0000 7f28a37fe640 1 -- 172.21.15.44:0/3366880406 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2894036070 con 0x7f288c003c60 2024-05-16T22:28:53.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.298+0000 7f28a37fe640 1 -- 172.21.15.44:0/3366880406 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2894031400 con 0x7f288c003c60 2024-05-16T22:28:53.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.298+0000 7f28a37fe640 1 -- 172.21.15.44:0/3366880406 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2894009860 con 0x7f288c003c60 2024-05-16T22:28:53.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.299+0000 7f28aab08640 1 -- 172.21.15.44:0/3366880406 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f288c003c60 msgr2=0x7f288c0040b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:53.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.299+0000 7f28aab08640 1 --2- 172.21.15.44:0/3366880406 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f288c003c60 0x7f288c0040b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2894009cc0 tx=0x7f288c005830 comp rx=0 tx=0).stop 2024-05-16T22:28:53.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.299+0000 7f28a90a5640 1 -- 172.21.15.44:0/3366880406 reap_dead start 2024-05-16T22:28:53.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.299+0000 7f28aab08640 1 -- 172.21.15.44:0/3366880406 shutdown_connections 2024-05-16T22:28:53.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.299+0000 7f28aab08640 1 -- 172.21.15.44:0/3366880406 >> 172.21.15.44:0/3366880406 conn(0x7f28a40c3d20 msgr2=0x7f28a40c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:28:54.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.299+0000 7f28aab08640 1 -- 172.21.15.44:0/3366880406 shutdown_connections 2024-05-16T22:28:54.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.299+0000 7f28aab08640 1 -- 172.21.15.44:0/3366880406 wait complete. 2024-05-16T22:28:54.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.301+0000 7f28aab08640 1 Processor -- start 2024-05-16T22:28:54.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.301+0000 7f28aab08640 1 -- start start 2024-05-16T22:28:54.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.302+0000 7f28aab08640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f288c003c60 0x7f28a40b8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:54.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.302+0000 7f28aab08640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28a414b0d0 0x7f28a414e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:54.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.302+0000 7f28aab08640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28a414e9d0 0x7f28a41e4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:54.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.302+0000 7f28aab08640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f28a40a3050 con 0x7f28a414e9d0 2024-05-16T22:28:54.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.302+0000 7f28aab08640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f28a40a2ed0 con 0x7f28a414b0d0 2024-05-16T22:28:54.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.302+0000 7f28aab08640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f28a406de40 con 0x7f288c003c60 2024-05-16T22:28:54.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.302+0000 7f28a90a5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28a414e9d0 0x7f28a41e4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:54.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.302+0000 7f28a90a5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28a414e9d0 0x7f28a41e4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49548/0 (socket says 172.21.15.44:49548) 2024-05-16T22:28:54.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.302+0000 7f28a90a5640 1 -- 172.21.15.44:0/3508332120 learned_addr learned my addr 172.21.15.44:0/3508332120 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:28:54.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.302+0000 7f28a3fff640 1 --2- 172.21.15.44:0/3508332120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28a414b0d0 0x7f28a414e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:54.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.303+0000 7f28a88a4640 1 --2- 172.21.15.44:0/3508332120 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f288c003c60 0x7f28a40b8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:54.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.303+0000 7f28a90a5640 1 -- 172.21.15.44:0/3508332120 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f288c003c60 msgr2=0x7f28a40b8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:54.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.303+0000 7f28a90a5640 1 --2- 172.21.15.44:0/3508332120 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f288c003c60 0x7f28a40b8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:54.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.303+0000 7f28a90a5640 1 -- 172.21.15.44:0/3508332120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28a414b0d0 msgr2=0x7f28a414e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:54.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.303+0000 7f28a90a5640 1 --2- 172.21.15.44:0/3508332120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28a414b0d0 0x7f28a414e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:54.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.303+0000 7f28a90a5640 1 -- 172.21.15.44:0/3508332120 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28a41e7790 con 0x7f28a414e9d0 2024-05-16T22:28:54.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.303+0000 7f28a88a4640 1 --2- 172.21.15.44:0/3508332120 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f288c003c60 0x7f28a40b8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T22:28:54.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.303+0000 7f28a3fff640 1 --2- 172.21.15.44:0/3508332120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28a414b0d0 0x7f28a414e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:28:54.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.303+0000 7f28a90a5640 1 --2- 172.21.15.44:0/3508332120 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28a414e9d0 0x7f28a41e4260 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f28a40bf8f0 tx=0x7f289c007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:54.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.303+0000 7f28a17fa640 1 -- 172.21.15.44:0/3508332120 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289c017020 con 0x7f28a414e9d0 2024-05-16T22:28:54.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.303+0000 7f28a17fa640 1 -- 172.21.15.44:0/3508332120 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f289c00aab0 con 0x7f28a414e9d0 2024-05-16T22:28:54.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.303+0000 7f28aab08640 1 -- 172.21.15.44:0/3508332120 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28a40b80c0 con 0x7f28a414e9d0 2024-05-16T22:28:54.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.303+0000 7f28a17fa640 1 -- 172.21.15.44:0/3508332120 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289c0133f0 con 0x7f28a414e9d0 2024-05-16T22:28:55.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.303+0000 7f28aab08640 1 -- 172.21.15.44:0/3508332120 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28a41e79a0 con 0x7f28a414e9d0 2024-05-16T22:28:55.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.304+0000 7f28aab08640 1 -- 172.21.15.44:0/3508332120 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28a40b78a0 con 0x7f28a414e9d0 2024-05-16T22:28:55.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.305+0000 7f28a17fa640 1 -- 172.21.15.44:0/3508332120 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f289c01a020 con 0x7f28a414e9d0 2024-05-16T22:28:55.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.305+0000 7f28a17fa640 1 --2- 172.21.15.44:0/3508332120 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f28900762d0 0x7f28900787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:55.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.305+0000 7f28a17fa640 1 -- 172.21.15.44:0/3508332120 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f289c097d80 con 0x7f28a414e9d0 2024-05-16T22:28:55.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.306+0000 7f28a88a4640 1 --2- 172.21.15.44:0/3508332120 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f28900762d0 0x7f28900787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:55.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.306+0000 7f28a88a4640 1 --2- 172.21.15.44:0/3508332120 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f28900762d0 0x7f28900787e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2894033000 tx=0x7f2894008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:55.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.310+0000 7f28a17fa640 1 -- 172.21.15.44:0/3508332120 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f289c021020 con 0x7f28a414e9d0 2024-05-16T22:28:55.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.496+0000 7f28aab08640 1 -- 172.21.15.44:0/3508332120 --> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f28a40b7e70 con 0x7f28900762d0 2024-05-16T22:28:55.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.503+0000 7f28a17fa640 1 -- 172.21.15.44:0/3508332120 <== mgr.4114 v2:172.21.15.70:6832/4049588098 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251820 (secure 0 0 0) 0x7f28a40b7e70 con 0x7f28900762d0 2024-05-16T22:28:55.385 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:28:55.424 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-05-16T22:28:55.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.505+0000 7f28aab08640 1 -- 172.21.15.44:0/3508332120 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f28900762d0 msgr2=0x7f28900787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:55.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.505+0000 7f28aab08640 1 --2- 172.21.15.44:0/3508332120 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f28900762d0 0x7f28900787e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2894033000 tx=0x7f2894008030 comp rx=0 tx=0).stop 2024-05-16T22:28:55.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.505+0000 7f28aab08640 1 -- 172.21.15.44:0/3508332120 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28a414e9d0 msgr2=0x7f28a41e4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:55.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.505+0000 7f28aab08640 1 --2- 172.21.15.44:0/3508332120 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28a414e9d0 0x7f28a41e4260 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f28a40bf8f0 tx=0x7f289c007bd0 comp rx=0 tx=0).stop 2024-05-16T22:28:55.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.506+0000 7f28aab08640 1 -- 172.21.15.44:0/3508332120 shutdown_connections 2024-05-16T22:28:55.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.506+0000 7f28aab08640 1 --2- 172.21.15.44:0/3508332120 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f28900762d0 0x7f28900787e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:55.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.506+0000 7f28aab08640 1 --2- 172.21.15.44:0/3508332120 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28a414e9d0 0x7f28a41e4260 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:55.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.506+0000 7f28aab08640 1 --2- 172.21.15.44:0/3508332120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28a414b0d0 0x7f28a414e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:55.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.506+0000 7f28aab08640 1 --2- 172.21.15.44:0/3508332120 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f288c003c60 0x7f28a40b8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:55.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.506+0000 7f28aab08640 1 -- 172.21.15.44:0/3508332120 >> 172.21.15.44:0/3508332120 conn(0x7f28a40c3d20 msgr2=0x7f28a40c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:28:55.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.506+0000 7f28aab08640 1 -- 172.21.15.44:0/3508332120 shutdown_connections 2024-05-16T22:28:55.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:52.506+0000 7f28aab08640 1 -- 172.21.15.44:0/3508332120 wait complete. 2024-05-16T22:28:55.890 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":76,"stamp":"2024-05-16T22:28:50.566819+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237040,"kb_used_data":4232,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737680,"statfs":{"total":773094113280,"available":772851384320,"internally_reserved":0,"allocated":4333568,"data_stored":2388228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003596"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.146970+0000","last_change":"2024-05-16T22:28:25.133922+0000","last_active":"2024-05-16T22:28:27.146970+0000","last_peered":"2024-05-16T22:28:27.146970+0000","last_clean":"2024-05-16T22:28:27.146970+0000","last_became_active":"2024-05-16T22:28:25.133614+0000","last_became_peered":"2024-05-16T22:28:25.133614+0000","last_unstale":"2024-05-16T22:28:27.146970+0000","last_undegraded":"2024-05-16T22:28:27.146970+0000","last_fullsized":"2024-05-16T22:28:27.146970+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:30:28.275470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.135885+0000","last_change":"2024-05-16T22:28:25.132180+0000","last_active":"2024-05-16T22:28:27.135885+0000","last_peered":"2024-05-16T22:28:27.135885+0000","last_clean":"2024-05-16T22:28:27.135885+0000","last_became_active":"2024-05-16T22:28:25.131840+0000","last_became_peered":"2024-05-16T22:28:25.131840+0000","last_unstale":"2024-05-16T22:28:27.135885+0000","last_undegraded":"2024-05-16T22:28:27.135885+0000","last_fullsized":"2024-05-16T22:28:27.135885+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:01:04.890716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.147507+0000","last_change":"2024-05-16T22:28:25.145313+0000","last_active":"2024-05-16T22:28:27.147507+0000","last_peered":"2024-05-16T22:28:27.147507+0000","last_clean":"2024-05-16T22:28:27.147507+0000","last_became_active":"2024-05-16T22:28:25.145018+0000","last_became_peered":"2024-05-16T22:28:25.145018+0000","last_unstale":"2024-05-16T22:28:27.147507+0000","last_undegraded":"2024-05-16T22:28:27.147507+0000","last_fullsized":"2024-05-16T22:28:27.147507+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:04:53.410394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.146228+0000","last_change":"2024-05-16T22:28:25.140103+0000","last_active":"2024-05-16T22:28:27.146228+0000","last_peered":"2024-05-16T22:28:27.146228+0000","last_clean":"2024-05-16T22:28:27.146228+0000","last_became_active":"2024-05-16T22:28:25.139693+0000","last_became_peered":"2024-05-16T22:28:25.139693+0000","last_unstale":"2024-05-16T22:28:27.146228+0000","last_undegraded":"2024-05-16T22:28:27.146228+0000","last_fullsized":"2024-05-16T22:28:27.146228+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:22:47.810153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.149954+0000","last_change":"2024-05-16T22:28:25.139319+0000","last_active":"2024-05-16T22:28:27.149954+0000","last_peered":"2024-05-16T22:28:27.149954+0000","last_clean":"2024-05-16T22:28:27.149954+0000","last_became_active":"2024-05-16T22:28:25.138050+0000","last_became_peered":"2024-05-16T22:28:25.138050+0000","last_unstale":"2024-05-16T22:28:27.149954+0000","last_undegraded":"2024-05-16T22:28:27.149954+0000","last_fullsized":"2024-05-16T22:28:27.149954+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:15:12.398211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.135678+0000","last_change":"2024-05-16T22:28:25.135924+0000","last_active":"2024-05-16T22:28:27.135678+0000","last_peered":"2024-05-16T22:28:27.135678+0000","last_clean":"2024-05-16T22:28:27.135678+0000","last_became_active":"2024-05-16T22:28:25.133351+0000","last_became_peered":"2024-05-16T22:28:25.133351+0000","last_unstale":"2024-05-16T22:28:27.135678+0000","last_undegraded":"2024-05-16T22:28:27.135678+0000","last_fullsized":"2024-05-16T22:28:27.135678+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:13:11.271883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.136093+0000","last_change":"2024-05-16T22:28:25.135384+0000","last_active":"2024-05-16T22:28:27.136093+0000","last_peered":"2024-05-16T22:28:27.136093+0000","last_clean":"2024-05-16T22:28:27.136093+0000","last_became_active":"2024-05-16T22:28:25.135086+0000","last_became_peered":"2024-05-16T22:28:25.135086+0000","last_unstale":"2024-05-16T22:28:27.136093+0000","last_undegraded":"2024-05-16T22:28:27.136093+0000","last_fullsized":"2024-05-16T22:28:27.136093+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:13:11.271883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.135682+0000","last_change":"2024-05-16T22:28:25.141069+0000","last_active":"2024-05-16T22:28:27.135682+0000","last_peered":"2024-05-16T22:28:27.135682+0000","last_clean":"2024-05-16T22:28:27.135682+0000","last_became_active":"2024-05-16T22:28:25.140719+0000","last_became_peered":"2024-05-16T22:28:25.140719+0000","last_unstale":"2024-05-16T22:28:27.135682+0000","last_undegraded":"2024-05-16T22:28:27.135682+0000","last_fullsized":"2024-05-16T22:28:27.135682+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:17:44.297474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.149715+0000","last_change":"2024-05-16T22:28:25.142859+0000","last_active":"2024-05-16T22:28:27.149715+0000","last_peered":"2024-05-16T22:28:27.149715+0000","last_clean":"2024-05-16T22:28:27.149715+0000","last_became_active":"2024-05-16T22:28:25.142576+0000","last_became_peered":"2024-05-16T22:28:25.142576+0000","last_unstale":"2024-05-16T22:28:27.149715+0000","last_undegraded":"2024-05-16T22:28:27.149715+0000","last_fullsized":"2024-05-16T22:28:27.149715+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:30:56.649366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.145532+0000","last_change":"2024-05-16T22:28:25.144818+0000","last_active":"2024-05-16T22:28:27.145532+0000","last_peered":"2024-05-16T22:28:27.145532+0000","last_clean":"2024-05-16T22:28:27.145532+0000","last_became_active":"2024-05-16T22:28:25.144459+0000","last_became_peered":"2024-05-16T22:28:25.144459+0000","last_unstale":"2024-05-16T22:28:27.145532+0000","last_undegraded":"2024-05-16T22:28:27.145532+0000","last_fullsized":"2024-05-16T22:28:27.145532+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:15:30.489744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.136436+0000","last_change":"2024-05-16T22:28:25.144429+0000","last_active":"2024-05-16T22:28:27.136436+0000","last_peered":"2024-05-16T22:28:27.136436+0000","last_clean":"2024-05-16T22:28:27.136436+0000","last_became_active":"2024-05-16T22:28:25.143998+0000","last_became_peered":"2024-05-16T22:28:25.143998+0000","last_unstale":"2024-05-16T22:28:27.136436+0000","last_undegraded":"2024-05-16T22:28:27.136436+0000","last_fullsized":"2024-05-16T22:28:27.136436+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:01:04.890716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.147047+0000","last_change":"2024-05-16T22:28:25.145927+0000","last_active":"2024-05-16T22:28:27.147047+0000","last_peered":"2024-05-16T22:28:27.147047+0000","last_clean":"2024-05-16T22:28:27.147047+0000","last_became_active":"2024-05-16T22:28:25.145626+0000","last_became_peered":"2024-05-16T22:28:25.145626+0000","last_unstale":"2024-05-16T22:28:27.147047+0000","last_undegraded":"2024-05-16T22:28:27.147047+0000","last_fullsized":"2024-05-16T22:28:27.147047+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:51:27.918280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.149750+0000","last_change":"2024-05-16T22:28:25.138083+0000","last_active":"2024-05-16T22:28:27.149750+0000","last_peered":"2024-05-16T22:28:27.149750+0000","last_clean":"2024-05-16T22:28:27.149750+0000","last_became_active":"2024-05-16T22:28:25.137738+0000","last_became_peered":"2024-05-16T22:28:25.137738+0000","last_unstale":"2024-05-16T22:28:27.149750+0000","last_undegraded":"2024-05-16T22:28:27.149750+0000","last_fullsized":"2024-05-16T22:28:27.149750+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:27:43.408332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.135515+0000","last_change":"2024-05-16T22:28:25.129793+0000","last_active":"2024-05-16T22:28:27.135515+0000","last_peered":"2024-05-16T22:28:27.135515+0000","last_clean":"2024-05-16T22:28:27.135515+0000","last_became_active":"2024-05-16T22:28:25.129458+0000","last_became_peered":"2024-05-16T22:28:25.129458+0000","last_unstale":"2024-05-16T22:28:27.135515+0000","last_undegraded":"2024-05-16T22:28:27.135515+0000","last_fullsized":"2024-05-16T22:28:27.135515+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:55:39.126558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.147279+0000","last_change":"2024-05-16T22:28:25.136981+0000","last_active":"2024-05-16T22:28:27.147279+0000","last_peered":"2024-05-16T22:28:27.147279+0000","last_clean":"2024-05-16T22:28:27.147279+0000","last_became_active":"2024-05-16T22:28:25.136671+0000","last_became_peered":"2024-05-16T22:28:25.136671+0000","last_unstale":"2024-05-16T22:28:27.147279+0000","last_undegraded":"2024-05-16T22:28:27.147279+0000","last_fullsized":"2024-05-16T22:28:27.147279+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:13:11.271883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.136141+0000","last_change":"2024-05-16T22:28:25.140801+0000","last_active":"2024-05-16T22:28:27.136141+0000","last_peered":"2024-05-16T22:28:27.136141+0000","last_clean":"2024-05-16T22:28:27.136141+0000","last_became_active":"2024-05-16T22:28:25.140188+0000","last_became_peered":"2024-05-16T22:28:25.140188+0000","last_unstale":"2024-05-16T22:28:27.136141+0000","last_undegraded":"2024-05-16T22:28:27.136141+0000","last_fullsized":"2024-05-16T22:28:27.136141+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:56:35.412674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.136649+0000","last_change":"2024-05-16T22:28:25.136128+0000","last_active":"2024-05-16T22:28:27.136649+0000","last_peered":"2024-05-16T22:28:27.136649+0000","last_clean":"2024-05-16T22:28:27.136649+0000","last_became_active":"2024-05-16T22:28:25.135816+0000","last_became_peered":"2024-05-16T22:28:25.135816+0000","last_unstale":"2024-05-16T22:28:27.136649+0000","last_undegraded":"2024-05-16T22:28:27.136649+0000","last_fullsized":"2024-05-16T22:28:27.136649+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:10:01.075196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.136100+0000","last_change":"2024-05-16T22:28:25.141692+0000","last_active":"2024-05-16T22:28:27.136100+0000","last_peered":"2024-05-16T22:28:27.136100+0000","last_clean":"2024-05-16T22:28:27.136100+0000","last_became_active":"2024-05-16T22:28:25.141358+0000","last_became_peered":"2024-05-16T22:28:25.141358+0000","last_unstale":"2024-05-16T22:28:27.136100+0000","last_undegraded":"2024-05-16T22:28:27.136100+0000","last_fullsized":"2024-05-16T22:28:27.136100+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:15:36.673232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.135670+0000","last_change":"2024-05-16T22:28:25.145342+0000","last_active":"2024-05-16T22:28:27.135670+0000","last_peered":"2024-05-16T22:28:27.135670+0000","last_clean":"2024-05-16T22:28:27.135670+0000","last_became_active":"2024-05-16T22:28:25.144979+0000","last_became_peered":"2024-05-16T22:28:25.144979+0000","last_unstale":"2024-05-16T22:28:27.135670+0000","last_undegraded":"2024-05-16T22:28:27.135670+0000","last_fullsized":"2024-05-16T22:28:27.135670+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:10:40.802675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.149696+0000","last_change":"2024-05-16T22:28:25.139441+0000","last_active":"2024-05-16T22:28:27.149696+0000","last_peered":"2024-05-16T22:28:27.149696+0000","last_clean":"2024-05-16T22:28:27.149696+0000","last_became_active":"2024-05-16T22:28:25.139107+0000","last_became_peered":"2024-05-16T22:28:25.139107+0000","last_unstale":"2024-05-16T22:28:27.149696+0000","last_undegraded":"2024-05-16T22:28:27.149696+0000","last_fullsized":"2024-05-16T22:28:27.149696+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:02:58.855363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.146509+0000","last_change":"2024-05-16T22:28:25.133279+0000","last_active":"2024-05-16T22:28:27.146509+0000","last_peered":"2024-05-16T22:28:27.146509+0000","last_clean":"2024-05-16T22:28:27.146509+0000","last_became_active":"2024-05-16T22:28:25.132924+0000","last_became_peered":"2024-05-16T22:28:25.132924+0000","last_unstale":"2024-05-16T22:28:27.146509+0000","last_undegraded":"2024-05-16T22:28:27.146509+0000","last_fullsized":"2024-05-16T22:28:27.146509+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:14:13.566727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.146660+0000","last_change":"2024-05-16T22:28:25.132955+0000","last_active":"2024-05-16T22:28:27.146660+0000","last_peered":"2024-05-16T22:28:27.146660+0000","last_clean":"2024-05-16T22:28:27.146660+0000","last_became_active":"2024-05-16T22:28:25.132508+0000","last_became_peered":"2024-05-16T22:28:25.132508+0000","last_unstale":"2024-05-16T22:28:27.146660+0000","last_undegraded":"2024-05-16T22:28:27.146660+0000","last_fullsized":"2024-05-16T22:28:27.146660+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:19:16.198221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.147461+0000","last_change":"2024-05-16T22:28:25.138421+0000","last_active":"2024-05-16T22:28:27.147461+0000","last_peered":"2024-05-16T22:28:27.147461+0000","last_clean":"2024-05-16T22:28:27.147461+0000","last_became_active":"2024-05-16T22:28:25.137691+0000","last_became_peered":"2024-05-16T22:28:25.137691+0000","last_unstale":"2024-05-16T22:28:27.147461+0000","last_undegraded":"2024-05-16T22:28:27.147461+0000","last_fullsized":"2024-05-16T22:28:27.147461+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:10:14.918313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.147193+0000","last_change":"2024-05-16T22:28:25.140241+0000","last_active":"2024-05-16T22:28:27.147193+0000","last_peered":"2024-05-16T22:28:27.147193+0000","last_clean":"2024-05-16T22:28:27.147193+0000","last_became_active":"2024-05-16T22:28:25.139933+0000","last_became_peered":"2024-05-16T22:28:25.139933+0000","last_unstale":"2024-05-16T22:28:27.147193+0000","last_undegraded":"2024-05-16T22:28:27.147193+0000","last_fullsized":"2024-05-16T22:28:27.147193+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:07:42.837164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.146525+0000","last_change":"2024-05-16T22:28:25.139344+0000","last_active":"2024-05-16T22:28:27.146525+0000","last_peered":"2024-05-16T22:28:27.146525+0000","last_clean":"2024-05-16T22:28:27.146525+0000","last_became_active":"2024-05-16T22:28:25.138885+0000","last_became_peered":"2024-05-16T22:28:25.138885+0000","last_unstale":"2024-05-16T22:28:27.146525+0000","last_undegraded":"2024-05-16T22:28:27.146525+0000","last_fullsized":"2024-05-16T22:28:27.146525+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:51:27.918280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.136114+0000","last_change":"2024-05-16T22:28:25.132924+0000","last_active":"2024-05-16T22:28:27.136114+0000","last_peered":"2024-05-16T22:28:27.136114+0000","last_clean":"2024-05-16T22:28:27.136114+0000","last_became_active":"2024-05-16T22:28:25.132601+0000","last_became_peered":"2024-05-16T22:28:25.132601+0000","last_unstale":"2024-05-16T22:28:27.136114+0000","last_undegraded":"2024-05-16T22:28:27.136114+0000","last_fullsized":"2024-05-16T22:28:27.136114+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:45:01.717370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.146277+0000","last_change":"2024-05-16T22:28:25.143854+0000","last_active":"2024-05-16T22:28:27.146277+0000","last_peered":"2024-05-16T22:28:27.146277+0000","last_clean":"2024-05-16T22:28:27.146277+0000","last_became_active":"2024-05-16T22:28:25.143521+0000","last_became_peered":"2024-05-16T22:28:25.143521+0000","last_unstale":"2024-05-16T22:28:27.146277+0000","last_undegraded":"2024-05-16T22:28:27.146277+0000","last_fullsized":"2024-05-16T22:28:27.146277+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:17:44.297474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.147474+0000","last_change":"2024-05-16T22:28:25.137918+0000","last_active":"2024-05-16T22:28:27.147474+0000","last_peered":"2024-05-16T22:28:27.147474+0000","last_clean":"2024-05-16T22:28:27.147474+0000","last_became_active":"2024-05-16T22:28:25.137610+0000","last_became_peered":"2024-05-16T22:28:25.137610+0000","last_unstale":"2024-05-16T22:28:27.147474+0000","last_undegraded":"2024-05-16T22:28:27.147474+0000","last_fullsized":"2024-05-16T22:28:27.147474+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:56:35.412674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.148039+0000","last_change":"2024-05-16T22:28:25.134027+0000","last_active":"2024-05-16T22:28:27.148039+0000","last_peered":"2024-05-16T22:28:27.148039+0000","last_clean":"2024-05-16T22:28:27.148039+0000","last_became_active":"2024-05-16T22:28:25.133675+0000","last_became_peered":"2024-05-16T22:28:25.133675+0000","last_unstale":"2024-05-16T22:28:27.148039+0000","last_undegraded":"2024-05-16T22:28:27.148039+0000","last_fullsized":"2024-05-16T22:28:27.148039+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:07:25.724126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.135950+0000","last_change":"2024-05-16T22:28:25.133367+0000","last_active":"2024-05-16T22:28:27.135950+0000","last_peered":"2024-05-16T22:28:27.135950+0000","last_clean":"2024-05-16T22:28:27.135950+0000","last_became_active":"2024-05-16T22:28:25.132750+0000","last_became_peered":"2024-05-16T22:28:25.132750+0000","last_unstale":"2024-05-16T22:28:27.135950+0000","last_undegraded":"2024-05-16T22:28:27.135950+0000","last_fullsized":"2024-05-16T22:28:27.135950+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:07:42.837164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.146185+0000","last_change":"2024-05-16T22:28:25.139732+0000","last_active":"2024-05-16T22:28:27.146185+0000","last_peered":"2024-05-16T22:28:27.146185+0000","last_clean":"2024-05-16T22:28:27.146185+0000","last_became_active":"2024-05-16T22:28:25.139417+0000","last_became_peered":"2024-05-16T22:28:25.139417+0000","last_unstale":"2024-05-16T22:28:27.146185+0000","last_undegraded":"2024-05-16T22:28:27.146185+0000","last_fullsized":"2024-05-16T22:28:27.146185+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:03:24.749982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.135692+0000","last_change":"2024-05-16T22:28:25.134493+0000","last_active":"2024-05-16T22:28:27.135692+0000","last_peered":"2024-05-16T22:28:27.135692+0000","last_clean":"2024-05-16T22:28:27.135692+0000","last_became_active":"2024-05-16T22:28:25.133628+0000","last_became_peered":"2024-05-16T22:28:25.133628+0000","last_unstale":"2024-05-16T22:28:27.135692+0000","last_undegraded":"2024-05-16T22:28:27.135692+0000","last_fullsized":"2024-05-16T22:28:27.135692+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:52:19.687304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.148036+0000","last_change":"2024-05-16T22:28:25.138102+0000","last_active":"2024-05-16T22:28:27.148036+0000","last_peered":"2024-05-16T22:28:27.148036+0000","last_clean":"2024-05-16T22:28:27.148036+0000","last_became_active":"2024-05-16T22:28:25.137703+0000","last_became_peered":"2024-05-16T22:28:25.137703+0000","last_unstale":"2024-05-16T22:28:27.148036+0000","last_undegraded":"2024-05-16T22:28:27.148036+0000","last_fullsized":"2024-05-16T22:28:27.148036+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:07:25.724126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.153034+0000","last_change":"2024-05-16T22:28:22.106753+0000","last_active":"2024-05-16T22:28:27.153034+0000","last_peered":"2024-05-16T22:28:27.153034+0000","last_clean":"2024-05-16T22:28:27.153034+0000","last_became_active":"2024-05-16T22:28:22.106441+0000","last_became_peered":"2024-05-16T22:28:22.106441+0000","last_unstale":"2024-05-16T22:28:27.153034+0000","last_undegraded":"2024-05-16T22:28:27.153034+0000","last_fullsized":"2024-05-16T22:28:27.153034+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:14:10.547488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.146457+0000","last_change":"2024-05-16T22:28:25.135818+0000","last_active":"2024-05-16T22:28:27.146457+0000","last_peered":"2024-05-16T22:28:27.146457+0000","last_clean":"2024-05-16T22:28:27.146457+0000","last_became_active":"2024-05-16T22:28:25.135509+0000","last_became_peered":"2024-05-16T22:28:25.135509+0000","last_unstale":"2024-05-16T22:28:27.146457+0000","last_undegraded":"2024-05-16T22:28:27.146457+0000","last_fullsized":"2024-05-16T22:28:27.146457+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:42:55.890324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.148220+0000","last_change":"2024-05-16T22:28:22.360464+0000","last_active":"2024-05-16T22:28:27.148220+0000","last_peered":"2024-05-16T22:28:27.148220+0000","last_clean":"2024-05-16T22:28:27.148220+0000","last_became_active":"2024-05-16T22:28:22.360059+0000","last_became_peered":"2024-05-16T22:28:22.360059+0000","last_unstale":"2024-05-16T22:28:27.148220+0000","last_undegraded":"2024-05-16T22:28:27.148220+0000","last_fullsized":"2024-05-16T22:28:27.148220+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:32:08.459699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.147118+0000","last_change":"2024-05-16T22:28:25.133445+0000","last_active":"2024-05-16T22:28:27.147118+0000","last_peered":"2024-05-16T22:28:27.147118+0000","last_clean":"2024-05-16T22:28:27.147118+0000","last_became_active":"2024-05-16T22:28:25.130250+0000","last_became_peered":"2024-05-16T22:28:25.130250+0000","last_unstale":"2024-05-16T22:28:27.147118+0000","last_undegraded":"2024-05-16T22:28:27.147118+0000","last_fullsized":"2024-05-16T22:28:27.147118+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:10:58.932522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.151165+0000","last_change":"2024-05-16T22:28:22.110905+0000","last_active":"2024-05-16T22:28:27.151165+0000","last_peered":"2024-05-16T22:28:27.151165+0000","last_clean":"2024-05-16T22:28:27.151165+0000","last_became_active":"2024-05-16T22:28:22.110563+0000","last_became_peered":"2024-05-16T22:28:22.110563+0000","last_unstale":"2024-05-16T22:28:27.151165+0000","last_undegraded":"2024-05-16T22:28:27.151165+0000","last_fullsized":"2024-05-16T22:28:27.151165+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:09:58.055956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.146341+0000","last_change":"2024-05-16T22:28:25.144239+0000","last_active":"2024-05-16T22:28:27.146341+0000","last_peered":"2024-05-16T22:28:27.146341+0000","last_clean":"2024-05-16T22:28:27.146341+0000","last_became_active":"2024-05-16T22:28:25.143880+0000","last_became_peered":"2024-05-16T22:28:25.143880+0000","last_unstale":"2024-05-16T22:28:27.146341+0000","last_undegraded":"2024-05-16T22:28:27.146341+0000","last_fullsized":"2024-05-16T22:28:27.146341+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:55:39.126558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.154198+0000","last_change":"2024-05-16T22:28:22.108864+0000","last_active":"2024-05-16T22:28:27.154198+0000","last_peered":"2024-05-16T22:28:27.154198+0000","last_clean":"2024-05-16T22:28:27.154198+0000","last_became_active":"2024-05-16T22:28:22.108340+0000","last_became_peered":"2024-05-16T22:28:22.108340+0000","last_unstale":"2024-05-16T22:28:27.154198+0000","last_undegraded":"2024-05-16T22:28:27.154198+0000","last_fullsized":"2024-05-16T22:28:27.154198+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:02:04.709374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.136003+0000","last_change":"2024-05-16T22:28:25.133079+0000","last_active":"2024-05-16T22:28:27.136003+0000","last_peered":"2024-05-16T22:28:27.136003+0000","last_clean":"2024-05-16T22:28:27.136003+0000","last_became_active":"2024-05-16T22:28:25.132406+0000","last_became_peered":"2024-05-16T22:28:25.132406+0000","last_unstale":"2024-05-16T22:28:27.136003+0000","last_undegraded":"2024-05-16T22:28:27.136003+0000","last_fullsized":"2024-05-16T22:28:27.136003+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:10:40.802675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.147099+0000","last_change":"2024-05-16T22:28:22.113682+0000","last_active":"2024-05-16T22:28:27.147099+0000","last_peered":"2024-05-16T22:28:27.147099+0000","last_clean":"2024-05-16T22:28:27.147099+0000","last_became_active":"2024-05-16T22:28:22.113347+0000","last_became_peered":"2024-05-16T22:28:22.113347+0000","last_unstale":"2024-05-16T22:28:27.147099+0000","last_undegraded":"2024-05-16T22:28:27.147099+0000","last_fullsized":"2024-05-16T22:28:27.147099+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:10:11.899074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.146174+0000","last_change":"2024-05-16T22:28:25.136162+0000","last_active":"2024-05-16T22:28:27.146174+0000","last_peered":"2024-05-16T22:28:27.146174+0000","last_clean":"2024-05-16T22:28:27.146174+0000","last_became_active":"2024-05-16T22:28:25.135037+0000","last_became_peered":"2024-05-16T22:28:25.135037+0000","last_unstale":"2024-05-16T22:28:27.146174+0000","last_undegraded":"2024-05-16T22:28:27.146174+0000","last_fullsized":"2024-05-16T22:28:27.146174+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:52:19.687304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.146465+0000","last_change":"2024-05-16T22:28:22.113590+0000","last_active":"2024-05-16T22:28:27.146465+0000","last_peered":"2024-05-16T22:28:27.146465+0000","last_clean":"2024-05-16T22:28:27.146465+0000","last_became_active":"2024-05-16T22:28:22.113334+0000","last_became_peered":"2024-05-16T22:28:22.113334+0000","last_unstale":"2024-05-16T22:28:27.146465+0000","last_undegraded":"2024-05-16T22:28:27.146465+0000","last_fullsized":"2024-05-16T22:28:27.146465+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:28:23.827905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.145602+0000","last_change":"2024-05-16T22:28:25.131093+0000","last_active":"2024-05-16T22:28:27.145602+0000","last_peered":"2024-05-16T22:28:27.145602+0000","last_clean":"2024-05-16T22:28:27.145602+0000","last_became_active":"2024-05-16T22:28:25.130738+0000","last_became_peered":"2024-05-16T22:28:25.130738+0000","last_unstale":"2024-05-16T22:28:27.145602+0000","last_undegraded":"2024-05-16T22:28:27.145602+0000","last_fullsized":"2024-05-16T22:28:27.145602+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:31:04.601858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.135463+0000","last_change":"2024-05-16T22:28:22.112253+0000","last_active":"2024-05-16T22:28:27.135463+0000","last_peered":"2024-05-16T22:28:27.135463+0000","last_clean":"2024-05-16T22:28:27.135463+0000","last_became_active":"2024-05-16T22:28:22.111906+0000","last_became_peered":"2024-05-16T22:28:22.111906+0000","last_unstale":"2024-05-16T22:28:27.135463+0000","last_undegraded":"2024-05-16T22:28:27.135463+0000","last_fullsized":"2024-05-16T22:28:27.135463+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:51:24.899040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.145447+0000","last_change":"2024-05-16T22:28:25.139184+0000","last_active":"2024-05-16T22:28:27.145447+0000","last_peered":"2024-05-16T22:28:27.145447+0000","last_clean":"2024-05-16T22:28:27.145447+0000","last_became_active":"2024-05-16T22:28:25.138810+0000","last_became_peered":"2024-05-16T22:28:25.138810+0000","last_unstale":"2024-05-16T22:28:27.145447+0000","last_undegraded":"2024-05-16T22:28:27.145447+0000","last_fullsized":"2024-05-16T22:28:27.145447+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:32:11.478939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.145865+0000","last_change":"2024-05-16T22:28:22.104994+0000","last_active":"2024-05-16T22:28:27.145865+0000","last_peered":"2024-05-16T22:28:27.145865+0000","last_clean":"2024-05-16T22:28:27.145865+0000","last_became_active":"2024-05-16T22:28:22.104619+0000","last_became_peered":"2024-05-16T22:28:22.104619+0000","last_unstale":"2024-05-16T22:28:27.145865+0000","last_undegraded":"2024-05-16T22:28:27.145865+0000","last_fullsized":"2024-05-16T22:28:27.145865+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:42:52.871084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.146652+0000","last_change":"2024-05-16T22:28:25.144872+0000","last_active":"2024-05-16T22:28:27.146652+0000","last_peered":"2024-05-16T22:28:27.146652+0000","last_clean":"2024-05-16T22:28:27.146652+0000","last_became_active":"2024-05-16T22:28:25.144477+0000","last_became_peered":"2024-05-16T22:28:25.144477+0000","last_unstale":"2024-05-16T22:28:27.146652+0000","last_undegraded":"2024-05-16T22:28:27.146652+0000","last_fullsized":"2024-05-16T22:28:27.146652+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:55:39.126558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.135785+0000","last_change":"2024-05-16T22:28:22.360598+0000","last_active":"2024-05-16T22:28:27.135785+0000","last_peered":"2024-05-16T22:28:27.135785+0000","last_clean":"2024-05-16T22:28:27.135785+0000","last_became_active":"2024-05-16T22:28:22.360235+0000","last_became_peered":"2024-05-16T22:28:22.360235+0000","last_unstale":"2024-05-16T22:28:27.135785+0000","last_undegraded":"2024-05-16T22:28:27.135785+0000","last_fullsized":"2024-05-16T22:28:27.135785+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:56:32.393435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.135586+0000","last_change":"2024-05-16T22:28:25.141509+0000","last_active":"2024-05-16T22:28:27.135586+0000","last_peered":"2024-05-16T22:28:27.135586+0000","last_clean":"2024-05-16T22:28:27.135586+0000","last_became_active":"2024-05-16T22:28:25.140644+0000","last_became_peered":"2024-05-16T22:28:25.140644+0000","last_unstale":"2024-05-16T22:28:27.135586+0000","last_undegraded":"2024-05-16T22:28:27.135586+0000","last_fullsized":"2024-05-16T22:28:27.135586+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:07:42.837164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.148505+0000","last_change":"2024-05-16T22:28:22.112113+0000","last_active":"2024-05-16T22:28:27.148505+0000","last_peered":"2024-05-16T22:28:27.148505+0000","last_clean":"2024-05-16T22:28:27.148505+0000","last_became_active":"2024-05-16T22:28:22.111768+0000","last_became_peered":"2024-05-16T22:28:22.111768+0000","last_unstale":"2024-05-16T22:28:27.148505+0000","last_undegraded":"2024-05-16T22:28:27.148505+0000","last_fullsized":"2024-05-16T22:28:27.148505+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:30:53.630126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.135872+0000","last_change":"2024-05-16T22:28:25.134837+0000","last_active":"2024-05-16T22:28:27.135872+0000","last_peered":"2024-05-16T22:28:27.135872+0000","last_clean":"2024-05-16T22:28:27.135872+0000","last_became_active":"2024-05-16T22:28:25.132388+0000","last_became_peered":"2024-05-16T22:28:25.132388+0000","last_unstale":"2024-05-16T22:28:27.135872+0000","last_undegraded":"2024-05-16T22:28:27.135872+0000","last_fullsized":"2024-05-16T22:28:27.135872+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:04:53.410394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.152241+0000","last_change":"2024-05-16T22:28:22.360327+0000","last_active":"2024-05-16T22:28:27.152241+0000","last_peered":"2024-05-16T22:28:27.152241+0000","last_clean":"2024-05-16T22:28:27.152241+0000","last_became_active":"2024-05-16T22:28:22.359963+0000","last_became_peered":"2024-05-16T22:28:22.359963+0000","last_unstale":"2024-05-16T22:28:27.152241+0000","last_undegraded":"2024-05-16T22:28:27.152241+0000","last_fullsized":"2024-05-16T22:28:27.152241+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:07:30.885205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.148341+0000","last_change":"2024-05-16T22:28:25.145369+0000","last_active":"2024-05-16T22:28:27.148341+0000","last_peered":"2024-05-16T22:28:27.148341+0000","last_clean":"2024-05-16T22:28:27.148341+0000","last_became_active":"2024-05-16T22:28:25.145061+0000","last_became_peered":"2024-05-16T22:28:25.145061+0000","last_unstale":"2024-05-16T22:28:27.148341+0000","last_undegraded":"2024-05-16T22:28:27.148341+0000","last_fullsized":"2024-05-16T22:28:27.148341+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:15:36.673232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.154406+0000","last_change":"2024-05-16T22:28:22.111243+0000","last_active":"2024-05-16T22:28:27.154406+0000","last_peered":"2024-05-16T22:28:27.154406+0000","last_clean":"2024-05-16T22:28:27.154406+0000","last_became_active":"2024-05-16T22:28:22.110905+0000","last_became_peered":"2024-05-16T22:28:22.110905+0000","last_unstale":"2024-05-16T22:28:27.154406+0000","last_undegraded":"2024-05-16T22:28:27.154406+0000","last_fullsized":"2024-05-16T22:28:27.154406+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:07:30.885205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.145997+0000","last_change":"2024-05-16T22:28:25.140367+0000","last_active":"2024-05-16T22:28:27.145997+0000","last_peered":"2024-05-16T22:28:27.145997+0000","last_clean":"2024-05-16T22:28:27.145997+0000","last_became_active":"2024-05-16T22:28:25.140017+0000","last_became_peered":"2024-05-16T22:28:25.140017+0000","last_unstale":"2024-05-16T22:28:27.145997+0000","last_undegraded":"2024-05-16T22:28:27.145997+0000","last_fullsized":"2024-05-16T22:28:27.145997+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:23:28.509629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.151214+0000","last_change":"2024-05-16T22:28:22.105649+0000","last_active":"2024-05-16T22:28:27.151214+0000","last_peered":"2024-05-16T22:28:27.151214+0000","last_clean":"2024-05-16T22:28:27.151214+0000","last_became_active":"2024-05-16T22:28:22.105327+0000","last_became_peered":"2024-05-16T22:28:22.105327+0000","last_unstale":"2024-05-16T22:28:27.151214+0000","last_undegraded":"2024-05-16T22:28:27.151214+0000","last_fullsized":"2024-05-16T22:28:27.151214+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:32:13.089792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.135432+0000","last_change":"2024-05-16T22:28:25.134449+0000","last_active":"2024-05-16T22:28:27.135432+0000","last_peered":"2024-05-16T22:28:27.135432+0000","last_clean":"2024-05-16T22:28:27.135432+0000","last_became_active":"2024-05-16T22:28:25.134128+0000","last_became_peered":"2024-05-16T22:28:25.134128+0000","last_unstale":"2024-05-16T22:28:27.135432+0000","last_undegraded":"2024-05-16T22:28:27.135432+0000","last_fullsized":"2024-05-16T22:28:27.135432+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:52:19.687304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.146238+0000","last_change":"2024-05-16T22:28:22.107768+0000","last_active":"2024-05-16T22:28:27.146238+0000","last_peered":"2024-05-16T22:28:27.146238+0000","last_clean":"2024-05-16T22:28:27.146238+0000","last_became_active":"2024-05-16T22:28:22.107378+0000","last_became_peered":"2024-05-16T22:28:22.107378+0000","last_unstale":"2024-05-16T22:28:27.146238+0000","last_undegraded":"2024-05-16T22:28:27.146238+0000","last_fullsized":"2024-05-16T22:28:27.146238+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:52:16.668065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.135908+0000","last_change":"2024-05-16T22:28:25.134758+0000","last_active":"2024-05-16T22:28:27.135908+0000","last_peered":"2024-05-16T22:28:27.135908+0000","last_clean":"2024-05-16T22:28:27.135908+0000","last_became_active":"2024-05-16T22:28:25.134005+0000","last_became_peered":"2024-05-16T22:28:25.134005+0000","last_unstale":"2024-05-16T22:28:27.135908+0000","last_undegraded":"2024-05-16T22:28:27.135908+0000","last_fullsized":"2024-05-16T22:28:27.135908+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:51:27.918280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.135042+0000","last_change":"2024-05-16T22:28:22.360850+0000","last_active":"2024-05-16T22:28:27.135042+0000","last_peered":"2024-05-16T22:28:27.135042+0000","last_clean":"2024-05-16T22:28:27.135042+0000","last_became_active":"2024-05-16T22:28:22.360072+0000","last_became_peered":"2024-05-16T22:28:22.360072+0000","last_unstale":"2024-05-16T22:28:27.135042+0000","last_undegraded":"2024-05-16T22:28:27.135042+0000","last_fullsized":"2024-05-16T22:28:27.135042+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:12:46.825158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.146420+0000","last_change":"2024-05-16T22:28:25.131230+0000","last_active":"2024-05-16T22:28:27.146420+0000","last_peered":"2024-05-16T22:28:27.146420+0000","last_clean":"2024-05-16T22:28:27.146420+0000","last_became_active":"2024-05-16T22:28:25.130877+0000","last_became_peered":"2024-05-16T22:28:25.130877+0000","last_unstale":"2024-05-16T22:28:27.146420+0000","last_undegraded":"2024-05-16T22:28:27.146420+0000","last_fullsized":"2024-05-16T22:28:27.146420+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:28:26.847144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.151487+0000","last_change":"2024-05-16T22:28:22.111596+0000","last_active":"2024-05-16T22:28:27.151487+0000","last_peered":"2024-05-16T22:28:27.151487+0000","last_clean":"2024-05-16T22:28:27.151487+0000","last_became_active":"2024-05-16T22:28:22.110350+0000","last_became_peered":"2024-05-16T22:28:22.110350+0000","last_unstale":"2024-05-16T22:28:27.151487+0000","last_undegraded":"2024-05-16T22:28:27.151487+0000","last_fullsized":"2024-05-16T22:28:27.151487+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:17:41.278235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.149422+0000","last_change":"2024-05-16T22:28:25.133928+0000","last_active":"2024-05-16T22:28:27.149422+0000","last_peered":"2024-05-16T22:28:27.149422+0000","last_clean":"2024-05-16T22:28:27.149422+0000","last_became_active":"2024-05-16T22:28:25.133589+0000","last_became_peered":"2024-05-16T22:28:25.133589+0000","last_unstale":"2024-05-16T22:28:27.149422+0000","last_undegraded":"2024-05-16T22:28:27.149422+0000","last_fullsized":"2024-05-16T22:28:27.149422+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:32:11.478939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.146975+0000","last_change":"2024-05-16T22:28:22.113552+0000","last_active":"2024-05-16T22:28:27.146975+0000","last_peered":"2024-05-16T22:28:27.146975+0000","last_clean":"2024-05-16T22:28:27.146975+0000","last_became_active":"2024-05-16T22:28:22.113199+0000","last_became_peered":"2024-05-16T22:28:22.113199+0000","last_unstale":"2024-05-16T22:28:27.146975+0000","last_undegraded":"2024-05-16T22:28:27.146975+0000","last_fullsized":"2024-05-16T22:28:27.146975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:07:39.817925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.147539+0000","last_change":"2024-05-16T22:28:25.139252+0000","last_active":"2024-05-16T22:28:27.147539+0000","last_peered":"2024-05-16T22:28:27.147539+0000","last_clean":"2024-05-16T22:28:27.147539+0000","last_became_active":"2024-05-16T22:28:25.138961+0000","last_became_peered":"2024-05-16T22:28:25.138961+0000","last_unstale":"2024-05-16T22:28:27.147539+0000","last_undegraded":"2024-05-16T22:28:27.147539+0000","last_fullsized":"2024-05-16T22:28:27.147539+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:01:04.890716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.151928+0000","last_change":"2024-05-16T22:28:22.104921+0000","last_active":"2024-05-16T22:28:27.151928+0000","last_peered":"2024-05-16T22:28:27.151928+0000","last_clean":"2024-05-16T22:28:27.151928+0000","last_became_active":"2024-05-16T22:28:22.104579+0000","last_became_peered":"2024-05-16T22:28:22.104579+0000","last_unstale":"2024-05-16T22:28:27.151928+0000","last_undegraded":"2024-05-16T22:28:27.151928+0000","last_fullsized":"2024-05-16T22:28:27.151928+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:15:27.470505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.145683+0000","last_change":"2024-05-16T22:28:25.138216+0000","last_active":"2024-05-16T22:28:27.145683+0000","last_peered":"2024-05-16T22:28:27.145683+0000","last_clean":"2024-05-16T22:28:27.145683+0000","last_became_active":"2024-05-16T22:28:25.137897+0000","last_became_peered":"2024-05-16T22:28:25.137897+0000","last_unstale":"2024-05-16T22:28:27.145683+0000","last_undegraded":"2024-05-16T22:28:27.145683+0000","last_fullsized":"2024-05-16T22:28:27.145683+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:30:56.649366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.149824+0000","last_change":"2024-05-16T22:28:22.103517+0000","last_active":"2024-05-16T22:28:27.149824+0000","last_peered":"2024-05-16T22:28:27.149824+0000","last_clean":"2024-05-16T22:28:27.149824+0000","last_became_active":"2024-05-16T22:28:22.102808+0000","last_became_peered":"2024-05-16T22:28:22.102808+0000","last_unstale":"2024-05-16T22:28:27.149824+0000","last_undegraded":"2024-05-16T22:28:27.149824+0000","last_fullsized":"2024-05-16T22:28:27.149824+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:23:25.490389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.149822+0000","last_change":"2024-05-16T22:28:25.141247+0000","last_active":"2024-05-16T22:28:27.149822+0000","last_peered":"2024-05-16T22:28:27.149822+0000","last_clean":"2024-05-16T22:28:27.149822+0000","last_became_active":"2024-05-16T22:28:25.140922+0000","last_became_peered":"2024-05-16T22:28:25.140922+0000","last_unstale":"2024-05-16T22:28:27.149822+0000","last_undegraded":"2024-05-16T22:28:27.149822+0000","last_fullsized":"2024-05-16T22:28:27.149822+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:33:18.560884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.148989+0000","last_change":"2024-05-16T22:28:22.111941+0000","last_active":"2024-05-16T22:28:27.148989+0000","last_peered":"2024-05-16T22:28:27.148989+0000","last_clean":"2024-05-16T22:28:27.148989+0000","last_became_active":"2024-05-16T22:28:22.111633+0000","last_became_peered":"2024-05-16T22:28:22.111633+0000","last_unstale":"2024-05-16T22:28:27.148989+0000","last_undegraded":"2024-05-16T22:28:27.148989+0000","last_fullsized":"2024-05-16T22:28:27.148989+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:34:27.123768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.149592+0000","last_change":"2024-05-16T22:28:25.134854+0000","last_active":"2024-05-16T22:28:27.149592+0000","last_peered":"2024-05-16T22:28:27.149592+0000","last_clean":"2024-05-16T22:28:27.149592+0000","last_became_active":"2024-05-16T22:28:25.134458+0000","last_became_peered":"2024-05-16T22:28:25.134458+0000","last_unstale":"2024-05-16T22:28:27.149592+0000","last_undegraded":"2024-05-16T22:28:27.149592+0000","last_fullsized":"2024-05-16T22:28:27.149592+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:25:43.462461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.154181+0000","last_change":"2024-05-16T22:28:22.110116+0000","last_active":"2024-05-16T22:28:27.154181+0000","last_peered":"2024-05-16T22:28:27.154181+0000","last_clean":"2024-05-16T22:28:27.154181+0000","last_became_active":"2024-05-16T22:28:22.109761+0000","last_became_peered":"2024-05-16T22:28:22.109761+0000","last_unstale":"2024-05-16T22:28:27.154181+0000","last_undegraded":"2024-05-16T22:28:27.154181+0000","last_fullsized":"2024-05-16T22:28:27.154181+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:23:25.490389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.150005+0000","last_change":"2024-05-16T22:28:25.133539+0000","last_active":"2024-05-16T22:28:27.150005+0000","last_peered":"2024-05-16T22:28:27.150005+0000","last_clean":"2024-05-16T22:28:27.150005+0000","last_became_active":"2024-05-16T22:28:25.133206+0000","last_became_peered":"2024-05-16T22:28:25.133206+0000","last_unstale":"2024-05-16T22:28:27.150005+0000","last_undegraded":"2024-05-16T22:28:27.150005+0000","last_fullsized":"2024-05-16T22:28:27.150005+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:01:15.424193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.146164+0000","last_change":"2024-05-16T22:28:22.108925+0000","last_active":"2024-05-16T22:28:27.146164+0000","last_peered":"2024-05-16T22:28:27.146164+0000","last_clean":"2024-05-16T22:28:27.146164+0000","last_became_active":"2024-05-16T22:28:22.108596+0000","last_became_peered":"2024-05-16T22:28:22.108596+0000","last_unstale":"2024-05-16T22:28:27.146164+0000","last_undegraded":"2024-05-16T22:28:27.146164+0000","last_fullsized":"2024-05-16T22:28:27.146164+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:18:37.142117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.148998+0000","last_change":"2024-05-16T22:28:25.132733+0000","last_active":"2024-05-16T22:28:27.148998+0000","last_peered":"2024-05-16T22:28:27.148998+0000","last_clean":"2024-05-16T22:28:27.148998+0000","last_became_active":"2024-05-16T22:28:25.132391+0000","last_became_peered":"2024-05-16T22:28:25.132391+0000","last_unstale":"2024-05-16T22:28:27.148998+0000","last_undegraded":"2024-05-16T22:28:27.148998+0000","last_fullsized":"2024-05-16T22:28:27.148998+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:24:50.614166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.146290+0000","last_change":"2024-05-16T22:28:22.108404+0000","last_active":"2024-05-16T22:28:27.146290+0000","last_peered":"2024-05-16T22:28:27.146290+0000","last_clean":"2024-05-16T22:28:27.146290+0000","last_became_active":"2024-05-16T22:28:22.108070+0000","last_became_peered":"2024-05-16T22:28:22.108070+0000","last_unstale":"2024-05-16T22:28:27.146290+0000","last_undegraded":"2024-05-16T22:28:27.146290+0000","last_fullsized":"2024-05-16T22:28:27.146290+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:18:37.142117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.135789+0000","last_change":"2024-05-16T22:28:25.134609+0000","last_active":"2024-05-16T22:28:27.135789+0000","last_peered":"2024-05-16T22:28:27.135789+0000","last_clean":"2024-05-16T22:28:27.135789+0000","last_became_active":"2024-05-16T22:28:25.134275+0000","last_became_peered":"2024-05-16T22:28:25.134275+0000","last_unstale":"2024-05-16T22:28:27.135789+0000","last_undegraded":"2024-05-16T22:28:27.135789+0000","last_fullsized":"2024-05-16T22:28:27.135789+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:55:39.126558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.146782+0000","last_change":"2024-05-16T22:28:22.360743+0000","last_active":"2024-05-16T22:28:27.146782+0000","last_peered":"2024-05-16T22:28:27.146782+0000","last_clean":"2024-05-16T22:28:27.146782+0000","last_became_active":"2024-05-16T22:28:22.360219+0000","last_became_peered":"2024-05-16T22:28:22.360219+0000","last_unstale":"2024-05-16T22:28:27.146782+0000","last_undegraded":"2024-05-16T22:28:27.146782+0000","last_fullsized":"2024-05-16T22:28:27.146782+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:10:37.783435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.149362+0000","last_change":"2024-05-16T22:28:25.143383+0000","last_active":"2024-05-16T22:28:27.149362+0000","last_peered":"2024-05-16T22:28:27.149362+0000","last_clean":"2024-05-16T22:28:27.149362+0000","last_became_active":"2024-05-16T22:28:25.143000+0000","last_became_peered":"2024-05-16T22:28:25.143000+0000","last_unstale":"2024-05-16T22:28:27.149362+0000","last_undegraded":"2024-05-16T22:28:27.149362+0000","last_fullsized":"2024-05-16T22:28:27.149362+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:19:41.138517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.151499+0000","last_change":"2024-05-16T22:28:22.110457+0000","last_active":"2024-05-16T22:28:27.151499+0000","last_peered":"2024-05-16T22:28:27.151499+0000","last_clean":"2024-05-16T22:28:27.151499+0000","last_became_active":"2024-05-16T22:28:22.110026+0000","last_became_peered":"2024-05-16T22:28:22.110026+0000","last_unstale":"2024-05-16T22:28:27.151499+0000","last_undegraded":"2024-05-16T22:28:27.151499+0000","last_fullsized":"2024-05-16T22:28:27.151499+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:10:37.783435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.147728+0000","last_change":"2024-05-16T22:28:25.141835+0000","last_active":"2024-05-16T22:28:27.147728+0000","last_peered":"2024-05-16T22:28:27.147728+0000","last_clean":"2024-05-16T22:28:27.147728+0000","last_became_active":"2024-05-16T22:28:25.141435+0000","last_became_peered":"2024-05-16T22:28:25.141435+0000","last_unstale":"2024-05-16T22:28:27.147728+0000","last_undegraded":"2024-05-16T22:28:27.147728+0000","last_fullsized":"2024-05-16T22:28:27.147728+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:10:01.075196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"34'1","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.148382+0000","last_change":"2024-05-16T22:28:22.108917+0000","last_active":"2024-05-16T22:28:27.148382+0000","last_peered":"2024-05-16T22:28:27.148382+0000","last_clean":"2024-05-16T22:28:27.148382+0000","last_became_active":"2024-05-16T22:28:22.108557+0000","last_became_peered":"2024-05-16T22:28:22.108557+0000","last_unstale":"2024-05-16T22:28:27.148382+0000","last_undegraded":"2024-05-16T22:28:27.148382+0000","last_fullsized":"2024-05-16T22:28:27.148382+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:15:27.470505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.147745+0000","last_change":"2024-05-16T22:28:25.140626+0000","last_active":"2024-05-16T22:28:27.147745+0000","last_peered":"2024-05-16T22:28:27.147745+0000","last_clean":"2024-05-16T22:28:27.147745+0000","last_became_active":"2024-05-16T22:28:25.140298+0000","last_became_peered":"2024-05-16T22:28:25.140298+0000","last_unstale":"2024-05-16T22:28:27.147745+0000","last_undegraded":"2024-05-16T22:28:27.147745+0000","last_fullsized":"2024-05-16T22:28:27.147745+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:10:58.932522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.146042+0000","last_change":"2024-05-16T22:28:22.107827+0000","last_active":"2024-05-16T22:28:27.146042+0000","last_peered":"2024-05-16T22:28:27.146042+0000","last_clean":"2024-05-16T22:28:27.146042+0000","last_became_active":"2024-05-16T22:28:22.107458+0000","last_became_peered":"2024-05-16T22:28:22.107458+0000","last_unstale":"2024-05-16T22:28:27.146042+0000","last_undegraded":"2024-05-16T22:28:27.146042+0000","last_fullsized":"2024-05-16T22:28:27.146042+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:12:46.825158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.145800+0000","last_change":"2024-05-16T22:28:25.132368+0000","last_active":"2024-05-16T22:28:27.145800+0000","last_peered":"2024-05-16T22:28:27.145800+0000","last_clean":"2024-05-16T22:28:27.145800+0000","last_became_active":"2024-05-16T22:28:25.132025+0000","last_became_peered":"2024-05-16T22:28:25.132025+0000","last_unstale":"2024-05-16T22:28:27.145800+0000","last_undegraded":"2024-05-16T22:28:27.145800+0000","last_fullsized":"2024-05-16T22:28:27.145800+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:41:49.770349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.148174+0000","last_change":"2024-05-16T22:28:22.107462+0000","last_active":"2024-05-16T22:28:27.148174+0000","last_peered":"2024-05-16T22:28:27.148174+0000","last_clean":"2024-05-16T22:28:27.148174+0000","last_became_active":"2024-05-16T22:28:22.107067+0000","last_became_peered":"2024-05-16T22:28:22.107067+0000","last_unstale":"2024-05-16T22:28:27.148174+0000","last_undegraded":"2024-05-16T22:28:27.148174+0000","last_fullsized":"2024-05-16T22:28:27.148174+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:34:27.123768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.147840+0000","last_change":"2024-05-16T22:28:25.131916+0000","last_active":"2024-05-16T22:28:27.147840+0000","last_peered":"2024-05-16T22:28:27.147840+0000","last_clean":"2024-05-16T22:28:27.147840+0000","last_became_active":"2024-05-16T22:28:25.131503+0000","last_became_peered":"2024-05-16T22:28:25.131503+0000","last_unstale":"2024-05-16T22:28:27.147840+0000","last_undegraded":"2024-05-16T22:28:27.147840+0000","last_fullsized":"2024-05-16T22:28:27.147840+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:32:16.109032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.146148+0000","last_change":"2024-05-16T22:28:22.106472+0000","last_active":"2024-05-16T22:28:27.146148+0000","last_peered":"2024-05-16T22:28:27.146148+0000","last_clean":"2024-05-16T22:28:27.146148+0000","last_became_active":"2024-05-16T22:28:22.106105+0000","last_became_peered":"2024-05-16T22:28:22.106105+0000","last_unstale":"2024-05-16T22:28:27.146148+0000","last_undegraded":"2024-05-16T22:28:27.146148+0000","last_fullsized":"2024-05-16T22:28:27.146148+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:05:28.377682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.135154+0000","last_change":"2024-05-16T22:28:25.136424+0000","last_active":"2024-05-16T22:28:27.135154+0000","last_peered":"2024-05-16T22:28:27.135154+0000","last_clean":"2024-05-16T22:28:27.135154+0000","last_became_active":"2024-05-16T22:28:25.136018+0000","last_became_peered":"2024-05-16T22:28:25.136018+0000","last_unstale":"2024-05-16T22:28:27.135154+0000","last_undegraded":"2024-05-16T22:28:27.135154+0000","last_fullsized":"2024-05-16T22:28:27.135154+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:05:31.396921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.146500+0000","last_change":"2024-05-16T22:28:22.106541+0000","last_active":"2024-05-16T22:28:27.146500+0000","last_peered":"2024-05-16T22:28:27.146500+0000","last_clean":"2024-05-16T22:28:27.146500+0000","last_became_active":"2024-05-16T22:28:22.106188+0000","last_became_peered":"2024-05-16T22:28:22.106188+0000","last_unstale":"2024-05-16T22:28:27.146500+0000","last_undegraded":"2024-05-16T22:28:27.146500+0000","last_fullsized":"2024-05-16T22:28:27.146500+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:30:25.256231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.146305+0000","last_change":"2024-05-16T22:28:25.134738+0000","last_active":"2024-05-16T22:28:27.146305+0000","last_peered":"2024-05-16T22:28:27.146305+0000","last_clean":"2024-05-16T22:28:27.146305+0000","last_became_active":"2024-05-16T22:28:25.134288+0000","last_became_peered":"2024-05-16T22:28:25.134288+0000","last_unstale":"2024-05-16T22:28:27.146305+0000","last_undegraded":"2024-05-16T22:28:27.146305+0000","last_fullsized":"2024-05-16T22:28:27.146305+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:03:24.749982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.135139+0000","last_change":"2024-05-16T22:28:22.360846+0000","last_active":"2024-05-16T22:28:27.135139+0000","last_peered":"2024-05-16T22:28:27.135139+0000","last_clean":"2024-05-16T22:28:27.135139+0000","last_became_active":"2024-05-16T22:28:22.360345+0000","last_became_peered":"2024-05-16T22:28:22.360345+0000","last_unstale":"2024-05-16T22:28:27.135139+0000","last_undegraded":"2024-05-16T22:28:27.135139+0000","last_fullsized":"2024-05-16T22:28:27.135139+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:22:44.790913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.136328+0000","last_change":"2024-05-16T22:28:25.139698+0000","last_active":"2024-05-16T22:28:27.136328+0000","last_peered":"2024-05-16T22:28:27.136328+0000","last_clean":"2024-05-16T22:28:27.136328+0000","last_became_active":"2024-05-16T22:28:25.139387+0000","last_became_peered":"2024-05-16T22:28:25.139387+0000","last_unstale":"2024-05-16T22:28:27.136328+0000","last_undegraded":"2024-05-16T22:28:27.136328+0000","last_fullsized":"2024-05-16T22:28:27.136328+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:24.107807+0000","last_clean_scrub_stamp":"2024-05-16T22:28:24.107807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:04:53.410394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.145845+0000","last_change":"2024-05-16T22:28:22.108557+0000","last_active":"2024-05-16T22:28:27.145845+0000","last_peered":"2024-05-16T22:28:27.145845+0000","last_clean":"2024-05-16T22:28:27.145845+0000","last_became_active":"2024-05-16T22:28:22.108226+0000","last_became_peered":"2024-05-16T22:28:22.108226+0000","last_unstale":"2024-05-16T22:28:27.145845+0000","last_undegraded":"2024-05-16T22:28:27.145845+0000","last_fullsized":"2024-05-16T22:28:27.145845+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:28:21.088568+0000","last_clean_scrub_stamp":"2024-05-16T22:28:21.088568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:31:01.582618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":134,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-16T22:28:27.136058+0000","last_change":"2024-05-16T22:27:15.950850+0000","last_active":"2024-05-16T22:28:27.136058+0000","last_peered":"2024-05-16T22:28:27.136058+0000","last_clean":"2024-05-16T22:28:27.136058+0000","last_became_active":"2024-05-16T22:27:15.949553+0000","last_became_peered":"2024-05-16T22:27:15.949553+0000","last_unstale":"2024-05-16T22:28:27.136058+0000","last_undegraded":"2024-05-16T22:28:27.136058+0000","last_fullsized":"2024-05-16T22:28:27.136058+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:14.702385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:14.702385+0000","last_clean_scrub_stamp":"2024-05-16T22:27:14.702385+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:46:07.495562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542167,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":983040,"data_stored":740792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":393216,"data_stored":150950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":393216,"data_stored":151006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":393216,"data_stored":150438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":151968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":389120,"data_stored":150404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":151968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":978944,"data_stored":740702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-16T22:28:55.926 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-16T22:28:55.957 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-16T22:28:56.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.122+0000 7fc784738640 1 Processor -- start 2024-05-16T22:28:56.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.123+0000 7fc784738640 1 -- start start 2024-05-16T22:28:56.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.124+0000 7fc784738640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc77c146070 0x7fc77c146480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:56.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.124+0000 7fc784738640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc77c14c7e0 0x7fc77c14cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:56.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.124+0000 7fc784738640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc77c1469c0 con 0x7fc77c0c10a0 2024-05-16T22:28:56.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.124+0000 7fc784738640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fc77c0a1200 con 0x7fc77c14c7e0 2024-05-16T22:28:56.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.124+0000 7fc784738640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fc77c14c350 con 0x7fc77c146070 2024-05-16T22:28:56.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.124+0000 7fc782cd5640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc77c14c7e0 0x7fc77c14cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:56.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.124+0000 7fc782cd5640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc77c14c7e0 0x7fc77c14cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49556/0 (socket says 172.21.15.44:49556) 2024-05-16T22:28:56.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.124+0000 7fc782cd5640 1 -- 172.21.15.44:0/484866206 learned_addr learned my addr 172.21.15.44:0/484866206 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:28:56.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.124+0000 7fc781cd3640 1 --2- 172.21.15.44:0/484866206 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc77c146070 0x7fc77c146480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:56.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.124+0000 7fc782cd5640 1 -- 172.21.15.44:0/484866206 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc77c146070 msgr2=0x7fc77c146480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:28:56.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.124+0000 7fc782cd5640 1 --2- 172.21.15.44:0/484866206 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc77c146070 0x7fc77c146480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:56.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.124+0000 7fc782cd5640 1 -- 172.21.15.44:0/484866206 >> v1:172.21.15.44:6789/0 conn(0x7fc77c0c10a0 legacy=0x7fc77c14f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:56.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.124+0000 7fc782cd5640 1 -- 172.21.15.44:0/484866206 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc77c14ffe0 con 0x7fc77c14c7e0 2024-05-16T22:28:56.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.124+0000 7fc7814d2640 1 -- 172.21.15.44:0/484866206 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1574509305 0 0) 0x7fc77c1469c0 con 0x7fc77c0c10a0 2024-05-16T22:28:56.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.124+0000 7fc781cd3640 1 --2- 172.21.15.44:0/484866206 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc77c146070 0x7fc77c146480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:28:56.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.125+0000 7fc782cd5640 1 --2- 172.21.15.44:0/484866206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc77c14c7e0 0x7fc77c14cbf0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc76c009e50 tx=0x7fc76c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9021115b95733655 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:56.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.125+0000 7fc7814d2640 1 -- 172.21.15.44:0/484866206 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76c036070 con 0x7fc77c14c7e0 2024-05-16T22:28:56.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.125+0000 7fc7814d2640 1 -- 172.21.15.44:0/484866206 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc76c031600 con 0x7fc77c14c7e0 2024-05-16T22:28:56.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.125+0000 7fc7814d2640 1 -- 172.21.15.44:0/484866206 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76c0319d0 con 0x7fc77c14c7e0 2024-05-16T22:28:56.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.126+0000 7fc784738640 1 -- 172.21.15.44:0/484866206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc77c14c7e0 msgr2=0x7fc77c14cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:56.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.126+0000 7fc784738640 1 --2- 172.21.15.44:0/484866206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc77c14c7e0 0x7fc77c14cbf0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc76c009e50 tx=0x7fc76c02a7a0 comp rx=0 tx=0).stop 2024-05-16T22:28:56.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.126+0000 7fc784738640 1 -- 172.21.15.44:0/484866206 shutdown_connections 2024-05-16T22:28:57.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.126+0000 7fc784738640 1 --2- 172.21.15.44:0/484866206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc77c14c7e0 0x7fc77c14cbf0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:57.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.126+0000 7fc784738640 1 --2- 172.21.15.44:0/484866206 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc77c146070 0x7fc77c146480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:57.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.126+0000 7fc784738640 1 -- 172.21.15.44:0/484866206 >> 172.21.15.44:0/484866206 conn(0x7fc77c0c1830 msgr2=0x7fc77c0c1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:28:57.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.126+0000 7fc784738640 1 -- 172.21.15.44:0/484866206 shutdown_connections 2024-05-16T22:28:57.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.126+0000 7fc784738640 1 -- 172.21.15.44:0/484866206 wait complete. 2024-05-16T22:28:57.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.128+0000 7fc784738640 1 Processor -- start 2024-05-16T22:28:57.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.128+0000 7fc784738640 1 -- start start 2024-05-16T22:28:57.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.129+0000 7fc784738640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc77c0c10a0 0x7fc77c148ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:57.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.129+0000 7fc784738640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc77c146070 0x7fc77c149810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:57.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.129+0000 7fc784738640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc77c14c7e0 0x7fc77c1e5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:57.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.129+0000 7fc784738640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc77c0c14b0 con 0x7fc77c146070 2024-05-16T22:28:57.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.129+0000 7fc784738640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc77c1505a0 con 0x7fc77c14c7e0 2024-05-16T22:28:57.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.129+0000 7fc784738640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fc77c14d130 con 0x7fc77c0c10a0 2024-05-16T22:28:57.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.129+0000 7fc781cd3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc77c146070 0x7fc77c149810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:57.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.129+0000 7fc781cd3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc77c146070 0x7fc77c149810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49562/0 (socket says 172.21.15.44:49562) 2024-05-16T22:28:57.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.129+0000 7fc781cd3640 1 -- 172.21.15.44:0/60315820 learned_addr learned my addr 172.21.15.44:0/60315820 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:28:57.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.129+0000 7fc7824d4640 1 --2- 172.21.15.44:0/60315820 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc77c0c10a0 0x7fc77c148ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:57.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.129+0000 7fc782cd5640 1 --2- 172.21.15.44:0/60315820 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc77c14c7e0 0x7fc77c1e5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:57.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.129+0000 7fc781cd3640 1 -- 172.21.15.44:0/60315820 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc77c0c10a0 msgr2=0x7fc77c148ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:57.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.129+0000 7fc781cd3640 1 --2- 172.21.15.44:0/60315820 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc77c0c10a0 0x7fc77c148ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:57.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.129+0000 7fc781cd3640 1 -- 172.21.15.44:0/60315820 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc77c14c7e0 msgr2=0x7fc77c1e5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:57.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.129+0000 7fc781cd3640 1 --2- 172.21.15.44:0/60315820 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc77c14c7e0 0x7fc77c1e5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:57.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.129+0000 7fc781cd3640 1 -- 172.21.15.44:0/60315820 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc77c149d50 con 0x7fc77c146070 2024-05-16T22:28:57.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.129+0000 7fc782cd5640 1 --2- 172.21.15.44:0/60315820 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc77c14c7e0 0x7fc77c1e5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:28:57.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.130+0000 7fc781cd3640 1 --2- 172.21.15.44:0/60315820 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc77c146070 0x7fc77c149810 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc77000d800 tx=0x7fc77000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:57.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.130+0000 7fc77affd640 1 -- 172.21.15.44:0/60315820 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc770004030 con 0x7fc77c146070 2024-05-16T22:28:57.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.130+0000 7fc77affd640 1 -- 172.21.15.44:0/60315820 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7700041d0 con 0x7fc77c146070 2024-05-16T22:28:58.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.130+0000 7fc784738640 1 -- 172.21.15.44:0/60315820 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc77c1e60a0 con 0x7fc77c146070 2024-05-16T22:28:58.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.130+0000 7fc77affd640 1 -- 172.21.15.44:0/60315820 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc77000b6c0 con 0x7fc77c146070 2024-05-16T22:28:58.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.130+0000 7fc784738640 1 -- 172.21.15.44:0/60315820 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc77c0a7610 con 0x7fc77c146070 2024-05-16T22:28:58.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.131+0000 7fc784738640 1 -- 172.21.15.44:0/60315820 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc77c0a7370 con 0x7fc77c146070 2024-05-16T22:28:58.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.131+0000 7fc77affd640 1 -- 172.21.15.44:0/60315820 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc77000b860 con 0x7fc77c146070 2024-05-16T22:28:58.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.132+0000 7fc77affd640 1 --2- 172.21.15.44:0/60315820 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fc768076300 0x7fc768078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:58.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.132+0000 7fc77affd640 1 -- 172.21.15.44:0/60315820 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fc7700977b0 con 0x7fc77c146070 2024-05-16T22:28:58.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.132+0000 7fc7824d4640 1 --2- 172.21.15.44:0/60315820 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fc768076300 0x7fc768078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:58.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.133+0000 7fc7824d4640 1 --2- 172.21.15.44:0/60315820 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fc768076300 0x7fc768078810 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc774000f60 tx=0x7fc774009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:58.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.137+0000 7fc77affd640 1 -- 172.21.15.44:0/60315820 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc77c0a7370 con 0x7fc77c146070 2024-05-16T22:28:58.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.401+0000 7fc784738640 1 -- 172.21.15.44:0/60315820 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fc77c0691f0 con 0x7fc77c146070 2024-05-16T22:28:58.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.406+0000 7fc77affd640 1 -- 172.21.15.44:0/60315820 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7fc770061080 con 0x7fc77c146070 2024-05-16T22:28:58.443 INFO:teuthology.orchestra.run.smithi044.stdout:[client.0] 2024-05-16T22:28:58.475 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQAXiEZms3dqGBAAS4ISUkubc7YrigOk4RRlXA== 2024-05-16T22:28:58.509 INFO:teuthology.orchestra.run.smithi044.stdout: caps mds = "allow" 2024-05-16T22:28:58.542 INFO:teuthology.orchestra.run.smithi044.stdout: caps mon = "allow r" 2024-05-16T22:28:58.576 INFO:teuthology.orchestra.run.smithi044.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-16T22:28:58.610 INFO:teuthology.orchestra.run.smithi044.stderr:updated caps for client.0 2024-05-16T22:28:58.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.407+0000 7fc784738640 1 -- 172.21.15.44:0/60315820 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fc768076300 msgr2=0x7fc768078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:58.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.407+0000 7fc784738640 1 --2- 172.21.15.44:0/60315820 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fc768076300 0x7fc768078810 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc774000f60 tx=0x7fc774009040 comp rx=0 tx=0).stop 2024-05-16T22:28:58.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.407+0000 7fc784738640 1 -- 172.21.15.44:0/60315820 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc77c146070 msgr2=0x7fc77c149810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:58.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.407+0000 7fc784738640 1 --2- 172.21.15.44:0/60315820 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc77c146070 0x7fc77c149810 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc77000d800 tx=0x7fc77000dcc0 comp rx=0 tx=0).stop 2024-05-16T22:28:58.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.407+0000 7fc784738640 1 -- 172.21.15.44:0/60315820 shutdown_connections 2024-05-16T22:28:58.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.407+0000 7fc784738640 1 --2- 172.21.15.44:0/60315820 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fc768076300 0x7fc768078810 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:58.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.407+0000 7fc784738640 1 --2- 172.21.15.44:0/60315820 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc77c14c7e0 0x7fc77c1e5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:58.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.407+0000 7fc784738640 1 --2- 172.21.15.44:0/60315820 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc77c146070 0x7fc77c149810 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:58.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.407+0000 7fc784738640 1 --2- 172.21.15.44:0/60315820 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc77c0c10a0 0x7fc77c148ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:59.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.407+0000 7fc784738640 1 -- 172.21.15.44:0/60315820 >> 172.21.15.44:0/60315820 conn(0x7fc77c0c1830 msgr2=0x7fc77c0a3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:28:59.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.408+0000 7fc784738640 1 -- 172.21.15.44:0/60315820 shutdown_connections 2024-05-16T22:28:59.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:56.408+0000 7fc784738640 1 -- 172.21.15.44:0/60315820 wait complete. 2024-05-16T22:28:59.101 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T22:28:59.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.272+0000 7f7f81bc5640 1 Processor -- start 2024-05-16T22:28:59.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.272+0000 7f7f81bc5640 1 -- start start 2024-05-16T22:28:59.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.273+0000 7f7f81bc5640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7f7c14cf30 0x7f7f7c06c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:59.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.273+0000 7f7f81bc5640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7f7c0bbd10 0x7f7f7c14ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:28:59.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.273+0000 7f7f81bc5640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f7c0bf340 con 0x7f7f7c0bb900 2024-05-16T22:28:59.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.273+0000 7f7f81bc5640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f7f7c074710 con 0x7f7f7c14cf30 2024-05-16T22:28:59.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.274+0000 7f7f81bc5640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f7f7c0bf5d0 con 0x7f7f7c0bbd10 2024-05-16T22:28:59.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.274+0000 7f7f7b7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7f7c14cf30 0x7f7f7c06c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:59.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.274+0000 7f7f7b7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7f7c14cf30 0x7f7f7c06c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49578/0 (socket says 172.21.15.44:49578) 2024-05-16T22:28:59.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.274+0000 7f7f7b7fe640 1 -- 172.21.15.44:0/2122634351 learned_addr learned my addr 172.21.15.44:0/2122634351 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:28:59.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.274+0000 7f7f7bfff640 1 --2- 172.21.15.44:0/2122634351 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7f7c0bbd10 0x7f7f7c14ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:28:59.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.274+0000 7f7f7b7fe640 1 -- 172.21.15.44:0/2122634351 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7f7c0bbd10 msgr2=0x7f7f7c14ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:28:59.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.274+0000 7f7f7b7fe640 1 --2- 172.21.15.44:0/2122634351 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7f7c0bbd10 0x7f7f7c14ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:28:59.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.274+0000 7f7f7b7fe640 1 -- 172.21.15.44:0/2122634351 >> v1:172.21.15.70:6789/0 conn(0x7f7f7c0bb900 legacy=0x7f7f7c14f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:28:59.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.274+0000 7f7f7b7fe640 1 -- 172.21.15.44:0/2122634351 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f7c074b00 con 0x7f7f7c14cf30 2024-05-16T22:28:59.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.275+0000 7f7f7b7fe640 1 --2- 172.21.15.44:0/2122634351 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f7c14cf30 0x7f7f7c06c6e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c009870 tx=0x7f7f6c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc6e7de0825d12de server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:28:59.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.275+0000 7f7f7affd640 1 -- 172.21.15.44:0/2122634351 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c037070 con 0x7f7f7c14cf30 2024-05-16T22:28:59.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.275+0000 7f7f7affd640 1 -- 172.21.15.44:0/2122634351 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f6c032440 con 0x7f7f7c14cf30 2024-05-16T22:28:59.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.275+0000 7f7f7affd640 1 -- 172.21.15.44:0/2122634351 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c032810 con 0x7f7f7c14cf30 2024-05-16T22:28:59.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.276+0000 7f7f81bc5640 1 -- 172.21.15.44:0/2122634351 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f7c14cf30 msgr2=0x7f7f7c06c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:29:00.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.276+0000 7f7f81bc5640 1 --2- 172.21.15.44:0/2122634351 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f7c14cf30 0x7f7f7c06c6e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c009870 tx=0x7f7f6c02a270 comp rx=0 tx=0).stop 2024-05-16T22:29:00.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.276+0000 7f7f81bc5640 1 -- 172.21.15.44:0/2122634351 shutdown_connections 2024-05-16T22:29:00.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.276+0000 7f7f81bc5640 1 --2- 172.21.15.44:0/2122634351 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7f7c0bbd10 0x7f7f7c14ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:29:00.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.276+0000 7f7f81bc5640 1 --2- 172.21.15.44:0/2122634351 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f7c14cf30 0x7f7f7c06c6e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:29:00.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.276+0000 7f7f81bc5640 1 -- 172.21.15.44:0/2122634351 >> 172.21.15.44:0/2122634351 conn(0x7f7f7c0bd160 msgr2=0x7f7f7c0bd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:29:00.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.276+0000 7f7f81bc5640 1 -- 172.21.15.44:0/2122634351 shutdown_connections 2024-05-16T22:29:00.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.276+0000 7f7f81bc5640 1 -- 172.21.15.44:0/2122634351 wait complete. 2024-05-16T22:29:00.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.278+0000 7f7f81bc5640 1 Processor -- start 2024-05-16T22:29:00.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.278+0000 7f7f81bc5640 1 -- start start 2024-05-16T22:29:00.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.279+0000 7f7f81bc5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f7c0bb900 0x7f7f7c1d6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:29:00.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.279+0000 7f7f81bc5640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7f7c0bbd10 0x7f7f7c1e2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:29:00.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.279+0000 7f7f81bc5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f7c14cf30 0x7f7f7c1403c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:29:00.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.279+0000 7f7f81bc5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7c0bfaf0 con 0x7f7f7c14cf30 2024-05-16T22:29:00.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.279+0000 7f7f81bc5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7c06ce30 con 0x7f7f7c0bb900 2024-05-16T22:29:00.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.279+0000 7f7f81bc5640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f7f7c0bfc70 con 0x7f7f7c0bbd10 2024-05-16T22:29:00.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.279+0000 7f7f7bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f7c14cf30 0x7f7f7c1403c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:29:00.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.279+0000 7f7f7bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f7c14cf30 0x7f7f7c1403c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49590/0 (socket says 172.21.15.44:49590) 2024-05-16T22:29:00.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.279+0000 7f7f7bfff640 1 -- 172.21.15.44:0/3479226364 learned_addr learned my addr 172.21.15.44:0/3479226364 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:29:00.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.279+0000 7f7f72ffd640 1 --2- 172.21.15.44:0/3479226364 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7f7c0bbd10 0x7f7f7c1e2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:29:00.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.279+0000 7f7f7b7fe640 1 --2- 172.21.15.44:0/3479226364 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f7c0bb900 0x7f7f7c1d6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:29:00.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.279+0000 7f7f7bfff640 1 -- 172.21.15.44:0/3479226364 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7f7c0bbd10 msgr2=0x7f7f7c1e2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:29:00.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.279+0000 7f7f7bfff640 1 --2- 172.21.15.44:0/3479226364 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7f7c0bbd10 0x7f7f7c1e2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:29:00.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.279+0000 7f7f7bfff640 1 -- 172.21.15.44:0/3479226364 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f7c0bb900 msgr2=0x7f7f7c1d6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:29:00.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.279+0000 7f7f7bfff640 1 --2- 172.21.15.44:0/3479226364 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f7c0bb900 0x7f7f7c1d6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:29:00.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.280+0000 7f7f7bfff640 1 -- 172.21.15.44:0/3479226364 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f7c1d7510 con 0x7f7f7c14cf30 2024-05-16T22:29:01.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.280+0000 7f7f7bfff640 1 --2- 172.21.15.44:0/3479226364 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f7c14cf30 0x7f7f7c1403c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7f7400efc0 tx=0x7f7f7400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:29:01.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.280+0000 7f7f78ff9640 1 -- 172.21.15.44:0/3479226364 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f74018020 con 0x7f7f7c14cf30 2024-05-16T22:29:01.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.280+0000 7f7f78ff9640 1 -- 172.21.15.44:0/3479226364 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f74014480 con 0x7f7f7c14cf30 2024-05-16T22:29:01.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.280+0000 7f7f81bc5640 1 -- 172.21.15.44:0/3479226364 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f7c147cd0 con 0x7f7f7c14cf30 2024-05-16T22:29:01.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.280+0000 7f7f78ff9640 1 -- 172.21.15.44:0/3479226364 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f74014870 con 0x7f7f7c14cf30 2024-05-16T22:29:01.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.280+0000 7f7f81bc5640 1 -- 172.21.15.44:0/3479226364 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f7c1e2e00 con 0x7f7f7c14cf30 2024-05-16T22:29:01.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.281+0000 7f7f81bc5640 1 -- 172.21.15.44:0/3479226364 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f7c069b50 con 0x7f7f7c14cf30 2024-05-16T22:29:01.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.282+0000 7f7f78ff9640 1 -- 172.21.15.44:0/3479226364 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7f74005d10 con 0x7f7f7c14cf30 2024-05-16T22:29:01.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.282+0000 7f7f78ff9640 1 --2- 172.21.15.44:0/3479226364 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f7f5c0762d0 0x7f7f5c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:29:01.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.282+0000 7f7f78ff9640 1 -- 172.21.15.44:0/3479226364 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f7f740982e0 con 0x7f7f7c14cf30 2024-05-16T22:29:01.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.283+0000 7f7f7b7fe640 1 --2- 172.21.15.44:0/3479226364 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f7f5c0762d0 0x7f7f5c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:29:01.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.283+0000 7f7f7b7fe640 1 --2- 172.21.15.44:0/3479226364 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f7f5c0762d0 0x7f7f5c0787e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c034000 tx=0x7f7f6c02e000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:29:01.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.288+0000 7f7f78ff9640 1 -- 172.21.15.44:0/3479226364 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7f74022030 con 0x7f7f7c14cf30 2024-05-16T22:29:01.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.518+0000 7f7f81bc5640 1 -- 172.21.15.44:0/3479226364 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7f7c050940 con 0x7f7f7c14cf30 2024-05-16T22:29:01.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.518+0000 7f7f78ff9640 1 -- 172.21.15.44:0/3479226364 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+4357 (secure 0 0 0) 0x7f7f74010040 con 0x7f7f7c14cf30 2024-05-16T22:29:01.570 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:29:01.603 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4657,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3963814730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3963814730},{"type":"v1","addr":"172.21.15.70:6835","nonce":3963814730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4672,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/3024807024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3024807024},{"type":"v1","addr":"172.21.15.44:6835","nonce":3024807024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T22:28:26.864128+0000","modified":"2024-05-16T22:28:38.972823+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4728},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4728":{"gid":4728,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.44:6834/2647971069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2647971069},{"type":"v1","addr":"172.21.15.44:6834","nonce":2647971069}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4728,"qdb_cluster":[4728]},"id":2}]} 2024-05-16T22:29:01.638 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 16 2024-05-16T22:29:01.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.521+0000 7f7f81bc5640 1 -- 172.21.15.44:0/3479226364 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f7f5c0762d0 msgr2=0x7f7f5c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:29:01.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.521+0000 7f7f81bc5640 1 --2- 172.21.15.44:0/3479226364 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f7f5c0762d0 0x7f7f5c0787e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c034000 tx=0x7f7f6c02e000 comp rx=0 tx=0).stop 2024-05-16T22:29:01.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.521+0000 7f7f81bc5640 1 -- 172.21.15.44:0/3479226364 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f7c14cf30 msgr2=0x7f7f7c1403c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:29:01.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.521+0000 7f7f81bc5640 1 --2- 172.21.15.44:0/3479226364 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f7c14cf30 0x7f7f7c1403c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7f7400efc0 tx=0x7f7f7400c490 comp rx=0 tx=0).stop 2024-05-16T22:29:01.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.521+0000 7f7f81bc5640 1 -- 172.21.15.44:0/3479226364 shutdown_connections 2024-05-16T22:29:01.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.521+0000 7f7f81bc5640 1 --2- 172.21.15.44:0/3479226364 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f7f5c0762d0 0x7f7f5c0787e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:29:01.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.521+0000 7f7f81bc5640 1 --2- 172.21.15.44:0/3479226364 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7f7c0bbd10 0x7f7f7c1e2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:29:01.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.521+0000 7f7f81bc5640 1 --2- 172.21.15.44:0/3479226364 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f7c14cf30 0x7f7f7c1403c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:29:01.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.521+0000 7f7f81bc5640 1 --2- 172.21.15.44:0/3479226364 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f7c0bb900 0x7f7f7c1d6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:29:02.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.521+0000 7f7f81bc5640 1 -- 172.21.15.44:0/3479226364 >> 172.21.15.44:0/3479226364 conn(0x7f7f7c0bd160 msgr2=0x7f7f7c0a52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:29:02.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.521+0000 7f7f81bc5640 1 -- 172.21.15.44:0/3479226364 shutdown_connections 2024-05-16T22:29:02.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:28:59.521+0000 7f7f81bc5640 1 -- 172.21.15.44:0/3479226364 wait complete. 2024-05-16T22:29:02.431 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-16T22:28:26.864128+0000', 'modified': '2024-05-16T22:28:38.972823+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4728}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4728': {'gid': 4728, 'name': 'c', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.44:6834/2647971069', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6833', 'nonce': 2647971069}, {'type': 'v1', 'addr': '172.21.15.44:6834', 'nonce': 2647971069}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4728, 'qdb_cluster': [4728]} 2024-05-16T22:29:02.495 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-16T22:29:02.529 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-16T22:29:02.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.693+0000 7f00348a8640 1 Processor -- start 2024-05-16T22:29:02.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.693+0000 7f00348a8640 1 -- start start 2024-05-16T22:29:02.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.694+0000 7f00348a8640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f00300a3bd0 0x7f00300bb940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:29:02.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.694+0000 7f00348a8640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f003014fa20 0x7f003014fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:29:02.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.694+0000 7f00348a8640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00301469c0 con 0x7f00300bc8d0 2024-05-16T22:29:02.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.694+0000 7f00348a8640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f00300a49e0 con 0x7f003014fa20 2024-05-16T22:29:02.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.694+0000 7f00348a8640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f00300a40b0 con 0x7f00300a3bd0 2024-05-16T22:29:02.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.695+0000 7f002dd9b640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f00300bc8d0 0x7f00301462b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46934/0 (socket says 172.21.15.44:46934) 2024-05-16T22:29:03.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.695+0000 7f002dd9b640 1 -- 172.21.15.44:0/723546882 learned_addr learned my addr 172.21.15.44:0/723546882 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:29:03.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.695+0000 7f002e59c640 1 --2- 172.21.15.44:0/723546882 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f00300a3bd0 0x7f00300bb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:29:03.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.695+0000 7f002ed9d640 1 --2- 172.21.15.44:0/723546882 >> v2:172.21.15.70:3300/0 conn(0x7f003014fa20 0x7f003014fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:29:03.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.695+0000 7f002d59a640 1 -- 172.21.15.44:0/723546882 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2064227062 0 0) 0x7f00301469c0 con 0x7f00300bc8d0 2024-05-16T22:29:03.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.695+0000 7f002d59a640 1 -- 172.21.15.44:0/723546882 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f001c003520 con 0x7f00300bc8d0 2024-05-16T22:29:03.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.695+0000 7f002ed9d640 1 -- 172.21.15.44:0/723546882 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f00300a3bd0 msgr2=0x7f00300bb940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:29:03.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.695+0000 7f002ed9d640 1 --2- 172.21.15.44:0/723546882 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f00300a3bd0 0x7f00300bb940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:29:03.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.695+0000 7f002ed9d640 1 -- 172.21.15.44:0/723546882 >> v1:172.21.15.44:6789/0 conn(0x7f00300bc8d0 legacy=0x7f00301462b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:29:03.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.695+0000 7f002ed9d640 1 -- 172.21.15.44:0/723546882 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00300a4390 con 0x7f003014fa20 2024-05-16T22:29:03.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.695+0000 7f002e59c640 1 --2- 172.21.15.44:0/723546882 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f00300a3bd0 0x7f00300bb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:29:03.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.696+0000 7f002ed9d640 1 --2- 172.21.15.44:0/723546882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f003014fa20 0x7f003014fe30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0028009d90 tx=0x7f002802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ba0fbca7d621816 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:29:03.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.696+0000 7f002d59a640 1 -- 172.21.15.44:0/723546882 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0028007740 con 0x7f003014fa20 2024-05-16T22:29:03.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.696+0000 7f002d59a640 1 -- 172.21.15.44:0/723546882 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00280078e0 con 0x7f003014fa20 2024-05-16T22:29:03.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.696+0000 7f002d59a640 1 -- 172.21.15.44:0/723546882 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0028007c90 con 0x7f003014fa20 2024-05-16T22:29:03.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.697+0000 7f00348a8640 1 -- 172.21.15.44:0/723546882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f003014fa20 msgr2=0x7f003014fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:29:03.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.697+0000 7f00348a8640 1 --2- 172.21.15.44:0/723546882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f003014fa20 0x7f003014fe30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0028009d90 tx=0x7f002802a660 comp rx=0 tx=0).stop 2024-05-16T22:29:03.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.697+0000 7f00348a8640 1 -- 172.21.15.44:0/723546882 shutdown_connections 2024-05-16T22:29:03.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.697+0000 7f00348a8640 1 --2- 172.21.15.44:0/723546882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f003014fa20 0x7f003014fe30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:29:03.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.697+0000 7f00348a8640 1 --2- 172.21.15.44:0/723546882 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f00300a3bd0 0x7f00300bb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:29:03.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.697+0000 7f00348a8640 1 -- 172.21.15.44:0/723546882 >> 172.21.15.44:0/723546882 conn(0x7f00300a1ac0 msgr2=0x7f00300bbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:29:03.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.697+0000 7f00348a8640 1 -- 172.21.15.44:0/723546882 shutdown_connections 2024-05-16T22:29:03.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.697+0000 7f00348a8640 1 -- 172.21.15.44:0/723546882 wait complete. 2024-05-16T22:29:03.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.699+0000 7f00348a8640 1 Processor -- start 2024-05-16T22:29:03.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.699+0000 7f00348a8640 1 -- start start 2024-05-16T22:29:03.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.700+0000 7f00348a8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00300a3bd0 0x7f00300b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:29:03.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.700+0000 7f00348a8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00300bc8d0 0x7f003014ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:29:03.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.700+0000 7f00348a8640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f003014fa20 0x7f0030149c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:29:04.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.700+0000 7f00348a8640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f00300bcce0 con 0x7f00300a3bd0 2024-05-16T22:29:04.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.700+0000 7f00348a8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0030150370 con 0x7f00300bc8d0 2024-05-16T22:29:04.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.700+0000 7f00348a8640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f00300bce60 con 0x7f003014fa20 2024-05-16T22:29:04.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.700+0000 7f002e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00300a3bd0 0x7f00300b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:29:04.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.700+0000 7f002e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00300a3bd0 0x7f00300b78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37212/0 (socket says 172.21.15.44:37212) 2024-05-16T22:29:04.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.700+0000 7f002e59c640 1 -- 172.21.15.44:0/683645358 learned_addr learned my addr 172.21.15.44:0/683645358 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:29:04.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.700+0000 7f002ed9d640 1 --2- 172.21.15.44:0/683645358 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f003014fa20 0x7f0030149c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:29:04.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.700+0000 7f002dd9b640 1 --2- 172.21.15.44:0/683645358 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00300bc8d0 0x7f003014ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:29:04.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.701+0000 7f002e59c640 1 -- 172.21.15.44:0/683645358 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f003014fa20 msgr2=0x7f0030149c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:29:04.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.701+0000 7f002e59c640 1 --2- 172.21.15.44:0/683645358 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f003014fa20 0x7f0030149c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:29:04.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.701+0000 7f002e59c640 1 -- 172.21.15.44:0/683645358 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00300bc8d0 msgr2=0x7f003014ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:29:04.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.701+0000 7f002e59c640 1 --2- 172.21.15.44:0/683645358 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00300bc8d0 0x7f003014ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:29:04.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.701+0000 7f002e59c640 1 -- 172.21.15.44:0/683645358 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f003014cf40 con 0x7f00300a3bd0 2024-05-16T22:29:04.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.701+0000 7f002e59c640 1 --2- 172.21.15.44:0/683645358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00300a3bd0 0x7f00300b78d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f002000e960 tx=0x7f002000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:29:04.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.701+0000 7f0026ffd640 1 -- 172.21.15.44:0/683645358 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0020017070 con 0x7f00300a3bd0 2024-05-16T22:29:04.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.701+0000 7f0026ffd640 1 -- 172.21.15.44:0/683645358 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f002000ca00 con 0x7f00300a3bd0 2024-05-16T22:29:04.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.701+0000 7f00348a8640 1 -- 172.21.15.44:0/683645358 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00301e21c0 con 0x7f00300a3bd0 2024-05-16T22:29:04.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.701+0000 7f0026ffd640 1 -- 172.21.15.44:0/683645358 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002000cdd0 con 0x7f00300a3bd0 2024-05-16T22:29:04.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.701+0000 7f00348a8640 1 -- 172.21.15.44:0/683645358 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00301e2740 con 0x7f00300a3bd0 2024-05-16T22:29:04.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.703+0000 7f0026ffd640 1 -- 172.21.15.44:0/683645358 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f002001a070 con 0x7f00300a3bd0 2024-05-16T22:29:04.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.703+0000 7f0026ffd640 1 --2- 172.21.15.44:0/683645358 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0010076300 0x7f0010078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:29:04.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.704+0000 7f0026ffd640 1 -- 172.21.15.44:0/683645358 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f00200973b0 con 0x7f00300a3bd0 2024-05-16T22:29:04.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.704+0000 7f002dd9b640 1 --2- 172.21.15.44:0/683645358 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0010076300 0x7f0010078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:29:04.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.704+0000 7f003b837740 1 Processor -- start 2024-05-16T22:29:04.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.704+0000 7f002dd9b640 1 --2- 172.21.15.44:0/683645358 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0010076300 0x7f0010078810 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0018005880 tx=0x7f0018006aa0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:29:04.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.704+0000 7f003b837740 1 -- start start 2024-05-16T22:29:04.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.705+0000 7f003b837740 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55921eaf3270 0x55921eecc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:29:05.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.705+0000 7f003b837740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55921eaca3b0 0x55921ee90670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:29:05.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.705+0000 7f003b837740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55921ead2590 0x55921eec12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:29:05.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.705+0000 7f003b837740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55921ee06f10 con 0x55921ead2590 2024-05-16T22:29:05.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.705+0000 7f003b837740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55921edf6ab0 con 0x55921eaca3b0 2024-05-16T22:29:05.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.705+0000 7f003b837740 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x55921edfaaf0 con 0x55921eaf3270 2024-05-16T22:29:05.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.705+0000 7f002ed9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55921ead2590 0x55921eec12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:29:05.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.705+0000 7f002e59c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55921eaf3270 0x55921eecc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:29:05.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.706+0000 7f002ed9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55921ead2590 0x55921eec12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37220/0 (socket says 172.21.15.44:37220) 2024-05-16T22:29:05.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.706+0000 7f002dd9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55921eaca3b0 0x55921ee90670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:29:05.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.706+0000 7f002ed9d640 1 -- 172.21.15.44:0/1341036628 learned_addr learned my addr 172.21.15.44:0/1341036628 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:29:05.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.706+0000 7f002dd9b640 1 -- 172.21.15.44:0/1341036628 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55921eaf3270 msgr2=0x55921eecc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:29:05.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.706+0000 7f002dd9b640 1 --2- 172.21.15.44:0/1341036628 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55921eaf3270 0x55921eecc1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:29:05.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.706+0000 7f002dd9b640 1 -- 172.21.15.44:0/1341036628 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55921ead2590 msgr2=0x55921eec12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:29:05.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.706+0000 7f002dd9b640 1 --2- 172.21.15.44:0/1341036628 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55921ead2590 0x55921eec12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:29:05.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.706+0000 7f002dd9b640 1 -- 172.21.15.44:0/1341036628 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55921edba5d0 con 0x55921eaca3b0 2024-05-16T22:29:05.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.706+0000 7f002dd9b640 1 --2- 172.21.15.44:0/1341036628 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55921eaca3b0 0x55921ee90670 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0018001690 tx=0x7f0018012000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd7036ec6e8e597e server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:29:05.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.706+0000 7f000ffff640 1 -- 172.21.15.44:0/1341036628 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0018026070 con 0x55921eaca3b0 2024-05-16T22:29:05.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.706+0000 7f000ffff640 1 -- 172.21.15.44:0/1341036628 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f001801b050 con 0x55921eaca3b0 2024-05-16T22:29:05.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.706+0000 7f000ffff640 1 -- 172.21.15.44:0/1341036628 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0018014c10 con 0x55921eaca3b0 2024-05-16T22:29:05.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.707+0000 7f003b837740 1 -- 172.21.15.44:0/1341036628 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55921eaca3b0 msgr2=0x55921ee90670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:29:05.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.707+0000 7f003b837740 1 --2- 172.21.15.44:0/1341036628 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55921eaca3b0 0x55921ee90670 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0018001690 tx=0x7f0018012000 comp rx=0 tx=0).stop 2024-05-16T22:29:05.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.707+0000 7f003b837740 1 -- 172.21.15.44:0/1341036628 shutdown_connections 2024-05-16T22:29:05.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.707+0000 7f003b837740 1 --2- 172.21.15.44:0/1341036628 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55921ead2590 0x55921eec12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:29:05.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.707+0000 7f003b837740 1 --2- 172.21.15.44:0/1341036628 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55921eaca3b0 0x55921ee90670 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:29:05.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.707+0000 7f003b837740 1 --2- 172.21.15.44:0/1341036628 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55921eaf3270 0x55921eecc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:29:06.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.707+0000 7f003b837740 1 -- 172.21.15.44:0/1341036628 >> 172.21.15.44:0/1341036628 conn(0x55921eae73c0 msgr2=0x55921eecb8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:29:06.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.707+0000 7f003b837740 1 -- 172.21.15.44:0/1341036628 shutdown_connections 2024-05-16T22:29:06.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.707+0000 7f003b837740 1 -- 172.21.15.44:0/1341036628 wait complete. 2024-05-16T22:29:06.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.708+0000 7f003b837740 1 -- start start 2024-05-16T22:29:06.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.708+0000 7f003b837740 1 Processor -- start 2024-05-16T22:29:06.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.709+0000 7f003b837740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55921eaca3b0 0x55921eec0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:29:06.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.709+0000 7f003b837740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55921ead2590 0x55921eec0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:29:06.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.709+0000 7f003b837740 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55921eaf3270 0x55921eec4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:29:06.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.709+0000 7f003b837740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55921eadc850 con 0x55921ead2590 2024-05-16T22:29:06.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.709+0000 7f003b837740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55921edb2c10 con 0x55921eaca3b0 2024-05-16T22:29:06.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.709+0000 7f003b837740 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x55921ee91080 con 0x55921eaf3270 2024-05-16T22:29:06.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.709+0000 7f003b837740 10 client.0 _ll_register_callbacks cb 0x55921edb6150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-16T22:29:06.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.710+0000 7f002dd9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55921ead2590 0x55921eec0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:29:06.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.710+0000 7f002dd9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55921ead2590 0x55921eec0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37230/0 (socket says 172.21.15.44:37230) 2024-05-16T22:29:06.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.710+0000 7f002dd9b640 1 -- 172.21.15.44:0/4003060443 learned_addr learned my addr 172.21.15.44:0/4003060443 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:29:06.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.710+0000 7f002e59c640 1 --2- 172.21.15.44:0/4003060443 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55921eaca3b0 0x55921eec0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:29:06.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.710+0000 7f002ed9d640 1 --2- 172.21.15.44:0/4003060443 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55921eaf3270 0x55921eec4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:29:06.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.710+0000 7f002dd9b640 1 -- 172.21.15.44:0/4003060443 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55921eaf3270 msgr2=0x55921eec4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:29:06.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.710+0000 7f002dd9b640 1 --2- 172.21.15.44:0/4003060443 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55921eaf3270 0x55921eec4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:29:06.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.710+0000 7f002dd9b640 1 -- 172.21.15.44:0/4003060443 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55921eaca3b0 msgr2=0x55921eec0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:29:06.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.710+0000 7f002dd9b640 1 --2- 172.21.15.44:0/4003060443 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55921eaca3b0 0x55921eec0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:29:06.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.710+0000 7f002dd9b640 1 -- 172.21.15.44:0/4003060443 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55921eb0b2d0 con 0x55921ead2590 2024-05-16T22:29:06.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.710+0000 7f002dd9b640 1 --2- 172.21.15.44:0/4003060443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55921ead2590 0x55921eec0840 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0018006000 tx=0x7f0018007cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3299fb6f6c2d73ef server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:29:06.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.710+0000 7f000d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-05-16T22:29:06.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.710+0000 7f000d7fa640 1 -- 172.21.15.44:0/4003060443 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0018032060 con 0x55921ead2590 2024-05-16T22:29:06.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.710+0000 7f000d7fa640 1 -- 172.21.15.44:0/4003060443 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f0018005b40 con 0x55921ead2590 2024-05-16T22:29:06.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.710+0000 7f003b837740 1 -- 172.21.15.44:0/4003060443 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f001801b050 con 0x55921ead2590 2024-05-16T22:29:07.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.711+0000 7f000d7fa640 1 -- 172.21.15.44:0/4003060443 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f0018038050 con 0x55921ead2590 2024-05-16T22:29:07.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.711+0000 7f003b837740 10 client.4887 fetch_fsmap learned FSMap version 16 2024-05-16T22:29:07.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.711+0000 7f003b837740 1 -- 172.21.15.44:0/4003060443 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x55921ebd56b0 con 0x55921ead2590 2024-05-16T22:29:07.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.711+0000 7f000d7fa640 1 -- 172.21.15.44:0/4003060443 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f001801b050 con 0x55921ead2590 2024-05-16T22:29:07.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.711+0000 7f000d7fa640 1 -- 172.21.15.44:0/4003060443 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 16) ==== 2889+0+0 (secure 0 0 0) 0x7f0018006030 con 0x55921ead2590 2024-05-16T22:29:07.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.711+0000 7f003b837740 10 client.4887 fetch_fsmap finished waiting for FSMap version 16 2024-05-16T22:29:07.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.711+0000 7f003b837740 10 client.4887 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-16T22:29:07.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.711+0000 7f003b837740 20 client.4887 populate_metadata read hostname 'smithi044' 2024-05-16T22:29:07.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.711+0000 7f003b837740 1 --2- 172.21.15.44:0/4003060443 >> [v2:172.21.15.44:6833/2647971069,v1:172.21.15.44:6834/2647971069] conn(0x55921eab1e40 0x55921eec4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:29:07.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.711+0000 7f003b837740 4 client.4887 mds_command: new command op to 4728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-16T22:29:07.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.711+0000 7f003b837740 1 -- 172.21.15.44:0/4003060443 --> [v2:172.21.15.44:6833/2647971069,v1:172.21.15.44:6834/2647971069] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55921ee08e60 con 0x55921eab1e40 2024-05-16T22:29:07.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.711+0000 7f002e59c640 1 --2- 172.21.15.44:0/4003060443 >> [v2:172.21.15.44:6833/2647971069,v1:172.21.15.44:6834/2647971069] conn(0x55921eab1e40 0x55921eec4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:29:07.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.711+0000 7f000d7fa640 10 client.4887 ms_handle_connect on v2:172.21.15.44:6833/2647971069 2024-05-16T22:29:07.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.712+0000 7f002e59c640 1 --2- 172.21.15.44:0/4003060443 >> [v2:172.21.15.44:6833/2647971069,v1:172.21.15.44:6834/2647971069] conn(0x55921eab1e40 0x55921eec4c10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1777a97f04901c2 server_cookie=ba7c336df63af446 in_seq=0 out_seq=0 2024-05-16T22:29:07.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.712+0000 7f000d7fa640 1 -- 172.21.15.44:0/4003060443 <== mds.0 v2:172.21.15.44:6833/2647971069 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55921ee08e60 con 0x55921eab1e40 2024-05-16T22:29:07.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.712+0000 7f000d7fa640 10 client.4887 handle_command_reply: tid=0 2024-05-16T22:29:07.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.712+0000 7f003b837740 1 client.4887 shutdown 2024-05-16T22:29:07.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.713+0000 7f003b837740 1 -- 172.21.15.44:0/4003060443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55921ead2590 msgr2=0x55921eec0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:29:07.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.713+0000 7f003b837740 1 --2- 172.21.15.44:0/4003060443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55921ead2590 0x55921eec0840 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0018006000 tx=0x7f0018007cf0 comp rx=0 tx=0).stop 2024-05-16T22:29:07.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.713+0000 7f003b837740 1 -- 172.21.15.44:0/4003060443 shutdown_connections 2024-05-16T22:29:07.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.713+0000 7f003b837740 1 --2- 172.21.15.44:0/4003060443 >> [v2:172.21.15.44:6833/2647971069,v1:172.21.15.44:6834/2647971069] conn(0x55921eab1e40 0x55921eec4c10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:29:07.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.713+0000 7f003b837740 1 --2- 172.21.15.44:0/4003060443 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55921eaf3270 0x55921eec4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:29:07.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.713+0000 7f003b837740 1 --2- 172.21.15.44:0/4003060443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55921ead2590 0x55921eec0840 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:29:07.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.713+0000 7f000d7fa640 0 client.4887 ms_handle_reset on v2:172.21.15.44:6833/2647971069 2024-05-16T22:29:07.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.713+0000 7f003b837740 1 --2- 172.21.15.44:0/4003060443 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55921eaca3b0 0x55921eec0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:29:07.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.713+0000 7f003b837740 1 -- 172.21.15.44:0/4003060443 >> 172.21.15.44:0/4003060443 conn(0x55921eae73c0 msgr2=0x55921ee956a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:29:07.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.713+0000 7f003b837740 1 -- 172.21.15.44:0/4003060443 shutdown_connections 2024-05-16T22:29:08.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.713+0000 7f003b837740 1 -- 172.21.15.44:0/4003060443 wait complete. 2024-05-16T22:29:08.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.713+0000 7f003b837740 20 client.4887 trim_cache size 0 max 16384 2024-05-16T22:29:08.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.732+0000 7f003b837740 1 Processor -- start 2024-05-16T22:29:08.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.732+0000 7f003b837740 1 -- start start 2024-05-16T22:29:08.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.733+0000 7f003b837740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55921eaca3b0 0x55921eeec1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:29:08.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.733+0000 7f003b837740 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55921ead2590 0x55921eebc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:29:08.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.733+0000 7f003b837740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55921eaf3270 0x55921eed4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:29:08.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.733+0000 7f003b837740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f00301eede0 con 0x55921eaca3b0 2024-05-16T22:29:08.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.733+0000 7f003b837740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f00301e6330 con 0x55921eaf3270 2024-05-16T22:29:08.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.733+0000 7f003b837740 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f00301edeb0 con 0x55921ead2590 2024-05-16T22:29:08.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.733+0000 7f002e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55921eaca3b0 0x55921eeec1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:29:08.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.733+0000 7f002e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55921eaca3b0 0x55921eeec1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37236/0 (socket says 172.21.15.44:37236) 2024-05-16T22:29:08.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.733+0000 7f002e59c640 1 -- 172.21.15.44:0/3048429788 learned_addr learned my addr 172.21.15.44:0/3048429788 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:29:08.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.733+0000 7f002dd9b640 1 --2- 172.21.15.44:0/3048429788 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55921ead2590 0x55921eebc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:29:08.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.733+0000 7f002ed9d640 1 --2- 172.21.15.44:0/3048429788 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55921eaf3270 0x55921eed4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:29:08.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.734+0000 7f002e59c640 1 -- 172.21.15.44:0/3048429788 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55921ead2590 msgr2=0x55921eebc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:29:08.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.734+0000 7f002e59c640 1 --2- 172.21.15.44:0/3048429788 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55921ead2590 0x55921eebc6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:29:08.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.734+0000 7f002e59c640 1 -- 172.21.15.44:0/3048429788 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55921eaf3270 msgr2=0x55921eed4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:29:08.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.734+0000 7f002e59c640 1 --2- 172.21.15.44:0/3048429788 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55921eaf3270 0x55921eed4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:29:08.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.734+0000 7f002e59c640 1 -- 172.21.15.44:0/3048429788 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55921eec49c0 con 0x55921eaca3b0 2024-05-16T22:29:08.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.734+0000 7f002dd9b640 1 --2- 172.21.15.44:0/3048429788 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55921ead2590 0x55921eebc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:29:08.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.734+0000 7f002ed9d640 1 --2- 172.21.15.44:0/3048429788 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55921eaf3270 0x55921eed4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:29:08.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.734+0000 7f002e59c640 1 --2- 172.21.15.44:0/3048429788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55921eaca3b0 0x55921eeec1c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f002005ccb0 tx=0x7f0020097040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7251fb2dff3ce2ce server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:29:08.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.734+0000 7f000f7fe640 1 -- 172.21.15.44:0/3048429788 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0020021040 con 0x55921eaca3b0 2024-05-16T22:29:08.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.734+0000 7f000f7fe640 1 -- 172.21.15.44:0/3048429788 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00200693e0 con 0x55921eaca3b0 2024-05-16T22:29:09.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.734+0000 7f000f7fe640 1 -- 172.21.15.44:0/3048429788 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00200093e0 con 0x55921eaca3b0 2024-05-16T22:29:09.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.735+0000 7f003b837740 1 -- 172.21.15.44:0/3048429788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55921eaca3b0 msgr2=0x55921eeec1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:29:09.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.735+0000 7f003b837740 1 --2- 172.21.15.44:0/3048429788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55921eaca3b0 0x55921eeec1c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f002005ccb0 tx=0x7f0020097040 comp rx=0 tx=0).stop 2024-05-16T22:29:09.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.735+0000 7f003b837740 1 -- 172.21.15.44:0/3048429788 shutdown_connections 2024-05-16T22:29:09.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.735+0000 7f003b837740 1 --2- 172.21.15.44:0/3048429788 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55921ead2590 0x55921eebc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:29:09.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.735+0000 7f003b837740 1 --2- 172.21.15.44:0/3048429788 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55921eaf3270 0x55921eed4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:29:09.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.735+0000 7f003b837740 1 --2- 172.21.15.44:0/3048429788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55921eaca3b0 0x55921eeec1c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:29:09.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.735+0000 7f003b837740 1 -- 172.21.15.44:0/3048429788 >> 172.21.15.44:0/3048429788 conn(0x55921eae73c0 msgr2=0x55921ee90dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:29:09.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.735+0000 7f003b837740 1 -- 172.21.15.44:0/3048429788 shutdown_connections 2024-05-16T22:29:09.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.735+0000 7f003b837740 1 -- 172.21.15.44:0/3048429788 wait complete. 2024-05-16T22:29:09.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.736+0000 7f003b837740 1 -- start start 2024-05-16T22:29:09.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.736+0000 7f003b837740 1 Processor -- start 2024-05-16T22:29:09.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.737+0000 7f003b837740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55921eaca3b0 0x55921eec9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:29:09.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.737+0000 7f003b837740 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55921ead2590 0x55921ee953a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:29:09.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.737+0000 7f003b837740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55921eaf3270 0x55921ef3e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:29:09.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.737+0000 7f003b837740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55921eec2990 con 0x55921eaca3b0 2024-05-16T22:29:09.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.737+0000 7f003b837740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55921eadc850 con 0x55921eaf3270 2024-05-16T22:29:09.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.737+0000 7f003b837740 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x55921eedc4b0 con 0x55921ead2590 2024-05-16T22:29:09.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.737+0000 7f003b837740 10 client.0 _ll_register_callbacks cb 0x7f0018024070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-16T22:29:09.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.737+0000 7f002e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55921eaca3b0 0x55921eec9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:29:09.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.737+0000 7f002e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55921eaca3b0 0x55921eec9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37248/0 (socket says 172.21.15.44:37248) 2024-05-16T22:29:09.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.737+0000 7f002e59c640 1 -- 172.21.15.44:0/1461477407 learned_addr learned my addr 172.21.15.44:0/1461477407 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:29:09.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.737+0000 7f002ed9d640 1 --2- 172.21.15.44:0/1461477407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55921eaf3270 0x55921ef3e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:29:09.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.737+0000 7f002dd9b640 1 --2- 172.21.15.44:0/1461477407 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55921ead2590 0x55921ee953a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:29:09.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.737+0000 7f002e59c640 1 -- 172.21.15.44:0/1461477407 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55921ead2590 msgr2=0x55921ee953a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:29:09.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.737+0000 7f002e59c640 1 --2- 172.21.15.44:0/1461477407 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55921ead2590 0x55921ee953a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:29:09.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.737+0000 7f002e59c640 1 -- 172.21.15.44:0/1461477407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55921eaf3270 msgr2=0x55921ef3e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:29:09.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.737+0000 7f002e59c640 1 --2- 172.21.15.44:0/1461477407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55921eaf3270 0x55921ef3e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:29:09.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.737+0000 7f002e59c640 1 -- 172.21.15.44:0/1461477407 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55921ef44e20 con 0x55921eaca3b0 2024-05-16T22:29:10.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.737+0000 7f002ed9d640 1 --2- 172.21.15.44:0/1461477407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55921eaf3270 0x55921ef3e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:29:10.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.738+0000 7f002e59c640 1 --2- 172.21.15.44:0/1461477407 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55921eaca3b0 0x55921eec9f30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f00200603c0 tx=0x7f0018015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa1e990fd52de8ab server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:29:10.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.738+0000 7f000d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-05-16T22:29:10.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.738+0000 7f000d7fa640 1 -- 172.21.15.44:0/1461477407 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0020021030 con 0x55921eaca3b0 2024-05-16T22:29:10.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.738+0000 7f000d7fa640 1 -- 172.21.15.44:0/1461477407 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f0020093070 con 0x55921eaca3b0 2024-05-16T22:29:10.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.738+0000 7f003b837740 1 -- 172.21.15.44:0/1461477407 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00200693e0 con 0x55921eaca3b0 2024-05-16T22:29:10.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.738+0000 7f000d7fa640 1 -- 172.21.15.44:0/1461477407 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f002005c950 con 0x55921eaca3b0 2024-05-16T22:29:10.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.738+0000 7f003b837740 10 client.4893 fetch_fsmap learned FSMap version 16 2024-05-16T22:29:10.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.738+0000 7f003b837740 1 -- 172.21.15.44:0/1461477407 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x55921eec97f0 con 0x55921eaca3b0 2024-05-16T22:29:10.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.738+0000 7f000d7fa640 1 -- 172.21.15.44:0/1461477407 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00200693e0 con 0x55921eaca3b0 2024-05-16T22:29:10.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.738+0000 7f000d7fa640 1 -- 172.21.15.44:0/1461477407 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 16) ==== 2889+0+0 (secure 0 0 0) 0x7f0020024060 con 0x55921eaca3b0 2024-05-16T22:29:10.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.738+0000 7f003b837740 10 client.4893 fetch_fsmap finished waiting for FSMap version 16 2024-05-16T22:29:10.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.738+0000 7f003b837740 10 client.4893 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-16T22:29:10.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.738+0000 7f003b837740 20 client.4893 populate_metadata read hostname 'smithi044' 2024-05-16T22:29:10.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.738+0000 7f003b837740 1 --2- 172.21.15.44:0/1461477407 >> [v2:172.21.15.44:6833/2647971069,v1:172.21.15.44:6834/2647971069] conn(0x55921ef48040 0x55921ef48450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:29:10.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.738+0000 7f003b837740 4 client.4893 mds_command: new command op to 4728 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-16T22:29:10.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.738+0000 7f003b837740 1 -- 172.21.15.44:0/1461477407 --> [v2:172.21.15.44:6833/2647971069,v1:172.21.15.44:6834/2647971069] -- command(tid 0: {"prefix": "status"}) -- 0x55921ee02640 con 0x55921ef48040 2024-05-16T22:29:10.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.738+0000 7f002dd9b640 1 --2- 172.21.15.44:0/1461477407 >> [v2:172.21.15.44:6833/2647971069,v1:172.21.15.44:6834/2647971069] conn(0x55921ef48040 0x55921ef48450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:29:10.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.739+0000 7f000d7fa640 10 client.4893 ms_handle_connect on v2:172.21.15.44:6833/2647971069 2024-05-16T22:29:10.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.739+0000 7f002dd9b640 1 --2- 172.21.15.44:0/1461477407 >> [v2:172.21.15.44:6833/2647971069,v1:172.21.15.44:6834/2647971069] conn(0x55921ef48040 0x55921ef48450 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d1d516a0b237837 server_cookie=d93ef39682dbdc55 in_seq=0 out_seq=0 2024-05-16T22:29:10.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.739+0000 7f000d7fa640 1 -- 172.21.15.44:0/1461477407 <== mds.0 v2:172.21.15.44:6833/2647971069 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55921ee02640 con 0x55921ef48040 2024-05-16T22:29:10.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.739+0000 7f000d7fa640 10 client.4893 handle_command_reply: tid=0 2024-05-16T22:29:10.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.739+0000 7f003b837740 1 client.4893 shutdown 2024-05-16T22:29:10.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.739+0000 7f003b837740 1 -- 172.21.15.44:0/1461477407 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55921eaca3b0 msgr2=0x55921eec9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:29:10.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.739+0000 7f003b837740 1 --2- 172.21.15.44:0/1461477407 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55921eaca3b0 0x55921eec9f30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f00200603c0 tx=0x7f0018015000 comp rx=0 tx=0).stop 2024-05-16T22:29:10.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.740+0000 7f003b837740 1 -- 172.21.15.44:0/1461477407 shutdown_connections 2024-05-16T22:29:10.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.740+0000 7f003b837740 1 --2- 172.21.15.44:0/1461477407 >> [v2:172.21.15.44:6833/2647971069,v1:172.21.15.44:6834/2647971069] conn(0x55921ef48040 0x55921ef48450 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:29:11.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.740+0000 7f003b837740 1 --2- 172.21.15.44:0/1461477407 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55921ead2590 0x55921ee953a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:29:11.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.740+0000 7f003b837740 1 --2- 172.21.15.44:0/1461477407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55921eaf3270 0x55921ef3e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:29:11.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.740+0000 7f003b837740 1 --2- 172.21.15.44:0/1461477407 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55921eaca3b0 0x55921eec9f30 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:29:11.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.740+0000 7f000d7fa640 0 client.4893 ms_handle_reset on v2:172.21.15.44:6833/2647971069 2024-05-16T22:29:11.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.740+0000 7f003b837740 1 -- 172.21.15.44:0/1461477407 >> 172.21.15.44:0/1461477407 conn(0x55921eae73c0 msgr2=0x55921eeec1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:29:11.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.740+0000 7f003b837740 1 -- 172.21.15.44:0/1461477407 shutdown_connections 2024-05-16T22:29:11.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.740+0000 7f003b837740 1 -- 172.21.15.44:0/1461477407 wait complete. 2024-05-16T22:29:11.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.740+0000 7f003b837740 20 client.4893 trim_cache size 0 max 16384 2024-05-16T22:29:11.305 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-05-16T22:29:11.346 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "572ab7cc-b103-4548-ae8f-c6614d57f0c8", 2024-05-16T22:29:11.380 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2024-05-16T22:29:11.433 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 4728, 2024-05-16T22:29:11.471 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-05-16T22:29:11.505 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-05-16T22:29:11.538 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-05-16T22:29:11.571 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 35.601834691999997, 2024-05-16T22:29:11.605 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 16, 2024-05-16T22:29:11.638 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 34, 2024-05-16T22:29:11.672 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 34, 2024-05-16T22:29:11.705 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 71.320072072000002 2024-05-16T22:29:11.738 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-05-16T22:29:11.773 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:29:11.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.740+0000 7f00348a8640 1 -- 172.21.15.44:0/683645358 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0010076300 msgr2=0x7f0010078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:29:11.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.740+0000 7f00348a8640 1 --2- 172.21.15.44:0/683645358 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0010076300 0x7f0010078810 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0018005880 tx=0x7f0018006aa0 comp rx=0 tx=0).stop 2024-05-16T22:29:11.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.740+0000 7f00348a8640 1 -- 172.21.15.44:0/683645358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00300a3bd0 msgr2=0x7f00300b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:29:11.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.740+0000 7f00348a8640 1 --2- 172.21.15.44:0/683645358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00300a3bd0 0x7f00300b78d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f002000e960 tx=0x7f002000ee20 comp rx=0 tx=0).stop 2024-05-16T22:29:11.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.740+0000 7f00348a8640 1 -- 172.21.15.44:0/683645358 shutdown_connections 2024-05-16T22:29:12.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.740+0000 7f00348a8640 1 --2- 172.21.15.44:0/683645358 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0010076300 0x7f0010078810 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:29:12.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.740+0000 7f00348a8640 1 --2- 172.21.15.44:0/683645358 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f003014fa20 0x7f0030149c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:29:12.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.740+0000 7f00348a8640 1 --2- 172.21.15.44:0/683645358 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00300bc8d0 0x7f003014ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:29:12.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.740+0000 7f00348a8640 1 --2- 172.21.15.44:0/683645358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00300a3bd0 0x7f00300b78d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:29:12.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.740+0000 7f00348a8640 1 -- 172.21.15.44:0/683645358 >> 172.21.15.44:0/683645358 conn(0x7f00300a1ac0 msgr2=0x7f00300bdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:29:12.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.740+0000 7f00348a8640 1 -- 172.21.15.44:0/683645358 shutdown_connections 2024-05-16T22:29:12.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:02.741+0000 7f00348a8640 1 -- 172.21.15.44:0/683645358 wait complete. 2024-05-16T22:29:12.372 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-16T22:29:12.408 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:29:12.441 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:29:12.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.534+0000 7f6a35bee640 1 Processor -- start 2024-05-16T22:29:12.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.534+0000 7f6a35bee640 1 -- start start 2024-05-16T22:29:12.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.535+0000 7f6a35bee640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6a300b57f0 0x7f6a300b9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:29:12.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.535+0000 7f6a35bee640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a300bba80 con 0x7f6a300b4500 2024-05-16T22:29:12.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.535+0000 7f6a35bee640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a300b4ff0 con 0x7f6a300bb490 2024-05-16T22:29:12.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.535+0000 7f6a35bee640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f6a300bbd60 con 0x7f6a300b57f0 2024-05-16T22:29:12.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.535+0000 7f6a2ffff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6a300b57f0 0x7f6a300b9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:29:12.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.535+0000 7f6a2ffff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6a300b57f0 0x7f6a300b9ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58052/0 (socket says 172.21.15.44:58052) 2024-05-16T22:29:12.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.535+0000 7f6a2effd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f6a300b4500 0x7f6a300a4080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:42950/0 (socket says 172.21.15.44:42950) 2024-05-16T22:29:12.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.535+0000 7f6a2ffff640 1 -- 172.21.15.44:0/2101920740 learned_addr learned my addr 172.21.15.44:0/2101920740 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:29:12.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.536+0000 7f6a2ffff640 1 -- 172.21.15.44:0/2101920740 >> v1:172.21.15.70:6789/0 conn(0x7f6a300bb490 legacy=0x7f6a3006faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:29:12.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.536+0000 7f6a2ffff640 1 -- 172.21.15.44:0/2101920740 >> v1:172.21.15.44:6789/0 conn(0x7f6a300b4500 legacy=0x7f6a300a4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:29:13.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.536+0000 7f6a2ffff640 1 -- 172.21.15.44:0/2101920740 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a300b52d0 con 0x7f6a300b57f0 2024-05-16T22:29:13.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.536+0000 7f6a2e7fc640 1 -- 172.21.15.44:0/2101920740 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2776191500 0 0) 0x7f6a300bba80 con 0x7f6a300b4500 2024-05-16T22:29:13.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.536+0000 7f6a2ffff640 1 --2- 172.21.15.44:0/2101920740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a300b57f0 0x7f6a300b9ee0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6a28009e50 tx=0x7f6a2802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19a7031160d93386 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:29:13.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.537+0000 7f6a2e7fc640 1 -- 172.21.15.44:0/2101920740 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a28036070 con 0x7f6a300b57f0 2024-05-16T22:29:13.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.537+0000 7f6a2e7fc640 1 -- 172.21.15.44:0/2101920740 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a28031600 con 0x7f6a300b57f0 2024-05-16T22:29:13.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.537+0000 7f6a2e7fc640 1 -- 172.21.15.44:0/2101920740 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a280319d0 con 0x7f6a300b57f0 2024-05-16T22:29:14.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.537+0000 7f6a35bee640 1 -- 172.21.15.44:0/2101920740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a300b57f0 msgr2=0x7f6a300b9ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:29:14.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.537+0000 7f6a35bee640 1 --2- 172.21.15.44:0/2101920740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a300b57f0 0x7f6a300b9ee0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6a28009e50 tx=0x7f6a2802a730 comp rx=0 tx=0).stop 2024-05-16T22:29:14.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.537+0000 7f6a35bee640 1 -- 172.21.15.44:0/2101920740 shutdown_connections 2024-05-16T22:29:14.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.537+0000 7f6a35bee640 1 --2- 172.21.15.44:0/2101920740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a300b57f0 0x7f6a300b9ee0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:29:14.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.537+0000 7f6a35bee640 1 -- 172.21.15.44:0/2101920740 >> 172.21.15.44:0/2101920740 conn(0x7f6a300a1ac0 msgr2=0x7f6a300bbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:29:14.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.537+0000 7f6a35bee640 1 -- 172.21.15.44:0/2101920740 shutdown_connections 2024-05-16T22:29:14.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.537+0000 7f6a35bee640 1 -- 172.21.15.44:0/2101920740 wait complete. 2024-05-16T22:29:14.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.539+0000 7f6a35bee640 1 Processor -- start 2024-05-16T22:29:14.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.539+0000 7f6a35bee640 1 -- start start 2024-05-16T22:29:14.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.540+0000 7f6a35bee640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a300b4500 0x7f6a30073b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:29:15.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.540+0000 7f6a35bee640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6a300b57f0 0x7f6a301436b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:29:15.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.540+0000 7f6a35bee640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a300bb490 0x7f6a300b6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:29:15.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.540+0000 7f6a35bee640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6a300a4790 con 0x7f6a300b4500 2024-05-16T22:29:15.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.540+0000 7f6a35bee640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6a300ba420 con 0x7f6a300bb490 2024-05-16T22:29:15.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.540+0000 7f6a35bee640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f6a30156a80 con 0x7f6a300b57f0 2024-05-16T22:29:15.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.540+0000 7f6a2f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a300b4500 0x7f6a30073b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:29:15.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.540+0000 7f6a2f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a300b4500 0x7f6a30073b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58060/0 (socket says 172.21.15.44:58060) 2024-05-16T22:29:15.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.540+0000 7f6a2f7fe640 1 -- 172.21.15.44:0/1811634258 learned_addr learned my addr 172.21.15.44:0/1811634258 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:29:15.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.540+0000 7f6a2ffff640 1 --2- 172.21.15.44:0/1811634258 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a300bb490 0x7f6a300b6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:29:15.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.540+0000 7f6a2effd640 1 --2- 172.21.15.44:0/1811634258 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6a300b57f0 0x7f6a301436b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:29:15.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.541+0000 7f6a2f7fe640 1 -- 172.21.15.44:0/1811634258 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6a300b57f0 msgr2=0x7f6a301436b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:29:15.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.541+0000 7f6a2f7fe640 1 --2- 172.21.15.44:0/1811634258 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6a300b57f0 0x7f6a301436b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:29:15.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.541+0000 7f6a2f7fe640 1 -- 172.21.15.44:0/1811634258 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a300bb490 msgr2=0x7f6a300b6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:29:15.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.541+0000 7f6a2f7fe640 1 --2- 172.21.15.44:0/1811634258 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a300bb490 0x7f6a300b6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:29:15.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.541+0000 7f6a2f7fe640 1 -- 172.21.15.44:0/1811634258 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a30143bf0 con 0x7f6a300b4500 2024-05-16T22:29:15.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.541+0000 7f6a2ffff640 1 --2- 172.21.15.44:0/1811634258 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a300bb490 0x7f6a300b6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:29:15.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.541+0000 7f6a2effd640 1 --2- 172.21.15.44:0/1811634258 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6a300b57f0 0x7f6a301436b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:29:15.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.541+0000 7f6a2f7fe640 1 --2- 172.21.15.44:0/1811634258 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a300b4500 0x7f6a30073b20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6a2000c430 tx=0x7f6a2000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:29:15.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.541+0000 7f6a17fff640 1 -- 172.21.15.44:0/1811634258 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a20017070 con 0x7f6a300b4500 2024-05-16T22:29:15.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.541+0000 7f6a17fff640 1 -- 172.21.15.44:0/1811634258 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a200052d0 con 0x7f6a300b4500 2024-05-16T22:29:15.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.541+0000 7f6a17fff640 1 -- 172.21.15.44:0/1811634258 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a20003830 con 0x7f6a300b4500 2024-05-16T22:29:15.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.541+0000 7f6a35bee640 1 -- 172.21.15.44:0/1811634258 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a300b7b90 con 0x7f6a300b4500 2024-05-16T22:29:15.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.541+0000 7f6a35bee640 1 -- 172.21.15.44:0/1811634258 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a300725e0 con 0x7f6a300b4500 2024-05-16T22:29:15.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.542+0000 7f6a35bee640 1 -- 172.21.15.44:0/1811634258 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a300a2690 con 0x7f6a300b4500 2024-05-16T22:29:15.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.543+0000 7f6a17fff640 1 -- 172.21.15.44:0/1811634258 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6a2001a070 con 0x7f6a300b4500 2024-05-16T22:29:15.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.543+0000 7f6a17fff640 1 --2- 172.21.15.44:0/1811634258 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f6a1c0762d0 0x7f6a1c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:29:16.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.543+0000 7f6a17fff640 1 -- 172.21.15.44:0/1811634258 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f6a20096920 con 0x7f6a300b4500 2024-05-16T22:29:16.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.543+0000 7f6a2effd640 1 --2- 172.21.15.44:0/1811634258 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f6a1c0762d0 0x7f6a1c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:29:16.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.544+0000 7f6a2effd640 1 --2- 172.21.15.44:0/1811634258 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f6a1c0762d0 0x7f6a1c0787e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6a24007fd0 tx=0x7f6a24007de0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:29:16.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.548+0000 7f6a17fff640 1 -- 172.21.15.44:0/1811634258 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6a300b7b90 con 0x7f6a300b4500 2024-05-16T22:29:16.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.779+0000 7f6a35bee640 1 -- 172.21.15.44:0/1811634258 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6a30050940 con 0x7f6a300b4500 2024-05-16T22:29:16.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.779+0000 7f6a17fff640 1 -- 172.21.15.44:0/1811634258 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) ==== 53+0+73 (secure 0 0 0) 0x7f6a20060280 con 0x7f6a300b4500 2024-05-16T22:29:16.266 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-16T22:29:16.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.781+0000 7f6a35bee640 1 -- 172.21.15.44:0/1811634258 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f6a1c0762d0 msgr2=0x7f6a1c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:29:16.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.781+0000 7f6a35bee640 1 --2- 172.21.15.44:0/1811634258 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f6a1c0762d0 0x7f6a1c0787e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6a24007fd0 tx=0x7f6a24007de0 comp rx=0 tx=0).stop 2024-05-16T22:29:16.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.781+0000 7f6a35bee640 1 -- 172.21.15.44:0/1811634258 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a300b4500 msgr2=0x7f6a30073b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:29:16.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.781+0000 7f6a35bee640 1 --2- 172.21.15.44:0/1811634258 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a300b4500 0x7f6a30073b20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6a2000c430 tx=0x7f6a2000c8f0 comp rx=0 tx=0).stop 2024-05-16T22:29:16.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.781+0000 7f6a35bee640 1 -- 172.21.15.44:0/1811634258 shutdown_connections 2024-05-16T22:29:16.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.781+0000 7f6a35bee640 1 --2- 172.21.15.44:0/1811634258 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f6a1c0762d0 0x7f6a1c0787e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:29:16.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.781+0000 7f6a35bee640 1 --2- 172.21.15.44:0/1811634258 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6a300b57f0 0x7f6a301436b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:29:16.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.781+0000 7f6a35bee640 1 --2- 172.21.15.44:0/1811634258 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a300bb490 0x7f6a300b6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:29:16.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.781+0000 7f6a35bee640 1 --2- 172.21.15.44:0/1811634258 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a300b4500 0x7f6a30073b20 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:29:16.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.781+0000 7f6a35bee640 1 -- 172.21.15.44:0/1811634258 >> 172.21.15.44:0/1811634258 conn(0x7f6a300a1ac0 msgr2=0x7f6a30068600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:29:16.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.781+0000 7f6a35bee640 1 -- 172.21.15.44:0/1811634258 shutdown_connections 2024-05-16T22:29:16.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:29:12.781+0000 7f6a35bee640 1 -- 172.21.15.44:0/1811634258 wait complete. 2024-05-16T22:29:16.741 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-16T22:29:16.806 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-16T22:29:16.841 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi196.front.sepia.ceph.com 2024-05-16T22:29:16.875 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-16T22:29:16.908 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-16T22:29:16.950 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-16T22:29:16.983 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-16T22:29:17.016 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-16T22:29:17.058 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-16T22:29:17.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T22:29:17.225 DEBUG:teuthology.orchestra.run.smithi196:> ip addr 2024-05-16T22:29:17.317 INFO:teuthology.orchestra.run.smithi196.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-16T22:29:17.342 INFO:teuthology.orchestra.run.smithi196.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-16T22:29:17.383 INFO:teuthology.orchestra.run.smithi196.stdout: inet 127.0.0.1/8 scope host lo 2024-05-16T22:29:17.417 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2024-05-16T22:29:17.450 INFO:teuthology.orchestra.run.smithi196.stdout: inet6 ::1/128 scope host 2024-05-16T22:29:17.483 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2024-05-16T22:29:17.517 INFO:teuthology.orchestra.run.smithi196.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-16T22:29:17.581 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 0c:c4:7a:d9:38:be brd ff:ff:ff:ff:ff:ff 2024-05-16T22:29:17.625 INFO:teuthology.orchestra.run.smithi196.stdout: altname enp7s0f0 2024-05-16T22:29:17.659 INFO:teuthology.orchestra.run.smithi196.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-16T22:29:17.692 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 0c:c4:7a:d9:38:bf brd ff:ff:ff:ff:ff:ff 2024-05-16T22:29:17.725 INFO:teuthology.orchestra.run.smithi196.stdout: altname enp7s0f1 2024-05-16T22:29:17.759 INFO:teuthology.orchestra.run.smithi196.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-16T22:29:17.792 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 0c:c4:7a:88:7f:46 brd ff:ff:ff:ff:ff:ff 2024-05-16T22:29:17.842 INFO:teuthology.orchestra.run.smithi196.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-16T22:29:17.884 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 0c:c4:7a:88:7f:47 brd ff:ff:ff:ff:ff:ff 2024-05-16T22:29:17.917 INFO:teuthology.orchestra.run.smithi196.stdout: inet 172.21.15.196/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-16T22:29:17.950 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft 42534sec preferred_lft 42534sec 2024-05-16T22:29:18.000 INFO:teuthology.orchestra.run.smithi196.stdout: inet6 fe80::ec4:7aff:fe88:7f47/64 scope link 2024-05-16T22:29:18.034 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2024-05-16T22:29:18.067 INFO:teuthology.orchestra.run.smithi196.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-16T22:29:18.103 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 2a:27:dc:6e:82:51 brd ff:ff:ff:ff:ff:ff 2024-05-16T22:29:18.142 INFO:teuthology.orchestra.run.smithi196.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-16T22:29:18.176 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2024-05-16T22:29:18.239 INFO:teuthology.orchestra.run.smithi196.stdout: inet6 fe80::7403:a5ff:fe53:f2bf/64 scope link 2024-05-16T22:29:18.276 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2024-05-16T22:29:18.309 INFO:teuthology.orchestra.run.smithi196.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-16T22:29:18.343 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 2a:27:dc:6e:82:51 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-16T22:29:18.385 INFO:teuthology.orchestra.run.smithi196.stdout: inet6 fe80::2827:dcff:fe6e:8251/64 scope link 2024-05-16T22:29:18.418 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2024-05-16T22:29:18.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T22:29:18.501 DEBUG:teuthology.orchestra.run.smithi196:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-16T22:29:18.620 INFO:teuthology.orchestra.run.smithi196.stdout:1 2024-05-16T22:29:18.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T22:29:18.685 DEBUG:teuthology.orchestra.run.smithi196:> route 2024-05-16T22:29:18.786 INFO:teuthology.orchestra.run.smithi196.stdout:Kernel IP routing table 2024-05-16T22:29:18.810 INFO:teuthology.orchestra.run.smithi196.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-16T22:29:18.851 INFO:teuthology.orchestra.run.smithi196.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-16T22:29:18.885 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-16T22:29:18.960 INFO:teuthology.orchestra.run.smithi196.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-16T22:29:19.003 DEBUG:teuthology.orchestra.run.smithi196:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-16T22:29:19.081 DEBUG:teuthology.orchestra.run.smithi196:> set -e 2024-05-16T22:29:19.118 DEBUG:teuthology.orchestra.run.smithi196:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-16T22:29:19.160 DEBUG:teuthology.orchestra.run.smithi196:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-16T22:29:19.193 DEBUG:teuthology.orchestra.run.smithi196:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-16T22:29:19.227 DEBUG:teuthology.orchestra.run.smithi196:> ') 2024-05-16T22:29:19.391 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:29:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-16T22:29:19.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:29:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T22:29:19.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T22:29:19.552 DEBUG:teuthology.orchestra.run.smithi196:> ip netns list 2024-05-16T22:29:19.641 INFO:teuthology.orchestra.run.smithi196.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-16T22:29:19.661 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-16T22:29:19.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T22:29:19.727 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link set brx.0 up 2024-05-16T22:29:19.844 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-16T22:29:19.869 DEBUG:teuthology.orchestra.run.smithi196:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-16T22:29:19.976 INFO:teuthology.orchestra.run.smithi196.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-16T22:29:20.002 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-16T22:29:20.067 DEBUG:teuthology.orchestra.run.smithi196:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-16T22:29:20.160 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-16T22:29:20.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T22:29:20.219 DEBUG:teuthology.orchestra.run.smithi196:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-16T22:29:20.474 INFO:teuthology.orchestra.run.smithi196.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-16T22:29:20.511 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-16T22:29:20.544 INFO:teuthology.orchestra.run.smithi196.stdout:invalid new device string format 2024-05-16T22:29:20.579 INFO:teuthology.orchestra.run.smithi196.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-16T22:29:20.611 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-16T22:29:20.644 INFO:teuthology.orchestra.run.smithi196.stdout:invalid new device string format 2024-05-16T22:29:20.677 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.70:3300,172.21.15.70:3301" 2024-05-16T22:29:20.711 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-16T22:29:20.744 INFO:teuthology.orchestra.run.smithi196.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-16T22:29:20.778 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-16T22:29:20.811 INFO:teuthology.orchestra.run.smithi196.stdout:invalid new device string format 2024-05-16T22:29:20.882 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.70:3300,172.21.15.70:3301" 2024-05-16T22:29:20.920 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-16T22:29:20.972 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: resolved to: "172.21.15.44:6789,172.21.15.70:6789,172.21.15.70:6790" 2024-05-16T22:29:21.044 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.44:6789,172.21.15.70:6789,172.21.15.70:6790:/ 2024-05-16T22:29:21.086 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=572ab7cc-b103-4548-ae8f-c6614d57f0c8" will pass to kernel 2024-05-16T22:29:21.145 INFO:teuthology.orchestra.run.smithi196.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-16T22:29:21.178 INFO:teuthology.orchestra.run.smithi196.stdout: You just mounted a file system that supports labels which does not 2024-05-16T22:29:21.220 INFO:teuthology.orchestra.run.smithi196.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-16T22:29:21.253 INFO:teuthology.orchestra.run.smithi196.stdout: applications will generate AVC messages and not be allowed access to 2024-05-16T22:29:21.295 INFO:teuthology.orchestra.run.smithi196.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-16T22:29:21.328 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-16T22:29:21.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T22:29:21.395 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-16T22:29:21.544 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-16T22:29:21.689 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:29:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T22:29:21.754 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:29:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T22:29:21.786 INFO:teuthology.orchestra.run.smithi196.stdout:client4905 2024-05-16T22:29:21.839 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-16T22:29:21.878 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-16T22:29:21.997 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'sudo fscrypt --help') 2024-05-16T22:29:22.130 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:29:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T22:29:22.175 INFO:teuthology.orchestra.run.smithi196.stdout:fscrypt - A tool for managing Linux native filesystem encryption 2024-05-16T22:29:22.228 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:29:22.261 INFO:teuthology.orchestra.run.smithi196.stdout:Usage: 2024-05-16T22:29:22.295 INFO:teuthology.orchestra.run.smithi196.stdout: fscrypt COMMAND [arguments] [options] 2024-05-16T22:29:22.328 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:29:22.362 INFO:teuthology.orchestra.run.smithi196.stdout:Commands: 2024-05-16T22:29:22.395 INFO:teuthology.orchestra.run.smithi196.stdout: setup - perform global setup or filesystem setup 2024-05-16T22:29:22.428 INFO:teuthology.orchestra.run.smithi196.stdout: encrypt - enable filesystem encryption for a directory 2024-05-16T22:29:22.462 INFO:teuthology.orchestra.run.smithi196.stdout: unlock - unlock an encrypted directory 2024-05-16T22:29:22.495 INFO:teuthology.orchestra.run.smithi196.stdout: lock - lock an encrypted directory 2024-05-16T22:29:22.528 INFO:teuthology.orchestra.run.smithi196.stdout: purge - Remove a filesystem's keys 2024-05-16T22:29:22.562 INFO:teuthology.orchestra.run.smithi196.stdout: status - print the global, filesystem, or file status 2024-05-16T22:29:22.595 INFO:teuthology.orchestra.run.smithi196.stdout: metadata - [ADVANCED] manipulate the policy or protector metadata 2024-05-16T22:29:22.659 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:29:22.695 INFO:teuthology.orchestra.run.smithi196.stdout:Options: 2024-05-16T22:29:22.755 INFO:teuthology.orchestra.run.smithi196.stdout: --verbose Prints additional debug messages to standard 2024-05-16T22:29:22.795 INFO:teuthology.orchestra.run.smithi196.stdout: output. 2024-05-16T22:29:22.845 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:29:22.887 INFO:teuthology.orchestra.run.smithi196.stdout: --quiet Prints nothing to standard output except for 2024-05-16T22:29:22.929 INFO:teuthology.orchestra.run.smithi196.stdout: errors. Selects the default for any options that 2024-05-16T22:29:22.962 INFO:teuthology.orchestra.run.smithi196.stdout: would normally show a prompt. 2024-05-16T22:29:22.996 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:29:23.029 INFO:teuthology.orchestra.run.smithi196.stdout: --help Prints help screen for commands and subcommands. 2024-05-16T22:29:23.062 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:29:23.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:29:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T22:29:23.137 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'sudo fscrypt setup --help') 2024-05-16T22:29:23.295 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:29:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T22:29:23.342 INFO:teuthology.orchestra.run.smithi196.stdout:fscrypt setup - perform global setup or filesystem setup 2024-05-16T22:29:23.371 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:29:23.404 INFO:teuthology.orchestra.run.smithi196.stdout:Usage: 2024-05-16T22:29:23.437 INFO:teuthology.orchestra.run.smithi196.stdout: fscrypt setup [MOUNTPOINT] [options] 2024-05-16T22:29:23.471 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:29:23.538 INFO:teuthology.orchestra.run.smithi196.stdout:Description: 2024-05-16T22:29:23.596 INFO:teuthology.orchestra.run.smithi196.stdout: This command creates fscrypt's global config file and/or prepares a filesystem 2024-05-16T22:29:23.629 INFO:teuthology.orchestra.run.smithi196.stdout: for use with fscrypt. 2024-05-16T22:29:23.663 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:29:23.696 INFO:teuthology.orchestra.run.smithi196.stdout: (1) When used without MOUNTPOINT, this command creates the global config file 2024-05-16T22:29:23.737 INFO:teuthology.orchestra.run.smithi196.stdout: /etc/fscrypt.conf and the fscrypt metadata directory for the root filesystem 2024-05-16T22:29:23.771 INFO:teuthology.orchestra.run.smithi196.stdout: (i.e. /.fscrypt). This requires root privileges. The passphrase hashing 2024-05-16T22:29:23.813 INFO:teuthology.orchestra.run.smithi196.stdout: parameters in /etc/fscrypt.conf are automatically set to an appropriate 2024-05-16T22:29:23.846 INFO:teuthology.orchestra.run.smithi196.stdout: hardness, as determined by --time=TIME. The root filesystem's metadata 2024-05-16T22:29:23.888 INFO:teuthology.orchestra.run.smithi196.stdout: directory is created even if the root filesystem doesn't support encryption 2024-05-16T22:29:23.921 INFO:teuthology.orchestra.run.smithi196.stdout: itself, since it's where login passphrase protectors are stored. 2024-05-16T22:29:23.963 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:29:24.004 INFO:teuthology.orchestra.run.smithi196.stdout: (2) When used with MOUNTPOINT, this command creates the fscrypt metadata 2024-05-16T22:29:24.038 INFO:teuthology.orchestra.run.smithi196.stdout: directory for the filesystem mounted at MOUNTPOINT. This allows fscrypt to be 2024-05-16T22:29:24.071 INFO:teuthology.orchestra.run.smithi196.stdout: used on that filesystem, provided that any kernel and filesystem-specific 2024-05-16T22:29:24.104 INFO:teuthology.orchestra.run.smithi196.stdout: prerequisites are also met (see the README). This may require root privileges. 2024-05-16T22:29:24.138 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:29:24.205 INFO:teuthology.orchestra.run.smithi196.stdout:Options: 2024-05-16T22:29:24.246 INFO:teuthology.orchestra.run.smithi196.stdout: --time=TIME Set the global options so that passphrase hashing 2024-05-16T22:29:24.280 INFO:teuthology.orchestra.run.smithi196.stdout: takes TIME long. TIME should be formatted as a 2024-05-16T22:29:24.321 INFO:teuthology.orchestra.run.smithi196.stdout: sequence of decimal numbers, each with optional 2024-05-16T22:29:24.355 INFO:teuthology.orchestra.run.smithi196.stdout: fraction and a unit suffix, such as "300ms", 2024-05-16T22:29:24.397 INFO:teuthology.orchestra.run.smithi196.stdout: "1.5s" or "2h45m". Valid time units are "ms", 2024-05-16T22:29:24.438 INFO:teuthology.orchestra.run.smithi196.stdout: "s", "m", and "h". (default: 1s) 2024-05-16T22:29:24.488 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:29:24.521 INFO:teuthology.orchestra.run.smithi196.stdout: --force Suppresses all confirmation prompts and warnings, 2024-05-16T22:29:24.563 INFO:teuthology.orchestra.run.smithi196.stdout: causing any action to automatically proceed. 2024-05-16T22:29:24.605 INFO:teuthology.orchestra.run.smithi196.stdout: WARNING: This bypasses confirmations for 2024-05-16T22:29:24.647 INFO:teuthology.orchestra.run.smithi196.stdout: protective operations, use with care. 2024-05-16T22:29:24.688 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:29:24.722 INFO:teuthology.orchestra.run.smithi196.stdout: --all-users When setting up a filesystem for fscrypt, allow 2024-05-16T22:29:24.755 INFO:teuthology.orchestra.run.smithi196.stdout: users other than the calling user (typically 2024-05-16T22:29:24.800 INFO:teuthology.orchestra.run.smithi196.stdout: root) to create fscrypt policies and protectors 2024-05-16T22:29:24.855 INFO:teuthology.orchestra.run.smithi196.stdout: on the filesystem. Note that this will create a 2024-05-16T22:29:24.921 INFO:teuthology.orchestra.run.smithi196.stdout: world-writable directory, which users could use 2024-05-16T22:29:24.955 INFO:teuthology.orchestra.run.smithi196.stdout: to fill up the entire filesystem. Hence, this 2024-05-16T22:29:24.989 INFO:teuthology.orchestra.run.smithi196.stdout: option may not be appropriate for some systems. 2024-05-16T22:29:25.022 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:29:25.055 INFO:teuthology.orchestra.run.smithi196.stdout: --verbose Prints additional debug messages to standard 2024-05-16T22:29:25.089 INFO:teuthology.orchestra.run.smithi196.stdout: output. 2024-05-16T22:29:25.130 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:29:25.164 INFO:teuthology.orchestra.run.smithi196.stdout: --quiet Prints nothing to standard output except for 2024-05-16T22:29:25.197 INFO:teuthology.orchestra.run.smithi196.stdout: errors. Selects the default for any options that 2024-05-16T22:29:25.231 INFO:teuthology.orchestra.run.smithi196.stdout: would normally show a prompt. 2024-05-16T22:29:25.264 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:29:25.297 INFO:teuthology.orchestra.run.smithi196.stdout: --help Prints help screen for commands and subcommands. 2024-05-16T22:29:25.331 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:29:25.375 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:29:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T22:29:25.406 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'sudo fscrypt setup --force --quiet') 2024-05-16T22:29:25.583 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:29:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T22:29:28.748 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:29:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T22:29:28.849 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'sudo fscrypt status') 2024-05-16T22:29:29.005 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:29:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T22:29:29.044 INFO:teuthology.orchestra.run.smithi196.stdout:filesystems supporting encryption: 0 2024-05-16T22:29:29.072 INFO:teuthology.orchestra.run.smithi196.stdout:filesystems with fscrypt metadata: 1 2024-05-16T22:29:29.105 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:29:29.139 INFO:teuthology.orchestra.run.smithi196.stdout:MOUNTPOINT DEVICE FILESYSTEM ENCRYPTION FSCRYPT 2024-05-16T22:29:29.172 INFO:teuthology.orchestra.run.smithi196.stdout:/ /dev/sda1 ext4 not enabled Yes 2024-05-16T22:29:29.208 INFO:teuthology.orchestra.run.smithi196.stdout:/var/lib/ceph /dev/dm-4 xfs not supported No 2024-05-16T22:29:29.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:29:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T22:29:29.281 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'sudo fscrypt setup --quiet /home/ubuntu/cephtest/mnt.0') 2024-05-16T22:29:29.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:29:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T22:29:29.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:29:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T22:29:29.564 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'sudo fscrypt status') 2024-05-16T22:29:29.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:29:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T22:29:29.748 INFO:teuthology.orchestra.run.smithi196.stdout:filesystems supporting encryption: 1 2024-05-16T22:29:29.772 INFO:teuthology.orchestra.run.smithi196.stdout:filesystems with fscrypt metadata: 2 2024-05-16T22:29:29.831 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:29:29.894 INFO:teuthology.orchestra.run.smithi196.stdout:MOUNTPOINT DEVICE FILESYSTEM ENCRYPTION FSCRYPT 2024-05-16T22:29:29.939 INFO:teuthology.orchestra.run.smithi196.stdout:/ /dev/sda1 ext4 not enabled Yes 2024-05-16T22:29:29.981 INFO:teuthology.orchestra.run.smithi196.stdout:/home/ubuntu/cephtest/mnt.0 ceph supported Yes 2024-05-16T22:29:30.022 INFO:teuthology.orchestra.run.smithi196.stdout:/var/lib/ceph /dev/dm-4 xfs not supported No 2024-05-16T22:29:30.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:29:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T22:29:30.101 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'sudo dd if=/dev/urandom of=/tmp/key bs=32 count=1') 2024-05-16T22:29:30.251 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:29:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T22:29:30.281 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-05-16T22:29:30.339 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-05-16T22:29:30.373 INFO:teuthology.orchestra.run.smithi196.stderr:32 bytes copied, 0.000141222 s, 227 kB/s 2024-05-16T22:29:30.407 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:29:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T22:29:30.478 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'mkdir -p dir/') 2024-05-16T22:29:30.624 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:29:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T22:29:30.690 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:29:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T22:29:30.723 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'sudo fscrypt encrypt --quiet --source=raw_key --name=BYUfTkKc --no-recovery --skip-unlock --key=/tmp/key dir/') 2024-05-16T22:29:30.909 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:29:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T22:29:30.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:29:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T22:29:31.016 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'sudo fscrypt unlock --quiet --key=/tmp/key dir/') 2024-05-16T22:29:31.166 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:29:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T22:29:31.217 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:29:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T22:29:31.241 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'cp -av /usr/include dir//') 2024-05-16T22:29:31.379 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:29:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T22:29:31.604 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include' -> 'dir/include' 2024-05-16T22:29:31.640 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm' -> 'dir/include/asm' 2024-05-16T22:29:31.673 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/a.out.h' -> 'dir/include/asm/a.out.h' 2024-05-16T22:29:31.706 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/amd_hsmp.h' -> 'dir/include/asm/amd_hsmp.h' 2024-05-16T22:29:31.740 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/auxvec.h' -> 'dir/include/asm/auxvec.h' 2024-05-16T22:29:31.773 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/bitsperlong.h' -> 'dir/include/asm/bitsperlong.h' 2024-05-16T22:29:31.829 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/boot.h' -> 'dir/include/asm/boot.h' 2024-05-16T22:29:31.865 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/bootparam.h' -> 'dir/include/asm/bootparam.h' 2024-05-16T22:29:31.898 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/bpf_perf_event.h' -> 'dir/include/asm/bpf_perf_event.h' 2024-05-16T22:29:31.965 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/byteorder.h' -> 'dir/include/asm/byteorder.h' 2024-05-16T22:29:31.998 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/debugreg.h' -> 'dir/include/asm/debugreg.h' 2024-05-16T22:29:32.032 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/e820.h' -> 'dir/include/asm/e820.h' 2024-05-16T22:29:32.138 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/errno.h' -> 'dir/include/asm/errno.h' 2024-05-16T22:29:32.173 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/fcntl.h' -> 'dir/include/asm/fcntl.h' 2024-05-16T22:29:32.207 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/hw_breakpoint.h' -> 'dir/include/asm/hw_breakpoint.h' 2024-05-16T22:29:32.240 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/hwcap2.h' -> 'dir/include/asm/hwcap2.h' 2024-05-16T22:29:32.273 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/ioctl.h' -> 'dir/include/asm/ioctl.h' 2024-05-16T22:29:32.368 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/ioctls.h' -> 'dir/include/asm/ioctls.h' 2024-05-16T22:29:32.407 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/ipcbuf.h' -> 'dir/include/asm/ipcbuf.h' 2024-05-16T22:29:32.440 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/ist.h' -> 'dir/include/asm/ist.h' 2024-05-16T22:29:32.482 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/kvm.h' -> 'dir/include/asm/kvm.h' 2024-05-16T22:29:32.515 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/kvm_para.h' -> 'dir/include/asm/kvm_para.h' 2024-05-16T22:29:32.549 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/kvm_perf.h' -> 'dir/include/asm/kvm_perf.h' 2024-05-16T22:29:32.602 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/ldt.h' -> 'dir/include/asm/ldt.h' 2024-05-16T22:29:32.641 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/mce.h' -> 'dir/include/asm/mce.h' 2024-05-16T22:29:32.708 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/mman.h' -> 'dir/include/asm/mman.h' 2024-05-16T22:29:32.749 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/msgbuf.h' -> 'dir/include/asm/msgbuf.h' 2024-05-16T22:29:32.791 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/msr.h' -> 'dir/include/asm/msr.h' 2024-05-16T22:29:32.833 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/mtrr.h' -> 'dir/include/asm/mtrr.h' 2024-05-16T22:29:32.874 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/param.h' -> 'dir/include/asm/param.h' 2024-05-16T22:29:32.916 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/perf_regs.h' -> 'dir/include/asm/perf_regs.h' 2024-05-16T22:29:32.958 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/poll.h' -> 'dir/include/asm/poll.h' 2024-05-16T22:29:33.000 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/posix_types.h' -> 'dir/include/asm/posix_types.h' 2024-05-16T22:29:33.049 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/posix_types_32.h' -> 'dir/include/asm/posix_types_32.h' 2024-05-16T22:29:33.091 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/posix_types_64.h' -> 'dir/include/asm/posix_types_64.h' 2024-05-16T22:29:33.141 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/posix_types_x32.h' -> 'dir/include/asm/posix_types_x32.h' 2024-05-16T22:29:33.183 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/prctl.h' -> 'dir/include/asm/prctl.h' 2024-05-16T22:29:33.233 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/processor-flags.h' -> 'dir/include/asm/processor-flags.h' 2024-05-16T22:29:33.275 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/ptrace-abi.h' -> 'dir/include/asm/ptrace-abi.h' 2024-05-16T22:29:33.316 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/ptrace.h' -> 'dir/include/asm/ptrace.h' 2024-05-16T22:29:33.383 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/resource.h' -> 'dir/include/asm/resource.h' 2024-05-16T22:29:33.458 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/sembuf.h' -> 'dir/include/asm/sembuf.h' 2024-05-16T22:29:33.500 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/setup.h' -> 'dir/include/asm/setup.h' 2024-05-16T22:29:33.541 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/sgx.h' -> 'dir/include/asm/sgx.h' 2024-05-16T22:29:33.583 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/shmbuf.h' -> 'dir/include/asm/shmbuf.h' 2024-05-16T22:29:33.617 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/sigcontext.h' -> 'dir/include/asm/sigcontext.h' 2024-05-16T22:29:33.658 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/sigcontext32.h' -> 'dir/include/asm/sigcontext32.h' 2024-05-16T22:29:33.708 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/siginfo.h' -> 'dir/include/asm/siginfo.h' 2024-05-16T22:29:33.783 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/signal.h' -> 'dir/include/asm/signal.h' 2024-05-16T22:29:33.833 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/socket.h' -> 'dir/include/asm/socket.h' 2024-05-16T22:29:33.875 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/sockios.h' -> 'dir/include/asm/sockios.h' 2024-05-16T22:29:33.917 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/stat.h' -> 'dir/include/asm/stat.h' 2024-05-16T22:29:33.967 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/statfs.h' -> 'dir/include/asm/statfs.h' 2024-05-16T22:29:34.008 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/svm.h' -> 'dir/include/asm/svm.h' 2024-05-16T22:29:34.058 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/swab.h' -> 'dir/include/asm/swab.h' 2024-05-16T22:29:34.100 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/termbits.h' -> 'dir/include/asm/termbits.h' 2024-05-16T22:29:34.142 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/termios.h' -> 'dir/include/asm/termios.h' 2024-05-16T22:29:34.219 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/types.h' -> 'dir/include/asm/types.h' 2024-05-16T22:29:34.259 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/ucontext.h' -> 'dir/include/asm/ucontext.h' 2024-05-16T22:29:34.300 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/unistd.h' -> 'dir/include/asm/unistd.h' 2024-05-16T22:29:34.342 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/unistd_32.h' -> 'dir/include/asm/unistd_32.h' 2024-05-16T22:29:34.384 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/unistd_64.h' -> 'dir/include/asm/unistd_64.h' 2024-05-16T22:29:34.425 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/unistd_x32.h' -> 'dir/include/asm/unistd_x32.h' 2024-05-16T22:29:34.467 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/vm86.h' -> 'dir/include/asm/vm86.h' 2024-05-16T22:29:34.509 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/vmx.h' -> 'dir/include/asm/vmx.h' 2024-05-16T22:29:34.550 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm/vsyscall.h' -> 'dir/include/asm/vsyscall.h' 2024-05-16T22:29:34.592 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm-generic' -> 'dir/include/asm-generic' 2024-05-16T22:29:34.634 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm-generic/auxvec.h' -> 'dir/include/asm-generic/auxvec.h' 2024-05-16T22:29:34.679 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm-generic/bitsperlong.h' -> 'dir/include/asm-generic/bitsperlong.h' 2024-05-16T22:29:34.717 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm-generic/bpf_perf_event.h' -> 'dir/include/asm-generic/bpf_perf_event.h' 2024-05-16T22:29:34.759 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm-generic/errno-base.h' -> 'dir/include/asm-generic/errno-base.h' 2024-05-16T22:29:34.801 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm-generic/errno.h' -> 'dir/include/asm-generic/errno.h' 2024-05-16T22:29:34.842 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm-generic/fcntl.h' -> 'dir/include/asm-generic/fcntl.h' 2024-05-16T22:29:34.901 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm-generic/hugetlb_encode.h' -> 'dir/include/asm-generic/hugetlb_encode.h' 2024-05-16T22:29:34.960 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm-generic/int-l64.h' -> 'dir/include/asm-generic/int-l64.h' 2024-05-16T22:29:35.051 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm-generic/int-ll64.h' -> 'dir/include/asm-generic/int-ll64.h' 2024-05-16T22:29:35.084 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm-generic/ioctl.h' -> 'dir/include/asm-generic/ioctl.h' 2024-05-16T22:29:35.117 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm-generic/ioctls.h' -> 'dir/include/asm-generic/ioctls.h' 2024-05-16T22:29:35.151 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm-generic/ipcbuf.h' -> 'dir/include/asm-generic/ipcbuf.h' 2024-05-16T22:29:35.201 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm-generic/kvm_para.h' -> 'dir/include/asm-generic/kvm_para.h' 2024-05-16T22:29:35.234 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm-generic/mman-common.h' -> 'dir/include/asm-generic/mman-common.h' 2024-05-16T22:29:35.267 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm-generic/mman.h' -> 'dir/include/asm-generic/mman.h' 2024-05-16T22:29:35.301 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm-generic/msgbuf.h' -> 'dir/include/asm-generic/msgbuf.h' 2024-05-16T22:29:35.334 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm-generic/param.h' -> 'dir/include/asm-generic/param.h' 2024-05-16T22:29:35.368 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm-generic/poll.h' -> 'dir/include/asm-generic/poll.h' 2024-05-16T22:29:35.401 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm-generic/posix_types.h' -> 'dir/include/asm-generic/posix_types.h' 2024-05-16T22:29:35.434 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm-generic/resource.h' -> 'dir/include/asm-generic/resource.h' 2024-05-16T22:29:35.468 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm-generic/sembuf.h' -> 'dir/include/asm-generic/sembuf.h' 2024-05-16T22:29:35.526 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm-generic/setup.h' -> 'dir/include/asm-generic/setup.h' 2024-05-16T22:29:35.560 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm-generic/shmbuf.h' -> 'dir/include/asm-generic/shmbuf.h' 2024-05-16T22:29:35.618 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm-generic/siginfo.h' -> 'dir/include/asm-generic/siginfo.h' 2024-05-16T22:29:35.660 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm-generic/signal-defs.h' -> 'dir/include/asm-generic/signal-defs.h' 2024-05-16T22:29:35.693 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm-generic/signal.h' -> 'dir/include/asm-generic/signal.h' 2024-05-16T22:29:35.735 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm-generic/socket.h' -> 'dir/include/asm-generic/socket.h' 2024-05-16T22:29:35.768 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm-generic/sockios.h' -> 'dir/include/asm-generic/sockios.h' 2024-05-16T22:29:35.801 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm-generic/stat.h' -> 'dir/include/asm-generic/stat.h' 2024-05-16T22:29:35.835 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm-generic/statfs.h' -> 'dir/include/asm-generic/statfs.h' 2024-05-16T22:29:35.869 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm-generic/swab.h' -> 'dir/include/asm-generic/swab.h' 2024-05-16T22:29:35.910 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm-generic/termbits.h' -> 'dir/include/asm-generic/termbits.h' 2024-05-16T22:29:35.943 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm-generic/termios.h' -> 'dir/include/asm-generic/termios.h' 2024-05-16T22:29:35.985 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm-generic/types.h' -> 'dir/include/asm-generic/types.h' 2024-05-16T22:29:36.021 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm-generic/ucontext.h' -> 'dir/include/asm-generic/ucontext.h' 2024-05-16T22:29:36.060 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/asm-generic/unistd.h' -> 'dir/include/asm-generic/unistd.h' 2024-05-16T22:29:36.110 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/cpuidle.h' -> 'dir/include/cpuidle.h' 2024-05-16T22:29:36.168 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/drm' -> 'dir/include/drm' 2024-05-16T22:29:36.202 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/drm/amdgpu_drm.h' -> 'dir/include/drm/amdgpu_drm.h' 2024-05-16T22:29:36.235 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/drm/armada_drm.h' -> 'dir/include/drm/armada_drm.h' 2024-05-16T22:29:36.303 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/drm/drm.h' -> 'dir/include/drm/drm.h' 2024-05-16T22:29:36.335 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/drm/drm_fourcc.h' -> 'dir/include/drm/drm_fourcc.h' 2024-05-16T22:29:36.393 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/drm/drm_mode.h' -> 'dir/include/drm/drm_mode.h' 2024-05-16T22:29:36.427 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/drm/drm_sarea.h' -> 'dir/include/drm/drm_sarea.h' 2024-05-16T22:29:36.460 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/drm/etnaviv_drm.h' -> 'dir/include/drm/etnaviv_drm.h' 2024-05-16T22:29:36.494 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/drm/exynos_drm.h' -> 'dir/include/drm/exynos_drm.h' 2024-05-16T22:29:36.543 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/drm/habanalabs_accel.h' -> 'dir/include/drm/habanalabs_accel.h' 2024-05-16T22:29:36.577 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/drm/ivpu_accel.h' -> 'dir/include/drm/ivpu_accel.h' 2024-05-16T22:29:36.610 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/drm/msm_drm.h' -> 'dir/include/drm/msm_drm.h' 2024-05-16T22:29:36.644 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/drm/nouveau_drm.h' -> 'dir/include/drm/nouveau_drm.h' 2024-05-16T22:29:36.677 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/drm/omap_drm.h' -> 'dir/include/drm/omap_drm.h' 2024-05-16T22:29:36.713 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/drm/panfrost_drm.h' -> 'dir/include/drm/panfrost_drm.h' 2024-05-16T22:29:36.744 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/drm/qaic_accel.h' -> 'dir/include/drm/qaic_accel.h' 2024-05-16T22:29:36.827 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/drm/radeon_drm.h' -> 'dir/include/drm/radeon_drm.h' 2024-05-16T22:29:36.861 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/drm/tegra_drm.h' -> 'dir/include/drm/tegra_drm.h' 2024-05-16T22:29:36.894 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/drm/v3d_drm.h' -> 'dir/include/drm/v3d_drm.h' 2024-05-16T22:29:36.927 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/drm/vc4_drm.h' -> 'dir/include/drm/vc4_drm.h' 2024-05-16T22:29:36.987 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/drm/vgem_drm.h' -> 'dir/include/drm/vgem_drm.h' 2024-05-16T22:29:37.019 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/drm/virtgpu_drm.h' -> 'dir/include/drm/virtgpu_drm.h' 2024-05-16T22:29:37.052 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/drm/vmwgfx_drm.h' -> 'dir/include/drm/vmwgfx_drm.h' 2024-05-16T22:29:37.086 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/drm/i915_drm.h' -> 'dir/include/drm/i915_drm.h' 2024-05-16T22:29:37.119 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/drm/lima_drm.h' -> 'dir/include/drm/lima_drm.h' 2024-05-16T22:29:37.152 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/drm/qxl_drm.h' -> 'dir/include/drm/qxl_drm.h' 2024-05-16T22:29:37.209 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux' -> 'dir/include/linux' 2024-05-16T22:29:37.284 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/a.out.h' -> 'dir/include/linux/a.out.h' 2024-05-16T22:29:37.319 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/acct.h' -> 'dir/include/linux/acct.h' 2024-05-16T22:29:37.353 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/acrn.h' -> 'dir/include/linux/acrn.h' 2024-05-16T22:29:37.386 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/adb.h' -> 'dir/include/linux/adb.h' 2024-05-16T22:29:37.419 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/adfs_fs.h' -> 'dir/include/linux/adfs_fs.h' 2024-05-16T22:29:37.478 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/affs_hardblocks.h' -> 'dir/include/linux/affs_hardblocks.h' 2024-05-16T22:29:37.511 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/agpgart.h' -> 'dir/include/linux/agpgart.h' 2024-05-16T22:29:37.544 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/aio_abi.h' -> 'dir/include/linux/aio_abi.h' 2024-05-16T22:29:37.578 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/am437x-vpfe.h' -> 'dir/include/linux/am437x-vpfe.h' 2024-05-16T22:29:37.611 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/android' -> 'dir/include/linux/android' 2024-05-16T22:29:37.671 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/android/binder.h' -> 'dir/include/linux/android/binder.h' 2024-05-16T22:29:37.703 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/android/binderfs.h' -> 'dir/include/linux/android/binderfs.h' 2024-05-16T22:29:37.736 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/apm_bios.h' -> 'dir/include/linux/apm_bios.h' 2024-05-16T22:29:37.769 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/arcfb.h' -> 'dir/include/linux/arcfb.h' 2024-05-16T22:29:37.803 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/arm_sdei.h' -> 'dir/include/linux/arm_sdei.h' 2024-05-16T22:29:37.836 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/aspeed-lpc-ctrl.h' -> 'dir/include/linux/aspeed-lpc-ctrl.h' 2024-05-16T22:29:37.874 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/aspeed-p2a-ctrl.h' -> 'dir/include/linux/aspeed-p2a-ctrl.h' 2024-05-16T22:29:37.903 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/atalk.h' -> 'dir/include/linux/atalk.h' 2024-05-16T22:29:37.936 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/atm.h' -> 'dir/include/linux/atm.h' 2024-05-16T22:29:37.976 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/atm_eni.h' -> 'dir/include/linux/atm_eni.h' 2024-05-16T22:29:38.018 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/atm_he.h' -> 'dir/include/linux/atm_he.h' 2024-05-16T22:29:38.077 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/atm_idt77105.h' -> 'dir/include/linux/atm_idt77105.h' 2024-05-16T22:29:38.135 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/atm_nicstar.h' -> 'dir/include/linux/atm_nicstar.h' 2024-05-16T22:29:38.177 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/atm_tcp.h' -> 'dir/include/linux/atm_tcp.h' 2024-05-16T22:29:38.218 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/atm_zatm.h' -> 'dir/include/linux/atm_zatm.h' 2024-05-16T22:29:38.260 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/atmapi.h' -> 'dir/include/linux/atmapi.h' 2024-05-16T22:29:38.302 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/atmarp.h' -> 'dir/include/linux/atmarp.h' 2024-05-16T22:29:38.350 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/atmbr2684.h' -> 'dir/include/linux/atmbr2684.h' 2024-05-16T22:29:38.385 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/atmclip.h' -> 'dir/include/linux/atmclip.h' 2024-05-16T22:29:38.427 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/atmdev.h' -> 'dir/include/linux/atmdev.h' 2024-05-16T22:29:38.468 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/atmioc.h' -> 'dir/include/linux/atmioc.h' 2024-05-16T22:29:38.510 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/atmlec.h' -> 'dir/include/linux/atmlec.h' 2024-05-16T22:29:38.552 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/atmmpc.h' -> 'dir/include/linux/atmmpc.h' 2024-05-16T22:29:38.594 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/atmppp.h' -> 'dir/include/linux/atmppp.h' 2024-05-16T22:29:38.635 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/atmsap.h' -> 'dir/include/linux/atmsap.h' 2024-05-16T22:29:38.677 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/atmsvc.h' -> 'dir/include/linux/atmsvc.h' 2024-05-16T22:29:38.719 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/audit.h' -> 'dir/include/linux/audit.h' 2024-05-16T22:29:38.777 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/auto_dev-ioctl.h' -> 'dir/include/linux/auto_dev-ioctl.h' 2024-05-16T22:29:38.819 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/auto_fs.h' -> 'dir/include/linux/auto_fs.h' 2024-05-16T22:29:38.860 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/auto_fs4.h' -> 'dir/include/linux/auto_fs4.h' 2024-05-16T22:29:38.902 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/auxvec.h' -> 'dir/include/linux/auxvec.h' 2024-05-16T22:29:38.944 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/ax25.h' -> 'dir/include/linux/ax25.h' 2024-05-16T22:29:39.000 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/batadv_packet.h' -> 'dir/include/linux/batadv_packet.h' 2024-05-16T22:29:39.369 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/batman_adv.h' -> 'dir/include/linux/batman_adv.h' 2024-05-16T22:29:39.411 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/baycom.h' -> 'dir/include/linux/baycom.h' 2024-05-16T22:29:39.452 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/bcm933xx_hcs.h' -> 'dir/include/linux/bcm933xx_hcs.h' 2024-05-16T22:29:39.502 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/bfs_fs.h' -> 'dir/include/linux/bfs_fs.h' 2024-05-16T22:29:39.544 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/binfmts.h' -> 'dir/include/linux/binfmts.h' 2024-05-16T22:29:39.586 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/blkpg.h' -> 'dir/include/linux/blkpg.h' 2024-05-16T22:29:39.659 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/blktrace_api.h' -> 'dir/include/linux/blktrace_api.h' 2024-05-16T22:29:39.704 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/blkzoned.h' -> 'dir/include/linux/blkzoned.h' 2024-05-16T22:29:39.744 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/bpf.h' -> 'dir/include/linux/bpf.h' 2024-05-16T22:29:39.811 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/bpf_common.h' -> 'dir/include/linux/bpf_common.h' 2024-05-16T22:29:39.853 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/bpf_perf_event.h' -> 'dir/include/linux/bpf_perf_event.h' 2024-05-16T22:29:39.894 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/bpfilter.h' -> 'dir/include/linux/bpfilter.h' 2024-05-16T22:29:39.936 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/bpqether.h' -> 'dir/include/linux/bpqether.h' 2024-05-16T22:29:39.978 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/bsg.h' -> 'dir/include/linux/bsg.h' 2024-05-16T22:29:40.020 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/bt-bmc.h' -> 'dir/include/linux/bt-bmc.h' 2024-05-16T22:29:40.070 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/btf.h' -> 'dir/include/linux/btf.h' 2024-05-16T22:29:40.119 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/btrfs.h' -> 'dir/include/linux/btrfs.h' 2024-05-16T22:29:40.192 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/btrfs_tree.h' -> 'dir/include/linux/btrfs_tree.h' 2024-05-16T22:29:40.228 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/byteorder' -> 'dir/include/linux/byteorder' 2024-05-16T22:29:40.286 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/byteorder/big_endian.h' -> 'dir/include/linux/byteorder/big_endian.h' 2024-05-16T22:29:40.328 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/byteorder/little_endian.h' -> 'dir/include/linux/byteorder/little_endian.h' 2024-05-16T22:29:40.370 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/cachefiles.h' -> 'dir/include/linux/cachefiles.h' 2024-05-16T22:29:40.411 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/caif' -> 'dir/include/linux/caif' 2024-05-16T22:29:40.470 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/caif/caif_socket.h' -> 'dir/include/linux/caif/caif_socket.h' 2024-05-16T22:29:40.519 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/caif/if_caif.h' -> 'dir/include/linux/caif/if_caif.h' 2024-05-16T22:29:40.587 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/can.h' -> 'dir/include/linux/can.h' 2024-05-16T22:29:40.628 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/can' -> 'dir/include/linux/can' 2024-05-16T22:29:40.681 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/can/bcm.h' -> 'dir/include/linux/can/bcm.h' 2024-05-16T22:29:40.778 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/can/error.h' -> 'dir/include/linux/can/error.h' 2024-05-16T22:29:40.820 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/can/gw.h' -> 'dir/include/linux/can/gw.h' 2024-05-16T22:29:40.862 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/can/isotp.h' -> 'dir/include/linux/can/isotp.h' 2024-05-16T22:29:40.903 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/can/j1939.h' -> 'dir/include/linux/can/j1939.h' 2024-05-16T22:29:40.953 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/can/netlink.h' -> 'dir/include/linux/can/netlink.h' 2024-05-16T22:29:41.037 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/can/raw.h' -> 'dir/include/linux/can/raw.h' 2024-05-16T22:29:41.092 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/can/vxcan.h' -> 'dir/include/linux/can/vxcan.h' 2024-05-16T22:29:41.128 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/capability.h' -> 'dir/include/linux/capability.h' 2024-05-16T22:29:41.170 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/capi.h' -> 'dir/include/linux/capi.h' 2024-05-16T22:29:41.212 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/cciss_defs.h' -> 'dir/include/linux/cciss_defs.h' 2024-05-16T22:29:41.254 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/cciss_ioctl.h' -> 'dir/include/linux/cciss_ioctl.h' 2024-05-16T22:29:41.295 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/ccs.h' -> 'dir/include/linux/ccs.h' 2024-05-16T22:29:41.337 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/cdrom.h' -> 'dir/include/linux/cdrom.h' 2024-05-16T22:29:41.412 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/cec-funcs.h' -> 'dir/include/linux/cec-funcs.h' 2024-05-16T22:29:41.454 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/cec.h' -> 'dir/include/linux/cec.h' 2024-05-16T22:29:41.495 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/cfm_bridge.h' -> 'dir/include/linux/cfm_bridge.h' 2024-05-16T22:29:41.546 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/cgroupstats.h' -> 'dir/include/linux/cgroupstats.h' 2024-05-16T22:29:41.596 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/chio.h' -> 'dir/include/linux/chio.h' 2024-05-16T22:29:41.646 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/cifs' -> 'dir/include/linux/cifs' 2024-05-16T22:29:41.696 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/cifs/cifs_mount.h' -> 'dir/include/linux/cifs/cifs_mount.h' 2024-05-16T22:29:41.746 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/cifs/cifs_netlink.h' -> 'dir/include/linux/cifs/cifs_netlink.h' 2024-05-16T22:29:41.796 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/close_range.h' -> 'dir/include/linux/close_range.h' 2024-05-16T22:29:41.846 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/cm4000_cs.h' -> 'dir/include/linux/cm4000_cs.h' 2024-05-16T22:29:41.891 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/cn_proc.h' -> 'dir/include/linux/cn_proc.h' 2024-05-16T22:29:41.938 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/coda.h' -> 'dir/include/linux/coda.h' 2024-05-16T22:29:41.988 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/coff.h' -> 'dir/include/linux/coff.h' 2024-05-16T22:29:42.038 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/connector.h' -> 'dir/include/linux/connector.h' 2024-05-16T22:29:42.088 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/const.h' -> 'dir/include/linux/const.h' 2024-05-16T22:29:42.138 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/coresight-stm.h' -> 'dir/include/linux/coresight-stm.h' 2024-05-16T22:29:42.205 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/cramfs_fs.h' -> 'dir/include/linux/cramfs_fs.h' 2024-05-16T22:29:42.255 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/cryptouser.h' -> 'dir/include/linux/cryptouser.h' 2024-05-16T22:29:42.305 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/cuda.h' -> 'dir/include/linux/cuda.h' 2024-05-16T22:29:42.355 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/cxl_mem.h' -> 'dir/include/linux/cxl_mem.h' 2024-05-16T22:29:42.405 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/cycx_cfm.h' -> 'dir/include/linux/cycx_cfm.h' 2024-05-16T22:29:42.455 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/dcbnl.h' -> 'dir/include/linux/dcbnl.h' 2024-05-16T22:29:42.505 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/dccp.h' -> 'dir/include/linux/dccp.h' 2024-05-16T22:29:42.555 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/devlink.h' -> 'dir/include/linux/devlink.h' 2024-05-16T22:29:42.605 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/dlm.h' -> 'dir/include/linux/dlm.h' 2024-05-16T22:29:42.655 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/dlm_device.h' -> 'dir/include/linux/dlm_device.h' 2024-05-16T22:29:42.705 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/dlm_netlink.h' -> 'dir/include/linux/dlm_netlink.h' 2024-05-16T22:29:42.772 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/dlm_plock.h' -> 'dir/include/linux/dlm_plock.h' 2024-05-16T22:29:42.822 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/dlmconstants.h' -> 'dir/include/linux/dlmconstants.h' 2024-05-16T22:29:42.872 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/dm-ioctl.h' -> 'dir/include/linux/dm-ioctl.h' 2024-05-16T22:29:42.922 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/dm-log-userspace.h' -> 'dir/include/linux/dm-log-userspace.h' 2024-05-16T22:29:42.972 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/dma-buf.h' -> 'dir/include/linux/dma-buf.h' 2024-05-16T22:29:43.039 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/dma-heap.h' -> 'dir/include/linux/dma-heap.h' 2024-05-16T22:29:43.088 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/dn.h' -> 'dir/include/linux/dn.h' 2024-05-16T22:29:43.139 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/dns_resolver.h' -> 'dir/include/linux/dns_resolver.h' 2024-05-16T22:29:43.189 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/dpll.h' -> 'dir/include/linux/dpll.h' 2024-05-16T22:29:43.239 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/dvb' -> 'dir/include/linux/dvb' 2024-05-16T22:29:43.355 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/dvb/audio.h' -> 'dir/include/linux/dvb/audio.h' 2024-05-16T22:29:43.405 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/dvb/ca.h' -> 'dir/include/linux/dvb/ca.h' 2024-05-16T22:29:43.455 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/dvb/dmx.h' -> 'dir/include/linux/dvb/dmx.h' 2024-05-16T22:29:43.505 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/dvb/frontend.h' -> 'dir/include/linux/dvb/frontend.h' 2024-05-16T22:29:43.555 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/dvb/net.h' -> 'dir/include/linux/dvb/net.h' 2024-05-16T22:29:43.605 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/dvb/osd.h' -> 'dir/include/linux/dvb/osd.h' 2024-05-16T22:29:43.655 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/dvb/version.h' -> 'dir/include/linux/dvb/version.h' 2024-05-16T22:29:43.709 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/dvb/video.h' -> 'dir/include/linux/dvb/video.h' 2024-05-16T22:29:43.772 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/edd.h' -> 'dir/include/linux/edd.h' 2024-05-16T22:29:43.822 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/efs_fs_sb.h' -> 'dir/include/linux/efs_fs_sb.h' 2024-05-16T22:29:43.872 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/elf-em.h' -> 'dir/include/linux/elf-em.h' 2024-05-16T22:29:43.939 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/elf-fdpic.h' -> 'dir/include/linux/elf-fdpic.h' 2024-05-16T22:29:43.989 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/elf.h' -> 'dir/include/linux/elf.h' 2024-05-16T22:29:44.039 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/errno.h' -> 'dir/include/linux/errno.h' 2024-05-16T22:29:44.089 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/errqueue.h' -> 'dir/include/linux/errqueue.h' 2024-05-16T22:29:44.139 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/erspan.h' -> 'dir/include/linux/erspan.h' 2024-05-16T22:29:44.189 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/ethtool.h' -> 'dir/include/linux/ethtool.h' 2024-05-16T22:29:44.239 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/ethtool_netlink.h' -> 'dir/include/linux/ethtool_netlink.h' 2024-05-16T22:29:44.289 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/eventpoll.h' -> 'dir/include/linux/eventpoll.h' 2024-05-16T22:29:44.339 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/f2fs.h' -> 'dir/include/linux/f2fs.h' 2024-05-16T22:29:44.389 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/fadvise.h' -> 'dir/include/linux/fadvise.h' 2024-05-16T22:29:44.439 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/falloc.h' -> 'dir/include/linux/falloc.h' 2024-05-16T22:29:44.489 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/fanotify.h' -> 'dir/include/linux/fanotify.h' 2024-05-16T22:29:44.539 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/fb.h' -> 'dir/include/linux/fb.h' 2024-05-16T22:29:44.607 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/fcntl.h' -> 'dir/include/linux/fcntl.h' 2024-05-16T22:29:44.656 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/fd.h' -> 'dir/include/linux/fd.h' 2024-05-16T22:29:44.706 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/fdreg.h' -> 'dir/include/linux/fdreg.h' 2024-05-16T22:29:44.781 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/fib_rules.h' -> 'dir/include/linux/fib_rules.h' 2024-05-16T22:29:44.831 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/fiemap.h' -> 'dir/include/linux/fiemap.h' 2024-05-16T22:29:44.881 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/filter.h' -> 'dir/include/linux/filter.h' 2024-05-16T22:29:44.931 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/firewire-cdev.h' -> 'dir/include/linux/firewire-cdev.h' 2024-05-16T22:29:44.981 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/firewire-constants.h' -> 'dir/include/linux/firewire-constants.h' 2024-05-16T22:29:45.031 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/fou.h' -> 'dir/include/linux/fou.h' 2024-05-16T22:29:45.081 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/fpga-dfl.h' -> 'dir/include/linux/fpga-dfl.h' 2024-05-16T22:29:45.131 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/fs.h' -> 'dir/include/linux/fs.h' 2024-05-16T22:29:45.181 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/fscrypt.h' -> 'dir/include/linux/fscrypt.h' 2024-05-16T22:29:45.231 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/fsi.h' -> 'dir/include/linux/fsi.h' 2024-05-16T22:29:45.281 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/fsl_hypervisor.h' -> 'dir/include/linux/fsl_hypervisor.h' 2024-05-16T22:29:45.331 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/fsl_mc.h' -> 'dir/include/linux/fsl_mc.h' 2024-05-16T22:29:45.381 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/fsmap.h' -> 'dir/include/linux/fsmap.h' 2024-05-16T22:29:45.432 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/fsverity.h' -> 'dir/include/linux/fsverity.h' 2024-05-16T22:29:45.484 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/fuse.h' -> 'dir/include/linux/fuse.h' 2024-05-16T22:29:45.532 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/futex.h' -> 'dir/include/linux/futex.h' 2024-05-16T22:29:45.598 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/gameport.h' -> 'dir/include/linux/gameport.h' 2024-05-16T22:29:45.648 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/gen_stats.h' -> 'dir/include/linux/gen_stats.h' 2024-05-16T22:29:45.698 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/genetlink.h' -> 'dir/include/linux/genetlink.h' 2024-05-16T22:29:45.740 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/genwqe' -> 'dir/include/linux/genwqe' 2024-05-16T22:29:45.782 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/genwqe/genwqe_card.h' -> 'dir/include/linux/genwqe/genwqe_card.h' 2024-05-16T22:29:45.815 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/gfs2_ondisk.h' -> 'dir/include/linux/gfs2_ondisk.h' 2024-05-16T22:29:45.865 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/gpio.h' -> 'dir/include/linux/gpio.h' 2024-05-16T22:29:45.915 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/gsmmux.h' -> 'dir/include/linux/gsmmux.h' 2024-05-16T22:29:45.957 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/gtp.h' -> 'dir/include/linux/gtp.h' 2024-05-16T22:29:45.999 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/handshake.h' -> 'dir/include/linux/handshake.h' 2024-05-16T22:29:46.040 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/hdlc.h' -> 'dir/include/linux/hdlc.h' 2024-05-16T22:29:46.090 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/hdlc' -> 'dir/include/linux/hdlc' 2024-05-16T22:29:46.132 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/hdlc/ioctl.h' -> 'dir/include/linux/hdlc/ioctl.h' 2024-05-16T22:29:46.174 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/hdlcdrv.h' -> 'dir/include/linux/hdlcdrv.h' 2024-05-16T22:29:46.207 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/hdreg.h' -> 'dir/include/linux/hdreg.h' 2024-05-16T22:29:46.265 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/hid.h' -> 'dir/include/linux/hid.h' 2024-05-16T22:29:46.332 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/hiddev.h' -> 'dir/include/linux/hiddev.h' 2024-05-16T22:29:46.365 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/hidraw.h' -> 'dir/include/linux/hidraw.h' 2024-05-16T22:29:46.399 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/hpet.h' -> 'dir/include/linux/hpet.h' 2024-05-16T22:29:46.440 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/hsi' -> 'dir/include/linux/hsi' 2024-05-16T22:29:46.482 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/hsi/cs-protocol.h' -> 'dir/include/linux/hsi/cs-protocol.h' 2024-05-16T22:29:46.523 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/hsi/hsi_char.h' -> 'dir/include/linux/hsi/hsi_char.h' 2024-05-16T22:29:46.566 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/hsr_netlink.h' -> 'dir/include/linux/hsr_netlink.h' 2024-05-16T22:29:46.624 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/hw_breakpoint.h' -> 'dir/include/linux/hw_breakpoint.h' 2024-05-16T22:29:46.674 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/hyperv.h' -> 'dir/include/linux/hyperv.h' 2024-05-16T22:29:46.724 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/i2c-dev.h' -> 'dir/include/linux/i2c-dev.h' 2024-05-16T22:29:46.782 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/i2c.h' -> 'dir/include/linux/i2c.h' 2024-05-16T22:29:46.832 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/i2o-dev.h' -> 'dir/include/linux/i2o-dev.h' 2024-05-16T22:29:46.883 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/i8k.h' -> 'dir/include/linux/i8k.h' 2024-05-16T22:29:46.932 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/icmp.h' -> 'dir/include/linux/icmp.h' 2024-05-16T22:29:46.982 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/icmpv6.h' -> 'dir/include/linux/icmpv6.h' 2024-05-16T22:29:47.032 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/idxd.h' -> 'dir/include/linux/idxd.h' 2024-05-16T22:29:47.108 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/if.h' -> 'dir/include/linux/if.h' 2024-05-16T22:29:47.158 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/if_addr.h' -> 'dir/include/linux/if_addr.h' 2024-05-16T22:29:47.208 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/if_addrlabel.h' -> 'dir/include/linux/if_addrlabel.h' 2024-05-16T22:29:47.258 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/if_alg.h' -> 'dir/include/linux/if_alg.h' 2024-05-16T22:29:47.308 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/if_arcnet.h' -> 'dir/include/linux/if_arcnet.h' 2024-05-16T22:29:47.358 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/if_arp.h' -> 'dir/include/linux/if_arp.h' 2024-05-16T22:29:47.408 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/if_bonding.h' -> 'dir/include/linux/if_bonding.h' 2024-05-16T22:29:47.449 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/if_bridge.h' -> 'dir/include/linux/if_bridge.h' 2024-05-16T22:29:47.491 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/if_cablemodem.h' -> 'dir/include/linux/if_cablemodem.h' 2024-05-16T22:29:47.533 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/if_eql.h' -> 'dir/include/linux/if_eql.h' 2024-05-16T22:29:47.575 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/if_ether.h' -> 'dir/include/linux/if_ether.h' 2024-05-16T22:29:47.616 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/if_fc.h' -> 'dir/include/linux/if_fc.h' 2024-05-16T22:29:47.658 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/if_fddi.h' -> 'dir/include/linux/if_fddi.h' 2024-05-16T22:29:47.700 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/if_hippi.h' -> 'dir/include/linux/if_hippi.h' 2024-05-16T22:29:47.741 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/if_infiniband.h' -> 'dir/include/linux/if_infiniband.h' 2024-05-16T22:29:47.783 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/if_link.h' -> 'dir/include/linux/if_link.h' 2024-05-16T22:29:47.850 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/if_ltalk.h' -> 'dir/include/linux/if_ltalk.h' 2024-05-16T22:29:47.914 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/if_macsec.h' -> 'dir/include/linux/if_macsec.h' 2024-05-16T22:29:47.950 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/if_packet.h' -> 'dir/include/linux/if_packet.h' 2024-05-16T22:29:47.992 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/if_phonet.h' -> 'dir/include/linux/if_phonet.h' 2024-05-16T22:29:48.033 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/if_plip.h' -> 'dir/include/linux/if_plip.h' 2024-05-16T22:29:48.075 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/if_ppp.h' -> 'dir/include/linux/if_ppp.h' 2024-05-16T22:29:48.116 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/if_pppol2tp.h' -> 'dir/include/linux/if_pppol2tp.h' 2024-05-16T22:29:48.158 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/if_pppox.h' -> 'dir/include/linux/if_pppox.h' 2024-05-16T22:29:48.200 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/if_slip.h' -> 'dir/include/linux/if_slip.h' 2024-05-16T22:29:48.242 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/if_team.h' -> 'dir/include/linux/if_team.h' 2024-05-16T22:29:48.283 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/if_tun.h' -> 'dir/include/linux/if_tun.h' 2024-05-16T22:29:48.325 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/if_tunnel.h' -> 'dir/include/linux/if_tunnel.h' 2024-05-16T22:29:48.367 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/if_vlan.h' -> 'dir/include/linux/if_vlan.h' 2024-05-16T22:29:48.409 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/if_x25.h' -> 'dir/include/linux/if_x25.h' 2024-05-16T22:29:48.450 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/if_xdp.h' -> 'dir/include/linux/if_xdp.h' 2024-05-16T22:29:48.492 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/ife.h' -> 'dir/include/linux/ife.h' 2024-05-16T22:29:48.550 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/igmp.h' -> 'dir/include/linux/igmp.h' 2024-05-16T22:29:48.592 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/iio' -> 'dir/include/linux/iio' 2024-05-16T22:29:48.634 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/iio/buffer.h' -> 'dir/include/linux/iio/buffer.h' 2024-05-16T22:29:48.675 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/iio/events.h' -> 'dir/include/linux/iio/events.h' 2024-05-16T22:29:48.717 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/iio/types.h' -> 'dir/include/linux/iio/types.h' 2024-05-16T22:29:48.759 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/ila.h' -> 'dir/include/linux/ila.h' 2024-05-16T22:29:48.800 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/in.h' -> 'dir/include/linux/in.h' 2024-05-16T22:29:48.842 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/in6.h' -> 'dir/include/linux/in6.h' 2024-05-16T22:29:48.884 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/in_route.h' -> 'dir/include/linux/in_route.h' 2024-05-16T22:29:48.932 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/inet_diag.h' -> 'dir/include/linux/inet_diag.h' 2024-05-16T22:29:48.967 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/inotify.h' -> 'dir/include/linux/inotify.h' 2024-05-16T22:29:49.009 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/input-event-codes.h' -> 'dir/include/linux/input-event-codes.h' 2024-05-16T22:29:49.051 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/input.h' -> 'dir/include/linux/input.h' 2024-05-16T22:29:49.097 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/io_uring.h' -> 'dir/include/linux/io_uring.h' 2024-05-16T22:29:49.134 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/ioctl.h' -> 'dir/include/linux/ioctl.h' 2024-05-16T22:29:49.176 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/iommu.h' -> 'dir/include/linux/iommu.h' 2024-05-16T22:29:49.251 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/iommufd.h' -> 'dir/include/linux/iommufd.h' 2024-05-16T22:29:49.478 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/ip.h' -> 'dir/include/linux/ip.h' 2024-05-16T22:29:49.551 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/ip6_tunnel.h' -> 'dir/include/linux/ip6_tunnel.h' 2024-05-16T22:29:49.606 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/ip_vs.h' -> 'dir/include/linux/ip_vs.h' 2024-05-16T22:29:49.643 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/ipc.h' -> 'dir/include/linux/ipc.h' 2024-05-16T22:29:49.684 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/ipmi.h' -> 'dir/include/linux/ipmi.h' 2024-05-16T22:29:49.726 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/ipmi_bmc.h' -> 'dir/include/linux/ipmi_bmc.h' 2024-05-16T22:29:49.768 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/ipmi_msgdefs.h' -> 'dir/include/linux/ipmi_msgdefs.h' 2024-05-16T22:29:49.835 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/ipmi_ssif_bmc.h' -> 'dir/include/linux/ipmi_ssif_bmc.h' 2024-05-16T22:29:49.876 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/ipv6.h' -> 'dir/include/linux/ipv6.h' 2024-05-16T22:29:49.918 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/ipv6_route.h' -> 'dir/include/linux/ipv6_route.h' 2024-05-16T22:29:49.960 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/ipx.h' -> 'dir/include/linux/ipx.h' 2024-05-16T22:29:50.001 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/irqnr.h' -> 'dir/include/linux/irqnr.h' 2024-05-16T22:29:50.043 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/isdn' -> 'dir/include/linux/isdn' 2024-05-16T22:29:50.085 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/isdn/capicmd.h' -> 'dir/include/linux/isdn/capicmd.h' 2024-05-16T22:29:50.126 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/iso_fs.h' -> 'dir/include/linux/iso_fs.h' 2024-05-16T22:29:50.185 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/isst_if.h' -> 'dir/include/linux/isst_if.h' 2024-05-16T22:29:50.227 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/ivtv.h' -> 'dir/include/linux/ivtv.h' 2024-05-16T22:29:50.268 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/ivtvfb.h' -> 'dir/include/linux/ivtvfb.h' 2024-05-16T22:29:50.310 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/jffs2.h' -> 'dir/include/linux/jffs2.h' 2024-05-16T22:29:50.397 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/joystick.h' -> 'dir/include/linux/joystick.h' 2024-05-16T22:29:50.435 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/kcm.h' -> 'dir/include/linux/kcm.h' 2024-05-16T22:29:50.476 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/kcmp.h' -> 'dir/include/linux/kcmp.h' 2024-05-16T22:29:50.518 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/kcov.h' -> 'dir/include/linux/kcov.h' 2024-05-16T22:29:50.568 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/kd.h' -> 'dir/include/linux/kd.h' 2024-05-16T22:29:50.610 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/kdev_t.h' -> 'dir/include/linux/kdev_t.h' 2024-05-16T22:29:50.652 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/kernel-page-flags.h' -> 'dir/include/linux/kernel-page-flags.h' 2024-05-16T22:29:50.693 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/kernel.h' -> 'dir/include/linux/kernel.h' 2024-05-16T22:29:50.735 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/kernelcapi.h' -> 'dir/include/linux/kernelcapi.h' 2024-05-16T22:29:50.777 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/kexec.h' -> 'dir/include/linux/kexec.h' 2024-05-16T22:29:50.819 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/keyboard.h' -> 'dir/include/linux/keyboard.h' 2024-05-16T22:29:50.860 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/keyctl.h' -> 'dir/include/linux/keyctl.h' 2024-05-16T22:29:50.935 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/kfd_ioctl.h' -> 'dir/include/linux/kfd_ioctl.h' 2024-05-16T22:29:50.985 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/kfd_sysfs.h' -> 'dir/include/linux/kfd_sysfs.h' 2024-05-16T22:29:51.027 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/kvm.h' -> 'dir/include/linux/kvm.h' 2024-05-16T22:29:51.069 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/kvm_para.h' -> 'dir/include/linux/kvm_para.h' 2024-05-16T22:29:51.110 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/l2tp.h' -> 'dir/include/linux/l2tp.h' 2024-05-16T22:29:51.164 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/landlock.h' -> 'dir/include/linux/landlock.h' 2024-05-16T22:29:51.202 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/libc-compat.h' -> 'dir/include/linux/libc-compat.h' 2024-05-16T22:29:51.244 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/limits.h' -> 'dir/include/linux/limits.h' 2024-05-16T22:29:51.285 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/lirc.h' -> 'dir/include/linux/lirc.h' 2024-05-16T22:29:51.327 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/llc.h' -> 'dir/include/linux/llc.h' 2024-05-16T22:29:51.369 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/loadpin.h' -> 'dir/include/linux/loadpin.h' 2024-05-16T22:29:51.411 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/loop.h' -> 'dir/include/linux/loop.h' 2024-05-16T22:29:51.461 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/lp.h' -> 'dir/include/linux/lp.h' 2024-05-16T22:29:51.502 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/lwtunnel.h' -> 'dir/include/linux/lwtunnel.h' 2024-05-16T22:29:51.544 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/magic.h' -> 'dir/include/linux/magic.h' 2024-05-16T22:29:51.586 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/major.h' -> 'dir/include/linux/major.h' 2024-05-16T22:29:51.636 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/map_to_7segment.h' -> 'dir/include/linux/map_to_7segment.h' 2024-05-16T22:29:51.678 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/matroxfb.h' -> 'dir/include/linux/matroxfb.h' 2024-05-16T22:29:51.711 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/max2175.h' -> 'dir/include/linux/max2175.h' 2024-05-16T22:29:51.745 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/mdio.h' -> 'dir/include/linux/mdio.h' 2024-05-16T22:29:51.778 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/media-bus-format.h' -> 'dir/include/linux/media-bus-format.h' 2024-05-16T22:29:51.811 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/media.h' -> 'dir/include/linux/media.h' 2024-05-16T22:29:51.855 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/mei.h' -> 'dir/include/linux/mei.h' 2024-05-16T22:29:51.887 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/membarrier.h' -> 'dir/include/linux/membarrier.h' 2024-05-16T22:29:51.920 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/memfd.h' -> 'dir/include/linux/memfd.h' 2024-05-16T22:29:51.953 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/mempolicy.h' -> 'dir/include/linux/mempolicy.h' 2024-05-16T22:29:51.987 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/meye.h' -> 'dir/include/linux/meye.h' 2024-05-16T22:29:52.020 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/mii.h' -> 'dir/include/linux/mii.h' 2024-05-16T22:29:52.053 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/minix_fs.h' -> 'dir/include/linux/minix_fs.h' 2024-05-16T22:29:52.087 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/misc' -> 'dir/include/linux/misc' 2024-05-16T22:29:52.120 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/misc/bcm_vk.h' -> 'dir/include/linux/misc/bcm_vk.h' 2024-05-16T22:29:52.153 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/mman.h' -> 'dir/include/linux/mman.h' 2024-05-16T22:29:52.212 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/mmc' -> 'dir/include/linux/mmc' 2024-05-16T22:29:52.270 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/mmc/ioctl.h' -> 'dir/include/linux/mmc/ioctl.h' 2024-05-16T22:29:52.320 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/mmtimer.h' -> 'dir/include/linux/mmtimer.h' 2024-05-16T22:29:52.370 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/module.h' -> 'dir/include/linux/module.h' 2024-05-16T22:29:52.420 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/mount.h' -> 'dir/include/linux/mount.h' 2024-05-16T22:29:52.470 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/mpls.h' -> 'dir/include/linux/mpls.h' 2024-05-16T22:29:52.520 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/mpls_iptunnel.h' -> 'dir/include/linux/mpls_iptunnel.h' 2024-05-16T22:29:52.570 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/mptcp.h' -> 'dir/include/linux/mptcp.h' 2024-05-16T22:29:52.620 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/mptcp_pm.h' -> 'dir/include/linux/mptcp_pm.h' 2024-05-16T22:29:52.670 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/mroute.h' -> 'dir/include/linux/mroute.h' 2024-05-16T22:29:52.720 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/mroute6.h' -> 'dir/include/linux/mroute6.h' 2024-05-16T22:29:52.770 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/mrp_bridge.h' -> 'dir/include/linux/mrp_bridge.h' 2024-05-16T22:29:52.837 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/msdos_fs.h' -> 'dir/include/linux/msdos_fs.h' 2024-05-16T22:29:52.887 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/msg.h' -> 'dir/include/linux/msg.h' 2024-05-16T22:29:52.937 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/mtio.h' -> 'dir/include/linux/mtio.h' 2024-05-16T22:29:52.987 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/nbd-netlink.h' -> 'dir/include/linux/nbd-netlink.h' 2024-05-16T22:29:53.054 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/nbd.h' -> 'dir/include/linux/nbd.h' 2024-05-16T22:29:53.104 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/ncsi.h' -> 'dir/include/linux/ncsi.h' 2024-05-16T22:29:53.154 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/ndctl.h' -> 'dir/include/linux/ndctl.h' 2024-05-16T22:29:53.204 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/neighbour.h' -> 'dir/include/linux/neighbour.h' 2024-05-16T22:29:53.254 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/net.h' -> 'dir/include/linux/net.h' 2024-05-16T22:29:53.304 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/net_dropmon.h' -> 'dir/include/linux/net_dropmon.h' 2024-05-16T22:29:53.354 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/net_namespace.h' -> 'dir/include/linux/net_namespace.h' 2024-05-16T22:29:53.404 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/net_tstamp.h' -> 'dir/include/linux/net_tstamp.h' 2024-05-16T22:29:53.463 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netconf.h' -> 'dir/include/linux/netconf.h' 2024-05-16T22:29:53.513 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netdev.h' -> 'dir/include/linux/netdev.h' 2024-05-16T22:29:53.563 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter.h' -> 'dir/include/linux/netfilter.h' 2024-05-16T22:29:53.613 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter' -> 'dir/include/linux/netfilter' 2024-05-16T22:29:53.663 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/ipset' -> 'dir/include/linux/netfilter/ipset' 2024-05-16T22:29:53.713 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/ipset/ip_set.h' -> 'dir/include/linux/netfilter/ipset/ip_set.h' 2024-05-16T22:29:53.763 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/ipset/ip_set_bitmap.h' -> 'dir/include/linux/netfilter/ipset/ip_set_bitmap.h' 2024-05-16T22:29:53.813 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/ipset/ip_set_hash.h' -> 'dir/include/linux/netfilter/ipset/ip_set_hash.h' 2024-05-16T22:29:53.888 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/ipset/ip_set_list.h' -> 'dir/include/linux/netfilter/ipset/ip_set_list.h' 2024-05-16T22:29:53.938 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/nf_conntrack_common.h' -> 'dir/include/linux/netfilter/nf_conntrack_common.h' 2024-05-16T22:29:53.988 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/nf_conntrack_ftp.h' -> 'dir/include/linux/netfilter/nf_conntrack_ftp.h' 2024-05-16T22:29:54.038 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/nf_conntrack_sctp.h' -> 'dir/include/linux/netfilter/nf_conntrack_sctp.h' 2024-05-16T22:29:54.088 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/nf_conntrack_tcp.h' -> 'dir/include/linux/netfilter/nf_conntrack_tcp.h' 2024-05-16T22:29:54.138 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/nf_conntrack_tuple_common.h' -> 'dir/include/linux/netfilter/nf_conntrack_tuple_common.h' 2024-05-16T22:29:54.188 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/nf_log.h' -> 'dir/include/linux/netfilter/nf_log.h' 2024-05-16T22:29:54.238 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/nf_nat.h' -> 'dir/include/linux/netfilter/nf_nat.h' 2024-05-16T22:29:54.280 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/nf_synproxy.h' -> 'dir/include/linux/netfilter/nf_synproxy.h' 2024-05-16T22:29:54.334 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/nf_tables.h' -> 'dir/include/linux/netfilter/nf_tables.h' 2024-05-16T22:29:54.380 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/nf_tables_compat.h' -> 'dir/include/linux/netfilter/nf_tables_compat.h' 2024-05-16T22:29:54.423 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/nfnetlink.h' -> 'dir/include/linux/netfilter/nfnetlink.h' 2024-05-16T22:29:54.463 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/nfnetlink_acct.h' -> 'dir/include/linux/netfilter/nfnetlink_acct.h' 2024-05-16T22:29:54.505 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/nfnetlink_compat.h' -> 'dir/include/linux/netfilter/nfnetlink_compat.h' 2024-05-16T22:29:54.550 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/nfnetlink_conntrack.h' -> 'dir/include/linux/netfilter/nfnetlink_conntrack.h' 2024-05-16T22:29:54.622 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/nfnetlink_cthelper.h' -> 'dir/include/linux/netfilter/nfnetlink_cthelper.h' 2024-05-16T22:29:54.663 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/nfnetlink_cttimeout.h' -> 'dir/include/linux/netfilter/nfnetlink_cttimeout.h' 2024-05-16T22:29:54.722 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/nfnetlink_hook.h' -> 'dir/include/linux/netfilter/nfnetlink_hook.h' 2024-05-16T22:29:54.772 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/nfnetlink_log.h' -> 'dir/include/linux/netfilter/nfnetlink_log.h' 2024-05-16T22:29:54.813 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/nfnetlink_osf.h' -> 'dir/include/linux/netfilter/nfnetlink_osf.h' 2024-05-16T22:29:54.863 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/nfnetlink_queue.h' -> 'dir/include/linux/netfilter/nfnetlink_queue.h' 2024-05-16T22:29:54.897 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/x_tables.h' -> 'dir/include/linux/netfilter/x_tables.h' 2024-05-16T22:29:54.947 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_AUDIT.h' -> 'dir/include/linux/netfilter/xt_AUDIT.h' 2024-05-16T22:29:54.997 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_CHECKSUM.h' -> 'dir/include/linux/netfilter/xt_CHECKSUM.h' 2024-05-16T22:29:55.047 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_CLASSIFY.h' -> 'dir/include/linux/netfilter/xt_CLASSIFY.h' 2024-05-16T22:29:55.097 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_CONNMARK.h' -> 'dir/include/linux/netfilter/xt_CONNMARK.h' 2024-05-16T22:29:55.171 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_CONNSECMARK.h' -> 'dir/include/linux/netfilter/xt_CONNSECMARK.h' 2024-05-16T22:29:55.222 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_CT.h' -> 'dir/include/linux/netfilter/xt_CT.h' 2024-05-16T22:29:55.264 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_DSCP.h' -> 'dir/include/linux/netfilter/xt_DSCP.h' 2024-05-16T22:29:55.297 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_HMARK.h' -> 'dir/include/linux/netfilter/xt_HMARK.h' 2024-05-16T22:29:55.339 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_IDLETIMER.h' -> 'dir/include/linux/netfilter/xt_IDLETIMER.h' 2024-05-16T22:29:55.372 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_LED.h' -> 'dir/include/linux/netfilter/xt_LED.h' 2024-05-16T22:29:55.439 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_LOG.h' -> 'dir/include/linux/netfilter/xt_LOG.h' 2024-05-16T22:29:55.481 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_MARK.h' -> 'dir/include/linux/netfilter/xt_MARK.h' 2024-05-16T22:29:55.514 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_NFLOG.h' -> 'dir/include/linux/netfilter/xt_NFLOG.h' 2024-05-16T22:29:55.556 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_NFQUEUE.h' -> 'dir/include/linux/netfilter/xt_NFQUEUE.h' 2024-05-16T22:29:55.589 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_RATEEST.h' -> 'dir/include/linux/netfilter/xt_RATEEST.h' 2024-05-16T22:29:55.622 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_SECMARK.h' -> 'dir/include/linux/netfilter/xt_SECMARK.h' 2024-05-16T22:29:55.656 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_SYNPROXY.h' -> 'dir/include/linux/netfilter/xt_SYNPROXY.h' 2024-05-16T22:29:55.689 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_TCPMSS.h' -> 'dir/include/linux/netfilter/xt_TCPMSS.h' 2024-05-16T22:29:55.722 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_TCPOPTSTRIP.h' -> 'dir/include/linux/netfilter/xt_TCPOPTSTRIP.h' 2024-05-16T22:29:55.756 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_TEE.h' -> 'dir/include/linux/netfilter/xt_TEE.h' 2024-05-16T22:29:55.789 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_TPROXY.h' -> 'dir/include/linux/netfilter/xt_TPROXY.h' 2024-05-16T22:29:55.837 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_addrtype.h' -> 'dir/include/linux/netfilter/xt_addrtype.h' 2024-05-16T22:29:55.889 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_bpf.h' -> 'dir/include/linux/netfilter/xt_bpf.h' 2024-05-16T22:29:55.939 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_cgroup.h' -> 'dir/include/linux/netfilter/xt_cgroup.h' 2024-05-16T22:29:55.973 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_cluster.h' -> 'dir/include/linux/netfilter/xt_cluster.h' 2024-05-16T22:29:56.014 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_comment.h' -> 'dir/include/linux/netfilter/xt_comment.h' 2024-05-16T22:29:56.081 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_connbytes.h' -> 'dir/include/linux/netfilter/xt_connbytes.h' 2024-05-16T22:29:56.118 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_connlabel.h' -> 'dir/include/linux/netfilter/xt_connlabel.h' 2024-05-16T22:29:56.148 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_connlimit.h' -> 'dir/include/linux/netfilter/xt_connlimit.h' 2024-05-16T22:29:56.181 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_connmark.h' -> 'dir/include/linux/netfilter/xt_connmark.h' 2024-05-16T22:29:56.214 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_conntrack.h' -> 'dir/include/linux/netfilter/xt_conntrack.h' 2024-05-16T22:29:56.256 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_cpu.h' -> 'dir/include/linux/netfilter/xt_cpu.h' 2024-05-16T22:29:56.289 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_dccp.h' -> 'dir/include/linux/netfilter/xt_dccp.h' 2024-05-16T22:29:56.323 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_devgroup.h' -> 'dir/include/linux/netfilter/xt_devgroup.h' 2024-05-16T22:29:56.356 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_dscp.h' -> 'dir/include/linux/netfilter/xt_dscp.h' 2024-05-16T22:29:56.398 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_ecn.h' -> 'dir/include/linux/netfilter/xt_ecn.h' 2024-05-16T22:29:56.431 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_esp.h' -> 'dir/include/linux/netfilter/xt_esp.h' 2024-05-16T22:29:56.465 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_hashlimit.h' -> 'dir/include/linux/netfilter/xt_hashlimit.h' 2024-05-16T22:29:56.512 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_helper.h' -> 'dir/include/linux/netfilter/xt_helper.h' 2024-05-16T22:29:56.540 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_ipcomp.h' -> 'dir/include/linux/netfilter/xt_ipcomp.h' 2024-05-16T22:29:56.573 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_iprange.h' -> 'dir/include/linux/netfilter/xt_iprange.h' 2024-05-16T22:29:56.606 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_ipvs.h' -> 'dir/include/linux/netfilter/xt_ipvs.h' 2024-05-16T22:29:56.665 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_l2tp.h' -> 'dir/include/linux/netfilter/xt_l2tp.h' 2024-05-16T22:29:56.699 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_length.h' -> 'dir/include/linux/netfilter/xt_length.h' 2024-05-16T22:29:56.738 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_limit.h' -> 'dir/include/linux/netfilter/xt_limit.h' 2024-05-16T22:29:56.765 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_mac.h' -> 'dir/include/linux/netfilter/xt_mac.h' 2024-05-16T22:29:56.798 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_mark.h' -> 'dir/include/linux/netfilter/xt_mark.h' 2024-05-16T22:29:56.832 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_multiport.h' -> 'dir/include/linux/netfilter/xt_multiport.h' 2024-05-16T22:29:56.865 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_nfacct.h' -> 'dir/include/linux/netfilter/xt_nfacct.h' 2024-05-16T22:29:56.908 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_osf.h' -> 'dir/include/linux/netfilter/xt_osf.h' 2024-05-16T22:29:56.940 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_owner.h' -> 'dir/include/linux/netfilter/xt_owner.h' 2024-05-16T22:29:56.973 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_physdev.h' -> 'dir/include/linux/netfilter/xt_physdev.h' 2024-05-16T22:29:57.015 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_pkttype.h' -> 'dir/include/linux/netfilter/xt_pkttype.h' 2024-05-16T22:29:57.074 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_policy.h' -> 'dir/include/linux/netfilter/xt_policy.h' 2024-05-16T22:29:57.115 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_quota.h' -> 'dir/include/linux/netfilter/xt_quota.h' 2024-05-16T22:29:57.162 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_rateest.h' -> 'dir/include/linux/netfilter/xt_rateest.h' 2024-05-16T22:29:57.199 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_realm.h' -> 'dir/include/linux/netfilter/xt_realm.h' 2024-05-16T22:29:57.240 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_recent.h' -> 'dir/include/linux/netfilter/xt_recent.h' 2024-05-16T22:29:57.299 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_rpfilter.h' -> 'dir/include/linux/netfilter/xt_rpfilter.h' 2024-05-16T22:29:57.332 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_sctp.h' -> 'dir/include/linux/netfilter/xt_sctp.h' 2024-05-16T22:29:57.374 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_set.h' -> 'dir/include/linux/netfilter/xt_set.h' 2024-05-16T22:29:57.418 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_socket.h' -> 'dir/include/linux/netfilter/xt_socket.h' 2024-05-16T22:29:57.457 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_state.h' -> 'dir/include/linux/netfilter/xt_state.h' 2024-05-16T22:29:57.499 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_statistic.h' -> 'dir/include/linux/netfilter/xt_statistic.h' 2024-05-16T22:29:57.540 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_string.h' -> 'dir/include/linux/netfilter/xt_string.h' 2024-05-16T22:29:57.582 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_tcpmss.h' -> 'dir/include/linux/netfilter/xt_tcpmss.h' 2024-05-16T22:29:57.624 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_tcpudp.h' -> 'dir/include/linux/netfilter/xt_tcpudp.h' 2024-05-16T22:29:57.666 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_time.h' -> 'dir/include/linux/netfilter/xt_time.h' 2024-05-16T22:29:57.707 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter/xt_u32.h' -> 'dir/include/linux/netfilter/xt_u32.h' 2024-05-16T22:29:57.749 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_arp.h' -> 'dir/include/linux/netfilter_arp.h' 2024-05-16T22:29:57.791 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_arp' -> 'dir/include/linux/netfilter_arp' 2024-05-16T22:29:57.832 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_arp/arp_tables.h' -> 'dir/include/linux/netfilter_arp/arp_tables.h' 2024-05-16T22:29:57.874 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_arp/arpt_mangle.h' -> 'dir/include/linux/netfilter_arp/arpt_mangle.h' 2024-05-16T22:29:57.916 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_bridge.h' -> 'dir/include/linux/netfilter_bridge.h' 2024-05-16T22:29:57.991 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_bridge' -> 'dir/include/linux/netfilter_bridge' 2024-05-16T22:29:58.058 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_bridge/ebt_802_3.h' -> 'dir/include/linux/netfilter_bridge/ebt_802_3.h' 2024-05-16T22:29:58.099 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_bridge/ebt_among.h' -> 'dir/include/linux/netfilter_bridge/ebt_among.h' 2024-05-16T22:29:58.141 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_bridge/ebt_arp.h' -> 'dir/include/linux/netfilter_bridge/ebt_arp.h' 2024-05-16T22:29:58.183 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_bridge/ebt_arpreply.h' -> 'dir/include/linux/netfilter_bridge/ebt_arpreply.h' 2024-05-16T22:29:58.224 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_bridge/ebt_ip.h' -> 'dir/include/linux/netfilter_bridge/ebt_ip.h' 2024-05-16T22:29:58.266 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_bridge/ebt_ip6.h' -> 'dir/include/linux/netfilter_bridge/ebt_ip6.h' 2024-05-16T22:29:58.308 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_bridge/ebt_limit.h' -> 'dir/include/linux/netfilter_bridge/ebt_limit.h' 2024-05-16T22:29:58.350 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_bridge/ebt_log.h' -> 'dir/include/linux/netfilter_bridge/ebt_log.h' 2024-05-16T22:29:58.397 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_bridge/ebt_mark_m.h' -> 'dir/include/linux/netfilter_bridge/ebt_mark_m.h' 2024-05-16T22:29:58.433 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_bridge/ebt_mark_t.h' -> 'dir/include/linux/netfilter_bridge/ebt_mark_t.h' 2024-05-16T22:29:58.475 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_bridge/ebt_nat.h' -> 'dir/include/linux/netfilter_bridge/ebt_nat.h' 2024-05-16T22:29:58.516 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_bridge/ebt_nflog.h' -> 'dir/include/linux/netfilter_bridge/ebt_nflog.h' 2024-05-16T22:29:58.558 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_bridge/ebt_pkttype.h' -> 'dir/include/linux/netfilter_bridge/ebt_pkttype.h' 2024-05-16T22:29:58.600 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_bridge/ebt_redirect.h' -> 'dir/include/linux/netfilter_bridge/ebt_redirect.h' 2024-05-16T22:29:58.646 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_bridge/ebt_stp.h' -> 'dir/include/linux/netfilter_bridge/ebt_stp.h' 2024-05-16T22:29:58.700 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_bridge/ebt_vlan.h' -> 'dir/include/linux/netfilter_bridge/ebt_vlan.h' 2024-05-16T22:29:58.741 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_bridge/ebtables.h' -> 'dir/include/linux/netfilter_bridge/ebtables.h' 2024-05-16T22:29:58.783 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_decnet.h' -> 'dir/include/linux/netfilter_decnet.h' 2024-05-16T22:29:58.825 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_ipv4.h' -> 'dir/include/linux/netfilter_ipv4.h' 2024-05-16T22:29:58.867 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_ipv4' -> 'dir/include/linux/netfilter_ipv4' 2024-05-16T22:29:58.917 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_ipv4/ip_tables.h' -> 'dir/include/linux/netfilter_ipv4/ip_tables.h' 2024-05-16T22:29:58.958 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_ipv4/ipt_CLUSTERIP.h' -> 'dir/include/linux/netfilter_ipv4/ipt_CLUSTERIP.h' 2024-05-16T22:29:59.000 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_ipv4/ipt_ECN.h' -> 'dir/include/linux/netfilter_ipv4/ipt_ECN.h' 2024-05-16T22:29:59.046 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_ipv4/ipt_LOG.h' -> 'dir/include/linux/netfilter_ipv4/ipt_LOG.h' 2024-05-16T22:29:59.084 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_ipv4/ipt_REJECT.h' -> 'dir/include/linux/netfilter_ipv4/ipt_REJECT.h' 2024-05-16T22:29:59.125 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_ipv4/ipt_TTL.h' -> 'dir/include/linux/netfilter_ipv4/ipt_TTL.h' 2024-05-16T22:29:59.167 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_ipv4/ipt_ah.h' -> 'dir/include/linux/netfilter_ipv4/ipt_ah.h' 2024-05-16T22:29:59.209 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_ipv4/ipt_ecn.h' -> 'dir/include/linux/netfilter_ipv4/ipt_ecn.h' 2024-05-16T22:29:59.250 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_ipv4/ipt_ttl.h' -> 'dir/include/linux/netfilter_ipv4/ipt_ttl.h' 2024-05-16T22:29:59.292 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_ipv6.h' -> 'dir/include/linux/netfilter_ipv6.h' 2024-05-16T22:29:59.334 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netlink.h' -> 'dir/include/linux/netlink.h' 2024-05-16T22:29:59.400 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netlink_diag.h' -> 'dir/include/linux/netlink_diag.h' 2024-05-16T22:29:59.450 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netrom.h' -> 'dir/include/linux/netrom.h' 2024-05-16T22:29:59.625 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/nexthop.h' -> 'dir/include/linux/nexthop.h' 2024-05-16T22:29:59.851 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/nfc.h' -> 'dir/include/linux/nfc.h' 2024-05-16T22:29:59.894 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/nfs.h' -> 'dir/include/linux/nfs.h' 2024-05-16T22:29:59.926 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/nfs2.h' -> 'dir/include/linux/nfs2.h' 2024-05-16T22:29:59.967 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/nfs3.h' -> 'dir/include/linux/nfs3.h' 2024-05-16T22:30:00.009 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/nfs4.h' -> 'dir/include/linux/nfs4.h' 2024-05-16T22:30:00.051 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/nfs4_mount.h' -> 'dir/include/linux/nfs4_mount.h' 2024-05-16T22:30:00.101 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/nfs_fs.h' -> 'dir/include/linux/nfs_fs.h' 2024-05-16T22:30:00.142 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/nfs_idmap.h' -> 'dir/include/linux/nfs_idmap.h' 2024-05-16T22:30:00.184 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/nfs_mount.h' -> 'dir/include/linux/nfs_mount.h' 2024-05-16T22:30:00.226 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/nfsacl.h' -> 'dir/include/linux/nfsacl.h' 2024-05-16T22:30:00.267 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/nilfs2_api.h' -> 'dir/include/linux/nilfs2_api.h' 2024-05-16T22:30:00.309 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/nilfs2_ondisk.h' -> 'dir/include/linux/nilfs2_ondisk.h' 2024-05-16T22:30:00.350 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/nitro_enclaves.h' -> 'dir/include/linux/nitro_enclaves.h' 2024-05-16T22:30:00.409 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/nl80211.h' -> 'dir/include/linux/nl80211.h' 2024-05-16T22:30:00.472 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/nsfs.h' -> 'dir/include/linux/nsfs.h' 2024-05-16T22:30:00.509 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/nubus.h' -> 'dir/include/linux/nubus.h' 2024-05-16T22:30:00.551 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/nvme_ioctl.h' -> 'dir/include/linux/nvme_ioctl.h' 2024-05-16T22:30:00.601 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/nvram.h' -> 'dir/include/linux/nvram.h' 2024-05-16T22:30:00.643 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/omap3isp.h' -> 'dir/include/linux/omap3isp.h' 2024-05-16T22:30:00.684 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/omapfb.h' -> 'dir/include/linux/omapfb.h' 2024-05-16T22:30:00.744 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/oom.h' -> 'dir/include/linux/oom.h' 2024-05-16T22:30:00.784 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/openat2.h' -> 'dir/include/linux/openat2.h' 2024-05-16T22:30:00.826 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/openvswitch.h' -> 'dir/include/linux/openvswitch.h' 2024-05-16T22:30:00.868 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/packet_diag.h' -> 'dir/include/linux/packet_diag.h' 2024-05-16T22:30:00.909 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/param.h' -> 'dir/include/linux/param.h' 2024-05-16T22:30:00.955 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/parport.h' -> 'dir/include/linux/parport.h' 2024-05-16T22:30:01.001 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/patchkey.h' -> 'dir/include/linux/patchkey.h' 2024-05-16T22:30:01.043 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/pci.h' -> 'dir/include/linux/pci.h' 2024-05-16T22:30:01.085 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/pci_regs.h' -> 'dir/include/linux/pci_regs.h' 2024-05-16T22:30:01.151 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/pcitest.h' -> 'dir/include/linux/pcitest.h' 2024-05-16T22:30:01.193 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/perf_event.h' -> 'dir/include/linux/perf_event.h' 2024-05-16T22:30:01.239 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/personality.h' -> 'dir/include/linux/personality.h' 2024-05-16T22:30:01.268 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/pfkeyv2.h' -> 'dir/include/linux/pfkeyv2.h' 2024-05-16T22:30:01.302 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/pfrut.h' -> 'dir/include/linux/pfrut.h' 2024-05-16T22:30:01.344 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/pg.h' -> 'dir/include/linux/pg.h' 2024-05-16T22:30:01.377 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/phantom.h' -> 'dir/include/linux/phantom.h' 2024-05-16T22:30:01.410 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/phonet.h' -> 'dir/include/linux/phonet.h' 2024-05-16T22:30:01.475 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/pidfd.h' -> 'dir/include/linux/pidfd.h' 2024-05-16T22:30:01.502 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/pkt_cls.h' -> 'dir/include/linux/pkt_cls.h' 2024-05-16T22:30:01.535 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/pkt_sched.h' -> 'dir/include/linux/pkt_sched.h' 2024-05-16T22:30:01.613 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/pktcdvd.h' -> 'dir/include/linux/pktcdvd.h' 2024-05-16T22:30:01.646 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/pmu.h' -> 'dir/include/linux/pmu.h' 2024-05-16T22:30:01.680 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/poll.h' -> 'dir/include/linux/poll.h' 2024-05-16T22:30:01.713 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/posix_acl.h' -> 'dir/include/linux/posix_acl.h' 2024-05-16T22:30:01.746 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/posix_acl_xattr.h' -> 'dir/include/linux/posix_acl_xattr.h' 2024-05-16T22:30:01.805 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/posix_types.h' -> 'dir/include/linux/posix_types.h' 2024-05-16T22:30:01.847 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/ppdev.h' -> 'dir/include/linux/ppdev.h' 2024-05-16T22:30:01.880 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/ppp-comp.h' -> 'dir/include/linux/ppp-comp.h' 2024-05-16T22:30:01.930 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/ppp-ioctl.h' -> 'dir/include/linux/ppp-ioctl.h' 2024-05-16T22:30:01.963 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/ppp_defs.h' -> 'dir/include/linux/ppp_defs.h' 2024-05-16T22:30:01.997 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/pps.h' -> 'dir/include/linux/pps.h' 2024-05-16T22:30:02.030 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/pr.h' -> 'dir/include/linux/pr.h' 2024-05-16T22:30:02.064 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/prctl.h' -> 'dir/include/linux/prctl.h' 2024-05-16T22:30:02.105 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/psample.h' -> 'dir/include/linux/psample.h' 2024-05-16T22:30:02.139 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/psci.h' -> 'dir/include/linux/psci.h' 2024-05-16T22:30:02.172 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/psp-dbc.h' -> 'dir/include/linux/psp-dbc.h' 2024-05-16T22:30:02.207 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/ptp_clock.h' -> 'dir/include/linux/ptp_clock.h' 2024-05-16T22:30:02.239 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/ptrace.h' -> 'dir/include/linux/ptrace.h' 2024-05-16T22:30:02.272 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/qemu_fw_cfg.h' -> 'dir/include/linux/qemu_fw_cfg.h' 2024-05-16T22:30:02.306 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/qnx4_fs.h' -> 'dir/include/linux/qnx4_fs.h' 2024-05-16T22:30:02.339 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/qnxtypes.h' -> 'dir/include/linux/qnxtypes.h' 2024-05-16T22:30:02.372 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/qrtr.h' -> 'dir/include/linux/qrtr.h' 2024-05-16T22:30:02.439 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/quota.h' -> 'dir/include/linux/quota.h' 2024-05-16T22:30:02.472 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/radeonfb.h' -> 'dir/include/linux/radeonfb.h' 2024-05-16T22:30:02.506 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/random.h' -> 'dir/include/linux/random.h' 2024-05-16T22:30:02.557 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/rds.h' -> 'dir/include/linux/rds.h' 2024-05-16T22:30:02.589 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/reboot.h' -> 'dir/include/linux/reboot.h' 2024-05-16T22:30:02.622 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/reiserfs_fs.h' -> 'dir/include/linux/reiserfs_fs.h' 2024-05-16T22:30:02.656 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/reiserfs_xattr.h' -> 'dir/include/linux/reiserfs_xattr.h' 2024-05-16T22:30:02.689 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/remoteproc_cdev.h' -> 'dir/include/linux/remoteproc_cdev.h' 2024-05-16T22:30:02.723 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/resource.h' -> 'dir/include/linux/resource.h' 2024-05-16T22:30:02.791 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/rfkill.h' -> 'dir/include/linux/rfkill.h' 2024-05-16T22:30:02.822 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/rio_cm_cdev.h' -> 'dir/include/linux/rio_cm_cdev.h' 2024-05-16T22:30:02.856 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/rio_mport_cdev.h' -> 'dir/include/linux/rio_mport_cdev.h' 2024-05-16T22:30:02.889 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/rkisp1-config.h' -> 'dir/include/linux/rkisp1-config.h' 2024-05-16T22:30:02.923 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/romfs_fs.h' -> 'dir/include/linux/romfs_fs.h' 2024-05-16T22:30:02.972 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/rose.h' -> 'dir/include/linux/rose.h' 2024-05-16T22:30:03.039 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/route.h' -> 'dir/include/linux/route.h' 2024-05-16T22:30:03.073 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/rpl.h' -> 'dir/include/linux/rpl.h' 2024-05-16T22:30:03.106 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/rpl_iptunnel.h' -> 'dir/include/linux/rpl_iptunnel.h' 2024-05-16T22:30:03.140 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/rpmsg.h' -> 'dir/include/linux/rpmsg.h' 2024-05-16T22:30:03.173 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/rpmsg_types.h' -> 'dir/include/linux/rpmsg_types.h' 2024-05-16T22:30:03.235 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/rseq.h' -> 'dir/include/linux/rseq.h' 2024-05-16T22:30:03.264 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/rtc.h' -> 'dir/include/linux/rtc.h' 2024-05-16T22:30:03.298 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/rtnetlink.h' -> 'dir/include/linux/rtnetlink.h' 2024-05-16T22:30:03.331 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/rxrpc.h' -> 'dir/include/linux/rxrpc.h' 2024-05-16T22:30:03.365 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/scc.h' -> 'dir/include/linux/scc.h' 2024-05-16T22:30:03.398 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/sched.h' -> 'dir/include/linux/sched.h' 2024-05-16T22:30:03.436 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/scif_ioctl.h' -> 'dir/include/linux/scif_ioctl.h' 2024-05-16T22:30:03.465 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/screen_info.h' -> 'dir/include/linux/screen_info.h' 2024-05-16T22:30:03.498 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/sctp.h' -> 'dir/include/linux/sctp.h' 2024-05-16T22:30:03.532 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/seccomp.h' -> 'dir/include/linux/seccomp.h' 2024-05-16T22:30:03.565 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/securebits.h' -> 'dir/include/linux/securebits.h' 2024-05-16T22:30:03.623 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/sed-opal.h' -> 'dir/include/linux/sed-opal.h' 2024-05-16T22:30:03.657 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/seg6.h' -> 'dir/include/linux/seg6.h' 2024-05-16T22:30:03.690 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/seg6_genl.h' -> 'dir/include/linux/seg6_genl.h' 2024-05-16T22:30:03.724 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/seg6_hmac.h' -> 'dir/include/linux/seg6_hmac.h' 2024-05-16T22:30:03.757 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/seg6_iptunnel.h' -> 'dir/include/linux/seg6_iptunnel.h' 2024-05-16T22:30:03.790 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/seg6_local.h' -> 'dir/include/linux/seg6_local.h' 2024-05-16T22:30:03.838 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/selinux_netlink.h' -> 'dir/include/linux/selinux_netlink.h' 2024-05-16T22:30:03.874 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/sem.h' -> 'dir/include/linux/sem.h' 2024-05-16T22:30:03.907 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/serial.h' -> 'dir/include/linux/serial.h' 2024-05-16T22:30:03.940 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/serial_core.h' -> 'dir/include/linux/serial_core.h' 2024-05-16T22:30:03.974 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/serial_reg.h' -> 'dir/include/linux/serial_reg.h' 2024-05-16T22:30:04.007 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/serio.h' -> 'dir/include/linux/serio.h' 2024-05-16T22:30:04.040 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/sev-guest.h' -> 'dir/include/linux/sev-guest.h' 2024-05-16T22:30:04.074 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/shm.h' -> 'dir/include/linux/shm.h' 2024-05-16T22:30:04.107 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/signal.h' -> 'dir/include/linux/signal.h' 2024-05-16T22:30:04.140 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/signalfd.h' -> 'dir/include/linux/signalfd.h' 2024-05-16T22:30:04.199 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/smc.h' -> 'dir/include/linux/smc.h' 2024-05-16T22:30:04.232 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/smc_diag.h' -> 'dir/include/linux/smc_diag.h' 2024-05-16T22:30:04.266 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/smiapp.h' -> 'dir/include/linux/smiapp.h' 2024-05-16T22:30:04.299 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/snmp.h' -> 'dir/include/linux/snmp.h' 2024-05-16T22:30:04.332 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/sock_diag.h' -> 'dir/include/linux/sock_diag.h' 2024-05-16T22:30:04.366 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/socket.h' -> 'dir/include/linux/socket.h' 2024-05-16T22:30:04.399 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/sockios.h' -> 'dir/include/linux/sockios.h' 2024-05-16T22:30:04.446 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/sonet.h' -> 'dir/include/linux/sonet.h' 2024-05-16T22:30:04.482 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/sonypi.h' -> 'dir/include/linux/sonypi.h' 2024-05-16T22:30:04.516 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/sound.h' -> 'dir/include/linux/sound.h' 2024-05-16T22:30:04.549 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/soundcard.h' -> 'dir/include/linux/soundcard.h' 2024-05-16T22:30:04.586 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/stat.h' -> 'dir/include/linux/stat.h' 2024-05-16T22:30:04.616 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/stddef.h' -> 'dir/include/linux/stddef.h' 2024-05-16T22:30:04.677 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/stm.h' -> 'dir/include/linux/stm.h' 2024-05-16T22:30:04.958 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/string.h' -> 'dir/include/linux/string.h' 2024-05-16T22:30:04.995 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/suspend_ioctls.h' -> 'dir/include/linux/suspend_ioctls.h' 2024-05-16T22:30:05.049 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/swab.h' -> 'dir/include/linux/swab.h' 2024-05-16T22:30:05.083 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/switchtec_ioctl.h' -> 'dir/include/linux/switchtec_ioctl.h' 2024-05-16T22:30:05.116 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/sync_file.h' -> 'dir/include/linux/sync_file.h' 2024-05-16T22:30:05.149 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/synclink.h' -> 'dir/include/linux/synclink.h' 2024-05-16T22:30:05.183 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/sysctl.h' -> 'dir/include/linux/sysctl.h' 2024-05-16T22:30:05.216 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/sysinfo.h' -> 'dir/include/linux/sysinfo.h' 2024-05-16T22:30:05.249 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/target_core_user.h' -> 'dir/include/linux/target_core_user.h' 2024-05-16T22:30:05.283 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/taskstats.h' -> 'dir/include/linux/taskstats.h' 2024-05-16T22:30:05.362 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/tcp.h' -> 'dir/include/linux/tcp.h' 2024-05-16T22:30:05.391 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/tcp_metrics.h' -> 'dir/include/linux/tcp_metrics.h' 2024-05-16T22:30:05.425 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/tdx-guest.h' -> 'dir/include/linux/tdx-guest.h' 2024-05-16T22:30:05.458 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/termios.h' -> 'dir/include/linux/termios.h' 2024-05-16T22:30:05.491 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/thermal.h' -> 'dir/include/linux/thermal.h' 2024-05-16T22:30:05.525 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/time.h' -> 'dir/include/linux/time.h' 2024-05-16T22:30:05.575 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/time_types.h' -> 'dir/include/linux/time_types.h' 2024-05-16T22:30:05.608 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/timerfd.h' -> 'dir/include/linux/timerfd.h' 2024-05-16T22:30:05.666 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/times.h' -> 'dir/include/linux/times.h' 2024-05-16T22:30:05.700 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/timex.h' -> 'dir/include/linux/timex.h' 2024-05-16T22:30:05.733 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/tiocl.h' -> 'dir/include/linux/tiocl.h' 2024-05-16T22:30:05.767 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/tipc.h' -> 'dir/include/linux/tipc.h' 2024-05-16T22:30:05.800 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/tipc_config.h' -> 'dir/include/linux/tipc_config.h' 2024-05-16T22:30:05.833 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/tipc_netlink.h' -> 'dir/include/linux/tipc_netlink.h' 2024-05-16T22:30:05.867 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/tipc_sockets_diag.h' -> 'dir/include/linux/tipc_sockets_diag.h' 2024-05-16T22:30:05.900 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/tls.h' -> 'dir/include/linux/tls.h' 2024-05-16T22:30:05.933 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/toshiba.h' -> 'dir/include/linux/toshiba.h' 2024-05-16T22:30:06.010 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/tty.h' -> 'dir/include/linux/tty.h' 2024-05-16T22:30:06.042 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/tty_flags.h' -> 'dir/include/linux/tty_flags.h' 2024-05-16T22:30:06.075 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/types.h' -> 'dir/include/linux/types.h' 2024-05-16T22:30:06.108 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/udf_fs_i.h' -> 'dir/include/linux/udf_fs_i.h' 2024-05-16T22:30:06.142 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/udmabuf.h' -> 'dir/include/linux/udmabuf.h' 2024-05-16T22:30:06.175 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/udp.h' -> 'dir/include/linux/udp.h' 2024-05-16T22:30:06.246 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/uhid.h' -> 'dir/include/linux/uhid.h' 2024-05-16T22:30:06.300 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/uinput.h' -> 'dir/include/linux/uinput.h' 2024-05-16T22:30:06.334 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/uio.h' -> 'dir/include/linux/uio.h' 2024-05-16T22:30:06.367 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/uleds.h' -> 'dir/include/linux/uleds.h' 2024-05-16T22:30:06.402 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/ultrasound.h' -> 'dir/include/linux/ultrasound.h' 2024-05-16T22:30:06.434 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/um_timetravel.h' -> 'dir/include/linux/um_timetravel.h' 2024-05-16T22:30:06.467 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/un.h' -> 'dir/include/linux/un.h' 2024-05-16T22:30:06.500 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/unistd.h' -> 'dir/include/linux/unistd.h' 2024-05-16T22:30:06.534 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/unix_diag.h' -> 'dir/include/linux/unix_diag.h' 2024-05-16T22:30:06.567 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/usbdevice_fs.h' -> 'dir/include/linux/usbdevice_fs.h' 2024-05-16T22:30:06.600 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/usbip.h' -> 'dir/include/linux/usbip.h' 2024-05-16T22:30:06.651 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/userfaultfd.h' -> 'dir/include/linux/userfaultfd.h' 2024-05-16T22:30:06.684 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/userio.h' -> 'dir/include/linux/userio.h' 2024-05-16T22:30:06.717 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/utime.h' -> 'dir/include/linux/utime.h' 2024-05-16T22:30:06.751 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/utsname.h' -> 'dir/include/linux/utsname.h' 2024-05-16T22:30:06.784 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/uuid.h' -> 'dir/include/linux/uuid.h' 2024-05-16T22:30:06.817 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/uvcvideo.h' -> 'dir/include/linux/uvcvideo.h' 2024-05-16T22:30:06.875 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/v4l2-common.h' -> 'dir/include/linux/v4l2-common.h' 2024-05-16T22:30:06.918 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/v4l2-controls.h' -> 'dir/include/linux/v4l2-controls.h' 2024-05-16T22:30:06.951 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/v4l2-dv-timings.h' -> 'dir/include/linux/v4l2-dv-timings.h' 2024-05-16T22:30:06.984 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/v4l2-mediabus.h' -> 'dir/include/linux/v4l2-mediabus.h' 2024-05-16T22:30:07.018 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/v4l2-subdev.h' -> 'dir/include/linux/v4l2-subdev.h' 2024-05-16T22:30:07.051 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/vbox_err.h' -> 'dir/include/linux/vbox_err.h' 2024-05-16T22:30:07.084 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/vbox_vmmdev_types.h' -> 'dir/include/linux/vbox_vmmdev_types.h' 2024-05-16T22:30:07.118 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/vboxguest.h' -> 'dir/include/linux/vboxguest.h' 2024-05-16T22:30:07.151 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/vdpa.h' -> 'dir/include/linux/vdpa.h' 2024-05-16T22:30:07.184 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/version.h' -> 'dir/include/linux/version.h' 2024-05-16T22:30:07.218 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/veth.h' -> 'dir/include/linux/veth.h' 2024-05-16T22:30:07.267 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/vfio.h' -> 'dir/include/linux/vfio.h' 2024-05-16T22:30:07.335 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/vfio_ccw.h' -> 'dir/include/linux/vfio_ccw.h' 2024-05-16T22:30:07.368 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/vfio_zdev.h' -> 'dir/include/linux/vfio_zdev.h' 2024-05-16T22:30:07.401 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/vhost.h' -> 'dir/include/linux/vhost.h' 2024-05-16T22:30:07.434 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/vhost_types.h' -> 'dir/include/linux/vhost_types.h' 2024-05-16T22:30:07.501 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/videodev2.h' -> 'dir/include/linux/videodev2.h' 2024-05-16T22:30:07.535 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/virtio_9p.h' -> 'dir/include/linux/virtio_9p.h' 2024-05-16T22:30:07.568 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/virtio_balloon.h' -> 'dir/include/linux/virtio_balloon.h' 2024-05-16T22:30:07.643 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/virtio_blk.h' -> 'dir/include/linux/virtio_blk.h' 2024-05-16T22:30:07.676 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/virtio_bt.h' -> 'dir/include/linux/virtio_bt.h' 2024-05-16T22:30:07.710 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/virtio_config.h' -> 'dir/include/linux/virtio_config.h' 2024-05-16T22:30:07.747 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/virtio_console.h' -> 'dir/include/linux/virtio_console.h' 2024-05-16T22:30:07.776 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/virtio_crypto.h' -> 'dir/include/linux/virtio_crypto.h' 2024-05-16T22:30:07.810 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/virtio_fs.h' -> 'dir/include/linux/virtio_fs.h' 2024-05-16T22:30:07.843 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/virtio_gpio.h' -> 'dir/include/linux/virtio_gpio.h' 2024-05-16T22:30:07.877 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/virtio_gpu.h' -> 'dir/include/linux/virtio_gpu.h' 2024-05-16T22:30:07.910 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/virtio_i2c.h' -> 'dir/include/linux/virtio_i2c.h' 2024-05-16T22:30:07.970 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/virtio_ids.h' -> 'dir/include/linux/virtio_ids.h' 2024-05-16T22:30:08.002 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/virtio_input.h' -> 'dir/include/linux/virtio_input.h' 2024-05-16T22:30:08.035 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/virtio_iommu.h' -> 'dir/include/linux/virtio_iommu.h' 2024-05-16T22:30:08.068 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/virtio_mem.h' -> 'dir/include/linux/virtio_mem.h' 2024-05-16T22:30:08.127 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/virtio_mmio.h' -> 'dir/include/linux/virtio_mmio.h' 2024-05-16T22:30:08.160 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/virtio_net.h' -> 'dir/include/linux/virtio_net.h' 2024-05-16T22:30:08.193 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/virtio_pci.h' -> 'dir/include/linux/virtio_pci.h' 2024-05-16T22:30:08.227 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/virtio_pcidev.h' -> 'dir/include/linux/virtio_pcidev.h' 2024-05-16T22:30:08.260 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/virtio_pmem.h' -> 'dir/include/linux/virtio_pmem.h' 2024-05-16T22:30:08.294 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/virtio_ring.h' -> 'dir/include/linux/virtio_ring.h' 2024-05-16T22:30:08.327 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/virtio_rng.h' -> 'dir/include/linux/virtio_rng.h' 2024-05-16T22:30:08.360 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/virtio_scmi.h' -> 'dir/include/linux/virtio_scmi.h' 2024-05-16T22:30:08.394 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/virtio_scsi.h' -> 'dir/include/linux/virtio_scsi.h' 2024-05-16T22:30:08.427 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/virtio_snd.h' -> 'dir/include/linux/virtio_snd.h' 2024-05-16T22:30:08.460 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/virtio_types.h' -> 'dir/include/linux/virtio_types.h' 2024-05-16T22:30:08.494 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/virtio_vsock.h' -> 'dir/include/linux/virtio_vsock.h' 2024-05-16T22:30:08.527 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/vm_sockets.h' -> 'dir/include/linux/vm_sockets.h' 2024-05-16T22:30:08.560 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/vm_sockets_diag.h' -> 'dir/include/linux/vm_sockets_diag.h' 2024-05-16T22:30:08.594 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/vmcore.h' -> 'dir/include/linux/vmcore.h' 2024-05-16T22:30:08.627 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/vsockmon.h' -> 'dir/include/linux/vsockmon.h' 2024-05-16T22:30:08.686 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/vt.h' -> 'dir/include/linux/vt.h' 2024-05-16T22:30:08.719 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/vtpm_proxy.h' -> 'dir/include/linux/vtpm_proxy.h' 2024-05-16T22:30:08.752 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/wait.h' -> 'dir/include/linux/wait.h' 2024-05-16T22:30:08.813 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/watch_queue.h' -> 'dir/include/linux/watch_queue.h' 2024-05-16T22:30:08.844 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/watchdog.h' -> 'dir/include/linux/watchdog.h' 2024-05-16T22:30:08.878 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/wireguard.h' -> 'dir/include/linux/wireguard.h' 2024-05-16T22:30:08.911 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/wireless.h' -> 'dir/include/linux/wireless.h' 2024-05-16T22:30:08.944 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/wmi.h' -> 'dir/include/linux/wmi.h' 2024-05-16T22:30:08.984 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/wwan.h' -> 'dir/include/linux/wwan.h' 2024-05-16T22:30:09.019 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/x25.h' -> 'dir/include/linux/x25.h' 2024-05-16T22:30:09.053 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/xattr.h' -> 'dir/include/linux/xattr.h' 2024-05-16T22:30:09.086 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/xdp_diag.h' -> 'dir/include/linux/xdp_diag.h' 2024-05-16T22:30:09.119 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/xfrm.h' -> 'dir/include/linux/xfrm.h' 2024-05-16T22:30:09.153 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/xilinx-v4l2-controls.h' -> 'dir/include/linux/xilinx-v4l2-controls.h' 2024-05-16T22:30:09.211 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/zorro.h' -> 'dir/include/linux/zorro.h' 2024-05-16T22:30:09.244 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/zorro_ids.h' -> 'dir/include/linux/zorro_ids.h' 2024-05-16T22:30:09.303 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/dqblk_xfs.h' -> 'dir/include/linux/dqblk_xfs.h' 2024-05-16T22:30:09.336 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/hash_info.h' -> 'dir/include/linux/hash_info.h' 2024-05-16T22:30:09.370 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/ioprio.h' -> 'dir/include/linux/ioprio.h' 2024-05-16T22:30:09.403 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/ipsec.h' -> 'dir/include/linux/ipsec.h' 2024-05-16T22:30:09.443 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/mqueue.h' -> 'dir/include/linux/mqueue.h' 2024-05-16T22:30:09.478 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netdevice.h' -> 'dir/include/linux/netdevice.h' 2024-05-16T22:30:09.511 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/psp-sev.h' -> 'dir/include/linux/psp-sev.h' 2024-05-16T22:30:09.545 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/tee.h' -> 'dir/include/linux/tee.h' 2024-05-16T22:30:09.578 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_ipv6' -> 'dir/include/linux/netfilter_ipv6' 2024-05-16T22:30:09.612 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_ipv6/ip6t_HL.h' -> 'dir/include/linux/netfilter_ipv6/ip6t_HL.h' 2024-05-16T22:30:09.645 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_ipv6/ip6t_LOG.h' -> 'dir/include/linux/netfilter_ipv6/ip6t_LOG.h' 2024-05-16T22:30:09.678 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_ipv6/ip6t_NPT.h' -> 'dir/include/linux/netfilter_ipv6/ip6t_NPT.h' 2024-05-16T22:30:09.712 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_ipv6/ip6t_REJECT.h' -> 'dir/include/linux/netfilter_ipv6/ip6t_REJECT.h' 2024-05-16T22:30:09.745 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_ipv6/ip6t_ah.h' -> 'dir/include/linux/netfilter_ipv6/ip6t_ah.h' 2024-05-16T22:30:09.778 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_ipv6/ip6t_frag.h' -> 'dir/include/linux/netfilter_ipv6/ip6t_frag.h' 2024-05-16T22:30:09.838 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_ipv6/ip6t_hl.h' -> 'dir/include/linux/netfilter_ipv6/ip6t_hl.h' 2024-05-16T22:30:09.895 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_ipv6/ip6t_ipv6header.h' -> 'dir/include/linux/netfilter_ipv6/ip6t_ipv6header.h' 2024-05-16T22:30:09.928 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_ipv6/ip6t_mh.h' -> 'dir/include/linux/netfilter_ipv6/ip6t_mh.h' 2024-05-16T22:30:09.962 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_ipv6/ip6t_opts.h' -> 'dir/include/linux/netfilter_ipv6/ip6t_opts.h' 2024-05-16T22:30:09.995 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_ipv6/ip6t_rt.h' -> 'dir/include/linux/netfilter_ipv6/ip6t_rt.h' 2024-05-16T22:30:10.028 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_ipv6/ip6t_srh.h' -> 'dir/include/linux/netfilter_ipv6/ip6t_srh.h' 2024-05-16T22:30:10.062 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/netfilter_ipv6/ip6_tables.h' -> 'dir/include/linux/netfilter_ipv6/ip6_tables.h' 2024-05-16T22:30:10.095 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/nfsd' -> 'dir/include/linux/nfsd' 2024-05-16T22:30:10.129 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/nfsd/cld.h' -> 'dir/include/linux/nfsd/cld.h' 2024-05-16T22:30:10.162 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/nfsd/debug.h' -> 'dir/include/linux/nfsd/debug.h' 2024-05-16T22:30:10.196 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/nfsd/export.h' -> 'dir/include/linux/nfsd/export.h' 2024-05-16T22:30:10.229 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/nfsd/stats.h' -> 'dir/include/linux/nfsd/stats.h' 2024-05-16T22:30:10.263 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/raid' -> 'dir/include/linux/raid' 2024-05-16T22:30:10.296 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/raid/md_p.h' -> 'dir/include/linux/raid/md_p.h' 2024-05-16T22:30:10.329 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/raid/md_u.h' -> 'dir/include/linux/raid/md_u.h' 2024-05-16T22:30:10.363 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/sched' -> 'dir/include/linux/sched' 2024-05-16T22:30:10.396 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/sched/types.h' -> 'dir/include/linux/sched/types.h' 2024-05-16T22:30:10.463 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/spi' -> 'dir/include/linux/spi' 2024-05-16T22:30:10.496 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/spi/spi.h' -> 'dir/include/linux/spi/spi.h' 2024-05-16T22:30:10.529 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/spi/spidev.h' -> 'dir/include/linux/spi/spidev.h' 2024-05-16T22:30:10.563 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/sunrpc' -> 'dir/include/linux/sunrpc' 2024-05-16T22:30:10.596 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/sunrpc/debug.h' -> 'dir/include/linux/sunrpc/debug.h' 2024-05-16T22:30:10.630 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/surface_aggregator' -> 'dir/include/linux/surface_aggregator' 2024-05-16T22:30:10.669 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/surface_aggregator/cdev.h' -> 'dir/include/linux/surface_aggregator/cdev.h' 2024-05-16T22:30:10.704 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/surface_aggregator/dtx.h' -> 'dir/include/linux/surface_aggregator/dtx.h' 2024-05-16T22:30:10.738 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/tc_act' -> 'dir/include/linux/tc_act' 2024-05-16T22:30:10.771 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/tc_act/tc_bpf.h' -> 'dir/include/linux/tc_act/tc_bpf.h' 2024-05-16T22:30:10.805 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/tc_act/tc_connmark.h' -> 'dir/include/linux/tc_act/tc_connmark.h' 2024-05-16T22:30:10.838 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/tc_act/tc_csum.h' -> 'dir/include/linux/tc_act/tc_csum.h' 2024-05-16T22:30:10.872 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/tc_act/tc_ct.h' -> 'dir/include/linux/tc_act/tc_ct.h' 2024-05-16T22:30:10.905 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/tc_act/tc_ctinfo.h' -> 'dir/include/linux/tc_act/tc_ctinfo.h' 2024-05-16T22:30:10.938 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/tc_act/tc_defact.h' -> 'dir/include/linux/tc_act/tc_defact.h' 2024-05-16T22:30:10.972 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/tc_act/tc_gact.h' -> 'dir/include/linux/tc_act/tc_gact.h' 2024-05-16T22:30:11.047 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/tc_act/tc_gate.h' -> 'dir/include/linux/tc_act/tc_gate.h' 2024-05-16T22:30:11.100 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/tc_act/tc_ife.h' -> 'dir/include/linux/tc_act/tc_ife.h' 2024-05-16T22:30:11.130 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/tc_act/tc_ipt.h' -> 'dir/include/linux/tc_act/tc_ipt.h' 2024-05-16T22:30:11.172 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/tc_act/tc_mirred.h' -> 'dir/include/linux/tc_act/tc_mirred.h' 2024-05-16T22:30:11.205 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/tc_act/tc_mpls.h' -> 'dir/include/linux/tc_act/tc_mpls.h' 2024-05-16T22:30:11.238 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/tc_act/tc_nat.h' -> 'dir/include/linux/tc_act/tc_nat.h' 2024-05-16T22:30:11.272 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/tc_act/tc_pedit.h' -> 'dir/include/linux/tc_act/tc_pedit.h' 2024-05-16T22:30:11.343 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/tc_act/tc_sample.h' -> 'dir/include/linux/tc_act/tc_sample.h' 2024-05-16T22:30:11.372 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/tc_act/tc_skbedit.h' -> 'dir/include/linux/tc_act/tc_skbedit.h' 2024-05-16T22:30:11.405 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/tc_act/tc_skbmod.h' -> 'dir/include/linux/tc_act/tc_skbmod.h' 2024-05-16T22:30:11.438 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/tc_act/tc_tunnel_key.h' -> 'dir/include/linux/tc_act/tc_tunnel_key.h' 2024-05-16T22:30:11.472 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/tc_act/tc_vlan.h' -> 'dir/include/linux/tc_act/tc_vlan.h' 2024-05-16T22:30:11.505 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/tc_ematch' -> 'dir/include/linux/tc_ematch' 2024-05-16T22:30:11.538 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/tc_ematch/tc_em_cmp.h' -> 'dir/include/linux/tc_ematch/tc_em_cmp.h' 2024-05-16T22:30:11.572 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/tc_ematch/tc_em_ipt.h' -> 'dir/include/linux/tc_ematch/tc_em_ipt.h' 2024-05-16T22:30:11.606 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/tc_ematch/tc_em_meta.h' -> 'dir/include/linux/tc_ematch/tc_em_meta.h' 2024-05-16T22:30:11.664 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/tc_ematch/tc_em_nbyte.h' -> 'dir/include/linux/tc_ematch/tc_em_nbyte.h' 2024-05-16T22:30:11.697 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/tc_ematch/tc_em_text.h' -> 'dir/include/linux/tc_ematch/tc_em_text.h' 2024-05-16T22:30:11.741 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/usb' -> 'dir/include/linux/usb' 2024-05-16T22:30:11.772 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/usb/audio.h' -> 'dir/include/linux/usb/audio.h' 2024-05-16T22:30:11.805 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/usb/cdc-wdm.h' -> 'dir/include/linux/usb/cdc-wdm.h' 2024-05-16T22:30:11.839 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/usb/cdc.h' -> 'dir/include/linux/usb/cdc.h' 2024-05-16T22:30:11.872 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/usb/ch11.h' -> 'dir/include/linux/usb/ch11.h' 2024-05-16T22:30:11.906 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/usb/ch9.h' -> 'dir/include/linux/usb/ch9.h' 2024-05-16T22:30:11.944 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/usb/charger.h' -> 'dir/include/linux/usb/charger.h' 2024-05-16T22:30:11.981 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/usb/functionfs.h' -> 'dir/include/linux/usb/functionfs.h' 2024-05-16T22:30:12.014 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/usb/g_printer.h' -> 'dir/include/linux/usb/g_printer.h' 2024-05-16T22:30:12.047 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/usb/g_uvc.h' -> 'dir/include/linux/usb/g_uvc.h' 2024-05-16T22:30:12.081 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/usb/gadgetfs.h' -> 'dir/include/linux/usb/gadgetfs.h' 2024-05-16T22:30:12.114 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/usb/midi.h' -> 'dir/include/linux/usb/midi.h' 2024-05-16T22:30:12.148 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/usb/raw_gadget.h' -> 'dir/include/linux/usb/raw_gadget.h' 2024-05-16T22:30:12.181 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/usb/tmc.h' -> 'dir/include/linux/usb/tmc.h' 2024-05-16T22:30:12.231 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/linux/usb/video.h' -> 'dir/include/linux/usb/video.h' 2024-05-16T22:30:12.264 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/powercap.h' -> 'dir/include/powercap.h' 2024-05-16T22:30:12.298 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/gnumake.h' -> 'dir/include/gnumake.h' 2024-05-16T22:30:12.399 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/a.out.h' -> 'dir/include/a.out.h' 2024-05-16T22:30:12.456 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/aio.h' -> 'dir/include/aio.h' 2024-05-16T22:30:12.489 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/aliases.h' -> 'dir/include/aliases.h' 2024-05-16T22:30:12.523 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/alloca.h' -> 'dir/include/alloca.h' 2024-05-16T22:30:12.556 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ar.h' -> 'dir/include/ar.h' 2024-05-16T22:30:12.590 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/argp.h' -> 'dir/include/argp.h' 2024-05-16T22:30:12.642 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/argz.h' -> 'dir/include/argz.h' 2024-05-16T22:30:12.673 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/assert.h' -> 'dir/include/assert.h' 2024-05-16T22:30:12.706 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/byteswap.h' -> 'dir/include/byteswap.h' 2024-05-16T22:30:12.739 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/complex.h' -> 'dir/include/complex.h' 2024-05-16T22:30:12.773 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/cpio.h' -> 'dir/include/cpio.h' 2024-05-16T22:30:12.806 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ctype.h' -> 'dir/include/ctype.h' 2024-05-16T22:30:12.840 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/dirent.h' -> 'dir/include/dirent.h' 2024-05-16T22:30:12.907 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/dlfcn.h' -> 'dir/include/dlfcn.h' 2024-05-16T22:30:12.940 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/elf.h' -> 'dir/include/elf.h' 2024-05-16T22:30:12.973 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/endian.h' -> 'dir/include/endian.h' 2024-05-16T22:30:13.007 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/envz.h' -> 'dir/include/envz.h' 2024-05-16T22:30:13.083 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/err.h' -> 'dir/include/err.h' 2024-05-16T22:30:13.115 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/errno.h' -> 'dir/include/errno.h' 2024-05-16T22:30:13.148 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/error.h' -> 'dir/include/error.h' 2024-05-16T22:30:13.182 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/execinfo.h' -> 'dir/include/execinfo.h' 2024-05-16T22:30:13.215 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/fcntl.h' -> 'dir/include/fcntl.h' 2024-05-16T22:30:13.248 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/features-time64.h' -> 'dir/include/features-time64.h' 2024-05-16T22:30:13.292 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/features.h' -> 'dir/include/features.h' 2024-05-16T22:30:13.323 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/fenv.h' -> 'dir/include/fenv.h' 2024-05-16T22:30:13.357 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/fmtmsg.h' -> 'dir/include/fmtmsg.h' 2024-05-16T22:30:13.390 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/fnmatch.h' -> 'dir/include/fnmatch.h' 2024-05-16T22:30:13.424 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/fpu_control.h' -> 'dir/include/fpu_control.h' 2024-05-16T22:30:13.458 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/fstab.h' -> 'dir/include/fstab.h' 2024-05-16T22:30:13.507 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/fts.h' -> 'dir/include/fts.h' 2024-05-16T22:30:13.540 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ftw.h' -> 'dir/include/ftw.h' 2024-05-16T22:30:13.574 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/gconv.h' -> 'dir/include/gconv.h' 2024-05-16T22:30:13.607 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/getopt.h' -> 'dir/include/getopt.h' 2024-05-16T22:30:13.640 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/glob.h' -> 'dir/include/glob.h' 2024-05-16T22:30:13.708 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/gnu-versions.h' -> 'dir/include/gnu-versions.h' 2024-05-16T22:30:13.741 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/grp.h' -> 'dir/include/grp.h' 2024-05-16T22:30:13.774 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/gshadow.h' -> 'dir/include/gshadow.h' 2024-05-16T22:30:13.807 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/iconv.h' -> 'dir/include/iconv.h' 2024-05-16T22:30:13.841 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ieee754.h' -> 'dir/include/ieee754.h' 2024-05-16T22:30:13.874 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ifaddrs.h' -> 'dir/include/ifaddrs.h' 2024-05-16T22:30:13.914 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/inttypes.h' -> 'dir/include/inttypes.h' 2024-05-16T22:30:13.949 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/langinfo.h' -> 'dir/include/langinfo.h' 2024-05-16T22:30:13.982 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/lastlog.h' -> 'dir/include/lastlog.h' 2024-05-16T22:30:14.016 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/libgen.h' -> 'dir/include/libgen.h' 2024-05-16T22:30:14.066 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/libintl.h' -> 'dir/include/libintl.h' 2024-05-16T22:30:14.116 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/limits.h' -> 'dir/include/limits.h' 2024-05-16T22:30:14.149 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/link.h' -> 'dir/include/link.h' 2024-05-16T22:30:14.182 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/locale.h' -> 'dir/include/locale.h' 2024-05-16T22:30:14.216 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/malloc.h' -> 'dir/include/malloc.h' 2024-05-16T22:30:14.249 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/math.h' -> 'dir/include/math.h' 2024-05-16T22:30:14.283 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/mcheck.h' -> 'dir/include/mcheck.h' 2024-05-16T22:30:14.337 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/memory.h' -> 'dir/include/memory.h' 2024-05-16T22:30:14.366 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/mntent.h' -> 'dir/include/mntent.h' 2024-05-16T22:30:14.400 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/monetary.h' -> 'dir/include/monetary.h' 2024-05-16T22:30:14.433 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/mqueue.h' -> 'dir/include/mqueue.h' 2024-05-16T22:30:14.466 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/netdb.h' -> 'dir/include/netdb.h' 2024-05-16T22:30:14.500 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/nl_types.h' -> 'dir/include/nl_types.h' 2024-05-16T22:30:14.534 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/nss.h' -> 'dir/include/nss.h' 2024-05-16T22:30:14.566 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/obstack.h' -> 'dir/include/obstack.h' 2024-05-16T22:30:14.602 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/paths.h' -> 'dir/include/paths.h' 2024-05-16T22:30:14.633 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/poll.h' -> 'dir/include/poll.h' 2024-05-16T22:30:14.691 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/printf.h' -> 'dir/include/printf.h' 2024-05-16T22:30:14.725 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/proc_service.h' -> 'dir/include/proc_service.h' 2024-05-16T22:30:14.758 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/pthread.h' -> 'dir/include/pthread.h' 2024-05-16T22:30:14.791 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/pty.h' -> 'dir/include/pty.h' 2024-05-16T22:30:14.825 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/pwd.h' -> 'dir/include/pwd.h' 2024-05-16T22:30:14.858 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/re_comp.h' -> 'dir/include/re_comp.h' 2024-05-16T22:30:15.158 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/regex.h' -> 'dir/include/regex.h' 2024-05-16T22:30:15.224 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/regexp.h' -> 'dir/include/regexp.h' 2024-05-16T22:30:15.258 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/resolv.h' -> 'dir/include/resolv.h' 2024-05-16T22:30:15.292 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sched.h' -> 'dir/include/sched.h' 2024-05-16T22:30:15.325 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/search.h' -> 'dir/include/search.h' 2024-05-16T22:30:15.358 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/semaphore.h' -> 'dir/include/semaphore.h' 2024-05-16T22:30:15.392 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/setjmp.h' -> 'dir/include/setjmp.h' 2024-05-16T22:30:15.448 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sgtty.h' -> 'dir/include/sgtty.h' 2024-05-16T22:30:15.484 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/shadow.h' -> 'dir/include/shadow.h' 2024-05-16T22:30:15.517 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/signal.h' -> 'dir/include/signal.h' 2024-05-16T22:30:15.575 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/spawn.h' -> 'dir/include/spawn.h' 2024-05-16T22:30:15.609 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/stab.h' -> 'dir/include/stab.h' 2024-05-16T22:30:15.643 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/stdc-predef.h' -> 'dir/include/stdc-predef.h' 2024-05-16T22:30:15.675 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/stdint.h' -> 'dir/include/stdint.h' 2024-05-16T22:30:15.709 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/stdio.h' -> 'dir/include/stdio.h' 2024-05-16T22:30:15.742 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/stdio_ext.h' -> 'dir/include/stdio_ext.h' 2024-05-16T22:30:15.775 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/stdlib.h' -> 'dir/include/stdlib.h' 2024-05-16T22:30:15.809 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/string.h' -> 'dir/include/string.h' 2024-05-16T22:30:15.857 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/strings.h' -> 'dir/include/strings.h' 2024-05-16T22:30:15.892 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/syscall.h' -> 'dir/include/syscall.h' 2024-05-16T22:30:15.925 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sysexits.h' -> 'dir/include/sysexits.h' 2024-05-16T22:30:15.959 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/syslog.h' -> 'dir/include/syslog.h' 2024-05-16T22:30:15.992 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/tar.h' -> 'dir/include/tar.h' 2024-05-16T22:30:16.026 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/termio.h' -> 'dir/include/termio.h' 2024-05-16T22:30:16.070 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/termios.h' -> 'dir/include/termios.h' 2024-05-16T22:30:16.101 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/tgmath.h' -> 'dir/include/tgmath.h' 2024-05-16T22:30:16.151 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/thread_db.h' -> 'dir/include/thread_db.h' 2024-05-16T22:30:16.184 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/threads.h' -> 'dir/include/threads.h' 2024-05-16T22:30:16.218 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/time.h' -> 'dir/include/time.h' 2024-05-16T22:30:16.251 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ttyent.h' -> 'dir/include/ttyent.h' 2024-05-16T22:30:16.318 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/uchar.h' -> 'dir/include/uchar.h' 2024-05-16T22:30:16.351 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ucontext.h' -> 'dir/include/ucontext.h' 2024-05-16T22:30:16.384 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ulimit.h' -> 'dir/include/ulimit.h' 2024-05-16T22:30:16.418 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/unistd.h' -> 'dir/include/unistd.h' 2024-05-16T22:30:16.451 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/utime.h' -> 'dir/include/utime.h' 2024-05-16T22:30:16.507 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/utmp.h' -> 'dir/include/utmp.h' 2024-05-16T22:30:16.543 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/utmpx.h' -> 'dir/include/utmpx.h' 2024-05-16T22:30:16.576 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/values.h' -> 'dir/include/values.h' 2024-05-16T22:30:16.609 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/wait.h' -> 'dir/include/wait.h' 2024-05-16T22:30:16.643 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/wchar.h' -> 'dir/include/wchar.h' 2024-05-16T22:30:16.676 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/wctype.h' -> 'dir/include/wctype.h' 2024-05-16T22:30:16.714 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/wordexp.h' -> 'dir/include/wordexp.h' 2024-05-16T22:30:16.776 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/crypt.h' -> 'dir/include/crypt.h' 2024-05-16T22:30:16.810 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/pcp' -> 'dir/include/pcp' 2024-05-16T22:30:16.843 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/pcp/builddefs' -> 'dir/include/pcp/builddefs' 2024-05-16T22:30:16.876 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/pcp/buildrules' -> 'dir/include/pcp/buildrules' 2024-05-16T22:30:16.910 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/attr' -> 'dir/include/attr' 2024-05-16T22:30:16.943 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/attr/attributes.h' -> 'dir/include/attr/attributes.h' 2024-05-16T22:30:16.976 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/attr/error_context.h' -> 'dir/include/attr/error_context.h' 2024-05-16T22:30:17.035 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/attr/libattr.h' -> 'dir/include/attr/libattr.h' 2024-05-16T22:30:17.076 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/attr/xattr.h' -> 'dir/include/attr/xattr.h' 2024-05-16T22:30:17.110 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/gdb' -> 'dir/include/gdb' 2024-05-16T22:30:17.173 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/gdb/jit-reader.h' -> 'dir/include/gdb/jit-reader.h' 2024-05-16T22:30:17.201 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/acl' -> 'dir/include/acl' 2024-05-16T22:30:17.235 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/acl/libacl.h' -> 'dir/include/acl/libacl.h' 2024-05-16T22:30:17.268 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/curses.h' -> 'dir/include/curses.h' 2024-05-16T22:30:17.302 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/cursesapp.h' -> 'dir/include/cursesapp.h' 2024-05-16T22:30:17.336 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/cursesf.h' -> 'dir/include/cursesf.h' 2024-05-16T22:30:17.427 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/cursesm.h' -> 'dir/include/cursesm.h' 2024-05-16T22:30:17.460 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/cursesp.h' -> 'dir/include/cursesp.h' 2024-05-16T22:30:17.493 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/cursesw.h' -> 'dir/include/cursesw.h' 2024-05-16T22:30:17.527 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/cursslk.h' -> 'dir/include/cursslk.h' 2024-05-16T22:30:17.560 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/eti.h' -> 'dir/include/eti.h' 2024-05-16T22:30:17.593 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/etip.h' -> 'dir/include/etip.h' 2024-05-16T22:30:17.627 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/form.h' -> 'dir/include/form.h' 2024-05-16T22:30:17.660 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/menu.h' -> 'dir/include/menu.h' 2024-05-16T22:30:17.694 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/nc_tparm.h' -> 'dir/include/nc_tparm.h' 2024-05-16T22:30:17.727 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ncurses' -> 'dir/include/ncurses' 2024-05-16T22:30:17.760 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ncurses/curses.h' -> 'dir/include/ncurses/curses.h' 2024-05-16T22:30:17.817 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ncurses/cursesapp.h' -> 'dir/include/ncurses/cursesapp.h' 2024-05-16T22:30:17.852 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ncurses/cursesf.h' -> 'dir/include/ncurses/cursesf.h' 2024-05-16T22:30:17.886 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ncurses/cursesm.h' -> 'dir/include/ncurses/cursesm.h' 2024-05-16T22:30:17.919 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ncurses/cursesp.h' -> 'dir/include/ncurses/cursesp.h' 2024-05-16T22:30:17.952 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ncurses/cursesw.h' -> 'dir/include/ncurses/cursesw.h' 2024-05-16T22:30:18.011 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ncurses/cursslk.h' -> 'dir/include/ncurses/cursslk.h' 2024-05-16T22:30:18.052 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ncurses/eti.h' -> 'dir/include/ncurses/eti.h' 2024-05-16T22:30:18.086 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ncurses/etip.h' -> 'dir/include/ncurses/etip.h' 2024-05-16T22:30:18.119 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ncurses/form.h' -> 'dir/include/ncurses/form.h' 2024-05-16T22:30:18.152 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ncurses/menu.h' -> 'dir/include/ncurses/menu.h' 2024-05-16T22:30:18.186 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ncurses/nc_tparm.h' -> 'dir/include/ncurses/nc_tparm.h' 2024-05-16T22:30:18.219 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ncurses/ncurses.h' -> 'dir/include/ncurses/ncurses.h' 2024-05-16T22:30:18.252 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ncurses/ncurses_dll.h' -> 'dir/include/ncurses/ncurses_dll.h' 2024-05-16T22:30:18.286 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ncurses/panel.h' -> 'dir/include/ncurses/panel.h' 2024-05-16T22:30:18.319 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ncurses/term.h' -> 'dir/include/ncurses/term.h' 2024-05-16T22:30:18.352 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ncurses/term_entry.h' -> 'dir/include/ncurses/term_entry.h' 2024-05-16T22:30:18.386 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ncurses/termcap.h' -> 'dir/include/ncurses/termcap.h' 2024-05-16T22:30:18.439 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ncurses/tic.h' -> 'dir/include/ncurses/tic.h' 2024-05-16T22:30:18.469 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ncurses/unctrl.h' -> 'dir/include/ncurses/unctrl.h' 2024-05-16T22:30:18.503 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ncurses.h' -> 'dir/include/ncurses.h' 2024-05-16T22:30:18.536 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ncurses_dll.h' -> 'dir/include/ncurses_dll.h' 2024-05-16T22:30:18.603 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ncursesw' -> 'dir/include/ncursesw' 2024-05-16T22:30:18.636 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ncursesw/curses.h' -> 'dir/include/ncursesw/curses.h' 2024-05-16T22:30:18.671 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ncursesw/cursesapp.h' -> 'dir/include/ncursesw/cursesapp.h' 2024-05-16T22:30:18.703 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ncursesw/cursesf.h' -> 'dir/include/ncursesw/cursesf.h' 2024-05-16T22:30:18.736 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ncursesw/cursesm.h' -> 'dir/include/ncursesw/cursesm.h' 2024-05-16T22:30:18.770 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ncursesw/cursesp.h' -> 'dir/include/ncursesw/cursesp.h' 2024-05-16T22:30:18.803 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ncursesw/cursesw.h' -> 'dir/include/ncursesw/cursesw.h' 2024-05-16T22:30:18.837 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ncursesw/cursslk.h' -> 'dir/include/ncursesw/cursslk.h' 2024-05-16T22:30:18.870 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ncursesw/eti.h' -> 'dir/include/ncursesw/eti.h' 2024-05-16T22:30:18.903 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ncursesw/etip.h' -> 'dir/include/ncursesw/etip.h' 2024-05-16T22:30:18.937 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ncursesw/form.h' -> 'dir/include/ncursesw/form.h' 2024-05-16T22:30:18.970 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ncursesw/menu.h' -> 'dir/include/ncursesw/menu.h' 2024-05-16T22:30:19.003 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ncursesw/nc_tparm.h' -> 'dir/include/ncursesw/nc_tparm.h' 2024-05-16T22:30:19.048 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ncursesw/ncurses.h' -> 'dir/include/ncursesw/ncurses.h' 2024-05-16T22:30:19.079 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ncursesw/ncurses_dll.h' -> 'dir/include/ncursesw/ncurses_dll.h' 2024-05-16T22:30:19.112 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ncursesw/panel.h' -> 'dir/include/ncursesw/panel.h' 2024-05-16T22:30:19.170 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ncursesw/term.h' -> 'dir/include/ncursesw/term.h' 2024-05-16T22:30:19.204 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ncursesw/term_entry.h' -> 'dir/include/ncursesw/term_entry.h' 2024-05-16T22:30:19.237 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ncursesw/termcap.h' -> 'dir/include/ncursesw/termcap.h' 2024-05-16T22:30:19.283 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ncursesw/tic.h' -> 'dir/include/ncursesw/tic.h' 2024-05-16T22:30:19.312 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/ncursesw/unctrl.h' -> 'dir/include/ncursesw/unctrl.h' 2024-05-16T22:30:19.345 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/panel.h' -> 'dir/include/panel.h' 2024-05-16T22:30:19.379 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/term.h' -> 'dir/include/term.h' 2024-05-16T22:30:19.412 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/term_entry.h' -> 'dir/include/term_entry.h' 2024-05-16T22:30:19.446 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/termcap.h' -> 'dir/include/termcap.h' 2024-05-16T22:30:19.479 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/tic.h' -> 'dir/include/tic.h' 2024-05-16T22:30:19.512 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/unctrl.h' -> 'dir/include/unctrl.h' 2024-05-16T22:30:19.546 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/misc' -> 'dir/include/misc' 2024-05-16T22:30:19.579 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/misc/cxl.h' -> 'dir/include/misc/cxl.h' 2024-05-16T22:30:19.612 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/misc/fastrpc.h' -> 'dir/include/misc/fastrpc.h' 2024-05-16T22:30:19.664 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/misc/habanalabs.h' -> 'dir/include/misc/habanalabs.h' 2024-05-16T22:30:19.696 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/misc/ocxl.h' -> 'dir/include/misc/ocxl.h' 2024-05-16T22:30:19.746 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/misc/pvpanic.h' -> 'dir/include/misc/pvpanic.h' 2024-05-16T22:30:19.779 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/misc/uacce' -> 'dir/include/misc/uacce' 2024-05-16T22:30:19.812 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/misc/uacce/hisi_qm.h' -> 'dir/include/misc/uacce/hisi_qm.h' 2024-05-16T22:30:19.846 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/misc/uacce/uacce.h' -> 'dir/include/misc/uacce/uacce.h' 2024-05-16T22:30:19.882 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/misc/xilinx_sdfec.h' -> 'dir/include/misc/xilinx_sdfec.h' 2024-05-16T22:30:19.913 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/mtd' -> 'dir/include/mtd' 2024-05-16T22:30:19.946 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/mtd/inftl-user.h' -> 'dir/include/mtd/inftl-user.h' 2024-05-16T22:30:19.979 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/mtd/mtd-abi.h' -> 'dir/include/mtd/mtd-abi.h' 2024-05-16T22:30:20.013 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/mtd/mtd-user.h' -> 'dir/include/mtd/mtd-user.h' 2024-05-16T22:30:20.046 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/mtd/nftl-user.h' -> 'dir/include/mtd/nftl-user.h' 2024-05-16T22:30:20.096 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/mtd/ubi-user.h' -> 'dir/include/mtd/ubi-user.h' 2024-05-16T22:30:20.130 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/rdma' -> 'dir/include/rdma' 2024-05-16T22:30:20.163 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/rdma/bnxt_re-abi.h' -> 'dir/include/rdma/bnxt_re-abi.h' 2024-05-16T22:30:20.196 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/rdma/cxgb4-abi.h' -> 'dir/include/rdma/cxgb4-abi.h' 2024-05-16T22:30:20.229 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/rdma/efa-abi.h' -> 'dir/include/rdma/efa-abi.h' 2024-05-16T22:30:20.289 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/rdma/hfi' -> 'dir/include/rdma/hfi' 2024-05-16T22:30:20.338 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/rdma/hfi/hfi1_ioctl.h' -> 'dir/include/rdma/hfi/hfi1_ioctl.h' 2024-05-16T22:30:20.372 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/rdma/hfi/hfi1_user.h' -> 'dir/include/rdma/hfi/hfi1_user.h' 2024-05-16T22:30:20.405 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/rdma/hns-abi.h' -> 'dir/include/rdma/hns-abi.h' 2024-05-16T22:30:20.438 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/rdma/ib_user_ioctl_cmds.h' -> 'dir/include/rdma/ib_user_ioctl_cmds.h' 2024-05-16T22:30:20.505 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/rdma/ib_user_ioctl_verbs.h' -> 'dir/include/rdma/ib_user_ioctl_verbs.h' 2024-05-16T22:30:20.544 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/rdma/ib_user_mad.h' -> 'dir/include/rdma/ib_user_mad.h' 2024-05-16T22:30:20.580 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/rdma/ib_user_sa.h' -> 'dir/include/rdma/ib_user_sa.h' 2024-05-16T22:30:20.613 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/rdma/ib_user_verbs.h' -> 'dir/include/rdma/ib_user_verbs.h' 2024-05-16T22:30:20.647 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/rdma/irdma-abi.h' -> 'dir/include/rdma/irdma-abi.h' 2024-05-16T22:30:20.680 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/rdma/mana-abi.h' -> 'dir/include/rdma/mana-abi.h' 2024-05-16T22:30:20.713 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/rdma/mlx5-abi.h' -> 'dir/include/rdma/mlx5-abi.h' 2024-05-16T22:30:20.747 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/rdma/mlx5_user_ioctl_cmds.h' -> 'dir/include/rdma/mlx5_user_ioctl_cmds.h' 2024-05-16T22:30:20.780 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/rdma/mlx5_user_ioctl_verbs.h' -> 'dir/include/rdma/mlx5_user_ioctl_verbs.h' 2024-05-16T22:30:20.813 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/rdma/mthca-abi.h' -> 'dir/include/rdma/mthca-abi.h' 2024-05-16T22:30:20.847 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/rdma/ocrdma-abi.h' -> 'dir/include/rdma/ocrdma-abi.h' 2024-05-16T22:30:20.897 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/rdma/qedr-abi.h' -> 'dir/include/rdma/qedr-abi.h' 2024-05-16T22:30:20.955 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/rdma/rdma_netlink.h' -> 'dir/include/rdma/rdma_netlink.h' 2024-05-16T22:30:20.989 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/rdma/rdma_user_cm.h' -> 'dir/include/rdma/rdma_user_cm.h' 2024-05-16T22:30:21.022 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/rdma/rdma_user_ioctl.h' -> 'dir/include/rdma/rdma_user_ioctl.h' 2024-05-16T22:30:21.055 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/rdma/rdma_user_ioctl_cmds.h' -> 'dir/include/rdma/rdma_user_ioctl_cmds.h' 2024-05-16T22:30:21.089 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/rdma/rdma_user_rxe.h' -> 'dir/include/rdma/rdma_user_rxe.h' 2024-05-16T22:30:21.122 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/rdma/rvt-abi.h' -> 'dir/include/rdma/rvt-abi.h' 2024-05-16T22:30:21.155 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/rdma/siw-abi.h' -> 'dir/include/rdma/siw-abi.h' 2024-05-16T22:30:21.188 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/rdma/vmw_pvrdma-abi.h' -> 'dir/include/rdma/vmw_pvrdma-abi.h' 2024-05-16T22:30:21.222 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/rdma/mlx4-abi.h' -> 'dir/include/rdma/mlx4-abi.h' 2024-05-16T22:30:21.255 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/scsi' -> 'dir/include/scsi' 2024-05-16T22:30:21.289 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/scsi/cxlflash_ioctl.h' -> 'dir/include/scsi/cxlflash_ioctl.h' 2024-05-16T22:30:21.320 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/scsi/fc' -> 'dir/include/scsi/fc' 2024-05-16T22:30:21.353 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/scsi/fc/fc_els.h' -> 'dir/include/scsi/fc/fc_els.h' 2024-05-16T22:30:21.387 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/scsi/fc/fc_fs.h' -> 'dir/include/scsi/fc/fc_fs.h' 2024-05-16T22:30:21.420 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/scsi/fc/fc_gs.h' -> 'dir/include/scsi/fc/fc_gs.h' 2024-05-16T22:30:21.453 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/scsi/fc/fc_ns.h' -> 'dir/include/scsi/fc/fc_ns.h' 2024-05-16T22:30:21.513 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:30:21.588 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/scsi/scsi_bsg_fc.h' -> 'dir/include/scsi/scsi_bsg_fc.h' 2024-05-16T22:30:21.612 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/scsi/scsi_bsg_mpi3mr.h' -> 'dir/include/scsi/scsi_bsg_mpi3mr.h' 2024-05-16T22:30:21.645 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/scsi/scsi_bsg_ufs.h' -> 'dir/include/scsi/scsi_bsg_ufs.h' 2024-05-16T22:30:21.678 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/scsi/scsi_netlink.h' -> 'dir/include/scsi/scsi_netlink.h' 2024-05-16T22:30:21.712 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/scsi/scsi_netlink_fc.h' -> 'dir/include/scsi/scsi_netlink_fc.h' 2024-05-16T22:30:21.745 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/scsi/scsi.h' -> 'dir/include/scsi/scsi.h' 2024-05-16T22:30:21.778 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/scsi/scsi_ioctl.h' -> 'dir/include/scsi/scsi_ioctl.h' 2024-05-16T22:30:21.812 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/scsi/sg.h' -> 'dir/include/scsi/sg.h' 2024-05-16T22:30:21.845 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sound' -> 'dir/include/sound' 2024-05-16T22:30:21.879 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sound/asequencer.h' -> 'dir/include/sound/asequencer.h' 2024-05-16T22:30:21.912 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sound/asoc.h' -> 'dir/include/sound/asoc.h' 2024-05-16T22:30:21.945 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sound/asound.h' -> 'dir/include/sound/asound.h' 2024-05-16T22:30:21.979 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sound/asound_fm.h' -> 'dir/include/sound/asound_fm.h' 2024-05-16T22:30:22.012 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sound/compress_offload.h' -> 'dir/include/sound/compress_offload.h' 2024-05-16T22:30:22.045 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sound/compress_params.h' -> 'dir/include/sound/compress_params.h' 2024-05-16T22:30:22.104 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sound/emu10k1.h' -> 'dir/include/sound/emu10k1.h' 2024-05-16T22:30:22.137 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sound/firewire.h' -> 'dir/include/sound/firewire.h' 2024-05-16T22:30:22.189 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sound/hdsp.h' -> 'dir/include/sound/hdsp.h' 2024-05-16T22:30:22.221 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sound/hdspm.h' -> 'dir/include/sound/hdspm.h' 2024-05-16T22:30:22.254 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sound/intel' -> 'dir/include/sound/intel' 2024-05-16T22:30:22.288 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sound/intel/avs' -> 'dir/include/sound/intel/avs' 2024-05-16T22:30:22.321 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sound/intel/avs/tokens.h' -> 'dir/include/sound/intel/avs/tokens.h' 2024-05-16T22:30:22.354 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sound/sb16_csp.h' -> 'dir/include/sound/sb16_csp.h' 2024-05-16T22:30:22.388 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sound/sfnt_info.h' -> 'dir/include/sound/sfnt_info.h' 2024-05-16T22:30:22.429 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sound/skl-tplg-interface.h' -> 'dir/include/sound/skl-tplg-interface.h' 2024-05-16T22:30:22.479 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sound/snd_ar_tokens.h' -> 'dir/include/sound/snd_ar_tokens.h' 2024-05-16T22:30:22.530 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sound/snd_sst_tokens.h' -> 'dir/include/sound/snd_sst_tokens.h' 2024-05-16T22:30:22.571 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sound/sof' -> 'dir/include/sound/sof' 2024-05-16T22:30:22.621 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sound/sof/abi.h' -> 'dir/include/sound/sof/abi.h' 2024-05-16T22:30:22.662 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sound/sof/fw.h' -> 'dir/include/sound/sof/fw.h' 2024-05-16T22:30:22.704 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sound/sof/header.h' -> 'dir/include/sound/sof/header.h' 2024-05-16T22:30:22.763 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sound/sof/tokens.h' -> 'dir/include/sound/sof/tokens.h' 2024-05-16T22:30:22.796 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sound/tlv.h' -> 'dir/include/sound/tlv.h' 2024-05-16T22:30:22.838 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sound/usb_stream.h' -> 'dir/include/sound/usb_stream.h' 2024-05-16T22:30:22.907 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/video' -> 'dir/include/video' 2024-05-16T22:30:22.938 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/video/edid.h' -> 'dir/include/video/edid.h' 2024-05-16T22:30:22.980 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/video/sisfb.h' -> 'dir/include/video/sisfb.h' 2024-05-16T22:30:23.029 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/video/uvesafb.h' -> 'dir/include/video/uvesafb.h' 2024-05-16T22:30:23.071 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/xen' -> 'dir/include/xen' 2024-05-16T22:30:23.105 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/xen/evtchn.h' -> 'dir/include/xen/evtchn.h' 2024-05-16T22:30:23.146 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/xen/gntalloc.h' -> 'dir/include/xen/gntalloc.h' 2024-05-16T22:30:23.180 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/xen/gntdev.h' -> 'dir/include/xen/gntdev.h' 2024-05-16T22:30:23.213 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/xen/privcmd.h' -> 'dir/include/xen/privcmd.h' 2024-05-16T22:30:23.246 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/zconf.h' -> 'dir/include/zconf.h' 2024-05-16T22:30:23.280 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/zlib.h' -> 'dir/include/zlib.h' 2024-05-16T22:30:23.321 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9' -> 'dir/include/python3.9' 2024-05-16T22:30:23.355 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/Python-ast.h' -> 'dir/include/python3.9/Python-ast.h' 2024-05-16T22:30:23.430 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/Python.h' -> 'dir/include/python3.9/Python.h' 2024-05-16T22:30:23.472 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/abstract.h' -> 'dir/include/python3.9/abstract.h' 2024-05-16T22:30:23.505 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/asdl.h' -> 'dir/include/python3.9/asdl.h' 2024-05-16T22:30:23.555 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/ast.h' -> 'dir/include/python3.9/ast.h' 2024-05-16T22:30:23.622 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/bitset.h' -> 'dir/include/python3.9/bitset.h' 2024-05-16T22:30:23.663 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/bltinmodule.h' -> 'dir/include/python3.9/bltinmodule.h' 2024-05-16T22:30:23.697 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/boolobject.h' -> 'dir/include/python3.9/boolobject.h' 2024-05-16T22:30:23.730 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/bytearrayobject.h' -> 'dir/include/python3.9/bytearrayobject.h' 2024-05-16T22:30:23.763 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/bytesobject.h' -> 'dir/include/python3.9/bytesobject.h' 2024-05-16T22:30:23.797 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/cellobject.h' -> 'dir/include/python3.9/cellobject.h' 2024-05-16T22:30:23.839 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/ceval.h' -> 'dir/include/python3.9/ceval.h' 2024-05-16T22:30:23.872 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/classobject.h' -> 'dir/include/python3.9/classobject.h' 2024-05-16T22:30:23.905 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/code.h' -> 'dir/include/python3.9/code.h' 2024-05-16T22:30:23.955 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/codecs.h' -> 'dir/include/python3.9/codecs.h' 2024-05-16T22:30:24.003 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/compile.h' -> 'dir/include/python3.9/compile.h' 2024-05-16T22:30:24.030 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/complexobject.h' -> 'dir/include/python3.9/complexobject.h' 2024-05-16T22:30:24.089 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/context.h' -> 'dir/include/python3.9/context.h' 2024-05-16T22:30:24.122 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/datetime.h' -> 'dir/include/python3.9/datetime.h' 2024-05-16T22:30:24.156 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/descrobject.h' -> 'dir/include/python3.9/descrobject.h' 2024-05-16T22:30:24.189 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/dictobject.h' -> 'dir/include/python3.9/dictobject.h' 2024-05-16T22:30:24.222 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/dynamic_annotations.h' -> 'dir/include/python3.9/dynamic_annotations.h' 2024-05-16T22:30:24.297 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/enumobject.h' -> 'dir/include/python3.9/enumobject.h' 2024-05-16T22:30:24.331 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/errcode.h' -> 'dir/include/python3.9/errcode.h' 2024-05-16T22:30:24.372 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/eval.h' -> 'dir/include/python3.9/eval.h' 2024-05-16T22:30:24.406 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/exports.h' -> 'dir/include/python3.9/exports.h' 2024-05-16T22:30:24.439 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/fileobject.h' -> 'dir/include/python3.9/fileobject.h' 2024-05-16T22:30:24.481 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/fileutils.h' -> 'dir/include/python3.9/fileutils.h' 2024-05-16T22:30:24.547 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/floatobject.h' -> 'dir/include/python3.9/floatobject.h' 2024-05-16T22:30:24.589 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/frameobject.h' -> 'dir/include/python3.9/frameobject.h' 2024-05-16T22:30:24.631 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/funcobject.h' -> 'dir/include/python3.9/funcobject.h' 2024-05-16T22:30:24.664 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/genericaliasobject.h' -> 'dir/include/python3.9/genericaliasobject.h' 2024-05-16T22:30:24.697 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/genobject.h' -> 'dir/include/python3.9/genobject.h' 2024-05-16T22:30:24.773 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/graminit.h' -> 'dir/include/python3.9/graminit.h' 2024-05-16T22:30:24.806 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/grammar.h' -> 'dir/include/python3.9/grammar.h' 2024-05-16T22:30:24.842 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/import.h' -> 'dir/include/python3.9/import.h' 2024-05-16T22:30:24.873 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/interpreteridobject.h' -> 'dir/include/python3.9/interpreteridobject.h' 2024-05-16T22:30:24.914 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/intrcheck.h' -> 'dir/include/python3.9/intrcheck.h' 2024-05-16T22:30:24.948 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/iterobject.h' -> 'dir/include/python3.9/iterobject.h' 2024-05-16T22:30:25.012 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/listobject.h' -> 'dir/include/python3.9/listobject.h' 2024-05-16T22:30:25.039 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/longintrepr.h' -> 'dir/include/python3.9/longintrepr.h' 2024-05-16T22:30:25.073 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/longobject.h' -> 'dir/include/python3.9/longobject.h' 2024-05-16T22:30:25.106 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/marshal.h' -> 'dir/include/python3.9/marshal.h' 2024-05-16T22:30:25.156 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/memoryobject.h' -> 'dir/include/python3.9/memoryobject.h' 2024-05-16T22:30:25.190 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/methodobject.h' -> 'dir/include/python3.9/methodobject.h' 2024-05-16T22:30:25.230 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/modsupport.h' -> 'dir/include/python3.9/modsupport.h' 2024-05-16T22:30:25.265 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/moduleobject.h' -> 'dir/include/python3.9/moduleobject.h' 2024-05-16T22:30:25.298 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/namespaceobject.h' -> 'dir/include/python3.9/namespaceobject.h' 2024-05-16T22:30:25.332 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/node.h' -> 'dir/include/python3.9/node.h' 2024-05-16T22:30:25.398 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/object.h' -> 'dir/include/python3.9/object.h' 2024-05-16T22:30:25.432 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/objimpl.h' -> 'dir/include/python3.9/objimpl.h' 2024-05-16T22:30:25.481 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/odictobject.h' -> 'dir/include/python3.9/odictobject.h' 2024-05-16T22:30:25.523 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/pyconfig-64.h' -> 'dir/include/python3.9/pyconfig-64.h' 2024-05-16T22:30:25.565 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/opcode.h' -> 'dir/include/python3.9/opcode.h' 2024-05-16T22:30:25.598 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/osdefs.h' -> 'dir/include/python3.9/osdefs.h' 2024-05-16T22:30:25.632 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/osmodule.h' -> 'dir/include/python3.9/osmodule.h' 2024-05-16T22:30:25.712 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/parsetok.h' -> 'dir/include/python3.9/parsetok.h' 2024-05-16T22:30:25.740 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/patchlevel.h' -> 'dir/include/python3.9/patchlevel.h' 2024-05-16T22:30:25.773 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/picklebufobject.h' -> 'dir/include/python3.9/picklebufobject.h' 2024-05-16T22:30:25.807 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/py_curses.h' -> 'dir/include/python3.9/py_curses.h' 2024-05-16T22:30:25.840 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/pyarena.h' -> 'dir/include/python3.9/pyarena.h' 2024-05-16T22:30:25.874 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/pycapsule.h' -> 'dir/include/python3.9/pycapsule.h' 2024-05-16T22:30:25.907 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/pyconfig.h' -> 'dir/include/python3.9/pyconfig.h' 2024-05-16T22:30:25.949 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/pyctype.h' -> 'dir/include/python3.9/pyctype.h' 2024-05-16T22:30:25.982 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/pydebug.h' -> 'dir/include/python3.9/pydebug.h' 2024-05-16T22:30:26.041 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/pydtrace.h' -> 'dir/include/python3.9/pydtrace.h' 2024-05-16T22:30:26.074 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/pyerrors.h' -> 'dir/include/python3.9/pyerrors.h' 2024-05-16T22:30:26.108 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/pyexpat.h' -> 'dir/include/python3.9/pyexpat.h' 2024-05-16T22:30:26.149 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/pyfpe.h' -> 'dir/include/python3.9/pyfpe.h' 2024-05-16T22:30:26.183 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/pyframe.h' -> 'dir/include/python3.9/pyframe.h' 2024-05-16T22:30:26.216 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/pyhash.h' -> 'dir/include/python3.9/pyhash.h' 2024-05-16T22:30:26.249 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/pylifecycle.h' -> 'dir/include/python3.9/pylifecycle.h' 2024-05-16T22:30:26.283 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/pymacconfig.h' -> 'dir/include/python3.9/pymacconfig.h' 2024-05-16T22:30:26.346 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/pymacro.h' -> 'dir/include/python3.9/pymacro.h' 2024-05-16T22:30:26.374 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/pymath.h' -> 'dir/include/python3.9/pymath.h' 2024-05-16T22:30:26.408 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/pymem.h' -> 'dir/include/python3.9/pymem.h' 2024-05-16T22:30:26.441 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/pyport.h' -> 'dir/include/python3.9/pyport.h' 2024-05-16T22:30:26.475 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/pystate.h' -> 'dir/include/python3.9/pystate.h' 2024-05-16T22:30:26.523 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/pystrcmp.h' -> 'dir/include/python3.9/pystrcmp.h' 2024-05-16T22:30:26.575 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/pystrhex.h' -> 'dir/include/python3.9/pystrhex.h' 2024-05-16T22:30:26.608 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/pystrtod.h' -> 'dir/include/python3.9/pystrtod.h' 2024-05-16T22:30:26.666 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/pythonrun.h' -> 'dir/include/python3.9/pythonrun.h' 2024-05-16T22:30:26.700 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/pythread.h' -> 'dir/include/python3.9/pythread.h' 2024-05-16T22:30:26.765 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/pytime.h' -> 'dir/include/python3.9/pytime.h' 2024-05-16T22:30:26.800 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/rangeobject.h' -> 'dir/include/python3.9/rangeobject.h' 2024-05-16T22:30:26.833 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/setobject.h' -> 'dir/include/python3.9/setobject.h' 2024-05-16T22:30:26.867 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/sliceobject.h' -> 'dir/include/python3.9/sliceobject.h' 2024-05-16T22:30:26.900 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/structmember.h' -> 'dir/include/python3.9/structmember.h' 2024-05-16T22:30:26.933 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/structseq.h' -> 'dir/include/python3.9/structseq.h' 2024-05-16T22:30:26.967 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/symtable.h' -> 'dir/include/python3.9/symtable.h' 2024-05-16T22:30:27.029 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/sysmodule.h' -> 'dir/include/python3.9/sysmodule.h' 2024-05-16T22:30:27.058 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/token.h' -> 'dir/include/python3.9/token.h' 2024-05-16T22:30:27.092 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/traceback.h' -> 'dir/include/python3.9/traceback.h' 2024-05-16T22:30:27.125 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/tracemalloc.h' -> 'dir/include/python3.9/tracemalloc.h' 2024-05-16T22:30:27.158 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/tupleobject.h' -> 'dir/include/python3.9/tupleobject.h' 2024-05-16T22:30:27.199 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/typeslots.h' -> 'dir/include/python3.9/typeslots.h' 2024-05-16T22:30:27.253 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/ucnhash.h' -> 'dir/include/python3.9/ucnhash.h' 2024-05-16T22:30:27.308 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/unicodeobject.h' -> 'dir/include/python3.9/unicodeobject.h' 2024-05-16T22:30:27.342 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/warnings.h' -> 'dir/include/python3.9/warnings.h' 2024-05-16T22:30:27.375 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/weakrefobject.h' -> 'dir/include/python3.9/weakrefobject.h' 2024-05-16T22:30:27.409 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/cpython' -> 'dir/include/python3.9/cpython' 2024-05-16T22:30:27.442 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/cpython/abstract.h' -> 'dir/include/python3.9/cpython/abstract.h' 2024-05-16T22:30:27.475 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/cpython/bytearrayobject.h' -> 'dir/include/python3.9/cpython/bytearrayobject.h' 2024-05-16T22:30:27.509 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/cpython/bytesobject.h' -> 'dir/include/python3.9/cpython/bytesobject.h' 2024-05-16T22:30:27.542 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/cpython/ceval.h' -> 'dir/include/python3.9/cpython/ceval.h' 2024-05-16T22:30:27.576 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/cpython/code.h' -> 'dir/include/python3.9/cpython/code.h' 2024-05-16T22:30:27.609 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/cpython/dictobject.h' -> 'dir/include/python3.9/cpython/dictobject.h' 2024-05-16T22:30:27.675 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/cpython/fileobject.h' -> 'dir/include/python3.9/cpython/fileobject.h' 2024-05-16T22:30:27.709 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/cpython/fileutils.h' -> 'dir/include/python3.9/cpython/fileutils.h' 2024-05-16T22:30:27.742 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/cpython/frameobject.h' -> 'dir/include/python3.9/cpython/frameobject.h' 2024-05-16T22:30:27.776 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/cpython/import.h' -> 'dir/include/python3.9/cpython/import.h' 2024-05-16T22:30:27.809 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/cpython/initconfig.h' -> 'dir/include/python3.9/cpython/initconfig.h' 2024-05-16T22:30:27.842 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/cpython/interpreteridobject.h' -> 'dir/include/python3.9/cpython/interpreteridobject.h' 2024-05-16T22:30:27.909 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/cpython/listobject.h' -> 'dir/include/python3.9/cpython/listobject.h' 2024-05-16T22:30:27.942 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/cpython/methodobject.h' -> 'dir/include/python3.9/cpython/methodobject.h' 2024-05-16T22:30:27.976 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/cpython/object.h' -> 'dir/include/python3.9/cpython/object.h' 2024-05-16T22:30:28.009 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/cpython/objimpl.h' -> 'dir/include/python3.9/cpython/objimpl.h' 2024-05-16T22:30:28.043 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/cpython/pyerrors.h' -> 'dir/include/python3.9/cpython/pyerrors.h' 2024-05-16T22:30:28.076 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/cpython/pylifecycle.h' -> 'dir/include/python3.9/cpython/pylifecycle.h' 2024-05-16T22:30:28.109 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/cpython/pymem.h' -> 'dir/include/python3.9/cpython/pymem.h' 2024-05-16T22:30:28.143 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/cpython/pystate.h' -> 'dir/include/python3.9/cpython/pystate.h' 2024-05-16T22:30:28.176 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/cpython/sysmodule.h' -> 'dir/include/python3.9/cpython/sysmodule.h' 2024-05-16T22:30:28.209 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/cpython/traceback.h' -> 'dir/include/python3.9/cpython/traceback.h' 2024-05-16T22:30:28.243 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/cpython/tupleobject.h' -> 'dir/include/python3.9/cpython/tupleobject.h' 2024-05-16T22:30:28.316 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/cpython/unicodeobject.h' -> 'dir/include/python3.9/cpython/unicodeobject.h' 2024-05-16T22:30:28.351 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/internal' -> 'dir/include/python3.9/internal' 2024-05-16T22:30:28.384 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/internal/pegen_interface.h' -> 'dir/include/python3.9/internal/pegen_interface.h' 2024-05-16T22:30:28.418 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/internal/pycore_abstract.h' -> 'dir/include/python3.9/internal/pycore_abstract.h' 2024-05-16T22:30:28.451 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/internal/pycore_accu.h' -> 'dir/include/python3.9/internal/pycore_accu.h' 2024-05-16T22:30:28.543 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/internal/pycore_atomic.h' -> 'dir/include/python3.9/internal/pycore_atomic.h' 2024-05-16T22:30:28.586 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/internal/pycore_bytes_methods.h' -> 'dir/include/python3.9/internal/pycore_bytes_methods.h' 2024-05-16T22:30:28.618 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/internal/pycore_byteswap.h' -> 'dir/include/python3.9/internal/pycore_byteswap.h' 2024-05-16T22:30:28.651 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/internal/pycore_call.h' -> 'dir/include/python3.9/internal/pycore_call.h' 2024-05-16T22:30:28.685 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/internal/pycore_ceval.h' -> 'dir/include/python3.9/internal/pycore_ceval.h' 2024-05-16T22:30:28.718 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/internal/pycore_code.h' -> 'dir/include/python3.9/internal/pycore_code.h' 2024-05-16T22:30:28.752 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/internal/pycore_condvar.h' -> 'dir/include/python3.9/internal/pycore_condvar.h' 2024-05-16T22:30:28.785 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/internal/pycore_context.h' -> 'dir/include/python3.9/internal/pycore_context.h' 2024-05-16T22:30:28.818 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/internal/pycore_dtoa.h' -> 'dir/include/python3.9/internal/pycore_dtoa.h' 2024-05-16T22:30:28.852 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/internal/pycore_fileutils.h' -> 'dir/include/python3.9/internal/pycore_fileutils.h' 2024-05-16T22:30:28.885 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/internal/pycore_gc.h' -> 'dir/include/python3.9/internal/pycore_gc.h' 2024-05-16T22:30:28.918 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/internal/pycore_getopt.h' -> 'dir/include/python3.9/internal/pycore_getopt.h' 2024-05-16T22:30:28.979 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/internal/pycore_gil.h' -> 'dir/include/python3.9/internal/pycore_gil.h' 2024-05-16T22:30:29.010 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/internal/pycore_hamt.h' -> 'dir/include/python3.9/internal/pycore_hamt.h' 2024-05-16T22:30:29.043 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/internal/pycore_hashtable.h' -> 'dir/include/python3.9/internal/pycore_hashtable.h' 2024-05-16T22:30:29.077 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/internal/pycore_import.h' -> 'dir/include/python3.9/internal/pycore_import.h' 2024-05-16T22:30:29.144 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/internal/pycore_initconfig.h' -> 'dir/include/python3.9/internal/pycore_initconfig.h' 2024-05-16T22:30:29.177 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/internal/pycore_interp.h' -> 'dir/include/python3.9/internal/pycore_interp.h' 2024-05-16T22:30:29.210 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/internal/pycore_long.h' -> 'dir/include/python3.9/internal/pycore_long.h' 2024-05-16T22:30:29.244 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/internal/pycore_object.h' -> 'dir/include/python3.9/internal/pycore_object.h' 2024-05-16T22:30:29.277 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/internal/pycore_pathconfig.h' -> 'dir/include/python3.9/internal/pycore_pathconfig.h' 2024-05-16T22:30:29.310 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/internal/pycore_pyerrors.h' -> 'dir/include/python3.9/internal/pycore_pyerrors.h' 2024-05-16T22:30:29.344 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/internal/pycore_pyhash.h' -> 'dir/include/python3.9/internal/pycore_pyhash.h' 2024-05-16T22:30:29.377 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/internal/pycore_pylifecycle.h' -> 'dir/include/python3.9/internal/pycore_pylifecycle.h' 2024-05-16T22:30:29.410 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/internal/pycore_pymem.h' -> 'dir/include/python3.9/internal/pycore_pymem.h' 2024-05-16T22:30:29.444 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/internal/pycore_pystate.h' -> 'dir/include/python3.9/internal/pycore_pystate.h' 2024-05-16T22:30:29.477 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/internal/pycore_runtime.h' -> 'dir/include/python3.9/internal/pycore_runtime.h' 2024-05-16T22:30:29.511 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/internal/pycore_sysmodule.h' -> 'dir/include/python3.9/internal/pycore_sysmodule.h' 2024-05-16T22:30:29.544 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/internal/pycore_traceback.h' -> 'dir/include/python3.9/internal/pycore_traceback.h' 2024-05-16T22:30:29.661 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/internal/pycore_tupleobject.h' -> 'dir/include/python3.9/internal/pycore_tupleobject.h' 2024-05-16T22:30:29.694 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/python3.9/internal/pycore_warnings.h' -> 'dir/include/python3.9/internal/pycore_warnings.h' 2024-05-16T22:30:29.727 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/lauxlib.h' -> 'dir/include/lauxlib.h' 2024-05-16T22:30:29.786 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/lua.h' -> 'dir/include/lua.h' 2024-05-16T22:30:29.819 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/lua.hpp' -> 'dir/include/lua.hpp' 2024-05-16T22:30:29.852 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/luaconf-x86_64.h' -> 'dir/include/luaconf-x86_64.h' 2024-05-16T22:30:29.886 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/luaconf.h' -> 'dir/include/luaconf.h' 2024-05-16T22:30:29.919 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys' -> 'dir/include/sys' 2024-05-16T22:30:29.953 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/acl.h' -> 'dir/include/sys/acl.h' 2024-05-16T22:30:29.986 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/sdt.h' -> 'dir/include/sys/sdt.h' 2024-05-16T22:30:30.036 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/sdt-config.h' -> 'dir/include/sys/sdt-config.h' 2024-05-16T22:30:30.069 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/auxv.h' -> 'dir/include/sys/auxv.h' 2024-05-16T22:30:30.103 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/bitypes.h' -> 'dir/include/sys/bitypes.h' 2024-05-16T22:30:30.136 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/cdefs.h' -> 'dir/include/sys/cdefs.h' 2024-05-16T22:30:30.169 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/debugreg.h' -> 'dir/include/sys/debugreg.h' 2024-05-16T22:30:30.224 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/dir.h' -> 'dir/include/sys/dir.h' 2024-05-16T22:30:30.253 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/elf.h' -> 'dir/include/sys/elf.h' 2024-05-16T22:30:30.310 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/epoll.h' -> 'dir/include/sys/epoll.h' 2024-05-16T22:30:30.386 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/errno.h' -> 'dir/include/sys/errno.h' 2024-05-16T22:30:30.445 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/eventfd.h' -> 'dir/include/sys/eventfd.h' 2024-05-16T22:30:30.478 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/fanotify.h' -> 'dir/include/sys/fanotify.h' 2024-05-16T22:30:30.511 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/fcntl.h' -> 'dir/include/sys/fcntl.h' 2024-05-16T22:30:30.545 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/file.h' -> 'dir/include/sys/file.h' 2024-05-16T22:30:30.578 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/fsuid.h' -> 'dir/include/sys/fsuid.h' 2024-05-16T22:30:30.612 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/gmon.h' -> 'dir/include/sys/gmon.h' 2024-05-16T22:30:30.645 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/gmon_out.h' -> 'dir/include/sys/gmon_out.h' 2024-05-16T22:30:30.678 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/inotify.h' -> 'dir/include/sys/inotify.h' 2024-05-16T22:30:30.712 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/io.h' -> 'dir/include/sys/io.h' 2024-05-16T22:30:30.745 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/ioctl.h' -> 'dir/include/sys/ioctl.h' 2024-05-16T22:30:30.778 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/ipc.h' -> 'dir/include/sys/ipc.h' 2024-05-16T22:30:30.812 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/kd.h' -> 'dir/include/sys/kd.h' 2024-05-16T22:30:30.845 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/klog.h' -> 'dir/include/sys/klog.h' 2024-05-16T22:30:30.878 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/mman.h' -> 'dir/include/sys/mman.h' 2024-05-16T22:30:30.912 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/mount.h' -> 'dir/include/sys/mount.h' 2024-05-16T22:30:30.977 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/msg.h' -> 'dir/include/sys/msg.h' 2024-05-16T22:30:31.037 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/mtio.h' -> 'dir/include/sys/mtio.h' 2024-05-16T22:30:31.070 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/param.h' -> 'dir/include/sys/param.h' 2024-05-16T22:30:31.103 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/pci.h' -> 'dir/include/sys/pci.h' 2024-05-16T22:30:31.137 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/perm.h' -> 'dir/include/sys/perm.h' 2024-05-16T22:30:31.183 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/personality.h' -> 'dir/include/sys/personality.h' 2024-05-16T22:30:31.212 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/poll.h' -> 'dir/include/sys/poll.h' 2024-05-16T22:30:31.245 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/prctl.h' -> 'dir/include/sys/prctl.h' 2024-05-16T22:30:31.279 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/procfs.h' -> 'dir/include/sys/procfs.h' 2024-05-16T22:30:31.312 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/profil.h' -> 'dir/include/sys/profil.h' 2024-05-16T22:30:31.345 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/ptrace.h' -> 'dir/include/sys/ptrace.h' 2024-05-16T22:30:31.379 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/queue.h' -> 'dir/include/sys/queue.h' 2024-05-16T22:30:31.412 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/quota.h' -> 'dir/include/sys/quota.h' 2024-05-16T22:30:31.446 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/random.h' -> 'dir/include/sys/random.h' 2024-05-16T22:30:31.479 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/raw.h' -> 'dir/include/sys/raw.h' 2024-05-16T22:30:31.512 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/reboot.h' -> 'dir/include/sys/reboot.h' 2024-05-16T22:30:31.546 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/reg.h' -> 'dir/include/sys/reg.h' 2024-05-16T22:30:31.612 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/resource.h' -> 'dir/include/sys/resource.h' 2024-05-16T22:30:31.646 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/rseq.h' -> 'dir/include/sys/rseq.h' 2024-05-16T22:30:31.679 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/select.h' -> 'dir/include/sys/select.h' 2024-05-16T22:30:31.712 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/sem.h' -> 'dir/include/sys/sem.h' 2024-05-16T22:30:31.746 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/sendfile.h' -> 'dir/include/sys/sendfile.h' 2024-05-16T22:30:31.779 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/shm.h' -> 'dir/include/sys/shm.h' 2024-05-16T22:30:31.816 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/signal.h' -> 'dir/include/sys/signal.h' 2024-05-16T22:30:31.896 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/signalfd.h' -> 'dir/include/sys/signalfd.h' 2024-05-16T22:30:31.929 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/single_threaded.h' -> 'dir/include/sys/single_threaded.h' 2024-05-16T22:30:31.963 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/socket.h' -> 'dir/include/sys/socket.h' 2024-05-16T22:30:31.996 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/socketvar.h' -> 'dir/include/sys/socketvar.h' 2024-05-16T22:30:32.029 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/soundcard.h' -> 'dir/include/sys/soundcard.h' 2024-05-16T22:30:32.063 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/stat.h' -> 'dir/include/sys/stat.h' 2024-05-16T22:30:32.096 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/statfs.h' -> 'dir/include/sys/statfs.h' 2024-05-16T22:30:32.129 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/statvfs.h' -> 'dir/include/sys/statvfs.h' 2024-05-16T22:30:32.163 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/swap.h' -> 'dir/include/sys/swap.h' 2024-05-16T22:30:32.221 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/syscall.h' -> 'dir/include/sys/syscall.h' 2024-05-16T22:30:32.255 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/sysinfo.h' -> 'dir/include/sys/sysinfo.h' 2024-05-16T22:30:32.294 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/syslog.h' -> 'dir/include/sys/syslog.h' 2024-05-16T22:30:32.321 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/sysmacros.h' -> 'dir/include/sys/sysmacros.h' 2024-05-16T22:30:32.355 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/termios.h' -> 'dir/include/sys/termios.h' 2024-05-16T22:30:32.388 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/time.h' -> 'dir/include/sys/time.h' 2024-05-16T22:30:32.437 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/timeb.h' -> 'dir/include/sys/timeb.h' 2024-05-16T22:30:32.496 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/timerfd.h' -> 'dir/include/sys/timerfd.h' 2024-05-16T22:30:32.530 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/times.h' -> 'dir/include/sys/times.h' 2024-05-16T22:30:32.563 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/timex.h' -> 'dir/include/sys/timex.h' 2024-05-16T22:30:32.596 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/ttychars.h' -> 'dir/include/sys/ttychars.h' 2024-05-16T22:30:32.630 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/ttydefaults.h' -> 'dir/include/sys/ttydefaults.h' 2024-05-16T22:30:32.663 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/types.h' -> 'dir/include/sys/types.h' 2024-05-16T22:30:32.697 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/ucontext.h' -> 'dir/include/sys/ucontext.h' 2024-05-16T22:30:32.730 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/uio.h' -> 'dir/include/sys/uio.h' 2024-05-16T22:30:32.763 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/un.h' -> 'dir/include/sys/un.h' 2024-05-16T22:30:32.838 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/unistd.h' -> 'dir/include/sys/unistd.h' 2024-05-16T22:30:32.872 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/user.h' -> 'dir/include/sys/user.h' 2024-05-16T22:30:32.927 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/utsname.h' -> 'dir/include/sys/utsname.h' 2024-05-16T22:30:32.955 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/vfs.h' -> 'dir/include/sys/vfs.h' 2024-05-16T22:30:32.988 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/vlimit.h' -> 'dir/include/sys/vlimit.h' 2024-05-16T22:30:33.022 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/vm86.h' -> 'dir/include/sys/vm86.h' 2024-05-16T22:30:33.088 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/vt.h' -> 'dir/include/sys/vt.h' 2024-05-16T22:30:33.128 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/wait.h' -> 'dir/include/sys/wait.h' 2024-05-16T22:30:33.187 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/xattr.h' -> 'dir/include/sys/xattr.h' 2024-05-16T22:30:33.222 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/acct.h' -> 'dir/include/sys/acct.h' 2024-05-16T22:30:33.255 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/platform' -> 'dir/include/sys/platform' 2024-05-16T22:30:33.289 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/sys/platform/x86.h' -> 'dir/include/sys/platform/x86.h' 2024-05-16T22:30:33.327 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++' -> 'dir/include/c++' 2024-05-16T22:30:33.356 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11' -> 'dir/include/c++/11' 2024-05-16T22:30:33.389 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/algorithm' -> 'dir/include/c++/11/algorithm' 2024-05-16T22:30:33.422 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/any' -> 'dir/include/c++/11/any' 2024-05-16T22:30:33.497 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/array' -> 'dir/include/c++/11/array' 2024-05-16T22:30:33.531 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/atomic' -> 'dir/include/c++/11/atomic' 2024-05-16T22:30:33.564 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/backward' -> 'dir/include/c++/11/backward' 2024-05-16T22:30:33.627 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/backward/auto_ptr.h' -> 'dir/include/c++/11/backward/auto_ptr.h' 2024-05-16T22:30:33.656 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/backward/backward_warning.h' -> 'dir/include/c++/11/backward/backward_warning.h' 2024-05-16T22:30:33.689 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/backward/binders.h' -> 'dir/include/c++/11/backward/binders.h' 2024-05-16T22:30:33.722 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/backward/hash_fun.h' -> 'dir/include/c++/11/backward/hash_fun.h' 2024-05-16T22:30:33.756 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/backward/hash_map' -> 'dir/include/c++/11/backward/hash_map' 2024-05-16T22:30:33.794 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/backward/hash_set' -> 'dir/include/c++/11/backward/hash_set' 2024-05-16T22:30:33.823 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/backward/hashtable.h' -> 'dir/include/c++/11/backward/hashtable.h' 2024-05-16T22:30:33.856 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/backward/strstream' -> 'dir/include/c++/11/backward/strstream' 2024-05-16T22:30:33.889 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/barrier' -> 'dir/include/c++/11/barrier' 2024-05-16T22:30:33.922 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bit' -> 'dir/include/c++/11/bit' 2024-05-16T22:30:33.956 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits' -> 'dir/include/c++/11/bits' 2024-05-16T22:30:33.989 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/algorithmfwd.h' -> 'dir/include/c++/11/bits/algorithmfwd.h' 2024-05-16T22:30:34.023 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/align.h' -> 'dir/include/c++/11/bits/align.h' 2024-05-16T22:30:34.081 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/alloc_traits.h' -> 'dir/include/c++/11/bits/alloc_traits.h' 2024-05-16T22:30:34.115 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/allocated_ptr.h' -> 'dir/include/c++/11/bits/allocated_ptr.h' 2024-05-16T22:30:34.148 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/allocator.h' -> 'dir/include/c++/11/bits/allocator.h' 2024-05-16T22:30:34.181 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/atomic_base.h' -> 'dir/include/c++/11/bits/atomic_base.h' 2024-05-16T22:30:34.227 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/atomic_futex.h' -> 'dir/include/c++/11/bits/atomic_futex.h' 2024-05-16T22:30:34.257 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/atomic_lockfree_defines.h' -> 'dir/include/c++/11/bits/atomic_lockfree_defines.h' 2024-05-16T22:30:34.290 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/atomic_timed_wait.h' -> 'dir/include/c++/11/bits/atomic_timed_wait.h' 2024-05-16T22:30:34.323 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/atomic_wait.h' -> 'dir/include/c++/11/bits/atomic_wait.h' 2024-05-16T22:30:34.374 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/basic_ios.h' -> 'dir/include/c++/11/bits/basic_ios.h' 2024-05-16T22:30:34.407 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/basic_ios.tcc' -> 'dir/include/c++/11/bits/basic_ios.tcc' 2024-05-16T22:30:34.440 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/basic_string.h' -> 'dir/include/c++/11/bits/basic_string.h' 2024-05-16T22:30:34.474 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/basic_string.tcc' -> 'dir/include/c++/11/bits/basic_string.tcc' 2024-05-16T22:30:34.507 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/boost_concept_check.h' -> 'dir/include/c++/11/bits/boost_concept_check.h' 2024-05-16T22:30:34.540 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/c++0x_warning.h' -> 'dir/include/c++/11/bits/c++0x_warning.h' 2024-05-16T22:30:34.574 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/char_traits.h' -> 'dir/include/c++/11/bits/char_traits.h' 2024-05-16T22:30:34.607 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/charconv.h' -> 'dir/include/c++/11/bits/charconv.h' 2024-05-16T22:30:34.674 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/codecvt.h' -> 'dir/include/c++/11/bits/codecvt.h' 2024-05-16T22:30:34.707 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/concept_check.h' -> 'dir/include/c++/11/bits/concept_check.h' 2024-05-16T22:30:34.740 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/cpp_type_traits.h' -> 'dir/include/c++/11/bits/cpp_type_traits.h' 2024-05-16T22:30:34.774 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/cxxabi_forced.h' -> 'dir/include/c++/11/bits/cxxabi_forced.h' 2024-05-16T22:30:34.807 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/cxxabi_init_exception.h' -> 'dir/include/c++/11/bits/cxxabi_init_exception.h' 2024-05-16T22:30:34.868 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/deque.tcc' -> 'dir/include/c++/11/bits/deque.tcc' 2024-05-16T22:30:34.899 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/enable_special_members.h' -> 'dir/include/c++/11/bits/enable_special_members.h' 2024-05-16T22:30:34.932 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/erase_if.h' -> 'dir/include/c++/11/bits/erase_if.h' 2024-05-16T22:30:34.966 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/exception.h' -> 'dir/include/c++/11/bits/exception.h' 2024-05-16T22:30:35.024 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/exception_defines.h' -> 'dir/include/c++/11/bits/exception_defines.h' 2024-05-16T22:30:35.059 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/exception_ptr.h' -> 'dir/include/c++/11/bits/exception_ptr.h' 2024-05-16T22:30:35.091 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/forward_list.h' -> 'dir/include/c++/11/bits/forward_list.h' 2024-05-16T22:30:35.124 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/forward_list.tcc' -> 'dir/include/c++/11/bits/forward_list.tcc' 2024-05-16T22:30:35.158 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/fs_dir.h' -> 'dir/include/c++/11/bits/fs_dir.h' 2024-05-16T22:30:35.191 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/fs_fwd.h' -> 'dir/include/c++/11/bits/fs_fwd.h' 2024-05-16T22:30:35.224 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/fs_ops.h' -> 'dir/include/c++/11/bits/fs_ops.h' 2024-05-16T22:30:35.283 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/fs_path.h' -> 'dir/include/c++/11/bits/fs_path.h' 2024-05-16T22:30:35.316 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/fstream.tcc' -> 'dir/include/c++/11/bits/fstream.tcc' 2024-05-16T22:30:35.416 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/functexcept.h' -> 'dir/include/c++/11/bits/functexcept.h' 2024-05-16T22:30:35.450 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/functional_hash.h' -> 'dir/include/c++/11/bits/functional_hash.h' 2024-05-16T22:30:35.483 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/gslice.h' -> 'dir/include/c++/11/bits/gslice.h' 2024-05-16T22:30:35.516 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/gslice_array.h' -> 'dir/include/c++/11/bits/gslice_array.h' 2024-05-16T22:30:35.618 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/hash_bytes.h' -> 'dir/include/c++/11/bits/hash_bytes.h' 2024-05-16T22:30:35.650 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/hashtable.h' -> 'dir/include/c++/11/bits/hashtable.h' 2024-05-16T22:30:35.683 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/hashtable_policy.h' -> 'dir/include/c++/11/bits/hashtable_policy.h' 2024-05-16T22:30:35.716 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/indirect_array.h' -> 'dir/include/c++/11/bits/indirect_array.h' 2024-05-16T22:30:35.750 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/invoke.h' -> 'dir/include/c++/11/bits/invoke.h' 2024-05-16T22:30:35.783 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/ios_base.h' -> 'dir/include/c++/11/bits/ios_base.h' 2024-05-16T22:30:35.830 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/istream.tcc' -> 'dir/include/c++/11/bits/istream.tcc' 2024-05-16T22:30:35.858 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/iterator_concepts.h' -> 'dir/include/c++/11/bits/iterator_concepts.h' 2024-05-16T22:30:35.892 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/list.tcc' -> 'dir/include/c++/11/bits/list.tcc' 2024-05-16T22:30:35.925 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/locale_classes.h' -> 'dir/include/c++/11/bits/locale_classes.h' 2024-05-16T22:30:36.000 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/locale_classes.tcc' -> 'dir/include/c++/11/bits/locale_classes.tcc' 2024-05-16T22:30:36.033 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/locale_conv.h' -> 'dir/include/c++/11/bits/locale_conv.h' 2024-05-16T22:30:36.067 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/locale_facets.h' -> 'dir/include/c++/11/bits/locale_facets.h' 2024-05-16T22:30:36.117 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/locale_facets.tcc' -> 'dir/include/c++/11/bits/locale_facets.tcc' 2024-05-16T22:30:36.150 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/locale_facets_nonio.h' -> 'dir/include/c++/11/bits/locale_facets_nonio.h' 2024-05-16T22:30:36.184 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/locale_facets_nonio.tcc' -> 'dir/include/c++/11/bits/locale_facets_nonio.tcc' 2024-05-16T22:30:36.217 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/localefwd.h' -> 'dir/include/c++/11/bits/localefwd.h' 2024-05-16T22:30:36.276 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/mask_array.h' -> 'dir/include/c++/11/bits/mask_array.h' 2024-05-16T22:30:36.308 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/max_size_type.h' -> 'dir/include/c++/11/bits/max_size_type.h' 2024-05-16T22:30:36.342 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/memoryfwd.h' -> 'dir/include/c++/11/bits/memoryfwd.h' 2024-05-16T22:30:36.375 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/move.h' -> 'dir/include/c++/11/bits/move.h' 2024-05-16T22:30:36.409 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/nested_exception.h' -> 'dir/include/c++/11/bits/nested_exception.h' 2024-05-16T22:30:36.442 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/node_handle.h' -> 'dir/include/c++/11/bits/node_handle.h' 2024-05-16T22:30:36.475 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/ostream.tcc' -> 'dir/include/c++/11/bits/ostream.tcc' 2024-05-16T22:30:36.509 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/ostream_insert.h' -> 'dir/include/c++/11/bits/ostream_insert.h' 2024-05-16T22:30:36.542 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/parse_numbers.h' -> 'dir/include/c++/11/bits/parse_numbers.h' 2024-05-16T22:30:36.600 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/postypes.h' -> 'dir/include/c++/11/bits/postypes.h' 2024-05-16T22:30:36.634 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/predefined_ops.h' -> 'dir/include/c++/11/bits/predefined_ops.h' 2024-05-16T22:30:36.667 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/ptr_traits.h' -> 'dir/include/c++/11/bits/ptr_traits.h' 2024-05-16T22:30:36.701 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/quoted_string.h' -> 'dir/include/c++/11/bits/quoted_string.h' 2024-05-16T22:30:36.734 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/random.h' -> 'dir/include/c++/11/bits/random.h' 2024-05-16T22:30:36.767 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/random.tcc' -> 'dir/include/c++/11/bits/random.tcc' 2024-05-16T22:30:36.801 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/range_access.h' -> 'dir/include/c++/11/bits/range_access.h' 2024-05-16T22:30:36.834 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/ranges_algo.h' -> 'dir/include/c++/11/bits/ranges_algo.h' 2024-05-16T22:30:36.893 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/ranges_algobase.h' -> 'dir/include/c++/11/bits/ranges_algobase.h' 2024-05-16T22:30:36.926 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/ranges_base.h' -> 'dir/include/c++/11/bits/ranges_base.h' 2024-05-16T22:30:36.959 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/ranges_cmp.h' -> 'dir/include/c++/11/bits/ranges_cmp.h' 2024-05-16T22:30:36.992 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/ranges_uninitialized.h' -> 'dir/include/c++/11/bits/ranges_uninitialized.h' 2024-05-16T22:30:37.026 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/ranges_util.h' -> 'dir/include/c++/11/bits/ranges_util.h' 2024-05-16T22:30:37.059 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/refwrap.h' -> 'dir/include/c++/11/bits/refwrap.h' 2024-05-16T22:30:37.093 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/regex.h' -> 'dir/include/c++/11/bits/regex.h' 2024-05-16T22:30:37.126 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/regex.tcc' -> 'dir/include/c++/11/bits/regex.tcc' 2024-05-16T22:30:37.184 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/regex_automaton.h' -> 'dir/include/c++/11/bits/regex_automaton.h' 2024-05-16T22:30:37.218 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/regex_automaton.tcc' -> 'dir/include/c++/11/bits/regex_automaton.tcc' 2024-05-16T22:30:37.259 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/regex_compiler.h' -> 'dir/include/c++/11/bits/regex_compiler.h' 2024-05-16T22:30:37.293 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/regex_compiler.tcc' -> 'dir/include/c++/11/bits/regex_compiler.tcc' 2024-05-16T22:30:37.326 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/regex_constants.h' -> 'dir/include/c++/11/bits/regex_constants.h' 2024-05-16T22:30:37.360 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/regex_error.h' -> 'dir/include/c++/11/bits/regex_error.h' 2024-05-16T22:30:37.393 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/regex_executor.h' -> 'dir/include/c++/11/bits/regex_executor.h' 2024-05-16T22:30:37.426 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/regex_executor.tcc' -> 'dir/include/c++/11/bits/regex_executor.tcc' 2024-05-16T22:30:37.460 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/regex_scanner.h' -> 'dir/include/c++/11/bits/regex_scanner.h' 2024-05-16T22:30:37.509 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/regex_scanner.tcc' -> 'dir/include/c++/11/bits/regex_scanner.tcc' 2024-05-16T22:30:37.543 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/semaphore_base.h' -> 'dir/include/c++/11/bits/semaphore_base.h' 2024-05-16T22:30:37.576 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/shared_ptr.h' -> 'dir/include/c++/11/bits/shared_ptr.h' 2024-05-16T22:30:37.610 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/shared_ptr_atomic.h' -> 'dir/include/c++/11/bits/shared_ptr_atomic.h' 2024-05-16T22:30:37.643 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/shared_ptr_base.h' -> 'dir/include/c++/11/bits/shared_ptr_base.h' 2024-05-16T22:30:37.676 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/slice_array.h' -> 'dir/include/c++/11/bits/slice_array.h' 2024-05-16T22:30:37.710 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/specfun.h' -> 'dir/include/c++/11/bits/specfun.h' 2024-05-16T22:30:37.768 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/sstream.tcc' -> 'dir/include/c++/11/bits/sstream.tcc' 2024-05-16T22:30:37.801 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/std_abs.h' -> 'dir/include/c++/11/bits/std_abs.h' 2024-05-16T22:30:37.835 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/std_function.h' -> 'dir/include/c++/11/bits/std_function.h' 2024-05-16T22:30:37.868 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/std_mutex.h' -> 'dir/include/c++/11/bits/std_mutex.h' 2024-05-16T22:30:37.902 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/std_thread.h' -> 'dir/include/c++/11/bits/std_thread.h' 2024-05-16T22:30:37.935 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/stl_algo.h' -> 'dir/include/c++/11/bits/stl_algo.h' 2024-05-16T22:30:37.968 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/stl_algobase.h' -> 'dir/include/c++/11/bits/stl_algobase.h' 2024-05-16T22:30:38.002 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/stl_bvector.h' -> 'dir/include/c++/11/bits/stl_bvector.h' 2024-05-16T22:30:38.035 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/stl_construct.h' -> 'dir/include/c++/11/bits/stl_construct.h' 2024-05-16T22:30:38.068 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/stl_deque.h' -> 'dir/include/c++/11/bits/stl_deque.h' 2024-05-16T22:30:38.126 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/stl_function.h' -> 'dir/include/c++/11/bits/stl_function.h' 2024-05-16T22:30:38.160 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/stl_heap.h' -> 'dir/include/c++/11/bits/stl_heap.h' 2024-05-16T22:30:38.194 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/stl_iterator.h' -> 'dir/include/c++/11/bits/stl_iterator.h' 2024-05-16T22:30:38.227 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/stl_iterator_base_funcs.h' -> 'dir/include/c++/11/bits/stl_iterator_base_funcs.h' 2024-05-16T22:30:38.260 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/stl_iterator_base_types.h' -> 'dir/include/c++/11/bits/stl_iterator_base_types.h' 2024-05-16T22:30:38.294 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/stl_list.h' -> 'dir/include/c++/11/bits/stl_list.h' 2024-05-16T22:30:38.377 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/stl_map.h' -> 'dir/include/c++/11/bits/stl_map.h' 2024-05-16T22:30:38.411 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/stl_multimap.h' -> 'dir/include/c++/11/bits/stl_multimap.h' 2024-05-16T22:30:38.444 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/stl_multiset.h' -> 'dir/include/c++/11/bits/stl_multiset.h' 2024-05-16T22:30:38.477 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/stl_numeric.h' -> 'dir/include/c++/11/bits/stl_numeric.h' 2024-05-16T22:30:38.534 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/stl_pair.h' -> 'dir/include/c++/11/bits/stl_pair.h' 2024-05-16T22:30:38.569 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/stl_queue.h' -> 'dir/include/c++/11/bits/stl_queue.h' 2024-05-16T22:30:38.602 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/stl_raw_storage_iter.h' -> 'dir/include/c++/11/bits/stl_raw_storage_iter.h' 2024-05-16T22:30:38.636 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/stl_relops.h' -> 'dir/include/c++/11/bits/stl_relops.h' 2024-05-16T22:30:38.669 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/stl_set.h' -> 'dir/include/c++/11/bits/stl_set.h' 2024-05-16T22:30:38.702 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/stl_stack.h' -> 'dir/include/c++/11/bits/stl_stack.h' 2024-05-16T22:30:38.736 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/stl_tempbuf.h' -> 'dir/include/c++/11/bits/stl_tempbuf.h' 2024-05-16T22:30:38.819 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/stl_tree.h' -> 'dir/include/c++/11/bits/stl_tree.h' 2024-05-16T22:30:38.852 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/stl_uninitialized.h' -> 'dir/include/c++/11/bits/stl_uninitialized.h' 2024-05-16T22:30:38.886 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/stl_vector.h' -> 'dir/include/c++/11/bits/stl_vector.h' 2024-05-16T22:30:38.919 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/stream_iterator.h' -> 'dir/include/c++/11/bits/stream_iterator.h' 2024-05-16T22:30:38.953 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/streambuf.tcc' -> 'dir/include/c++/11/bits/streambuf.tcc' 2024-05-16T22:30:39.036 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/streambuf_iterator.h' -> 'dir/include/c++/11/bits/streambuf_iterator.h' 2024-05-16T22:30:39.079 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/string_view.tcc' -> 'dir/include/c++/11/bits/string_view.tcc' 2024-05-16T22:30:39.111 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/stringfwd.h' -> 'dir/include/c++/11/bits/stringfwd.h' 2024-05-16T22:30:39.211 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/this_thread_sleep.h' -> 'dir/include/c++/11/bits/this_thread_sleep.h' 2024-05-16T22:30:39.244 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/uniform_int_dist.h' -> 'dir/include/c++/11/bits/uniform_int_dist.h' 2024-05-16T22:30:39.299 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/unique_lock.h' -> 'dir/include/c++/11/bits/unique_lock.h' 2024-05-16T22:30:39.328 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/unique_ptr.h' -> 'dir/include/c++/11/bits/unique_ptr.h' 2024-05-16T22:30:39.361 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/unordered_map.h' -> 'dir/include/c++/11/bits/unordered_map.h' 2024-05-16T22:30:39.395 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/unordered_set.h' -> 'dir/include/c++/11/bits/unordered_set.h' 2024-05-16T22:30:39.428 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/uses_allocator.h' -> 'dir/include/c++/11/bits/uses_allocator.h' 2024-05-16T22:30:39.461 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/uses_allocator_args.h' -> 'dir/include/c++/11/bits/uses_allocator_args.h' 2024-05-16T22:30:39.495 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/valarray_after.h' -> 'dir/include/c++/11/bits/valarray_after.h' 2024-05-16T22:30:39.568 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/valarray_array.h' -> 'dir/include/c++/11/bits/valarray_array.h' 2024-05-16T22:30:39.620 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/valarray_array.tcc' -> 'dir/include/c++/11/bits/valarray_array.tcc' 2024-05-16T22:30:39.653 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/valarray_before.h' -> 'dir/include/c++/11/bits/valarray_before.h' 2024-05-16T22:30:39.686 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bits/vector.tcc' -> 'dir/include/c++/11/bits/vector.tcc' 2024-05-16T22:30:39.745 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/bitset' -> 'dir/include/c++/11/bitset' 2024-05-16T22:30:39.778 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/cassert' -> 'dir/include/c++/11/cassert' 2024-05-16T22:30:39.812 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ccomplex' -> 'dir/include/c++/11/ccomplex' 2024-05-16T22:30:39.845 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/cctype' -> 'dir/include/c++/11/cctype' 2024-05-16T22:30:39.878 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/cerrno' -> 'dir/include/c++/11/cerrno' 2024-05-16T22:30:39.911 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/cfenv' -> 'dir/include/c++/11/cfenv' 2024-05-16T22:30:39.945 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/cfloat' -> 'dir/include/c++/11/cfloat' 2024-05-16T22:30:39.978 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/charconv' -> 'dir/include/c++/11/charconv' 2024-05-16T22:30:40.045 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/chrono' -> 'dir/include/c++/11/chrono' 2024-05-16T22:30:40.078 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/cinttypes' -> 'dir/include/c++/11/cinttypes' 2024-05-16T22:30:40.112 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ciso646' -> 'dir/include/c++/11/ciso646' 2024-05-16T22:30:40.145 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/climits' -> 'dir/include/c++/11/climits' 2024-05-16T22:30:40.196 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/clocale' -> 'dir/include/c++/11/clocale' 2024-05-16T22:30:40.228 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/cmath' -> 'dir/include/c++/11/cmath' 2024-05-16T22:30:40.262 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/codecvt' -> 'dir/include/c++/11/codecvt' 2024-05-16T22:30:40.329 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/compare' -> 'dir/include/c++/11/compare' 2024-05-16T22:30:40.362 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/complex' -> 'dir/include/c++/11/complex' 2024-05-16T22:30:40.397 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/complex.h' -> 'dir/include/c++/11/complex.h' 2024-05-16T22:30:40.429 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/concepts' -> 'dir/include/c++/11/concepts' 2024-05-16T22:30:40.462 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/condition_variable' -> 'dir/include/c++/11/condition_variable' 2024-05-16T22:30:40.496 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/coroutine' -> 'dir/include/c++/11/coroutine' 2024-05-16T22:30:40.529 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/csetjmp' -> 'dir/include/c++/11/csetjmp' 2024-05-16T22:30:40.562 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/csignal' -> 'dir/include/c++/11/csignal' 2024-05-16T22:30:40.596 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/cstdalign' -> 'dir/include/c++/11/cstdalign' 2024-05-16T22:30:40.629 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/cstdarg' -> 'dir/include/c++/11/cstdarg' 2024-05-16T22:30:40.662 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/cstdbool' -> 'dir/include/c++/11/cstdbool' 2024-05-16T22:30:40.696 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/cstddef' -> 'dir/include/c++/11/cstddef' 2024-05-16T22:30:40.729 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/cstdint' -> 'dir/include/c++/11/cstdint' 2024-05-16T22:30:40.762 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/cstdio' -> 'dir/include/c++/11/cstdio' 2024-05-16T22:30:40.808 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/cstdlib' -> 'dir/include/c++/11/cstdlib' 2024-05-16T22:30:40.837 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/cstring' -> 'dir/include/c++/11/cstring' 2024-05-16T22:30:40.896 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ctgmath' -> 'dir/include/c++/11/ctgmath' 2024-05-16T22:30:40.929 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ctime' -> 'dir/include/c++/11/ctime' 2024-05-16T22:30:40.963 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/cuchar' -> 'dir/include/c++/11/cuchar' 2024-05-16T22:30:40.997 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/cwchar' -> 'dir/include/c++/11/cwchar' 2024-05-16T22:30:41.031 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/cwctype' -> 'dir/include/c++/11/cwctype' 2024-05-16T22:30:41.063 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/cxxabi.h' -> 'dir/include/c++/11/cxxabi.h' 2024-05-16T22:30:41.096 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/debug' -> 'dir/include/c++/11/debug' 2024-05-16T22:30:41.129 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/debug/assertions.h' -> 'dir/include/c++/11/debug/assertions.h' 2024-05-16T22:30:41.163 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/debug/bitset' -> 'dir/include/c++/11/debug/bitset' 2024-05-16T22:30:41.197 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/debug/debug.h' -> 'dir/include/c++/11/debug/debug.h' 2024-05-16T22:30:41.231 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/debug/deque' -> 'dir/include/c++/11/debug/deque' 2024-05-16T22:30:41.264 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/debug/formatter.h' -> 'dir/include/c++/11/debug/formatter.h' 2024-05-16T22:30:41.297 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/debug/forward_list' -> 'dir/include/c++/11/debug/forward_list' 2024-05-16T22:30:41.331 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/debug/functions.h' -> 'dir/include/c++/11/debug/functions.h' 2024-05-16T22:30:41.364 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/debug/helper_functions.h' -> 'dir/include/c++/11/debug/helper_functions.h' 2024-05-16T22:30:41.425 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/debug/list' -> 'dir/include/c++/11/debug/list' 2024-05-16T22:30:41.481 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/debug/macros.h' -> 'dir/include/c++/11/debug/macros.h' 2024-05-16T22:30:41.514 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/debug/map' -> 'dir/include/c++/11/debug/map' 2024-05-16T22:30:41.547 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/debug/map.h' -> 'dir/include/c++/11/debug/map.h' 2024-05-16T22:30:41.581 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/debug/multimap.h' -> 'dir/include/c++/11/debug/multimap.h' 2024-05-16T22:30:41.614 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/debug/multiset.h' -> 'dir/include/c++/11/debug/multiset.h' 2024-05-16T22:30:41.647 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/debug/safe_base.h' -> 'dir/include/c++/11/debug/safe_base.h' 2024-05-16T22:30:41.681 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/debug/safe_container.h' -> 'dir/include/c++/11/debug/safe_container.h' 2024-05-16T22:30:41.714 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/debug/safe_iterator.h' -> 'dir/include/c++/11/debug/safe_iterator.h' 2024-05-16T22:30:41.748 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/debug/safe_iterator.tcc' -> 'dir/include/c++/11/debug/safe_iterator.tcc' 2024-05-16T22:30:41.781 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/debug/safe_local_iterator.h' -> 'dir/include/c++/11/debug/safe_local_iterator.h' 2024-05-16T22:30:41.814 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/debug/safe_local_iterator.tcc' -> 'dir/include/c++/11/debug/safe_local_iterator.tcc' 2024-05-16T22:30:41.848 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/debug/safe_sequence.h' -> 'dir/include/c++/11/debug/safe_sequence.h' 2024-05-16T22:30:41.881 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/debug/safe_sequence.tcc' -> 'dir/include/c++/11/debug/safe_sequence.tcc' 2024-05-16T22:30:41.915 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/debug/safe_unordered_base.h' -> 'dir/include/c++/11/debug/safe_unordered_base.h' 2024-05-16T22:30:41.948 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/debug/safe_unordered_container.h' -> 'dir/include/c++/11/debug/safe_unordered_container.h' 2024-05-16T22:30:41.981 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/debug/safe_unordered_container.tcc' -> 'dir/include/c++/11/debug/safe_unordered_container.tcc' 2024-05-16T22:30:42.040 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/debug/set' -> 'dir/include/c++/11/debug/set' 2024-05-16T22:30:42.073 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/debug/set.h' -> 'dir/include/c++/11/debug/set.h' 2024-05-16T22:30:42.106 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/debug/stl_iterator.h' -> 'dir/include/c++/11/debug/stl_iterator.h' 2024-05-16T22:30:42.140 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/debug/string' -> 'dir/include/c++/11/debug/string' 2024-05-16T22:30:42.173 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/debug/unordered_map' -> 'dir/include/c++/11/debug/unordered_map' 2024-05-16T22:30:42.206 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/debug/unordered_set' -> 'dir/include/c++/11/debug/unordered_set' 2024-05-16T22:30:42.244 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/debug/vector' -> 'dir/include/c++/11/debug/vector' 2024-05-16T22:30:42.273 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/decimal' -> 'dir/include/c++/11/decimal' 2024-05-16T22:30:42.306 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/decimal/decimal' -> 'dir/include/c++/11/decimal/decimal' 2024-05-16T22:30:42.340 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/decimal/decimal.h' -> 'dir/include/c++/11/decimal/decimal.h' 2024-05-16T22:30:42.373 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/deque' -> 'dir/include/c++/11/deque' 2024-05-16T22:30:42.407 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/exception' -> 'dir/include/c++/11/exception' 2024-05-16T22:30:42.440 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/execution' -> 'dir/include/c++/11/execution' 2024-05-16T22:30:42.473 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental' -> 'dir/include/c++/11/experimental' 2024-05-16T22:30:42.507 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/algorithm' -> 'dir/include/c++/11/experimental/algorithm' 2024-05-16T22:30:42.540 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/any' -> 'dir/include/c++/11/experimental/any' 2024-05-16T22:30:42.657 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/array' -> 'dir/include/c++/11/experimental/array' 2024-05-16T22:30:42.716 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/bits' -> 'dir/include/c++/11/experimental/bits' 2024-05-16T22:30:42.749 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/bits/fs_dir.h' -> 'dir/include/c++/11/experimental/bits/fs_dir.h' 2024-05-16T22:30:42.782 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/bits/fs_fwd.h' -> 'dir/include/c++/11/experimental/bits/fs_fwd.h' 2024-05-16T22:30:42.815 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/bits/fs_ops.h' -> 'dir/include/c++/11/experimental/bits/fs_ops.h' 2024-05-16T22:30:42.849 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/bits/fs_path.h' -> 'dir/include/c++/11/experimental/bits/fs_path.h' 2024-05-16T22:30:42.889 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/bits/lfts_config.h' -> 'dir/include/c++/11/experimental/bits/lfts_config.h' 2024-05-16T22:30:42.924 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/bits/net.h' -> 'dir/include/c++/11/experimental/bits/net.h' 2024-05-16T22:30:42.957 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/bits/numeric_traits.h' -> 'dir/include/c++/11/experimental/bits/numeric_traits.h' 2024-05-16T22:30:42.991 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/bits/shared_ptr.h' -> 'dir/include/c++/11/experimental/bits/shared_ptr.h' 2024-05-16T22:30:43.024 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/bits/simd.h' -> 'dir/include/c++/11/experimental/bits/simd.h' 2024-05-16T22:30:43.058 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/bits/simd_builtin.h' -> 'dir/include/c++/11/experimental/bits/simd_builtin.h' 2024-05-16T22:30:43.091 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/bits/simd_converter.h' -> 'dir/include/c++/11/experimental/bits/simd_converter.h' 2024-05-16T22:30:43.124 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/bits/simd_detail.h' -> 'dir/include/c++/11/experimental/bits/simd_detail.h' 2024-05-16T22:30:43.157 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/bits/simd_fixed_size.h' -> 'dir/include/c++/11/experimental/bits/simd_fixed_size.h' 2024-05-16T22:30:43.191 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/bits/simd_math.h' -> 'dir/include/c++/11/experimental/bits/simd_math.h' 2024-05-16T22:30:43.257 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/bits/simd_neon.h' -> 'dir/include/c++/11/experimental/bits/simd_neon.h' 2024-05-16T22:30:43.291 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/bits/simd_ppc.h' -> 'dir/include/c++/11/experimental/bits/simd_ppc.h' 2024-05-16T22:30:43.341 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/bits/simd_scalar.h' -> 'dir/include/c++/11/experimental/bits/simd_scalar.h' 2024-05-16T22:30:43.374 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/bits/simd_x86.h' -> 'dir/include/c++/11/experimental/bits/simd_x86.h' 2024-05-16T22:30:43.407 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/bits/simd_x86_conversions.h' -> 'dir/include/c++/11/experimental/bits/simd_x86_conversions.h' 2024-05-16T22:30:43.441 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/bits/string_view.tcc' -> 'dir/include/c++/11/experimental/bits/string_view.tcc' 2024-05-16T22:30:43.474 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/buffer' -> 'dir/include/c++/11/experimental/buffer' 2024-05-16T22:30:43.508 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/chrono' -> 'dir/include/c++/11/experimental/chrono' 2024-05-16T22:30:43.541 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/deque' -> 'dir/include/c++/11/experimental/deque' 2024-05-16T22:30:43.574 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/executor' -> 'dir/include/c++/11/experimental/executor' 2024-05-16T22:30:43.608 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/filesystem' -> 'dir/include/c++/11/experimental/filesystem' 2024-05-16T22:30:43.642 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/forward_list' -> 'dir/include/c++/11/experimental/forward_list' 2024-05-16T22:30:43.675 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/functional' -> 'dir/include/c++/11/experimental/functional' 2024-05-16T22:30:43.708 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/internet' -> 'dir/include/c++/11/experimental/internet' 2024-05-16T22:30:43.741 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/io_context' -> 'dir/include/c++/11/experimental/io_context' 2024-05-16T22:30:43.775 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/iterator' -> 'dir/include/c++/11/experimental/iterator' 2024-05-16T22:30:43.833 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/list' -> 'dir/include/c++/11/experimental/list' 2024-05-16T22:30:43.866 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/map' -> 'dir/include/c++/11/experimental/map' 2024-05-16T22:30:43.900 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/memory' -> 'dir/include/c++/11/experimental/memory' 2024-05-16T22:30:43.957 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/memory_resource' -> 'dir/include/c++/11/experimental/memory_resource' 2024-05-16T22:30:43.991 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/net' -> 'dir/include/c++/11/experimental/net' 2024-05-16T22:30:44.025 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/netfwd' -> 'dir/include/c++/11/experimental/netfwd' 2024-05-16T22:30:44.058 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/numeric' -> 'dir/include/c++/11/experimental/numeric' 2024-05-16T22:30:44.091 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/optional' -> 'dir/include/c++/11/experimental/optional' 2024-05-16T22:30:44.125 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/propagate_const' -> 'dir/include/c++/11/experimental/propagate_const' 2024-05-16T22:30:44.158 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/random' -> 'dir/include/c++/11/experimental/random' 2024-05-16T22:30:44.192 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/ratio' -> 'dir/include/c++/11/experimental/ratio' 2024-05-16T22:30:44.225 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/regex' -> 'dir/include/c++/11/experimental/regex' 2024-05-16T22:30:44.258 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/set' -> 'dir/include/c++/11/experimental/set' 2024-05-16T22:30:44.292 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/simd' -> 'dir/include/c++/11/experimental/simd' 2024-05-16T22:30:44.325 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/socket' -> 'dir/include/c++/11/experimental/socket' 2024-05-16T22:30:44.358 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/source_location' -> 'dir/include/c++/11/experimental/source_location' 2024-05-16T22:30:44.417 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/string' -> 'dir/include/c++/11/experimental/string' 2024-05-16T22:30:44.450 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/string_view' -> 'dir/include/c++/11/experimental/string_view' 2024-05-16T22:30:44.483 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/system_error' -> 'dir/include/c++/11/experimental/system_error' 2024-05-16T22:30:44.517 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/timer' -> 'dir/include/c++/11/experimental/timer' 2024-05-16T22:30:44.566 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/tuple' -> 'dir/include/c++/11/experimental/tuple' 2024-05-16T22:30:44.600 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/type_traits' -> 'dir/include/c++/11/experimental/type_traits' 2024-05-16T22:30:44.634 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/unordered_map' -> 'dir/include/c++/11/experimental/unordered_map' 2024-05-16T22:30:44.667 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/unordered_set' -> 'dir/include/c++/11/experimental/unordered_set' 2024-05-16T22:30:44.700 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/utility' -> 'dir/include/c++/11/experimental/utility' 2024-05-16T22:30:44.734 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/experimental/vector' -> 'dir/include/c++/11/experimental/vector' 2024-05-16T22:30:44.767 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext' -> 'dir/include/c++/11/ext' 2024-05-16T22:30:44.800 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/algorithm' -> 'dir/include/c++/11/ext/algorithm' 2024-05-16T22:30:44.834 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/aligned_buffer.h' -> 'dir/include/c++/11/ext/aligned_buffer.h' 2024-05-16T22:30:44.867 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/alloc_traits.h' -> 'dir/include/c++/11/ext/alloc_traits.h' 2024-05-16T22:30:44.900 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/atomicity.h' -> 'dir/include/c++/11/ext/atomicity.h' 2024-05-16T22:30:44.934 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/bitmap_allocator.h' -> 'dir/include/c++/11/ext/bitmap_allocator.h' 2024-05-16T22:30:44.992 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/cast.h' -> 'dir/include/c++/11/ext/cast.h' 2024-05-16T22:30:45.025 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/cmath' -> 'dir/include/c++/11/ext/cmath' 2024-05-16T22:30:45.059 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/codecvt_specializations.h' -> 'dir/include/c++/11/ext/codecvt_specializations.h' 2024-05-16T22:30:45.092 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/concurrence.h' -> 'dir/include/c++/11/ext/concurrence.h' 2024-05-16T22:30:45.126 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/debug_allocator.h' -> 'dir/include/c++/11/ext/debug_allocator.h' 2024-05-16T22:30:45.183 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/enc_filebuf.h' -> 'dir/include/c++/11/ext/enc_filebuf.h' 2024-05-16T22:30:45.251 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/extptr_allocator.h' -> 'dir/include/c++/11/ext/extptr_allocator.h' 2024-05-16T22:30:45.284 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/functional' -> 'dir/include/c++/11/ext/functional' 2024-05-16T22:30:45.317 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/hash_map' -> 'dir/include/c++/11/ext/hash_map' 2024-05-16T22:30:45.351 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/hash_set' -> 'dir/include/c++/11/ext/hash_set' 2024-05-16T22:30:45.384 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/iterator' -> 'dir/include/c++/11/ext/iterator' 2024-05-16T22:30:45.426 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/malloc_allocator.h' -> 'dir/include/c++/11/ext/malloc_allocator.h' 2024-05-16T22:30:45.459 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/memory' -> 'dir/include/c++/11/ext/memory' 2024-05-16T22:30:45.493 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/mt_allocator.h' -> 'dir/include/c++/11/ext/mt_allocator.h' 2024-05-16T22:30:45.526 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/new_allocator.h' -> 'dir/include/c++/11/ext/new_allocator.h' 2024-05-16T22:30:45.561 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/numeric' -> 'dir/include/c++/11/ext/numeric' 2024-05-16T22:30:45.626 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/numeric_traits.h' -> 'dir/include/c++/11/ext/numeric_traits.h' 2024-05-16T22:30:45.659 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds' -> 'dir/include/c++/11/ext/pb_ds' 2024-05-16T22:30:45.709 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/assoc_container.hpp' -> 'dir/include/c++/11/ext/pb_ds/assoc_container.hpp' 2024-05-16T22:30:45.743 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail' -> 'dir/include/c++/11/ext/pb_ds/detail' 2024-05-16T22:30:45.776 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/bin_search_tree_' -> 'dir/include/c++/11/ext/pb_ds/detail/bin_search_tree_' 2024-05-16T22:30:45.809 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/bin_search_tree_/bin_search_tree_.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/bin_search_tree_/bin_search_tree_.hpp' 2024-05-16T22:30:45.857 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/bin_search_tree_/constructors_destructor_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/bin_search_tree_/constructors_destructor_fn_imps.hpp' 2024-05-16T22:30:45.885 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/bin_search_tree_/debug_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/bin_search_tree_/debug_fn_imps.hpp' 2024-05-16T22:30:45.918 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/bin_search_tree_/erase_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/bin_search_tree_/erase_fn_imps.hpp' 2024-05-16T22:30:45.951 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/bin_search_tree_/find_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/bin_search_tree_/find_fn_imps.hpp' 2024-05-16T22:30:45.985 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/bin_search_tree_/info_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/bin_search_tree_/info_fn_imps.hpp' 2024-05-16T22:30:46.018 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/bin_search_tree_/insert_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/bin_search_tree_/insert_fn_imps.hpp' 2024-05-16T22:30:46.051 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/bin_search_tree_/iterators_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/bin_search_tree_/iterators_fn_imps.hpp' 2024-05-16T22:30:46.085 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/bin_search_tree_/node_iterators.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/bin_search_tree_/node_iterators.hpp' 2024-05-16T22:30:46.118 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/bin_search_tree_/point_iterators.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/bin_search_tree_/point_iterators.hpp' 2024-05-16T22:30:46.154 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/bin_search_tree_/policy_access_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/bin_search_tree_/policy_access_fn_imps.hpp' 2024-05-16T22:30:46.210 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/bin_search_tree_/r_erase_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/bin_search_tree_/r_erase_fn_imps.hpp' 2024-05-16T22:30:46.252 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/bin_search_tree_/rotate_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/bin_search_tree_/rotate_fn_imps.hpp' 2024-05-16T22:30:46.285 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/bin_search_tree_/split_join_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/bin_search_tree_/split_join_fn_imps.hpp' 2024-05-16T22:30:46.318 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/bin_search_tree_/traits.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/bin_search_tree_/traits.hpp' 2024-05-16T22:30:46.352 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binary_heap_' -> 'dir/include/c++/11/ext/pb_ds/detail/binary_heap_' 2024-05-16T22:30:46.385 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binary_heap_/binary_heap_.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binary_heap_/binary_heap_.hpp' 2024-05-16T22:30:46.418 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binary_heap_/const_iterator.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binary_heap_/const_iterator.hpp' 2024-05-16T22:30:46.474 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binary_heap_/constructors_destructor_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binary_heap_/constructors_destructor_fn_imps.hpp' 2024-05-16T22:30:46.502 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binary_heap_/debug_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binary_heap_/debug_fn_imps.hpp' 2024-05-16T22:30:46.535 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binary_heap_/entry_cmp.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binary_heap_/entry_cmp.hpp' 2024-05-16T22:30:46.569 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binary_heap_/entry_pred.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binary_heap_/entry_pred.hpp' 2024-05-16T22:30:46.602 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binary_heap_/erase_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binary_heap_/erase_fn_imps.hpp' 2024-05-16T22:30:46.635 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binary_heap_/find_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binary_heap_/find_fn_imps.hpp' 2024-05-16T22:30:46.724 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binary_heap_/info_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binary_heap_/info_fn_imps.hpp' 2024-05-16T22:30:46.794 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binary_heap_/insert_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binary_heap_/insert_fn_imps.hpp' 2024-05-16T22:30:46.827 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binary_heap_/iterators_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binary_heap_/iterators_fn_imps.hpp' 2024-05-16T22:30:46.894 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binary_heap_/point_const_iterator.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binary_heap_/point_const_iterator.hpp' 2024-05-16T22:30:46.927 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binary_heap_/policy_access_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binary_heap_/policy_access_fn_imps.hpp' 2024-05-16T22:30:46.961 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binary_heap_/resize_policy.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binary_heap_/resize_policy.hpp' 2024-05-16T22:30:46.994 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binary_heap_/split_join_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binary_heap_/split_join_fn_imps.hpp' 2024-05-16T22:30:47.027 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binary_heap_/trace_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binary_heap_/trace_fn_imps.hpp' 2024-05-16T22:30:47.061 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binomial_heap_' -> 'dir/include/c++/11/ext/pb_ds/detail/binomial_heap_' 2024-05-16T22:30:47.094 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binomial_heap_/binomial_heap_.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binomial_heap_/binomial_heap_.hpp' 2024-05-16T22:30:47.127 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binomial_heap_/constructors_destructor_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binomial_heap_/constructors_destructor_fn_imps.hpp' 2024-05-16T22:30:47.173 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binomial_heap_/debug_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binomial_heap_/debug_fn_imps.hpp' 2024-05-16T22:30:47.202 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binomial_heap_base_' -> 'dir/include/c++/11/ext/pb_ds/detail/binomial_heap_base_' 2024-05-16T22:30:47.236 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binomial_heap_base_/binomial_heap_base_.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binomial_heap_base_/binomial_heap_base_.hpp' 2024-05-16T22:30:47.269 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binomial_heap_base_/constructors_destructor_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binomial_heap_base_/constructors_destructor_fn_imps.hpp' 2024-05-16T22:30:47.302 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binomial_heap_base_/debug_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binomial_heap_base_/debug_fn_imps.hpp' 2024-05-16T22:30:47.336 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binomial_heap_base_/erase_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binomial_heap_base_/erase_fn_imps.hpp' 2024-05-16T22:30:47.410 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binomial_heap_base_/find_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binomial_heap_base_/find_fn_imps.hpp' 2024-05-16T22:30:47.445 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binomial_heap_base_/insert_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binomial_heap_base_/insert_fn_imps.hpp' 2024-05-16T22:30:47.503 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/binomial_heap_base_/split_join_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/binomial_heap_base_/split_join_fn_imps.hpp' 2024-05-16T22:30:47.536 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/branch_policy' -> 'dir/include/c++/11/ext/pb_ds/detail/branch_policy' 2024-05-16T22:30:47.570 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/branch_policy/branch_policy.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/branch_policy/branch_policy.hpp' 2024-05-16T22:30:47.603 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/branch_policy/null_node_metadata.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/branch_policy/null_node_metadata.hpp' 2024-05-16T22:30:47.636 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/branch_policy/traits.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/branch_policy/traits.hpp' 2024-05-16T22:30:47.670 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_' 2024-05-16T22:30:47.703 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/cc_ht_map_.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/cc_ht_map_.hpp' 2024-05-16T22:30:47.737 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/cmp_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/cmp_fn_imps.hpp' 2024-05-16T22:30:47.770 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/cond_key_dtor_entry_dealtor.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/cond_key_dtor_entry_dealtor.hpp' 2024-05-16T22:30:47.823 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/constructor_destructor_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/constructor_destructor_fn_imps.hpp' 2024-05-16T22:30:47.853 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/constructor_destructor_no_store_hash_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/constructor_destructor_no_store_hash_fn_imps.hpp' 2024-05-16T22:30:47.887 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/constructor_destructor_store_hash_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/constructor_destructor_store_hash_fn_imps.hpp' 2024-05-16T22:30:47.920 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/debug_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/debug_fn_imps.hpp' 2024-05-16T22:30:47.954 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/debug_no_store_hash_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/debug_no_store_hash_fn_imps.hpp' 2024-05-16T22:30:47.987 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/debug_store_hash_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/debug_store_hash_fn_imps.hpp' 2024-05-16T22:30:48.020 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/entry_list_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/entry_list_fn_imps.hpp' 2024-05-16T22:30:48.104 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/erase_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/erase_fn_imps.hpp' 2024-05-16T22:30:48.137 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/erase_no_store_hash_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/erase_no_store_hash_fn_imps.hpp' 2024-05-16T22:30:48.170 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/erase_store_hash_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/erase_store_hash_fn_imps.hpp' 2024-05-16T22:30:48.204 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/find_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/find_fn_imps.hpp' 2024-05-16T22:30:48.237 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/find_store_hash_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/find_store_hash_fn_imps.hpp' 2024-05-16T22:30:48.270 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/info_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/info_fn_imps.hpp' 2024-05-16T22:30:48.304 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/insert_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/insert_fn_imps.hpp' 2024-05-16T22:30:48.337 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/insert_no_store_hash_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/insert_no_store_hash_fn_imps.hpp' 2024-05-16T22:30:48.370 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/insert_store_hash_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/insert_store_hash_fn_imps.hpp' 2024-05-16T22:30:48.404 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/iterators_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/iterators_fn_imps.hpp' 2024-05-16T22:30:48.456 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/policy_access_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/policy_access_fn_imps.hpp' 2024-05-16T22:30:48.487 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/resize_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/resize_fn_imps.hpp' 2024-05-16T22:30:48.520 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/resize_no_store_hash_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/resize_no_store_hash_fn_imps.hpp' 2024-05-16T22:30:48.554 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/resize_store_hash_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/resize_store_hash_fn_imps.hpp' 2024-05-16T22:30:48.587 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/size_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/size_fn_imps.hpp' 2024-05-16T22:30:48.621 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/trace_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cc_hash_table_map_/trace_fn_imps.hpp' 2024-05-16T22:30:48.679 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/cond_dealtor.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/cond_dealtor.hpp' 2024-05-16T22:30:48.754 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/container_base_dispatch.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/container_base_dispatch.hpp' 2024-05-16T22:30:48.787 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/debug_map_base.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/debug_map_base.hpp' 2024-05-16T22:30:48.821 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/eq_fn' -> 'dir/include/c++/11/ext/pb_ds/detail/eq_fn' 2024-05-16T22:30:48.854 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/eq_fn/eq_by_less.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/eq_fn/eq_by_less.hpp' 2024-05-16T22:30:48.888 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/eq_fn/hash_eq_fn.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/eq_fn/hash_eq_fn.hpp' 2024-05-16T22:30:48.921 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_' -> 'dir/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_' 2024-05-16T22:30:48.954 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/constructor_destructor_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/constructor_destructor_fn_imps.hpp' 2024-05-16T22:30:48.988 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/constructor_destructor_no_store_hash_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/constructor_destructor_no_store_hash_fn_imps.hpp' 2024-05-16T22:30:49.021 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/constructor_destructor_store_hash_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/constructor_destructor_store_hash_fn_imps.hpp' 2024-05-16T22:30:49.071 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/debug_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/debug_fn_imps.hpp' 2024-05-16T22:30:49.104 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/debug_no_store_hash_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/debug_no_store_hash_fn_imps.hpp' 2024-05-16T22:30:49.140 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/debug_store_hash_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/debug_store_hash_fn_imps.hpp' 2024-05-16T22:30:49.171 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/erase_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/erase_fn_imps.hpp' 2024-05-16T22:30:49.204 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/erase_no_store_hash_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/erase_no_store_hash_fn_imps.hpp' 2024-05-16T22:30:49.276 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/erase_store_hash_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/erase_store_hash_fn_imps.hpp' 2024-05-16T22:30:49.330 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/find_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/find_fn_imps.hpp' 2024-05-16T22:30:49.363 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/find_no_store_hash_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/find_no_store_hash_fn_imps.hpp' 2024-05-16T22:30:49.396 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/find_store_hash_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/find_store_hash_fn_imps.hpp' 2024-05-16T22:30:49.430 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/gp_ht_map_.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/gp_ht_map_.hpp' 2024-05-16T22:30:49.463 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/info_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/info_fn_imps.hpp' 2024-05-16T22:30:49.496 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/insert_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/insert_fn_imps.hpp' 2024-05-16T22:30:49.530 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/insert_no_store_hash_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/insert_no_store_hash_fn_imps.hpp' 2024-05-16T22:30:49.563 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/insert_store_hash_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/insert_store_hash_fn_imps.hpp' 2024-05-16T22:30:49.596 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/iterator_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/iterator_fn_imps.hpp' 2024-05-16T22:30:49.630 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/policy_access_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/policy_access_fn_imps.hpp' 2024-05-16T22:30:49.663 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/resize_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/resize_fn_imps.hpp' 2024-05-16T22:30:49.696 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/resize_no_store_hash_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/resize_no_store_hash_fn_imps.hpp' 2024-05-16T22:30:49.747 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/resize_store_hash_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/resize_store_hash_fn_imps.hpp' 2024-05-16T22:30:49.780 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/trace_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/gp_hash_table_map_/trace_fn_imps.hpp' 2024-05-16T22:30:49.813 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/hash_fn' -> 'dir/include/c++/11/ext/pb_ds/detail/hash_fn' 2024-05-16T22:30:49.847 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/hash_fn/direct_mask_range_hashing_imp.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/hash_fn/direct_mask_range_hashing_imp.hpp' 2024-05-16T22:30:49.913 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/hash_fn/direct_mod_range_hashing_imp.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/hash_fn/direct_mod_range_hashing_imp.hpp' 2024-05-16T22:30:49.947 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/hash_fn/linear_probe_fn_imp.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/hash_fn/linear_probe_fn_imp.hpp' 2024-05-16T22:30:49.983 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/hash_fn/mask_based_range_hashing.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/hash_fn/mask_based_range_hashing.hpp' 2024-05-16T22:30:50.013 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/hash_fn/mod_based_range_hashing.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/hash_fn/mod_based_range_hashing.hpp' 2024-05-16T22:30:50.047 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/hash_fn/probe_fn_base.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/hash_fn/probe_fn_base.hpp' 2024-05-16T22:30:50.080 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/hash_fn/quadratic_probe_fn_imp.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/hash_fn/quadratic_probe_fn_imp.hpp' 2024-05-16T22:30:50.113 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/hash_fn/ranged_hash_fn.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/hash_fn/ranged_hash_fn.hpp' 2024-05-16T22:30:50.147 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/hash_fn/ranged_probe_fn.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/hash_fn/ranged_probe_fn.hpp' 2024-05-16T22:30:50.180 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/hash_fn/sample_probe_fn.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/hash_fn/sample_probe_fn.hpp' 2024-05-16T22:30:50.214 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/hash_fn/sample_range_hashing.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/hash_fn/sample_range_hashing.hpp' 2024-05-16T22:30:50.247 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/hash_fn/sample_ranged_hash_fn.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/hash_fn/sample_ranged_hash_fn.hpp' 2024-05-16T22:30:50.280 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/hash_fn/sample_ranged_probe_fn.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/hash_fn/sample_ranged_probe_fn.hpp' 2024-05-16T22:30:50.314 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_' -> 'dir/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_' 2024-05-16T22:30:50.381 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_/const_iterator.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_/const_iterator.hpp' 2024-05-16T22:30:50.421 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_/constructors_destructor_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_/constructors_destructor_fn_imps.hpp' 2024-05-16T22:30:50.456 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_/debug_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_/debug_fn_imps.hpp' 2024-05-16T22:30:50.514 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_/erase_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_/erase_fn_imps.hpp' 2024-05-16T22:30:50.548 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_/info_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_/info_fn_imps.hpp' 2024-05-16T22:30:50.581 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_/insert_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_/insert_fn_imps.hpp' 2024-05-16T22:30:50.614 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_/iterators_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_/iterators_fn_imps.hpp' 2024-05-16T22:30:50.648 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_/left_child_next_sibling_heap_.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_/left_child_next_sibling_heap_.hpp' 2024-05-16T22:30:50.687 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_/node.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_/node.hpp' 2024-05-16T22:30:50.931 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_/point_const_iterator.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_/point_const_iterator.hpp' 2024-05-16T22:30:50.964 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_/policy_access_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_/policy_access_fn_imps.hpp' 2024-05-16T22:30:50.997 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_/trace_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/left_child_next_sibling_heap_/trace_fn_imps.hpp' 2024-05-16T22:30:51.031 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/list_update_map_' -> 'dir/include/c++/11/ext/pb_ds/detail/list_update_map_' 2024-05-16T22:30:51.064 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/list_update_map_/constructor_destructor_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/list_update_map_/constructor_destructor_fn_imps.hpp' 2024-05-16T22:30:51.098 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/list_update_map_/debug_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/list_update_map_/debug_fn_imps.hpp' 2024-05-16T22:30:51.131 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/list_update_map_/entry_metadata_base.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/list_update_map_/entry_metadata_base.hpp' 2024-05-16T22:30:51.164 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/list_update_map_/erase_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/list_update_map_/erase_fn_imps.hpp' 2024-05-16T22:30:51.223 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/list_update_map_/find_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/list_update_map_/find_fn_imps.hpp' 2024-05-16T22:30:51.256 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/list_update_map_/info_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/list_update_map_/info_fn_imps.hpp' 2024-05-16T22:30:51.331 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/list_update_map_/insert_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/list_update_map_/insert_fn_imps.hpp' 2024-05-16T22:30:51.364 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/list_update_map_/iterators_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/list_update_map_/iterators_fn_imps.hpp' 2024-05-16T22:30:51.398 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/list_update_map_/lu_map_.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/list_update_map_/lu_map_.hpp' 2024-05-16T22:30:51.452 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/list_update_map_/trace_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/list_update_map_/trace_fn_imps.hpp' 2024-05-16T22:30:51.485 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/list_update_policy' -> 'dir/include/c++/11/ext/pb_ds/detail/list_update_policy' 2024-05-16T22:30:51.515 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/list_update_policy/lu_counter_metadata.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/list_update_policy/lu_counter_metadata.hpp' 2024-05-16T22:30:51.548 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/list_update_policy/sample_update_policy.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/list_update_policy/sample_update_policy.hpp' 2024-05-16T22:30:51.581 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/ov_tree_map_' -> 'dir/include/c++/11/ext/pb_ds/detail/ov_tree_map_' 2024-05-16T22:30:51.615 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/ov_tree_map_/constructors_destructor_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/ov_tree_map_/constructors_destructor_fn_imps.hpp' 2024-05-16T22:30:51.648 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/ov_tree_map_/debug_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/ov_tree_map_/debug_fn_imps.hpp' 2024-05-16T22:30:51.681 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/ov_tree_map_/erase_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/ov_tree_map_/erase_fn_imps.hpp' 2024-05-16T22:30:51.734 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/ov_tree_map_/info_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/ov_tree_map_/info_fn_imps.hpp' 2024-05-16T22:30:51.765 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/ov_tree_map_/insert_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/ov_tree_map_/insert_fn_imps.hpp' 2024-05-16T22:30:51.798 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/ov_tree_map_/iterators_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/ov_tree_map_/iterators_fn_imps.hpp' 2024-05-16T22:30:51.832 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/ov_tree_map_/node_iterators.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/ov_tree_map_/node_iterators.hpp' 2024-05-16T22:30:51.889 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/ov_tree_map_/ov_tree_map_.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/ov_tree_map_/ov_tree_map_.hpp' 2024-05-16T22:30:51.948 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/ov_tree_map_/policy_access_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/ov_tree_map_/policy_access_fn_imps.hpp' 2024-05-16T22:30:51.990 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/ov_tree_map_/split_join_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/ov_tree_map_/split_join_fn_imps.hpp' 2024-05-16T22:30:52.023 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/ov_tree_map_/traits.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/ov_tree_map_/traits.hpp' 2024-05-16T22:30:52.057 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pairing_heap_' -> 'dir/include/c++/11/ext/pb_ds/detail/pairing_heap_' 2024-05-16T22:30:52.090 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pairing_heap_/constructors_destructor_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/pairing_heap_/constructors_destructor_fn_imps.hpp' 2024-05-16T22:30:52.141 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pairing_heap_/debug_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/pairing_heap_/debug_fn_imps.hpp' 2024-05-16T22:30:52.174 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pairing_heap_/erase_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/pairing_heap_/erase_fn_imps.hpp' 2024-05-16T22:30:52.207 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pairing_heap_/find_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/pairing_heap_/find_fn_imps.hpp' 2024-05-16T22:30:52.240 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pairing_heap_/insert_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/pairing_heap_/insert_fn_imps.hpp' 2024-05-16T22:30:52.274 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pairing_heap_/pairing_heap_.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/pairing_heap_/pairing_heap_.hpp' 2024-05-16T22:30:52.307 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pairing_heap_/split_join_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/pairing_heap_/split_join_fn_imps.hpp' 2024-05-16T22:30:52.340 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pat_trie_' -> 'dir/include/c++/11/ext/pb_ds/detail/pat_trie_' 2024-05-16T22:30:52.374 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pat_trie_/constructors_destructor_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/pat_trie_/constructors_destructor_fn_imps.hpp' 2024-05-16T22:30:52.407 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pat_trie_/debug_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/pat_trie_/debug_fn_imps.hpp' 2024-05-16T22:30:52.440 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pat_trie_/erase_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/pat_trie_/erase_fn_imps.hpp' 2024-05-16T22:30:52.474 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pat_trie_/find_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/pat_trie_/find_fn_imps.hpp' 2024-05-16T22:30:52.532 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pat_trie_/info_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/pat_trie_/info_fn_imps.hpp' 2024-05-16T22:30:52.566 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pat_trie_/insert_join_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/pat_trie_/insert_join_fn_imps.hpp' 2024-05-16T22:30:52.599 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pat_trie_/iterators_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/pat_trie_/iterators_fn_imps.hpp' 2024-05-16T22:30:52.632 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pat_trie_/pat_trie_.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/pat_trie_/pat_trie_.hpp' 2024-05-16T22:30:52.665 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pat_trie_/pat_trie_base.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/pat_trie_/pat_trie_base.hpp' 2024-05-16T22:30:52.699 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pat_trie_/policy_access_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/pat_trie_/policy_access_fn_imps.hpp' 2024-05-16T22:30:52.749 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pat_trie_/r_erase_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/pat_trie_/r_erase_fn_imps.hpp' 2024-05-16T22:30:52.782 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pat_trie_/rotate_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/pat_trie_/rotate_fn_imps.hpp' 2024-05-16T22:30:52.816 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pat_trie_/split_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/pat_trie_/split_fn_imps.hpp' 2024-05-16T22:30:52.849 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pat_trie_/synth_access_traits.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/pat_trie_/synth_access_traits.hpp' 2024-05-16T22:30:52.882 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pat_trie_/trace_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/pat_trie_/trace_fn_imps.hpp' 2024-05-16T22:30:52.916 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pat_trie_/traits.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/pat_trie_/traits.hpp' 2024-05-16T22:30:52.949 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/pat_trie_/update_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/pat_trie_/update_fn_imps.hpp' 2024-05-16T22:30:52.983 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/priority_queue_base_dispatch.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/priority_queue_base_dispatch.hpp' 2024-05-16T22:30:53.016 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/rb_tree_map_' -> 'dir/include/c++/11/ext/pb_ds/detail/rb_tree_map_' 2024-05-16T22:30:53.049 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/rb_tree_map_/constructors_destructor_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/rb_tree_map_/constructors_destructor_fn_imps.hpp' 2024-05-16T22:30:53.099 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/rb_tree_map_/debug_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/rb_tree_map_/debug_fn_imps.hpp' 2024-05-16T22:30:53.163 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/rb_tree_map_/erase_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/rb_tree_map_/erase_fn_imps.hpp' 2024-05-16T22:30:53.191 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/rb_tree_map_/find_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/rb_tree_map_/find_fn_imps.hpp' 2024-05-16T22:30:53.224 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/rb_tree_map_/info_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/rb_tree_map_/info_fn_imps.hpp' 2024-05-16T22:30:53.258 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/rb_tree_map_/insert_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/rb_tree_map_/insert_fn_imps.hpp' 2024-05-16T22:30:53.291 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/rb_tree_map_/node.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/rb_tree_map_/node.hpp' 2024-05-16T22:30:53.325 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/rb_tree_map_/rb_tree_.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/rb_tree_map_/rb_tree_.hpp' 2024-05-16T22:30:53.374 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/rb_tree_map_/split_join_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/rb_tree_map_/split_join_fn_imps.hpp' 2024-05-16T22:30:53.473 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/rb_tree_map_/traits.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/rb_tree_map_/traits.hpp' 2024-05-16T22:30:53.572 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/rc_binomial_heap_' -> 'dir/include/c++/11/ext/pb_ds/detail/rc_binomial_heap_' 2024-05-16T22:30:53.669 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/rc_binomial_heap_/constructors_destructor_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/rc_binomial_heap_/constructors_destructor_fn_imps.hpp' 2024-05-16T22:30:53.741 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/rc_binomial_heap_/debug_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/rc_binomial_heap_/debug_fn_imps.hpp' 2024-05-16T22:30:53.808 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/rc_binomial_heap_/erase_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/rc_binomial_heap_/erase_fn_imps.hpp' 2024-05-16T22:30:53.866 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/rc_binomial_heap_/insert_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/rc_binomial_heap_/insert_fn_imps.hpp' 2024-05-16T22:30:53.916 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/rc_binomial_heap_/rc.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/rc_binomial_heap_/rc.hpp' 2024-05-16T22:30:53.950 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/rc_binomial_heap_/rc_binomial_heap_.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/rc_binomial_heap_/rc_binomial_heap_.hpp' 2024-05-16T22:30:54.000 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/rc_binomial_heap_/split_join_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/rc_binomial_heap_/split_join_fn_imps.hpp' 2024-05-16T22:30:54.033 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/rc_binomial_heap_/trace_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/rc_binomial_heap_/trace_fn_imps.hpp' 2024-05-16T22:30:54.079 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/resize_policy' -> 'dir/include/c++/11/ext/pb_ds/detail/resize_policy' 2024-05-16T22:30:54.117 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/resize_policy/cc_hash_max_collision_check_resize_trigger_imp.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/resize_policy/cc_hash_max_collision_check_resize_trigger_imp.hpp' 2024-05-16T22:30:54.150 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/resize_policy/hash_exponential_size_policy_imp.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/resize_policy/hash_exponential_size_policy_imp.hpp' 2024-05-16T22:30:54.183 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/resize_policy/hash_load_check_resize_trigger_imp.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/resize_policy/hash_load_check_resize_trigger_imp.hpp' 2024-05-16T22:30:54.217 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/resize_policy/hash_load_check_resize_trigger_size_base.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/resize_policy/hash_load_check_resize_trigger_size_base.hpp' 2024-05-16T22:30:54.250 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/resize_policy/hash_prime_size_policy_imp.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/resize_policy/hash_prime_size_policy_imp.hpp' 2024-05-16T22:30:54.284 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/resize_policy/hash_standard_resize_policy_imp.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/resize_policy/hash_standard_resize_policy_imp.hpp' 2024-05-16T22:30:54.317 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/resize_policy/sample_resize_policy.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/resize_policy/sample_resize_policy.hpp' 2024-05-16T22:30:54.350 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/resize_policy/sample_resize_trigger.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/resize_policy/sample_resize_trigger.hpp' 2024-05-16T22:30:54.384 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/resize_policy/sample_size_policy.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/resize_policy/sample_size_policy.hpp' 2024-05-16T22:30:54.425 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/splay_tree_' -> 'dir/include/c++/11/ext/pb_ds/detail/splay_tree_' 2024-05-16T22:30:54.459 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/splay_tree_/constructors_destructor_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/splay_tree_/constructors_destructor_fn_imps.hpp' 2024-05-16T22:30:54.492 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/splay_tree_/debug_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/splay_tree_/debug_fn_imps.hpp' 2024-05-16T22:30:54.525 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/splay_tree_/erase_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/splay_tree_/erase_fn_imps.hpp' 2024-05-16T22:30:54.559 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/splay_tree_/find_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/splay_tree_/find_fn_imps.hpp' 2024-05-16T22:30:54.625 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/splay_tree_/info_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/splay_tree_/info_fn_imps.hpp' 2024-05-16T22:30:54.659 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/splay_tree_/insert_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/splay_tree_/insert_fn_imps.hpp' 2024-05-16T22:30:54.722 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/splay_tree_/node.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/splay_tree_/node.hpp' 2024-05-16T22:30:54.759 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/splay_tree_/splay_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/splay_tree_/splay_fn_imps.hpp' 2024-05-16T22:30:54.792 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/splay_tree_/splay_tree_.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/splay_tree_/splay_tree_.hpp' 2024-05-16T22:30:54.826 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/splay_tree_/split_join_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/splay_tree_/split_join_fn_imps.hpp' 2024-05-16T22:30:54.859 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/splay_tree_/traits.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/splay_tree_/traits.hpp' 2024-05-16T22:30:54.914 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/standard_policies.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/standard_policies.hpp' 2024-05-16T22:30:54.969 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/thin_heap_' -> 'dir/include/c++/11/ext/pb_ds/detail/thin_heap_' 2024-05-16T22:30:55.001 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/thin_heap_/constructors_destructor_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/thin_heap_/constructors_destructor_fn_imps.hpp' 2024-05-16T22:30:55.034 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/thin_heap_/debug_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/thin_heap_/debug_fn_imps.hpp' 2024-05-16T22:30:55.068 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/thin_heap_/erase_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/thin_heap_/erase_fn_imps.hpp' 2024-05-16T22:30:55.121 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/thin_heap_/find_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/thin_heap_/find_fn_imps.hpp' 2024-05-16T22:30:55.226 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/thin_heap_/insert_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/thin_heap_/insert_fn_imps.hpp' 2024-05-16T22:30:55.259 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/thin_heap_/split_join_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/thin_heap_/split_join_fn_imps.hpp' 2024-05-16T22:30:55.309 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/thin_heap_/thin_heap_.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/thin_heap_/thin_heap_.hpp' 2024-05-16T22:30:55.343 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/thin_heap_/trace_fn_imps.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/thin_heap_/trace_fn_imps.hpp' 2024-05-16T22:30:55.376 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/tree_policy' -> 'dir/include/c++/11/ext/pb_ds/detail/tree_policy' 2024-05-16T22:30:55.409 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/tree_policy/node_metadata_selector.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/tree_policy/node_metadata_selector.hpp' 2024-05-16T22:30:55.471 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/tree_policy/order_statistics_imp.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/tree_policy/order_statistics_imp.hpp' 2024-05-16T22:30:55.501 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/tree_policy/sample_tree_node_update.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/tree_policy/sample_tree_node_update.hpp' 2024-05-16T22:30:55.535 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/tree_trace_base.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/tree_trace_base.hpp' 2024-05-16T22:30:55.568 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/trie_policy' -> 'dir/include/c++/11/ext/pb_ds/detail/trie_policy' 2024-05-16T22:30:55.626 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/trie_policy/node_metadata_selector.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/trie_policy/node_metadata_selector.hpp' 2024-05-16T22:30:55.671 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/trie_policy/order_statistics_imp.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/trie_policy/order_statistics_imp.hpp' 2024-05-16T22:30:55.707 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/trie_policy/prefix_search_node_update_imp.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/trie_policy/prefix_search_node_update_imp.hpp' 2024-05-16T22:30:55.743 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/trie_policy/sample_trie_access_traits.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/trie_policy/sample_trie_access_traits.hpp' 2024-05-16T22:30:55.776 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/trie_policy/sample_trie_node_update.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/trie_policy/sample_trie_node_update.hpp' 2024-05-16T22:30:55.810 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/trie_policy/trie_policy_base.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/trie_policy/trie_policy_base.hpp' 2024-05-16T22:30:55.844 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/trie_policy/trie_string_access_traits_imp.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/trie_policy/trie_string_access_traits_imp.hpp' 2024-05-16T22:30:55.876 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/type_utils.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/type_utils.hpp' 2024-05-16T22:30:55.935 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/types_traits.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/types_traits.hpp' 2024-05-16T22:30:55.968 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/unordered_iterator' -> 'dir/include/c++/11/ext/pb_ds/detail/unordered_iterator' 2024-05-16T22:30:56.001 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/unordered_iterator/const_iterator.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/unordered_iterator/const_iterator.hpp' 2024-05-16T22:30:56.035 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/unordered_iterator/iterator.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/unordered_iterator/iterator.hpp' 2024-05-16T22:30:56.069 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/unordered_iterator/point_const_iterator.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/unordered_iterator/point_const_iterator.hpp' 2024-05-16T22:30:56.121 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/detail/unordered_iterator/point_iterator.hpp' -> 'dir/include/c++/11/ext/pb_ds/detail/unordered_iterator/point_iterator.hpp' 2024-05-16T22:30:56.152 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/exception.hpp' -> 'dir/include/c++/11/ext/pb_ds/exception.hpp' 2024-05-16T22:30:56.186 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/hash_policy.hpp' -> 'dir/include/c++/11/ext/pb_ds/hash_policy.hpp' 2024-05-16T22:30:56.219 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/list_update_policy.hpp' -> 'dir/include/c++/11/ext/pb_ds/list_update_policy.hpp' 2024-05-16T22:30:56.252 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/priority_queue.hpp' -> 'dir/include/c++/11/ext/pb_ds/priority_queue.hpp' 2024-05-16T22:30:56.286 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/tag_and_trait.hpp' -> 'dir/include/c++/11/ext/pb_ds/tag_and_trait.hpp' 2024-05-16T22:30:56.319 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/tree_policy.hpp' -> 'dir/include/c++/11/ext/pb_ds/tree_policy.hpp' 2024-05-16T22:30:56.352 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pb_ds/trie_policy.hpp' -> 'dir/include/c++/11/ext/pb_ds/trie_policy.hpp' 2024-05-16T22:30:56.386 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pod_char_traits.h' -> 'dir/include/c++/11/ext/pod_char_traits.h' 2024-05-16T22:30:56.419 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pointer.h' -> 'dir/include/c++/11/ext/pointer.h' 2024-05-16T22:30:56.452 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/pool_allocator.h' -> 'dir/include/c++/11/ext/pool_allocator.h' 2024-05-16T22:30:56.511 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/random' -> 'dir/include/c++/11/ext/random' 2024-05-16T22:30:56.544 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/random.tcc' -> 'dir/include/c++/11/ext/random.tcc' 2024-05-16T22:30:56.578 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/rb_tree' -> 'dir/include/c++/11/ext/rb_tree' 2024-05-16T22:30:56.611 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/rc_string_base.h' -> 'dir/include/c++/11/ext/rc_string_base.h' 2024-05-16T22:30:56.644 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/rope' -> 'dir/include/c++/11/ext/rope' 2024-05-16T22:30:56.678 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/ropeimpl.h' -> 'dir/include/c++/11/ext/ropeimpl.h' 2024-05-16T22:30:56.729 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/slist' -> 'dir/include/c++/11/ext/slist' 2024-05-16T22:30:56.761 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/sso_string_base.h' -> 'dir/include/c++/11/ext/sso_string_base.h' 2024-05-16T22:30:56.794 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/stdio_filebuf.h' -> 'dir/include/c++/11/ext/stdio_filebuf.h' 2024-05-16T22:30:56.828 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/stdio_sync_filebuf.h' -> 'dir/include/c++/11/ext/stdio_sync_filebuf.h' 2024-05-16T22:30:56.861 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/string_conversions.h' -> 'dir/include/c++/11/ext/string_conversions.h' 2024-05-16T22:30:56.911 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/throw_allocator.h' -> 'dir/include/c++/11/ext/throw_allocator.h' 2024-05-16T22:30:56.968 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/type_traits.h' -> 'dir/include/c++/11/ext/type_traits.h' 2024-05-16T22:30:57.003 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/typelist.h' -> 'dir/include/c++/11/ext/typelist.h' 2024-05-16T22:30:57.036 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/vstring.h' -> 'dir/include/c++/11/ext/vstring.h' 2024-05-16T22:30:57.070 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/vstring.tcc' -> 'dir/include/c++/11/ext/vstring.tcc' 2024-05-16T22:30:57.136 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/vstring_fwd.h' -> 'dir/include/c++/11/ext/vstring_fwd.h' 2024-05-16T22:30:57.170 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ext/vstring_util.h' -> 'dir/include/c++/11/ext/vstring_util.h' 2024-05-16T22:30:57.203 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/fenv.h' -> 'dir/include/c++/11/fenv.h' 2024-05-16T22:30:57.236 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/filesystem' -> 'dir/include/c++/11/filesystem' 2024-05-16T22:30:57.270 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/forward_list' -> 'dir/include/c++/11/forward_list' 2024-05-16T22:30:57.303 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/fstream' -> 'dir/include/c++/11/fstream' 2024-05-16T22:30:57.336 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/functional' -> 'dir/include/c++/11/functional' 2024-05-16T22:30:57.387 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/future' -> 'dir/include/c++/11/future' 2024-05-16T22:30:57.420 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/initializer_list' -> 'dir/include/c++/11/initializer_list' 2024-05-16T22:30:57.453 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/iomanip' -> 'dir/include/c++/11/iomanip' 2024-05-16T22:30:57.487 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ios' -> 'dir/include/c++/11/ios' 2024-05-16T22:30:57.520 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/iosfwd' -> 'dir/include/c++/11/iosfwd' 2024-05-16T22:30:57.553 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/iostream' -> 'dir/include/c++/11/iostream' 2024-05-16T22:30:57.593 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/istream' -> 'dir/include/c++/11/istream' 2024-05-16T22:30:57.628 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/iterator' -> 'dir/include/c++/11/iterator' 2024-05-16T22:30:57.662 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/latch' -> 'dir/include/c++/11/latch' 2024-05-16T22:30:57.712 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/limits' -> 'dir/include/c++/11/limits' 2024-05-16T22:30:57.745 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/list' -> 'dir/include/c++/11/list' 2024-05-16T22:30:57.779 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/locale' -> 'dir/include/c++/11/locale' 2024-05-16T22:30:57.812 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/map' -> 'dir/include/c++/11/map' 2024-05-16T22:30:57.845 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/math.h' -> 'dir/include/c++/11/math.h' 2024-05-16T22:30:57.879 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/memory' -> 'dir/include/c++/11/memory' 2024-05-16T22:30:57.912 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/memory_resource' -> 'dir/include/c++/11/memory_resource' 2024-05-16T22:30:57.945 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/mutex' -> 'dir/include/c++/11/mutex' 2024-05-16T22:30:58.003 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/new' -> 'dir/include/c++/11/new' 2024-05-16T22:30:58.037 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/numbers' -> 'dir/include/c++/11/numbers' 2024-05-16T22:30:58.070 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/numeric' -> 'dir/include/c++/11/numeric' 2024-05-16T22:30:58.104 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/optional' -> 'dir/include/c++/11/optional' 2024-05-16T22:30:58.137 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ostream' -> 'dir/include/c++/11/ostream' 2024-05-16T22:30:58.171 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/parallel' -> 'dir/include/c++/11/parallel' 2024-05-16T22:30:58.248 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/parallel/algo.h' -> 'dir/include/c++/11/parallel/algo.h' 2024-05-16T22:30:58.279 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/parallel/algobase.h' -> 'dir/include/c++/11/parallel/algobase.h' 2024-05-16T22:30:58.337 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/parallel/algorithm' -> 'dir/include/c++/11/parallel/algorithm' 2024-05-16T22:30:58.371 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/parallel/algorithmfwd.h' -> 'dir/include/c++/11/parallel/algorithmfwd.h' 2024-05-16T22:30:58.411 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/parallel/balanced_quicksort.h' -> 'dir/include/c++/11/parallel/balanced_quicksort.h' 2024-05-16T22:30:58.446 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/parallel/base.h' -> 'dir/include/c++/11/parallel/base.h' 2024-05-16T22:30:58.479 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/parallel/basic_iterator.h' -> 'dir/include/c++/11/parallel/basic_iterator.h' 2024-05-16T22:30:58.512 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/parallel/checkers.h' -> 'dir/include/c++/11/parallel/checkers.h' 2024-05-16T22:30:58.546 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/parallel/compatibility.h' -> 'dir/include/c++/11/parallel/compatibility.h' 2024-05-16T22:30:58.579 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/parallel/compiletime_settings.h' -> 'dir/include/c++/11/parallel/compiletime_settings.h' 2024-05-16T22:30:58.613 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/parallel/equally_split.h' -> 'dir/include/c++/11/parallel/equally_split.h' 2024-05-16T22:30:58.670 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/parallel/features.h' -> 'dir/include/c++/11/parallel/features.h' 2024-05-16T22:30:58.704 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/parallel/find.h' -> 'dir/include/c++/11/parallel/find.h' 2024-05-16T22:30:58.738 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/parallel/find_selectors.h' -> 'dir/include/c++/11/parallel/find_selectors.h' 2024-05-16T22:30:58.771 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/parallel/for_each.h' -> 'dir/include/c++/11/parallel/for_each.h' 2024-05-16T22:30:58.804 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/parallel/for_each_selectors.h' -> 'dir/include/c++/11/parallel/for_each_selectors.h' 2024-05-16T22:30:58.838 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/parallel/iterator.h' -> 'dir/include/c++/11/parallel/iterator.h' 2024-05-16T22:30:58.879 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/parallel/list_partition.h' -> 'dir/include/c++/11/parallel/list_partition.h' 2024-05-16T22:30:58.938 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/parallel/losertree.h' -> 'dir/include/c++/11/parallel/losertree.h' 2024-05-16T22:30:58.971 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/parallel/merge.h' -> 'dir/include/c++/11/parallel/merge.h' 2024-05-16T22:30:59.005 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/parallel/multiseq_selection.h' -> 'dir/include/c++/11/parallel/multiseq_selection.h' 2024-05-16T22:30:59.038 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/parallel/multiway_merge.h' -> 'dir/include/c++/11/parallel/multiway_merge.h' 2024-05-16T22:30:59.071 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/parallel/multiway_mergesort.h' -> 'dir/include/c++/11/parallel/multiway_mergesort.h' 2024-05-16T22:30:59.105 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/parallel/numeric' -> 'dir/include/c++/11/parallel/numeric' 2024-05-16T22:30:59.138 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/parallel/numericfwd.h' -> 'dir/include/c++/11/parallel/numericfwd.h' 2024-05-16T22:30:59.171 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/parallel/omp_loop.h' -> 'dir/include/c++/11/parallel/omp_loop.h' 2024-05-16T22:30:59.205 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/parallel/omp_loop_static.h' -> 'dir/include/c++/11/parallel/omp_loop_static.h' 2024-05-16T22:30:59.238 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/parallel/par_loop.h' -> 'dir/include/c++/11/parallel/par_loop.h' 2024-05-16T22:30:59.271 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/parallel/parallel.h' -> 'dir/include/c++/11/parallel/parallel.h' 2024-05-16T22:30:59.305 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/parallel/partial_sum.h' -> 'dir/include/c++/11/parallel/partial_sum.h' 2024-05-16T22:30:59.338 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/parallel/partition.h' -> 'dir/include/c++/11/parallel/partition.h' 2024-05-16T22:30:59.371 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/parallel/queue.h' -> 'dir/include/c++/11/parallel/queue.h' 2024-05-16T22:30:59.405 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/parallel/quicksort.h' -> 'dir/include/c++/11/parallel/quicksort.h' 2024-05-16T22:30:59.438 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/parallel/random_number.h' -> 'dir/include/c++/11/parallel/random_number.h' 2024-05-16T22:30:59.505 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/parallel/random_shuffle.h' -> 'dir/include/c++/11/parallel/random_shuffle.h' 2024-05-16T22:30:59.538 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/parallel/search.h' -> 'dir/include/c++/11/parallel/search.h' 2024-05-16T22:30:59.622 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/parallel/set_operations.h' -> 'dir/include/c++/11/parallel/set_operations.h' 2024-05-16T22:30:59.655 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/parallel/settings.h' -> 'dir/include/c++/11/parallel/settings.h' 2024-05-16T22:30:59.689 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/parallel/sort.h' -> 'dir/include/c++/11/parallel/sort.h' 2024-05-16T22:30:59.722 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/parallel/tags.h' -> 'dir/include/c++/11/parallel/tags.h' 2024-05-16T22:30:59.755 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/parallel/types.h' -> 'dir/include/c++/11/parallel/types.h' 2024-05-16T22:30:59.789 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/parallel/unique_copy.h' -> 'dir/include/c++/11/parallel/unique_copy.h' 2024-05-16T22:30:59.822 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/parallel/workstealing.h' -> 'dir/include/c++/11/parallel/workstealing.h' 2024-05-16T22:30:59.855 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/pstl' -> 'dir/include/c++/11/pstl' 2024-05-16T22:30:59.889 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/pstl/algorithm_fwd.h' -> 'dir/include/c++/11/pstl/algorithm_fwd.h' 2024-05-16T22:30:59.945 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/pstl/algorithm_impl.h' -> 'dir/include/c++/11/pstl/algorithm_impl.h' 2024-05-16T22:30:59.980 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/pstl/execution_defs.h' -> 'dir/include/c++/11/pstl/execution_defs.h' 2024-05-16T22:31:00.014 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/pstl/execution_impl.h' -> 'dir/include/c++/11/pstl/execution_impl.h' 2024-05-16T22:31:00.047 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/pstl/glue_algorithm_defs.h' -> 'dir/include/c++/11/pstl/glue_algorithm_defs.h' 2024-05-16T22:31:00.080 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/pstl/glue_algorithm_impl.h' -> 'dir/include/c++/11/pstl/glue_algorithm_impl.h' 2024-05-16T22:31:00.131 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/pstl/glue_execution_defs.h' -> 'dir/include/c++/11/pstl/glue_execution_defs.h' 2024-05-16T22:31:00.166 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/pstl/glue_memory_defs.h' -> 'dir/include/c++/11/pstl/glue_memory_defs.h' 2024-05-16T22:31:00.197 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/pstl/glue_memory_impl.h' -> 'dir/include/c++/11/pstl/glue_memory_impl.h' 2024-05-16T22:31:00.231 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/pstl/glue_numeric_defs.h' -> 'dir/include/c++/11/pstl/glue_numeric_defs.h' 2024-05-16T22:31:00.264 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/pstl/glue_numeric_impl.h' -> 'dir/include/c++/11/pstl/glue_numeric_impl.h' 2024-05-16T22:31:00.310 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/pstl/memory_impl.h' -> 'dir/include/c++/11/pstl/memory_impl.h' 2024-05-16T22:31:00.348 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/pstl/numeric_fwd.h' -> 'dir/include/c++/11/pstl/numeric_fwd.h' 2024-05-16T22:31:00.381 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/pstl/numeric_impl.h' -> 'dir/include/c++/11/pstl/numeric_impl.h' 2024-05-16T22:31:00.414 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/pstl/parallel_backend.h' -> 'dir/include/c++/11/pstl/parallel_backend.h' 2024-05-16T22:31:00.448 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/pstl/parallel_backend_serial.h' -> 'dir/include/c++/11/pstl/parallel_backend_serial.h' 2024-05-16T22:31:00.481 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/pstl/parallel_backend_tbb.h' -> 'dir/include/c++/11/pstl/parallel_backend_tbb.h' 2024-05-16T22:31:00.514 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/pstl/parallel_backend_utils.h' -> 'dir/include/c++/11/pstl/parallel_backend_utils.h' 2024-05-16T22:31:00.548 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/pstl/parallel_impl.h' -> 'dir/include/c++/11/pstl/parallel_impl.h' 2024-05-16T22:31:00.581 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/pstl/pstl_config.h' -> 'dir/include/c++/11/pstl/pstl_config.h' 2024-05-16T22:31:00.614 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/pstl/unseq_backend_simd.h' -> 'dir/include/c++/11/pstl/unseq_backend_simd.h' 2024-05-16T22:31:00.648 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/pstl/utils.h' -> 'dir/include/c++/11/pstl/utils.h' 2024-05-16T22:31:00.698 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/queue' -> 'dir/include/c++/11/queue' 2024-05-16T22:31:00.731 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/random' -> 'dir/include/c++/11/random' 2024-05-16T22:31:00.765 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ranges' -> 'dir/include/c++/11/ranges' 2024-05-16T22:31:00.798 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/ratio' -> 'dir/include/c++/11/ratio' 2024-05-16T22:31:00.830 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/regex' -> 'dir/include/c++/11/regex' 2024-05-16T22:31:00.863 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/scoped_allocator' -> 'dir/include/c++/11/scoped_allocator' 2024-05-16T22:31:00.896 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/semaphore' -> 'dir/include/c++/11/semaphore' 2024-05-16T22:31:00.930 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/set' -> 'dir/include/c++/11/set' 2024-05-16T22:31:00.963 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/shared_mutex' -> 'dir/include/c++/11/shared_mutex' 2024-05-16T22:31:00.996 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/source_location' -> 'dir/include/c++/11/source_location' 2024-05-16T22:31:01.030 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/span' -> 'dir/include/c++/11/span' 2024-05-16T22:31:01.063 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/sstream' -> 'dir/include/c++/11/sstream' 2024-05-16T22:31:01.097 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/stack' -> 'dir/include/c++/11/stack' 2024-05-16T22:31:01.161 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/stdexcept' -> 'dir/include/c++/11/stdexcept' 2024-05-16T22:31:01.197 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/stdlib.h' -> 'dir/include/c++/11/stdlib.h' 2024-05-16T22:31:01.230 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/stop_token' -> 'dir/include/c++/11/stop_token' 2024-05-16T22:31:01.288 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/streambuf' -> 'dir/include/c++/11/streambuf' 2024-05-16T22:31:01.322 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/string' -> 'dir/include/c++/11/string' 2024-05-16T22:31:01.355 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/string_view' -> 'dir/include/c++/11/string_view' 2024-05-16T22:31:01.388 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/syncstream' -> 'dir/include/c++/11/syncstream' 2024-05-16T22:31:01.422 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/system_error' -> 'dir/include/c++/11/system_error' 2024-05-16T22:31:01.455 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tgmath.h' -> 'dir/include/c++/11/tgmath.h' 2024-05-16T22:31:01.488 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/thread' -> 'dir/include/c++/11/thread' 2024-05-16T22:31:01.522 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1' -> 'dir/include/c++/11/tr1' 2024-05-16T22:31:01.555 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/array' -> 'dir/include/c++/11/tr1/array' 2024-05-16T22:31:01.589 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/bessel_function.tcc' -> 'dir/include/c++/11/tr1/bessel_function.tcc' 2024-05-16T22:31:01.622 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/beta_function.tcc' -> 'dir/include/c++/11/tr1/beta_function.tcc' 2024-05-16T22:31:01.672 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/ccomplex' -> 'dir/include/c++/11/tr1/ccomplex' 2024-05-16T22:31:01.705 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/cctype' -> 'dir/include/c++/11/tr1/cctype' 2024-05-16T22:31:01.739 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/cfenv' -> 'dir/include/c++/11/tr1/cfenv' 2024-05-16T22:31:01.794 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/cfloat' -> 'dir/include/c++/11/tr1/cfloat' 2024-05-16T22:31:01.831 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/cinttypes' -> 'dir/include/c++/11/tr1/cinttypes' 2024-05-16T22:31:01.897 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/climits' -> 'dir/include/c++/11/tr1/climits' 2024-05-16T22:31:01.931 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/cmath' -> 'dir/include/c++/11/tr1/cmath' 2024-05-16T22:31:01.964 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/complex' -> 'dir/include/c++/11/tr1/complex' 2024-05-16T22:31:01.997 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/complex.h' -> 'dir/include/c++/11/tr1/complex.h' 2024-05-16T22:31:02.031 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/cstdarg' -> 'dir/include/c++/11/tr1/cstdarg' 2024-05-16T22:31:02.064 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/cstdbool' -> 'dir/include/c++/11/tr1/cstdbool' 2024-05-16T22:31:02.098 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/cstdint' -> 'dir/include/c++/11/tr1/cstdint' 2024-05-16T22:31:02.131 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/cstdio' -> 'dir/include/c++/11/tr1/cstdio' 2024-05-16T22:31:02.164 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/cstdlib' -> 'dir/include/c++/11/tr1/cstdlib' 2024-05-16T22:31:02.198 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/ctgmath' -> 'dir/include/c++/11/tr1/ctgmath' 2024-05-16T22:31:02.231 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/ctime' -> 'dir/include/c++/11/tr1/ctime' 2024-05-16T22:31:02.264 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/ctype.h' -> 'dir/include/c++/11/tr1/ctype.h' 2024-05-16T22:31:02.298 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/cwchar' -> 'dir/include/c++/11/tr1/cwchar' 2024-05-16T22:31:02.331 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/cwctype' -> 'dir/include/c++/11/tr1/cwctype' 2024-05-16T22:31:02.365 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/ell_integral.tcc' -> 'dir/include/c++/11/tr1/ell_integral.tcc' 2024-05-16T22:31:02.419 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/exp_integral.tcc' -> 'dir/include/c++/11/tr1/exp_integral.tcc' 2024-05-16T22:31:02.464 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/fenv.h' -> 'dir/include/c++/11/tr1/fenv.h' 2024-05-16T22:31:02.498 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/float.h' -> 'dir/include/c++/11/tr1/float.h' 2024-05-16T22:31:02.531 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/functional' -> 'dir/include/c++/11/tr1/functional' 2024-05-16T22:31:02.565 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/functional_hash.h' -> 'dir/include/c++/11/tr1/functional_hash.h' 2024-05-16T22:31:02.598 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/gamma.tcc' -> 'dir/include/c++/11/tr1/gamma.tcc' 2024-05-16T22:31:02.631 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/hashtable.h' -> 'dir/include/c++/11/tr1/hashtable.h' 2024-05-16T22:31:02.665 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/hashtable_policy.h' -> 'dir/include/c++/11/tr1/hashtable_policy.h' 2024-05-16T22:31:02.698 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/hypergeometric.tcc' -> 'dir/include/c++/11/tr1/hypergeometric.tcc' 2024-05-16T22:31:02.731 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/inttypes.h' -> 'dir/include/c++/11/tr1/inttypes.h' 2024-05-16T22:31:02.765 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/legendre_function.tcc' -> 'dir/include/c++/11/tr1/legendre_function.tcc' 2024-05-16T22:31:02.798 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/limits.h' -> 'dir/include/c++/11/tr1/limits.h' 2024-05-16T22:31:02.832 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/math.h' -> 'dir/include/c++/11/tr1/math.h' 2024-05-16T22:31:02.881 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/memory' -> 'dir/include/c++/11/tr1/memory' 2024-05-16T22:31:02.915 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/modified_bessel_func.tcc' -> 'dir/include/c++/11/tr1/modified_bessel_func.tcc' 2024-05-16T22:31:02.948 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/poly_hermite.tcc' -> 'dir/include/c++/11/tr1/poly_hermite.tcc' 2024-05-16T22:31:02.982 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/poly_laguerre.tcc' -> 'dir/include/c++/11/tr1/poly_laguerre.tcc' 2024-05-16T22:31:03.040 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/random' -> 'dir/include/c++/11/tr1/random' 2024-05-16T22:31:03.073 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/random.h' -> 'dir/include/c++/11/tr1/random.h' 2024-05-16T22:31:03.107 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/random.tcc' -> 'dir/include/c++/11/tr1/random.tcc' 2024-05-16T22:31:03.140 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/regex' -> 'dir/include/c++/11/tr1/regex' 2024-05-16T22:31:03.173 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/riemann_zeta.tcc' -> 'dir/include/c++/11/tr1/riemann_zeta.tcc' 2024-05-16T22:31:03.207 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/shared_ptr.h' -> 'dir/include/c++/11/tr1/shared_ptr.h' 2024-05-16T22:31:03.240 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/special_function_util.h' -> 'dir/include/c++/11/tr1/special_function_util.h' 2024-05-16T22:31:03.273 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/stdarg.h' -> 'dir/include/c++/11/tr1/stdarg.h' 2024-05-16T22:31:03.307 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/stdbool.h' -> 'dir/include/c++/11/tr1/stdbool.h' 2024-05-16T22:31:03.340 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/stdint.h' -> 'dir/include/c++/11/tr1/stdint.h' 2024-05-16T22:31:03.374 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/stdio.h' -> 'dir/include/c++/11/tr1/stdio.h' 2024-05-16T22:31:03.407 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/stdlib.h' -> 'dir/include/c++/11/tr1/stdlib.h' 2024-05-16T22:31:03.441 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/tgmath.h' -> 'dir/include/c++/11/tr1/tgmath.h' 2024-05-16T22:31:03.474 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/tuple' -> 'dir/include/c++/11/tr1/tuple' 2024-05-16T22:31:03.507 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/type_traits' -> 'dir/include/c++/11/tr1/type_traits' 2024-05-16T22:31:03.541 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/unordered_map' -> 'dir/include/c++/11/tr1/unordered_map' 2024-05-16T22:31:03.608 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/unordered_map.h' -> 'dir/include/c++/11/tr1/unordered_map.h' 2024-05-16T22:31:03.641 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/unordered_set' -> 'dir/include/c++/11/tr1/unordered_set' 2024-05-16T22:31:03.694 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/unordered_set.h' -> 'dir/include/c++/11/tr1/unordered_set.h' 2024-05-16T22:31:03.724 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/utility' -> 'dir/include/c++/11/tr1/utility' 2024-05-16T22:31:03.758 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/wchar.h' -> 'dir/include/c++/11/tr1/wchar.h' 2024-05-16T22:31:03.791 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr1/wctype.h' -> 'dir/include/c++/11/tr1/wctype.h' 2024-05-16T22:31:03.824 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr2' -> 'dir/include/c++/11/tr2' 2024-05-16T22:31:03.858 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr2/bool_set' -> 'dir/include/c++/11/tr2/bool_set' 2024-05-16T22:31:03.891 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr2/bool_set.tcc' -> 'dir/include/c++/11/tr2/bool_set.tcc' 2024-05-16T22:31:03.924 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr2/dynamic_bitset' -> 'dir/include/c++/11/tr2/dynamic_bitset' 2024-05-16T22:31:03.958 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr2/dynamic_bitset.tcc' -> 'dir/include/c++/11/tr2/dynamic_bitset.tcc' 2024-05-16T22:31:03.991 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr2/ratio' -> 'dir/include/c++/11/tr2/ratio' 2024-05-16T22:31:04.025 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tr2/type_traits' -> 'dir/include/c++/11/tr2/type_traits' 2024-05-16T22:31:04.058 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/tuple' -> 'dir/include/c++/11/tuple' 2024-05-16T22:31:04.091 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/type_traits' -> 'dir/include/c++/11/type_traits' 2024-05-16T22:31:04.125 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/typeindex' -> 'dir/include/c++/11/typeindex' 2024-05-16T22:31:04.183 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/typeinfo' -> 'dir/include/c++/11/typeinfo' 2024-05-16T22:31:04.217 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/unordered_map' -> 'dir/include/c++/11/unordered_map' 2024-05-16T22:31:04.269 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/unordered_set' -> 'dir/include/c++/11/unordered_set' 2024-05-16T22:31:04.300 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/utility' -> 'dir/include/c++/11/utility' 2024-05-16T22:31:04.333 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/valarray' -> 'dir/include/c++/11/valarray' 2024-05-16T22:31:04.367 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/variant' -> 'dir/include/c++/11/variant' 2024-05-16T22:31:04.400 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/vector' -> 'dir/include/c++/11/vector' 2024-05-16T22:31:04.436 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/version' -> 'dir/include/c++/11/version' 2024-05-16T22:31:04.489 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux' -> 'dir/include/c++/11/x86_64-redhat-linux' 2024-05-16T22:31:04.525 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32' -> 'dir/include/c++/11/x86_64-redhat-linux/32' 2024-05-16T22:31:04.558 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/bits' -> 'dir/include/c++/11/x86_64-redhat-linux/32/bits' 2024-05-16T22:31:04.592 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/bits/atomic_word.h' -> 'dir/include/c++/11/x86_64-redhat-linux/32/bits/atomic_word.h' 2024-05-16T22:31:04.634 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/bits/basic_file.h' -> 'dir/include/c++/11/x86_64-redhat-linux/32/bits/basic_file.h' 2024-05-16T22:31:04.667 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/bits/c++allocator.h' -> 'dir/include/c++/11/x86_64-redhat-linux/32/bits/c++allocator.h' 2024-05-16T22:31:04.768 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/bits/c++config.h' -> 'dir/include/c++/11/x86_64-redhat-linux/32/bits/c++config.h' 2024-05-16T22:31:04.800 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/bits/c++io.h' -> 'dir/include/c++/11/x86_64-redhat-linux/32/bits/c++io.h' 2024-05-16T22:31:04.850 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/bits/c++locale.h' -> 'dir/include/c++/11/x86_64-redhat-linux/32/bits/c++locale.h' 2024-05-16T22:31:04.884 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/bits/cpu_defines.h' -> 'dir/include/c++/11/x86_64-redhat-linux/32/bits/cpu_defines.h' 2024-05-16T22:31:04.917 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/bits/ctype_base.h' -> 'dir/include/c++/11/x86_64-redhat-linux/32/bits/ctype_base.h' 2024-05-16T22:31:04.950 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/bits/ctype_inline.h' -> 'dir/include/c++/11/x86_64-redhat-linux/32/bits/ctype_inline.h' 2024-05-16T22:31:04.988 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/bits/cxxabi_tweaks.h' -> 'dir/include/c++/11/x86_64-redhat-linux/32/bits/cxxabi_tweaks.h' 2024-05-16T22:31:05.017 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/bits/error_constants.h' -> 'dir/include/c++/11/x86_64-redhat-linux/32/bits/error_constants.h' 2024-05-16T22:31:05.051 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/bits/extc++.h' -> 'dir/include/c++/11/x86_64-redhat-linux/32/bits/extc++.h' 2024-05-16T22:31:05.084 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/bits/gthr-default.h' -> 'dir/include/c++/11/x86_64-redhat-linux/32/bits/gthr-default.h' 2024-05-16T22:31:05.117 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/bits/gthr-posix.h' -> 'dir/include/c++/11/x86_64-redhat-linux/32/bits/gthr-posix.h' 2024-05-16T22:31:05.167 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/bits/gthr-single.h' -> 'dir/include/c++/11/x86_64-redhat-linux/32/bits/gthr-single.h' 2024-05-16T22:31:05.201 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/bits/gthr.h' -> 'dir/include/c++/11/x86_64-redhat-linux/32/bits/gthr.h' 2024-05-16T22:31:05.234 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/bits/messages_members.h' -> 'dir/include/c++/11/x86_64-redhat-linux/32/bits/messages_members.h' 2024-05-16T22:31:05.267 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/bits/opt_random.h' -> 'dir/include/c++/11/x86_64-redhat-linux/32/bits/opt_random.h' 2024-05-16T22:31:05.301 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/bits/os_defines.h' -> 'dir/include/c++/11/x86_64-redhat-linux/32/bits/os_defines.h' 2024-05-16T22:31:05.334 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/bits/stdc++.h' -> 'dir/include/c++/11/x86_64-redhat-linux/32/bits/stdc++.h' 2024-05-16T22:31:05.367 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/bits/stdtr1c++.h' -> 'dir/include/c++/11/x86_64-redhat-linux/32/bits/stdtr1c++.h' 2024-05-16T22:31:05.451 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/bits/time_members.h' -> 'dir/include/c++/11/x86_64-redhat-linux/32/bits/time_members.h' 2024-05-16T22:31:05.484 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/ext' -> 'dir/include/c++/11/x86_64-redhat-linux/32/ext' 2024-05-16T22:31:05.518 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/32/ext/opt_random.h' -> 'dir/include/c++/11/x86_64-redhat-linux/32/ext/opt_random.h' 2024-05-16T22:31:05.551 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/bits' -> 'dir/include/c++/11/x86_64-redhat-linux/bits' 2024-05-16T22:31:05.604 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/bits/atomic_word.h' -> 'dir/include/c++/11/x86_64-redhat-linux/bits/atomic_word.h' 2024-05-16T22:31:05.635 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/bits/basic_file.h' -> 'dir/include/c++/11/x86_64-redhat-linux/bits/basic_file.h' 2024-05-16T22:31:05.668 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/bits/c++allocator.h' -> 'dir/include/c++/11/x86_64-redhat-linux/bits/c++allocator.h' 2024-05-16T22:31:05.701 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/bits/c++config.h' -> 'dir/include/c++/11/x86_64-redhat-linux/bits/c++config.h' 2024-05-16T22:31:05.735 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/bits/c++io.h' -> 'dir/include/c++/11/x86_64-redhat-linux/bits/c++io.h' 2024-05-16T22:31:05.768 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/bits/c++locale.h' -> 'dir/include/c++/11/x86_64-redhat-linux/bits/c++locale.h' 2024-05-16T22:31:05.801 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/bits/cpu_defines.h' -> 'dir/include/c++/11/x86_64-redhat-linux/bits/cpu_defines.h' 2024-05-16T22:31:05.834 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/bits/ctype_base.h' -> 'dir/include/c++/11/x86_64-redhat-linux/bits/ctype_base.h' 2024-05-16T22:31:05.868 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/bits/ctype_inline.h' -> 'dir/include/c++/11/x86_64-redhat-linux/bits/ctype_inline.h' 2024-05-16T22:31:05.901 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/bits/cxxabi_tweaks.h' -> 'dir/include/c++/11/x86_64-redhat-linux/bits/cxxabi_tweaks.h' 2024-05-16T22:31:05.935 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/bits/error_constants.h' -> 'dir/include/c++/11/x86_64-redhat-linux/bits/error_constants.h' 2024-05-16T22:31:05.968 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/bits/extc++.h' -> 'dir/include/c++/11/x86_64-redhat-linux/bits/extc++.h' 2024-05-16T22:31:06.026 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/bits/gthr-default.h' -> 'dir/include/c++/11/x86_64-redhat-linux/bits/gthr-default.h' 2024-05-16T22:31:06.060 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/bits/gthr-posix.h' -> 'dir/include/c++/11/x86_64-redhat-linux/bits/gthr-posix.h' 2024-05-16T22:31:06.093 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/bits/gthr-single.h' -> 'dir/include/c++/11/x86_64-redhat-linux/bits/gthr-single.h' 2024-05-16T22:31:06.127 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/bits/gthr.h' -> 'dir/include/c++/11/x86_64-redhat-linux/bits/gthr.h' 2024-05-16T22:31:06.160 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/bits/messages_members.h' -> 'dir/include/c++/11/x86_64-redhat-linux/bits/messages_members.h' 2024-05-16T22:31:06.220 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/bits/opt_random.h' -> 'dir/include/c++/11/x86_64-redhat-linux/bits/opt_random.h' 2024-05-16T22:31:06.252 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/bits/os_defines.h' -> 'dir/include/c++/11/x86_64-redhat-linux/bits/os_defines.h' 2024-05-16T22:31:06.285 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/bits/stdc++.h' -> 'dir/include/c++/11/x86_64-redhat-linux/bits/stdc++.h' 2024-05-16T22:31:06.318 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/bits/stdtr1c++.h' -> 'dir/include/c++/11/x86_64-redhat-linux/bits/stdtr1c++.h' 2024-05-16T22:31:06.352 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/bits/time_members.h' -> 'dir/include/c++/11/x86_64-redhat-linux/bits/time_members.h' 2024-05-16T22:31:06.385 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/ext' -> 'dir/include/c++/11/x86_64-redhat-linux/ext' 2024-05-16T22:31:06.418 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/c++/11/x86_64-redhat-linux/ext/opt_random.h' -> 'dir/include/c++/11/x86_64-redhat-linux/ext/opt_random.h' 2024-05-16T22:31:06.460 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/lualib.h' -> 'dir/include/lualib.h' 2024-05-16T22:31:06.493 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/arpa' -> 'dir/include/arpa' 2024-05-16T22:31:06.527 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/arpa/ftp.h' -> 'dir/include/arpa/ftp.h' 2024-05-16T22:31:06.560 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/arpa/inet.h' -> 'dir/include/arpa/inet.h' 2024-05-16T22:31:06.610 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/arpa/nameser.h' -> 'dir/include/arpa/nameser.h' 2024-05-16T22:31:06.644 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/arpa/nameser_compat.h' -> 'dir/include/arpa/nameser_compat.h' 2024-05-16T22:31:06.677 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/arpa/telnet.h' -> 'dir/include/arpa/telnet.h' 2024-05-16T22:31:06.710 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/arpa/tftp.h' -> 'dir/include/arpa/tftp.h' 2024-05-16T22:31:06.744 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits' -> 'dir/include/bits' 2024-05-16T22:31:06.777 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/a.out.h' -> 'dir/include/bits/a.out.h' 2024-05-16T22:31:06.828 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/argp-ldbl.h' -> 'dir/include/bits/argp-ldbl.h' 2024-05-16T22:31:06.860 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/byteswap.h' -> 'dir/include/bits/byteswap.h' 2024-05-16T22:31:06.894 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/cmathcalls.h' -> 'dir/include/bits/cmathcalls.h' 2024-05-16T22:31:06.929 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/confname.h' -> 'dir/include/bits/confname.h' 2024-05-16T22:31:06.961 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/cpu-set.h' -> 'dir/include/bits/cpu-set.h' 2024-05-16T22:31:06.994 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/dirent.h' -> 'dir/include/bits/dirent.h' 2024-05-16T22:31:07.028 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/dirent_ext.h' -> 'dir/include/bits/dirent_ext.h' 2024-05-16T22:31:07.061 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/dlfcn.h' -> 'dir/include/bits/dlfcn.h' 2024-05-16T22:31:07.094 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/elfclass.h' -> 'dir/include/bits/elfclass.h' 2024-05-16T22:31:07.128 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/endian.h' -> 'dir/include/bits/endian.h' 2024-05-16T22:31:07.194 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/endianness.h' -> 'dir/include/bits/endianness.h' 2024-05-16T22:31:07.228 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/environments.h' -> 'dir/include/bits/environments.h' 2024-05-16T22:31:07.261 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/epoll.h' -> 'dir/include/bits/epoll.h' 2024-05-16T22:31:07.294 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/err-ldbl.h' -> 'dir/include/bits/err-ldbl.h' 2024-05-16T22:31:07.344 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/errno.h' -> 'dir/include/bits/errno.h' 2024-05-16T22:31:07.378 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/error-ldbl.h' -> 'dir/include/bits/error-ldbl.h' 2024-05-16T22:31:07.411 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/error.h' -> 'dir/include/bits/error.h' 2024-05-16T22:31:07.487 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/eventfd.h' -> 'dir/include/bits/eventfd.h' 2024-05-16T22:31:07.519 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/fcntl-linux.h' -> 'dir/include/bits/fcntl-linux.h' 2024-05-16T22:31:07.553 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/fcntl.h' -> 'dir/include/bits/fcntl.h' 2024-05-16T22:31:07.586 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/fcntl2.h' -> 'dir/include/bits/fcntl2.h' 2024-05-16T22:31:07.619 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/fenv.h' -> 'dir/include/bits/fenv.h' 2024-05-16T22:31:07.653 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/floatn-common.h' -> 'dir/include/bits/floatn-common.h' 2024-05-16T22:31:07.686 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/floatn.h' -> 'dir/include/bits/floatn.h' 2024-05-16T22:31:07.719 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/flt-eval-method.h' -> 'dir/include/bits/flt-eval-method.h' 2024-05-16T22:31:07.753 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/fp-fast.h' -> 'dir/include/bits/fp-fast.h' 2024-05-16T22:31:07.820 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/fp-logb.h' -> 'dir/include/bits/fp-logb.h' 2024-05-16T22:31:07.853 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/getopt_core.h' -> 'dir/include/bits/getopt_core.h' 2024-05-16T22:31:07.886 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/getopt_ext.h' -> 'dir/include/bits/getopt_ext.h' 2024-05-16T22:31:07.920 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/getopt_posix.h' -> 'dir/include/bits/getopt_posix.h' 2024-05-16T22:31:07.953 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/hwcap.h' -> 'dir/include/bits/hwcap.h' 2024-05-16T22:31:07.986 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/in.h' -> 'dir/include/bits/in.h' 2024-05-16T22:31:08.020 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/indirect-return.h' -> 'dir/include/bits/indirect-return.h' 2024-05-16T22:31:08.053 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/initspin.h' -> 'dir/include/bits/initspin.h' 2024-05-16T22:31:08.103 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/inotify.h' -> 'dir/include/bits/inotify.h' 2024-05-16T22:31:08.137 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/ioctl-types.h' -> 'dir/include/bits/ioctl-types.h' 2024-05-16T22:31:08.203 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/ioctls.h' -> 'dir/include/bits/ioctls.h' 2024-05-16T22:31:08.237 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/ipc-perm.h' -> 'dir/include/bits/ipc-perm.h' 2024-05-16T22:31:08.270 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/ipc.h' -> 'dir/include/bits/ipc.h' 2024-05-16T22:31:08.303 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/ipctypes.h' -> 'dir/include/bits/ipctypes.h' 2024-05-16T22:31:08.337 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/iscanonical.h' -> 'dir/include/bits/iscanonical.h' 2024-05-16T22:31:08.370 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/libc-header-start.h' -> 'dir/include/bits/libc-header-start.h' 2024-05-16T22:31:08.428 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/libm-simd-decl-stubs.h' -> 'dir/include/bits/libm-simd-decl-stubs.h' 2024-05-16T22:31:08.462 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/link.h' -> 'dir/include/bits/link.h' 2024-05-16T22:31:08.495 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/link_lavcurrent.h' -> 'dir/include/bits/link_lavcurrent.h' 2024-05-16T22:31:08.529 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/local_lim.h' -> 'dir/include/bits/local_lim.h' 2024-05-16T22:31:08.562 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/locale.h' -> 'dir/include/bits/locale.h' 2024-05-16T22:31:08.595 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/long-double.h' -> 'dir/include/bits/long-double.h' 2024-05-16T22:31:08.629 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/math-vector.h' -> 'dir/include/bits/math-vector.h' 2024-05-16T22:31:08.662 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/mathcalls-helper-functions.h' -> 'dir/include/bits/mathcalls-helper-functions.h' 2024-05-16T22:31:08.695 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/mathcalls-narrow.h' -> 'dir/include/bits/mathcalls-narrow.h' 2024-05-16T22:31:08.761 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/mathcalls.h' -> 'dir/include/bits/mathcalls.h' 2024-05-16T22:31:08.795 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/mathdef.h' -> 'dir/include/bits/mathdef.h' 2024-05-16T22:31:08.829 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/mman-linux.h' -> 'dir/include/bits/mman-linux.h' 2024-05-16T22:31:08.862 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/mman-map-flags-generic.h' -> 'dir/include/bits/mman-map-flags-generic.h' 2024-05-16T22:31:08.896 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/mman-shared.h' -> 'dir/include/bits/mman-shared.h' 2024-05-16T22:31:08.929 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/mman.h' -> 'dir/include/bits/mman.h' 2024-05-16T22:31:08.969 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/monetary-ldbl.h' -> 'dir/include/bits/monetary-ldbl.h' 2024-05-16T22:31:09.037 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/mqueue.h' -> 'dir/include/bits/mqueue.h' 2024-05-16T22:31:09.071 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/mqueue2.h' -> 'dir/include/bits/mqueue2.h' 2024-05-16T22:31:09.104 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/msq.h' -> 'dir/include/bits/msq.h' 2024-05-16T22:31:09.145 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/netdb.h' -> 'dir/include/bits/netdb.h' 2024-05-16T22:31:09.179 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/param.h' -> 'dir/include/bits/param.h' 2024-05-16T22:31:09.212 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/platform' -> 'dir/include/bits/platform' 2024-05-16T22:31:09.246 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/platform/x86.h' -> 'dir/include/bits/platform/x86.h' 2024-05-16T22:31:09.279 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/poll.h' -> 'dir/include/bits/poll.h' 2024-05-16T22:31:09.313 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/poll2.h' -> 'dir/include/bits/poll2.h' 2024-05-16T22:31:09.346 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/posix1_lim.h' -> 'dir/include/bits/posix1_lim.h' 2024-05-16T22:31:09.400 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/posix2_lim.h' -> 'dir/include/bits/posix2_lim.h' 2024-05-16T22:31:09.429 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/posix_opt.h' -> 'dir/include/bits/posix_opt.h' 2024-05-16T22:31:09.463 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/printf-ldbl.h' -> 'dir/include/bits/printf-ldbl.h' 2024-05-16T22:31:09.496 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/procfs-extra.h' -> 'dir/include/bits/procfs-extra.h' 2024-05-16T22:31:09.530 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/procfs-id.h' -> 'dir/include/bits/procfs-id.h' 2024-05-16T22:31:09.563 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/procfs-prregset.h' -> 'dir/include/bits/procfs-prregset.h' 2024-05-16T22:31:09.630 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/procfs.h' -> 'dir/include/bits/procfs.h' 2024-05-16T22:31:09.663 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/pthread_stack_min-dynamic.h' -> 'dir/include/bits/pthread_stack_min-dynamic.h' 2024-05-16T22:31:09.696 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/pthread_stack_min.h' -> 'dir/include/bits/pthread_stack_min.h' 2024-05-16T22:31:09.730 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/pthreadtypes-arch.h' -> 'dir/include/bits/pthreadtypes-arch.h' 2024-05-16T22:31:09.763 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/pthreadtypes.h' -> 'dir/include/bits/pthreadtypes.h' 2024-05-16T22:31:09.796 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/ptrace-shared.h' -> 'dir/include/bits/ptrace-shared.h' 2024-05-16T22:31:09.830 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/resource.h' -> 'dir/include/bits/resource.h' 2024-05-16T22:31:09.863 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/rseq.h' -> 'dir/include/bits/rseq.h' 2024-05-16T22:31:09.896 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/sched.h' -> 'dir/include/bits/sched.h' 2024-05-16T22:31:09.930 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/select.h' -> 'dir/include/bits/select.h' 2024-05-16T22:31:09.963 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/select2.h' -> 'dir/include/bits/select2.h' 2024-05-16T22:31:10.036 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/sem.h' -> 'dir/include/bits/sem.h' 2024-05-16T22:31:10.072 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/semaphore.h' -> 'dir/include/bits/semaphore.h' 2024-05-16T22:31:10.105 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/setjmp.h' -> 'dir/include/bits/setjmp.h' 2024-05-16T22:31:10.138 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/setjmp2.h' -> 'dir/include/bits/setjmp2.h' 2024-05-16T22:31:10.172 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/shm.h' -> 'dir/include/bits/shm.h' 2024-05-16T22:31:10.230 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/shmlba.h' -> 'dir/include/bits/shmlba.h' 2024-05-16T22:31:10.263 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/sigaction.h' -> 'dir/include/bits/sigaction.h' 2024-05-16T22:31:10.297 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/sigcontext.h' -> 'dir/include/bits/sigcontext.h' 2024-05-16T22:31:10.330 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/sigevent-consts.h' -> 'dir/include/bits/sigevent-consts.h' 2024-05-16T22:31:10.364 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/siginfo-arch.h' -> 'dir/include/bits/siginfo-arch.h' 2024-05-16T22:31:10.422 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/siginfo-consts-arch.h' -> 'dir/include/bits/siginfo-consts-arch.h' 2024-05-16T22:31:10.455 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/siginfo-consts.h' -> 'dir/include/bits/siginfo-consts.h' 2024-05-16T22:31:10.489 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/signal_ext.h' -> 'dir/include/bits/signal_ext.h' 2024-05-16T22:31:10.522 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/signalfd.h' -> 'dir/include/bits/signalfd.h' 2024-05-16T22:31:10.555 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/signum-arch.h' -> 'dir/include/bits/signum-arch.h' 2024-05-16T22:31:10.589 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/signum-generic.h' -> 'dir/include/bits/signum-generic.h' 2024-05-16T22:31:10.622 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/sigstack.h' -> 'dir/include/bits/sigstack.h' 2024-05-16T22:31:10.666 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/sigstksz.h' -> 'dir/include/bits/sigstksz.h' 2024-05-16T22:31:10.697 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/sigthread.h' -> 'dir/include/bits/sigthread.h' 2024-05-16T22:31:10.731 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/sockaddr.h' -> 'dir/include/bits/sockaddr.h' 2024-05-16T22:31:10.764 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/socket-constants.h' -> 'dir/include/bits/socket-constants.h' 2024-05-16T22:31:10.814 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/socket.h' -> 'dir/include/bits/socket.h' 2024-05-16T22:31:10.848 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/socket2.h' -> 'dir/include/bits/socket2.h' 2024-05-16T22:31:10.881 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/socket_type.h' -> 'dir/include/bits/socket_type.h' 2024-05-16T22:31:10.931 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/ss_flags.h' -> 'dir/include/bits/ss_flags.h' 2024-05-16T22:31:10.964 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/stab.def' -> 'dir/include/bits/stab.def' 2024-05-16T22:31:10.997 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/stat.h' -> 'dir/include/bits/stat.h' 2024-05-16T22:31:11.031 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/statfs.h' -> 'dir/include/bits/statfs.h' 2024-05-16T22:31:11.064 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/statvfs.h' -> 'dir/include/bits/statvfs.h' 2024-05-16T22:31:11.098 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/statx-generic.h' -> 'dir/include/bits/statx-generic.h' 2024-05-16T22:31:11.131 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/statx.h' -> 'dir/include/bits/statx.h' 2024-05-16T22:31:11.165 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/stdint-intn.h' -> 'dir/include/bits/stdint-intn.h' 2024-05-16T22:31:11.232 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/stdint-uintn.h' -> 'dir/include/bits/stdint-uintn.h' 2024-05-16T22:31:11.265 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/stdio-ldbl.h' -> 'dir/include/bits/stdio-ldbl.h' 2024-05-16T22:31:11.298 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/stdio.h' -> 'dir/include/bits/stdio.h' 2024-05-16T22:31:11.353 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/stdio2-decl.h' -> 'dir/include/bits/stdio2-decl.h' 2024-05-16T22:31:11.382 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/stdio2.h' -> 'dir/include/bits/stdio2.h' 2024-05-16T22:31:11.468 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/stdio_lim.h' -> 'dir/include/bits/stdio_lim.h' 2024-05-16T22:31:11.507 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/stdlib-bsearch.h' -> 'dir/include/bits/stdlib-bsearch.h' 2024-05-16T22:31:11.540 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/stdlib-float.h' -> 'dir/include/bits/stdlib-float.h' 2024-05-16T22:31:11.585 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/stdlib-ldbl.h' -> 'dir/include/bits/stdlib-ldbl.h' 2024-05-16T22:31:11.615 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/stdlib.h' -> 'dir/include/bits/stdlib.h' 2024-05-16T22:31:11.648 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/string_fortified.h' -> 'dir/include/bits/string_fortified.h' 2024-05-16T22:31:11.682 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/strings_fortified.h' -> 'dir/include/bits/strings_fortified.h' 2024-05-16T22:31:11.715 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/struct_mutex.h' -> 'dir/include/bits/struct_mutex.h' 2024-05-16T22:31:11.748 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/struct_rwlock.h' -> 'dir/include/bits/struct_rwlock.h' 2024-05-16T22:31:11.782 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/struct_stat.h' -> 'dir/include/bits/struct_stat.h' 2024-05-16T22:31:11.815 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/struct_stat_time64_helper.h' -> 'dir/include/bits/struct_stat_time64_helper.h' 2024-05-16T22:31:11.849 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/syscall.h' -> 'dir/include/bits/syscall.h' 2024-05-16T22:31:11.882 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/syslog-ldbl.h' -> 'dir/include/bits/syslog-ldbl.h' 2024-05-16T22:31:11.915 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/syslog-path.h' -> 'dir/include/bits/syslog-path.h' 2024-05-16T22:31:11.966 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/syslog.h' -> 'dir/include/bits/syslog.h' 2024-05-16T22:31:11.999 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/sysmacros.h' -> 'dir/include/bits/sysmacros.h' 2024-05-16T22:31:12.057 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/termios-baud.h' -> 'dir/include/bits/termios-baud.h' 2024-05-16T22:31:12.091 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/termios-c_cc.h' -> 'dir/include/bits/termios-c_cc.h' 2024-05-16T22:31:12.124 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/termios-c_cflag.h' -> 'dir/include/bits/termios-c_cflag.h' 2024-05-16T22:31:12.161 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/termios-c_iflag.h' -> 'dir/include/bits/termios-c_iflag.h' 2024-05-16T22:31:12.197 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/termios-c_lflag.h' -> 'dir/include/bits/termios-c_lflag.h' 2024-05-16T22:31:12.232 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/termios-c_oflag.h' -> 'dir/include/bits/termios-c_oflag.h' 2024-05-16T22:31:12.266 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/termios-misc.h' -> 'dir/include/bits/termios-misc.h' 2024-05-16T22:31:12.299 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/termios-struct.h' -> 'dir/include/bits/termios-struct.h' 2024-05-16T22:31:12.332 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/termios-tcflow.h' -> 'dir/include/bits/termios-tcflow.h' 2024-05-16T22:31:12.366 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/termios.h' -> 'dir/include/bits/termios.h' 2024-05-16T22:31:12.399 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/thread-shared-types.h' -> 'dir/include/bits/thread-shared-types.h' 2024-05-16T22:31:12.466 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/time.h' -> 'dir/include/bits/time.h' 2024-05-16T22:31:12.499 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/time64.h' -> 'dir/include/bits/time64.h' 2024-05-16T22:31:12.532 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/timerfd.h' -> 'dir/include/bits/timerfd.h' 2024-05-16T22:31:12.566 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/timesize.h' -> 'dir/include/bits/timesize.h' 2024-05-16T22:31:12.632 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/timex.h' -> 'dir/include/bits/timex.h' 2024-05-16T22:31:12.691 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types.h' -> 'dir/include/bits/types.h' 2024-05-16T22:31:12.724 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types' -> 'dir/include/bits/types' 2024-05-16T22:31:12.758 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types/FILE.h' -> 'dir/include/bits/types/FILE.h' 2024-05-16T22:31:12.791 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types/__FILE.h' -> 'dir/include/bits/types/__FILE.h' 2024-05-16T22:31:12.824 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types/__fpos64_t.h' -> 'dir/include/bits/types/__fpos64_t.h' 2024-05-16T22:31:12.858 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types/__fpos_t.h' -> 'dir/include/bits/types/__fpos_t.h' 2024-05-16T22:31:12.891 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types/__locale_t.h' -> 'dir/include/bits/types/__locale_t.h' 2024-05-16T22:31:12.924 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types/__mbstate_t.h' -> 'dir/include/bits/types/__mbstate_t.h' 2024-05-16T22:31:12.958 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types/__sigset_t.h' -> 'dir/include/bits/types/__sigset_t.h' 2024-05-16T22:31:12.991 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types/__sigval_t.h' -> 'dir/include/bits/types/__sigval_t.h' 2024-05-16T22:31:13.025 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types/clock_t.h' -> 'dir/include/bits/types/clock_t.h' 2024-05-16T22:31:13.058 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types/clockid_t.h' -> 'dir/include/bits/types/clockid_t.h' 2024-05-16T22:31:13.091 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types/cookie_io_functions_t.h' -> 'dir/include/bits/types/cookie_io_functions_t.h' 2024-05-16T22:31:13.125 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types/error_t.h' -> 'dir/include/bits/types/error_t.h' 2024-05-16T22:31:13.158 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types/locale_t.h' -> 'dir/include/bits/types/locale_t.h' 2024-05-16T22:31:13.192 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types/mbstate_t.h' -> 'dir/include/bits/types/mbstate_t.h' 2024-05-16T22:31:13.258 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types/res_state.h' -> 'dir/include/bits/types/res_state.h' 2024-05-16T22:31:13.292 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types/sig_atomic_t.h' -> 'dir/include/bits/types/sig_atomic_t.h' 2024-05-16T22:31:13.325 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types/sigevent_t.h' -> 'dir/include/bits/types/sigevent_t.h' 2024-05-16T22:31:13.358 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types/siginfo_t.h' -> 'dir/include/bits/types/siginfo_t.h' 2024-05-16T22:31:13.392 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types/sigset_t.h' -> 'dir/include/bits/types/sigset_t.h' 2024-05-16T22:31:13.425 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types/sigval_t.h' -> 'dir/include/bits/types/sigval_t.h' 2024-05-16T22:31:13.458 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types/stack_t.h' -> 'dir/include/bits/types/stack_t.h' 2024-05-16T22:31:13.492 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types/struct_FILE.h' -> 'dir/include/bits/types/struct_FILE.h' 2024-05-16T22:31:13.525 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types/struct___jmp_buf_tag.h' -> 'dir/include/bits/types/struct___jmp_buf_tag.h' 2024-05-16T22:31:13.559 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types/struct_iovec.h' -> 'dir/include/bits/types/struct_iovec.h' 2024-05-16T22:31:13.592 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types/struct_itimerspec.h' -> 'dir/include/bits/types/struct_itimerspec.h' 2024-05-16T22:31:13.625 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types/struct_msqid64_ds.h' -> 'dir/include/bits/types/struct_msqid64_ds.h' 2024-05-16T22:31:13.659 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types/struct_msqid64_ds_helper.h' -> 'dir/include/bits/types/struct_msqid64_ds_helper.h' 2024-05-16T22:31:13.692 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types/struct_msqid_ds.h' -> 'dir/include/bits/types/struct_msqid_ds.h' 2024-05-16T22:31:13.725 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types/struct_osockaddr.h' -> 'dir/include/bits/types/struct_osockaddr.h' 2024-05-16T22:31:13.759 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types/struct_rusage.h' -> 'dir/include/bits/types/struct_rusage.h' 2024-05-16T22:31:13.817 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types/struct_sched_param.h' -> 'dir/include/bits/types/struct_sched_param.h' 2024-05-16T22:31:13.882 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types/struct_semid64_ds.h' -> 'dir/include/bits/types/struct_semid64_ds.h' 2024-05-16T22:31:13.917 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types/struct_semid64_ds_helper.h' -> 'dir/include/bits/types/struct_semid64_ds_helper.h' 2024-05-16T22:31:13.951 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types/struct_semid_ds.h' -> 'dir/include/bits/types/struct_semid_ds.h' 2024-05-16T22:31:13.984 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types/struct_shmid64_ds.h' -> 'dir/include/bits/types/struct_shmid64_ds.h' 2024-05-16T22:31:14.017 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types/struct_shmid64_ds_helper.h' -> 'dir/include/bits/types/struct_shmid64_ds_helper.h' 2024-05-16T22:31:14.057 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types/struct_shmid_ds.h' -> 'dir/include/bits/types/struct_shmid_ds.h' 2024-05-16T22:31:14.092 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types/struct_sigstack.h' -> 'dir/include/bits/types/struct_sigstack.h' 2024-05-16T22:31:14.126 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types/struct_statx.h' -> 'dir/include/bits/types/struct_statx.h' 2024-05-16T22:31:14.159 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types/struct_statx_timestamp.h' -> 'dir/include/bits/types/struct_statx_timestamp.h' 2024-05-16T22:31:14.192 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types/struct_timeb.h' -> 'dir/include/bits/types/struct_timeb.h' 2024-05-16T22:31:14.226 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types/struct_timespec.h' -> 'dir/include/bits/types/struct_timespec.h' 2024-05-16T22:31:14.334 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types/struct_timeval.h' -> 'dir/include/bits/types/struct_timeval.h' 2024-05-16T22:31:14.368 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types/struct_tm.h' -> 'dir/include/bits/types/struct_tm.h' 2024-05-16T22:31:14.401 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types/time_t.h' -> 'dir/include/bits/types/time_t.h' 2024-05-16T22:31:14.434 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types/timer_t.h' -> 'dir/include/bits/types/timer_t.h' 2024-05-16T22:31:14.493 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/types/wint_t.h' -> 'dir/include/bits/types/wint_t.h' 2024-05-16T22:31:14.526 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/typesizes.h' -> 'dir/include/bits/typesizes.h' 2024-05-16T22:31:14.598 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/uintn-identity.h' -> 'dir/include/bits/uintn-identity.h' 2024-05-16T22:31:14.634 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/uio-ext.h' -> 'dir/include/bits/uio-ext.h' 2024-05-16T22:31:14.668 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/uio_lim.h' -> 'dir/include/bits/uio_lim.h' 2024-05-16T22:31:14.710 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/unistd.h' -> 'dir/include/bits/unistd.h' 2024-05-16T22:31:14.743 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/unistd_ext.h' -> 'dir/include/bits/unistd_ext.h' 2024-05-16T22:31:14.802 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/utmp.h' -> 'dir/include/bits/utmp.h' 2024-05-16T22:31:14.880 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/utmpx.h' -> 'dir/include/bits/utmpx.h' 2024-05-16T22:31:14.910 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/utsname.h' -> 'dir/include/bits/utsname.h' 2024-05-16T22:31:14.943 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/waitflags.h' -> 'dir/include/bits/waitflags.h' 2024-05-16T22:31:14.976 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/waitstatus.h' -> 'dir/include/bits/waitstatus.h' 2024-05-16T22:31:15.039 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/wchar-ldbl.h' -> 'dir/include/bits/wchar-ldbl.h' 2024-05-16T22:31:15.068 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/wchar.h' -> 'dir/include/bits/wchar.h' 2024-05-16T22:31:15.101 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/wchar2-decl.h' -> 'dir/include/bits/wchar2-decl.h' 2024-05-16T22:31:15.135 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/wchar2.h' -> 'dir/include/bits/wchar2.h' 2024-05-16T22:31:15.218 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/wctype-wchar.h' -> 'dir/include/bits/wctype-wchar.h' 2024-05-16T22:31:15.252 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/wordsize.h' -> 'dir/include/bits/wordsize.h' 2024-05-16T22:31:15.285 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/bits/xopen_lim.h' -> 'dir/include/bits/xopen_lim.h' 2024-05-16T22:31:15.340 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/finclude' -> 'dir/include/finclude' 2024-05-16T22:31:15.377 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/finclude/math-vector-fortran.h' -> 'dir/include/finclude/math-vector-fortran.h' 2024-05-16T22:31:15.410 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/gnu' -> 'dir/include/gnu' 2024-05-16T22:31:15.444 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/gnu/lib-names.h' -> 'dir/include/gnu/lib-names.h' 2024-05-16T22:31:15.477 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/gnu/libc-version.h' -> 'dir/include/gnu/libc-version.h' 2024-05-16T22:31:15.510 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/gnu/stubs.h' -> 'dir/include/gnu/stubs.h' 2024-05-16T22:31:15.544 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/gnu/lib-names-64.h' -> 'dir/include/gnu/lib-names-64.h' 2024-05-16T22:31:15.577 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/gnu/stubs-64.h' -> 'dir/include/gnu/stubs-64.h' 2024-05-16T22:31:15.610 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/net' -> 'dir/include/net' 2024-05-16T22:31:15.644 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/net/ethernet.h' -> 'dir/include/net/ethernet.h' 2024-05-16T22:31:15.730 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/net/if.h' -> 'dir/include/net/if.h' 2024-05-16T22:31:15.760 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/net/if_arp.h' -> 'dir/include/net/if_arp.h' 2024-05-16T22:31:15.794 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/net/if_packet.h' -> 'dir/include/net/if_packet.h' 2024-05-16T22:31:15.844 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/net/if_ppp.h' -> 'dir/include/net/if_ppp.h' 2024-05-16T22:31:15.877 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/net/if_shaper.h' -> 'dir/include/net/if_shaper.h' 2024-05-16T22:31:15.911 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/net/if_slip.h' -> 'dir/include/net/if_slip.h' 2024-05-16T22:31:15.944 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/net/ppp-comp.h' -> 'dir/include/net/ppp-comp.h' 2024-05-16T22:31:15.990 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/net/ppp_defs.h' -> 'dir/include/net/ppp_defs.h' 2024-05-16T22:31:16.019 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/net/route.h' -> 'dir/include/net/route.h' 2024-05-16T22:31:16.052 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/netash' -> 'dir/include/netash' 2024-05-16T22:31:16.086 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/netash/ash.h' -> 'dir/include/netash/ash.h' 2024-05-16T22:31:16.119 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/netatalk' -> 'dir/include/netatalk' 2024-05-16T22:31:16.153 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/netatalk/at.h' -> 'dir/include/netatalk/at.h' 2024-05-16T22:31:16.186 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/netax25' -> 'dir/include/netax25' 2024-05-16T22:31:16.219 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/netax25/ax25.h' -> 'dir/include/netax25/ax25.h' 2024-05-16T22:31:16.252 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/neteconet' -> 'dir/include/neteconet' 2024-05-16T22:31:16.286 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/neteconet/ec.h' -> 'dir/include/neteconet/ec.h' 2024-05-16T22:31:16.328 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/netinet' -> 'dir/include/netinet' 2024-05-16T22:31:16.361 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/netinet/ether.h' -> 'dir/include/netinet/ether.h' 2024-05-16T22:31:16.420 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/netinet/icmp6.h' -> 'dir/include/netinet/icmp6.h' 2024-05-16T22:31:16.453 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/netinet/if_ether.h' -> 'dir/include/netinet/if_ether.h' 2024-05-16T22:31:16.486 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/netinet/if_fddi.h' -> 'dir/include/netinet/if_fddi.h' 2024-05-16T22:31:16.520 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/netinet/if_tr.h' -> 'dir/include/netinet/if_tr.h' 2024-05-16T22:31:16.553 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/netinet/igmp.h' -> 'dir/include/netinet/igmp.h' 2024-05-16T22:31:16.598 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/netinet/in.h' -> 'dir/include/netinet/in.h' 2024-05-16T22:31:16.628 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/netinet/in_systm.h' -> 'dir/include/netinet/in_systm.h' 2024-05-16T22:31:16.661 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/netinet/ip.h' -> 'dir/include/netinet/ip.h' 2024-05-16T22:31:16.695 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/netinet/ip6.h' -> 'dir/include/netinet/ip6.h' 2024-05-16T22:31:16.728 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/netinet/ip_icmp.h' -> 'dir/include/netinet/ip_icmp.h' 2024-05-16T22:31:16.761 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/netinet/tcp.h' -> 'dir/include/netinet/tcp.h' 2024-05-16T22:31:16.795 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/netinet/udp.h' -> 'dir/include/netinet/udp.h' 2024-05-16T22:31:16.828 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/netipx' -> 'dir/include/netipx' 2024-05-16T22:31:16.861 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/netipx/ipx.h' -> 'dir/include/netipx/ipx.h' 2024-05-16T22:31:16.895 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/netiucv' -> 'dir/include/netiucv' 2024-05-16T22:31:16.928 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/netiucv/iucv.h' -> 'dir/include/netiucv/iucv.h' 2024-05-16T22:31:16.986 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/netpacket' -> 'dir/include/netpacket' 2024-05-16T22:31:17.020 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/netpacket/packet.h' -> 'dir/include/netpacket/packet.h' 2024-05-16T22:31:17.053 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/netrom' -> 'dir/include/netrom' 2024-05-16T22:31:17.087 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/netrom/netrom.h' -> 'dir/include/netrom/netrom.h' 2024-05-16T22:31:17.120 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/netrose' -> 'dir/include/netrose' 2024-05-16T22:31:17.154 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/netrose/rose.h' -> 'dir/include/netrose/rose.h' 2024-05-16T22:31:17.223 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/nfs' -> 'dir/include/nfs' 2024-05-16T22:31:17.253 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/nfs/nfs.h' -> 'dir/include/nfs/nfs.h' 2024-05-16T22:31:17.287 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/protocols' -> 'dir/include/protocols' 2024-05-16T22:31:17.320 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/protocols/routed.h' -> 'dir/include/protocols/routed.h' 2024-05-16T22:31:17.353 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/protocols/rwhod.h' -> 'dir/include/protocols/rwhod.h' 2024-05-16T22:31:17.387 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/protocols/talkd.h' -> 'dir/include/protocols/talkd.h' 2024-05-16T22:31:17.420 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/protocols/timed.h' -> 'dir/include/protocols/timed.h' 2024-05-16T22:31:17.454 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/rpc' -> 'dir/include/rpc' 2024-05-16T22:31:17.487 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/rpc/netdb.h' -> 'dir/include/rpc/netdb.h' 2024-05-16T22:31:17.520 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/numpy' -> 'dir/include/numpy' 2024-05-16T22:31:17.587 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/zdict.h' -> 'dir/include/zdict.h' 2024-05-16T22:31:17.620 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/zstd.h' -> 'dir/include/zstd.h' 2024-05-16T22:31:17.654 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/zstd_errors.h' -> 'dir/include/zstd_errors.h' 2024-05-16T22:31:17.687 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/gelf.h' -> 'dir/include/gelf.h' 2024-05-16T22:31:17.729 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/libelf.h' -> 'dir/include/libelf.h' 2024-05-16T22:31:17.762 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/nlist.h' -> 'dir/include/nlist.h' 2024-05-16T22:31:17.795 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/libaio.h' -> 'dir/include/libaio.h' 2024-05-16T22:31:17.848 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/FlexLexer.h' -> 'dir/include/FlexLexer.h' 2024-05-16T22:31:17.879 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/rados' -> 'dir/include/rados' 2024-05-16T22:31:17.912 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/rados/librados.h' -> 'dir/include/rados/librados.h' 2024-05-16T22:31:17.946 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/rados/rados_types.h' -> 'dir/include/rados/rados_types.h' 2024-05-16T22:31:17.979 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/uuid' -> 'dir/include/uuid' 2024-05-16T22:31:18.012 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/uuid/uuid.h' -> 'dir/include/uuid/uuid.h' 2024-05-16T22:31:18.046 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/xfs' -> 'dir/include/xfs' 2024-05-16T22:31:18.079 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/xfs/handle.h' -> 'dir/include/xfs/handle.h' 2024-05-16T22:31:18.112 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/xfs/jdm.h' -> 'dir/include/xfs/jdm.h' 2024-05-16T22:31:18.171 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/xfs/linux.h' -> 'dir/include/xfs/linux.h' 2024-05-16T22:31:18.204 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/xfs/xfs.h' -> 'dir/include/xfs/xfs.h' 2024-05-16T22:31:18.238 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/xfs/xfs_arch.h' -> 'dir/include/xfs/xfs_arch.h' 2024-05-16T22:31:18.271 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/xfs/xfs_da_format.h' -> 'dir/include/xfs/xfs_da_format.h' 2024-05-16T22:31:18.304 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/xfs/xfs_format.h' -> 'dir/include/xfs/xfs_format.h' 2024-05-16T22:31:18.338 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/xfs/xfs_fs.h' -> 'dir/include/xfs/xfs_fs.h' 2024-05-16T22:31:18.371 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/xfs/xfs_fs_compat.h' -> 'dir/include/xfs/xfs_fs_compat.h' 2024-05-16T22:31:18.405 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/xfs/xfs_log_format.h' -> 'dir/include/xfs/xfs_log_format.h' 2024-05-16T22:31:18.464 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/xfs/xfs_types.h' -> 'dir/include/xfs/xfs_types.h' 2024-05-16T22:31:18.496 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/xfs/xqm.h' -> 'dir/include/xfs/xqm.h' 2024-05-16T22:31:18.529 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/cephfs' -> 'dir/include/cephfs' 2024-05-16T22:31:18.563 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/cephfs/ceph_ll_client.h' -> 'dir/include/cephfs/ceph_ll_client.h' 2024-05-16T22:31:18.596 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/cephfs/libcephfs.h' -> 'dir/include/cephfs/libcephfs.h' 2024-05-16T22:31:18.641 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/cephfs/metrics' -> 'dir/include/cephfs/metrics' 2024-05-16T22:31:18.671 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/cephfs/metrics/Types.h' -> 'dir/include/cephfs/metrics/Types.h' 2024-05-16T22:31:18.705 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/cephfs/types.h' -> 'dir/include/cephfs/types.h' 2024-05-16T22:31:18.755 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl' -> 'dir/include/openssl' 2024-05-16T22:31:18.788 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/aes.h' -> 'dir/include/openssl/aes.h' 2024-05-16T22:31:18.822 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/asn1.h' -> 'dir/include/openssl/asn1.h' 2024-05-16T22:31:18.855 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/asn1_mac.h' -> 'dir/include/openssl/asn1_mac.h' 2024-05-16T22:31:18.888 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/asn1err.h' -> 'dir/include/openssl/asn1err.h' 2024-05-16T22:31:18.922 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/asn1t.h' -> 'dir/include/openssl/asn1t.h' 2024-05-16T22:31:18.955 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/async.h' -> 'dir/include/openssl/async.h' 2024-05-16T22:31:18.989 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/asyncerr.h' -> 'dir/include/openssl/asyncerr.h' 2024-05-16T22:31:19.022 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/bio.h' -> 'dir/include/openssl/bio.h' 2024-05-16T22:31:19.081 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/bioerr.h' -> 'dir/include/openssl/bioerr.h' 2024-05-16T22:31:19.114 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/blowfish.h' -> 'dir/include/openssl/blowfish.h' 2024-05-16T22:31:19.147 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/bn.h' -> 'dir/include/openssl/bn.h' 2024-05-16T22:31:19.181 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/bnerr.h' -> 'dir/include/openssl/bnerr.h' 2024-05-16T22:31:19.214 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/buffer.h' -> 'dir/include/openssl/buffer.h' 2024-05-16T22:31:19.247 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/buffererr.h' -> 'dir/include/openssl/buffererr.h' 2024-05-16T22:31:19.281 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/camellia.h' -> 'dir/include/openssl/camellia.h' 2024-05-16T22:31:19.339 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/cast.h' -> 'dir/include/openssl/cast.h' 2024-05-16T22:31:19.372 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/cmac.h' -> 'dir/include/openssl/cmac.h' 2024-05-16T22:31:19.406 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/cmp.h' -> 'dir/include/openssl/cmp.h' 2024-05-16T22:31:19.479 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/cmp_util.h' -> 'dir/include/openssl/cmp_util.h' 2024-05-16T22:31:19.529 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/cmperr.h' -> 'dir/include/openssl/cmperr.h' 2024-05-16T22:31:19.571 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/cms.h' -> 'dir/include/openssl/cms.h' 2024-05-16T22:31:19.613 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/cmserr.h' -> 'dir/include/openssl/cmserr.h' 2024-05-16T22:31:19.646 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/comp.h' -> 'dir/include/openssl/comp.h' 2024-05-16T22:31:19.688 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/comperr.h' -> 'dir/include/openssl/comperr.h' 2024-05-16T22:31:19.737 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/conf.h' -> 'dir/include/openssl/conf.h' 2024-05-16T22:31:19.789 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/conf_api.h' -> 'dir/include/openssl/conf_api.h' 2024-05-16T22:31:19.821 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/conferr.h' -> 'dir/include/openssl/conferr.h' 2024-05-16T22:31:19.854 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/configuration-x86_64.h' -> 'dir/include/openssl/configuration-x86_64.h' 2024-05-16T22:31:19.904 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/configuration.h' -> 'dir/include/openssl/configuration.h' 2024-05-16T22:31:19.946 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/conftypes.h' -> 'dir/include/openssl/conftypes.h' 2024-05-16T22:31:20.001 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/core.h' -> 'dir/include/openssl/core.h' 2024-05-16T22:31:20.071 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/core_dispatch.h' -> 'dir/include/openssl/core_dispatch.h' 2024-05-16T22:31:20.113 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/core_names.h' -> 'dir/include/openssl/core_names.h' 2024-05-16T22:31:20.146 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/core_object.h' -> 'dir/include/openssl/core_object.h' 2024-05-16T22:31:20.188 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/crmf.h' -> 'dir/include/openssl/crmf.h' 2024-05-16T22:31:20.229 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/crmferr.h' -> 'dir/include/openssl/crmferr.h' 2024-05-16T22:31:20.271 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/crypto.h' -> 'dir/include/openssl/crypto.h' 2024-05-16T22:31:20.313 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/cryptoerr.h' -> 'dir/include/openssl/cryptoerr.h' 2024-05-16T22:31:20.355 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/cryptoerr_legacy.h' -> 'dir/include/openssl/cryptoerr_legacy.h' 2024-05-16T22:31:20.396 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/ct.h' -> 'dir/include/openssl/ct.h' 2024-05-16T22:31:20.438 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/cterr.h' -> 'dir/include/openssl/cterr.h' 2024-05-16T22:31:20.471 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/decoder.h' -> 'dir/include/openssl/decoder.h' 2024-05-16T22:31:20.564 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/decodererr.h' -> 'dir/include/openssl/decodererr.h' 2024-05-16T22:31:20.596 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/des.h' -> 'dir/include/openssl/des.h' 2024-05-16T22:31:20.630 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/dh.h' -> 'dir/include/openssl/dh.h' 2024-05-16T22:31:20.671 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/dherr.h' -> 'dir/include/openssl/dherr.h' 2024-05-16T22:31:20.713 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/dsa.h' -> 'dir/include/openssl/dsa.h' 2024-05-16T22:31:20.805 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/dsaerr.h' -> 'dir/include/openssl/dsaerr.h' 2024-05-16T22:31:20.847 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/dtls1.h' -> 'dir/include/openssl/dtls1.h' 2024-05-16T22:31:20.880 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/e_os2.h' -> 'dir/include/openssl/e_os2.h' 2024-05-16T22:31:20.913 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/e_ostime.h' -> 'dir/include/openssl/e_ostime.h' 2024-05-16T22:31:20.947 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/ebcdic.h' -> 'dir/include/openssl/ebcdic.h' 2024-05-16T22:31:20.980 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/ec.h' -> 'dir/include/openssl/ec.h' 2024-05-16T22:31:21.013 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/ecdh.h' -> 'dir/include/openssl/ecdh.h' 2024-05-16T22:31:21.047 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/ecdsa.h' -> 'dir/include/openssl/ecdsa.h' 2024-05-16T22:31:21.080 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/ecerr.h' -> 'dir/include/openssl/ecerr.h' 2024-05-16T22:31:21.114 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/encoder.h' -> 'dir/include/openssl/encoder.h' 2024-05-16T22:31:21.164 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/encodererr.h' -> 'dir/include/openssl/encodererr.h' 2024-05-16T22:31:21.197 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/engine.h' -> 'dir/include/openssl/engine.h' 2024-05-16T22:31:21.247 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/engineerr.h' -> 'dir/include/openssl/engineerr.h' 2024-05-16T22:31:21.280 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/err.h' -> 'dir/include/openssl/err.h' 2024-05-16T22:31:21.313 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/ess.h' -> 'dir/include/openssl/ess.h' 2024-05-16T22:31:21.347 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/esserr.h' -> 'dir/include/openssl/esserr.h' 2024-05-16T22:31:21.405 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/evp.h' -> 'dir/include/openssl/evp.h' 2024-05-16T22:31:21.456 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/evperr.h' -> 'dir/include/openssl/evperr.h' 2024-05-16T22:31:21.506 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/fips.h' -> 'dir/include/openssl/fips.h' 2024-05-16T22:31:21.556 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/fips_names.h' -> 'dir/include/openssl/fips_names.h' 2024-05-16T22:31:21.606 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/fipskey.h' -> 'dir/include/openssl/fipskey.h' 2024-05-16T22:31:21.656 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/hmac.h' -> 'dir/include/openssl/hmac.h' 2024-05-16T22:31:21.706 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/hpke.h' -> 'dir/include/openssl/hpke.h' 2024-05-16T22:31:21.756 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/http.h' -> 'dir/include/openssl/http.h' 2024-05-16T22:31:21.806 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/httperr.h' -> 'dir/include/openssl/httperr.h' 2024-05-16T22:31:21.856 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/idea.h' -> 'dir/include/openssl/idea.h' 2024-05-16T22:31:21.906 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/kdf.h' -> 'dir/include/openssl/kdf.h' 2024-05-16T22:31:21.956 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/kdferr.h' -> 'dir/include/openssl/kdferr.h' 2024-05-16T22:31:22.006 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/lhash.h' -> 'dir/include/openssl/lhash.h' 2024-05-16T22:31:22.056 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/macros.h' -> 'dir/include/openssl/macros.h' 2024-05-16T22:31:22.106 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/md2.h' -> 'dir/include/openssl/md2.h' 2024-05-16T22:31:22.156 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/md4.h' -> 'dir/include/openssl/md4.h' 2024-05-16T22:31:22.231 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/md5.h' -> 'dir/include/openssl/md5.h' 2024-05-16T22:31:22.281 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/mdc2.h' -> 'dir/include/openssl/mdc2.h' 2024-05-16T22:31:22.331 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/modes.h' -> 'dir/include/openssl/modes.h' 2024-05-16T22:31:22.381 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/obj_mac.h' -> 'dir/include/openssl/obj_mac.h' 2024-05-16T22:31:22.431 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/objects.h' -> 'dir/include/openssl/objects.h' 2024-05-16T22:31:22.481 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/objectserr.h' -> 'dir/include/openssl/objectserr.h' 2024-05-16T22:31:22.523 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/ocsp.h' -> 'dir/include/openssl/ocsp.h' 2024-05-16T22:31:22.564 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/ocsperr.h' -> 'dir/include/openssl/ocsperr.h' 2024-05-16T22:31:22.606 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/opensslconf.h' -> 'dir/include/openssl/opensslconf.h' 2024-05-16T22:31:22.650 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/opensslv.h' -> 'dir/include/openssl/opensslv.h' 2024-05-16T22:31:22.689 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/ossl_typ.h' -> 'dir/include/openssl/ossl_typ.h' 2024-05-16T22:31:22.731 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/param_build.h' -> 'dir/include/openssl/param_build.h' 2024-05-16T22:31:22.773 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/params.h' -> 'dir/include/openssl/params.h' 2024-05-16T22:31:22.815 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/pem.h' -> 'dir/include/openssl/pem.h' 2024-05-16T22:31:22.863 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/pem2.h' -> 'dir/include/openssl/pem2.h' 2024-05-16T22:31:22.907 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/pemerr.h' -> 'dir/include/openssl/pemerr.h' 2024-05-16T22:31:22.981 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/pkcs12.h' -> 'dir/include/openssl/pkcs12.h' 2024-05-16T22:31:23.032 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/pkcs12err.h' -> 'dir/include/openssl/pkcs12err.h' 2024-05-16T22:31:23.073 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/pkcs7.h' -> 'dir/include/openssl/pkcs7.h' 2024-05-16T22:31:23.115 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/pkcs7err.h' -> 'dir/include/openssl/pkcs7err.h' 2024-05-16T22:31:23.156 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/prov_ssl.h' -> 'dir/include/openssl/prov_ssl.h' 2024-05-16T22:31:23.198 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/proverr.h' -> 'dir/include/openssl/proverr.h' 2024-05-16T22:31:23.240 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/provider.h' -> 'dir/include/openssl/provider.h' 2024-05-16T22:31:23.282 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/quic.h' -> 'dir/include/openssl/quic.h' 2024-05-16T22:31:23.323 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/rand.h' -> 'dir/include/openssl/rand.h' 2024-05-16T22:31:23.373 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/randerr.h' -> 'dir/include/openssl/randerr.h' 2024-05-16T22:31:23.423 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/rc2.h' -> 'dir/include/openssl/rc2.h' 2024-05-16T22:31:23.465 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/rc4.h' -> 'dir/include/openssl/rc4.h' 2024-05-16T22:31:23.507 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/rc5.h' -> 'dir/include/openssl/rc5.h' 2024-05-16T22:31:23.548 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/ripemd.h' -> 'dir/include/openssl/ripemd.h' 2024-05-16T22:31:23.590 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/rsa.h' -> 'dir/include/openssl/rsa.h' 2024-05-16T22:31:23.638 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/rsaerr.h' -> 'dir/include/openssl/rsaerr.h' 2024-05-16T22:31:23.699 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/safestack.h' -> 'dir/include/openssl/safestack.h' 2024-05-16T22:31:23.749 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/seed.h' -> 'dir/include/openssl/seed.h' 2024-05-16T22:31:23.790 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/self_test.h' -> 'dir/include/openssl/self_test.h' 2024-05-16T22:31:23.832 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/sha.h' -> 'dir/include/openssl/sha.h' 2024-05-16T22:31:23.874 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/srp.h' -> 'dir/include/openssl/srp.h' 2024-05-16T22:31:23.915 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/srtp.h' -> 'dir/include/openssl/srtp.h' 2024-05-16T22:31:23.957 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/ssl.h' -> 'dir/include/openssl/ssl.h' 2024-05-16T22:31:23.999 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/ssl2.h' -> 'dir/include/openssl/ssl2.h' 2024-05-16T22:31:24.040 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/ssl3.h' -> 'dir/include/openssl/ssl3.h' 2024-05-16T22:31:24.082 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/sslerr.h' -> 'dir/include/openssl/sslerr.h' 2024-05-16T22:31:24.124 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/sslerr_legacy.h' -> 'dir/include/openssl/sslerr_legacy.h' 2024-05-16T22:31:24.232 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/stack.h' -> 'dir/include/openssl/stack.h' 2024-05-16T22:31:24.282 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/store.h' -> 'dir/include/openssl/store.h' 2024-05-16T22:31:24.332 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/storeerr.h' -> 'dir/include/openssl/storeerr.h' 2024-05-16T22:31:24.374 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/symhacks.h' -> 'dir/include/openssl/symhacks.h' 2024-05-16T22:31:24.424 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/thread.h' -> 'dir/include/openssl/thread.h' 2024-05-16T22:31:24.491 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/tls1.h' -> 'dir/include/openssl/tls1.h' 2024-05-16T22:31:24.533 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/trace.h' -> 'dir/include/openssl/trace.h' 2024-05-16T22:31:24.574 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/ts.h' -> 'dir/include/openssl/ts.h' 2024-05-16T22:31:24.624 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/tserr.h' -> 'dir/include/openssl/tserr.h' 2024-05-16T22:31:24.674 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/txt_db.h' -> 'dir/include/openssl/txt_db.h' 2024-05-16T22:31:24.724 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/types.h' -> 'dir/include/openssl/types.h' 2024-05-16T22:31:24.766 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/ui.h' -> 'dir/include/openssl/ui.h' 2024-05-16T22:31:24.816 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/uierr.h' -> 'dir/include/openssl/uierr.h' 2024-05-16T22:31:24.866 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/whrlpool.h' -> 'dir/include/openssl/whrlpool.h' 2024-05-16T22:31:24.916 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/x509.h' -> 'dir/include/openssl/x509.h' 2024-05-16T22:31:24.966 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/x509_vfy.h' -> 'dir/include/openssl/x509_vfy.h' 2024-05-16T22:31:25.016 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/x509err.h' -> 'dir/include/openssl/x509err.h' 2024-05-16T22:31:25.066 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/x509v3.h' -> 'dir/include/openssl/x509v3.h' 2024-05-16T22:31:25.108 INFO:teuthology.orchestra.run.smithi196.stdout:'/usr/include/openssl/x509v3err.h' -> 'dir/include/openssl/x509v3err.h' 2024-05-16T22:31:25.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:29:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T22:31:25.192 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'sudo fscrypt purge --force --quiet /home/ubuntu/cephtest/mnt.0') 2024-05-16T22:31:25.269 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:31:25.320 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:31:25.378 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:31:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T22:31:25.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:31:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T22:31:25.967 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-16T22:31:26.016 DEBUG:teuthology.orchestra.run.smithi044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-16T22:31:26.098 DEBUG:teuthology.orchestra.run.smithi070:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-16T22:31:26.164 DEBUG:teuthology.orchestra.run.smithi196:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-16T22:31:26.303 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-16T22:31:26.333 INFO:tasks.cephfs.mount:Terminating background process 2024-05-16T22:31:26.383 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-16T22:31:26.433 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-16T22:31:26.542 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-16T22:31:26.575 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-16T22:31:26.682 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-16T22:31:26.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.836+0000 7f70a2c4c640 1 Processor -- start 2024-05-16T22:31:26.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.836+0000 7f70a2c4c640 1 -- start start 2024-05-16T22:31:26.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.837+0000 7f70a2c4c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f709c0bd440 0x7f709c0bd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:27.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.837+0000 7f70a2c4c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f709c0b8d70 0x7f709c0b9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:27.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.837+0000 7f70a2c4c640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f709c0bdd90 con 0x7f709c14e530 2024-05-16T22:31:27.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.837+0000 7f70a2c4c640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f709c0b88e0 con 0x7f709c0b8d70 2024-05-16T22:31:27.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.837+0000 7f70a2c4c640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f709c14ece0 con 0x7f709c0bd440 2024-05-16T22:31:27.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.837+0000 7f709bfff640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f709c0bd440 0x7f709c0bd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:27.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.837+0000 7f70a11e9640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f709c0b8d70 0x7f709c0b9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:27.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.837+0000 7f70a11e9640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f709c0b8d70 0x7f709c0b9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.44:38580/0 (socket says 172.21.15.44:38580) 2024-05-16T22:31:27.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.837+0000 7f709bfff640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f709c0bd440 0x7f709c0bd850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.44:43258/0 (socket says 172.21.15.44:43258) 2024-05-16T22:31:27.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.837+0000 7f70a11e9640 1 -- 172.21.15.44:0/3930662838 learned_addr learned my addr 172.21.15.44:0/3930662838 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:31:27.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.837+0000 7f70a09e8640 1 --1- 172.21.15.44:0/3930662838 >> v1:172.21.15.70:6789/0 conn(0x7f709c14e530 0x7f709c0ba320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.44:55846/0 (socket says 172.21.15.44:55846) 2024-05-16T22:31:27.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.837+0000 7f709bfff640 1 -- 172.21.15.44:0/3930662838 >> v2:172.21.15.70:3300/0 conn(0x7f709c0b8d70 msgr2=0x7f709c0b9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:31:27.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.837+0000 7f709bfff640 1 --2- 172.21.15.44:0/3930662838 >> v2:172.21.15.70:3300/0 conn(0x7f709c0b8d70 0x7f709c0b9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:27.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.837+0000 7f709bfff640 1 -- 172.21.15.44:0/3930662838 >> v1:172.21.15.70:6789/0 conn(0x7f709c14e530 legacy=0x7f709c0ba320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:27.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.837+0000 7f709bfff640 1 -- 172.21.15.44:0/3930662838 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f709c14efc0 con 0x7f709c0bd440 2024-05-16T22:31:27.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.837+0000 7f70a11e9640 1 --2- 172.21.15.44:0/3930662838 >> v2:172.21.15.70:3300/0 conn(0x7f709c0b8d70 0x7f709c0b9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:31:27.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.838+0000 7f709bfff640 1 --2- 172.21.15.44:0/3930662838 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f709c0bd440 0x7f709c0bd850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f70900097a0 tx=0x7f709002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d915f3b8fc138da4 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:31:27.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.838+0000 7f709b7fe640 1 -- 172.21.15.44:0/3930662838 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7090037070 con 0x7f709c0bd440 2024-05-16T22:31:27.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.838+0000 7f709b7fe640 1 -- 172.21.15.44:0/3930662838 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7090032440 con 0x7f709c0bd440 2024-05-16T22:31:27.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.838+0000 7f709b7fe640 1 -- 172.21.15.44:0/3930662838 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7090032810 con 0x7f709c0bd440 2024-05-16T22:31:27.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.839+0000 7f70a2c4c640 1 -- 172.21.15.44:0/3930662838 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f709c0bd440 msgr2=0x7f709c0bd850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:27.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.839+0000 7f70a2c4c640 1 --2- 172.21.15.44:0/3930662838 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f709c0bd440 0x7f709c0bd850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f70900097a0 tx=0x7f709002a180 comp rx=0 tx=0).stop 2024-05-16T22:31:27.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.839+0000 7f70a2c4c640 1 -- 172.21.15.44:0/3930662838 shutdown_connections 2024-05-16T22:31:28.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.839+0000 7f70a2c4c640 1 --2- 172.21.15.44:0/3930662838 >> v2:172.21.15.70:3300/0 conn(0x7f709c0b8d70 0x7f709c0b9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:28.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.839+0000 7f70a2c4c640 1 --2- 172.21.15.44:0/3930662838 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f709c0bd440 0x7f709c0bd850 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:28.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.839+0000 7f70a2c4c640 1 -- 172.21.15.44:0/3930662838 >> 172.21.15.44:0/3930662838 conn(0x7f709c0c0570 msgr2=0x7f709c0c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:31:28.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.839+0000 7f70a2c4c640 1 -- 172.21.15.44:0/3930662838 shutdown_connections 2024-05-16T22:31:28.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.839+0000 7f70a2c4c640 1 -- 172.21.15.44:0/3930662838 wait complete. 2024-05-16T22:31:28.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.841+0000 7f70a2c4c640 1 Processor -- start 2024-05-16T22:31:28.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.841+0000 7f70a2c4c640 1 -- start start 2024-05-16T22:31:28.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.842+0000 7f70a2c4c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f709c0b8d70 0x7f709c0bc460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:28.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.842+0000 7f70a2c4c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f709c0bd440 0x7f709c1e8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:28.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.842+0000 7f70a2c4c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f709c14e530 0x7f709c1e4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:28.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.842+0000 7f70a2c4c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f709c0b96c0 con 0x7f709c0bd440 2024-05-16T22:31:28.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.842+0000 7f70a2c4c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f709c0bbb70 con 0x7f709c14e530 2024-05-16T22:31:28.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.842+0000 7f70a2c4c640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f709c14e940 con 0x7f709c0b8d70 2024-05-16T22:31:28.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.842+0000 7f709bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f709c0bd440 0x7f709c1e8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:28.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.842+0000 7f709bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f709c0bd440 0x7f709c1e8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56334/0 (socket says 172.21.15.44:56334) 2024-05-16T22:31:28.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.842+0000 7f709bfff640 1 -- 172.21.15.44:0/4027951438 learned_addr learned my addr 172.21.15.44:0/4027951438 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:31:28.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.842+0000 7f70a11e9640 1 --2- 172.21.15.44:0/4027951438 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f709c14e530 0x7f709c1e4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:28.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.842+0000 7f70a09e8640 1 --2- 172.21.15.44:0/4027951438 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f709c0b8d70 0x7f709c0bc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:28.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.842+0000 7f709bfff640 1 -- 172.21.15.44:0/4027951438 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f709c0b8d70 msgr2=0x7f709c0bc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:28.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.842+0000 7f709bfff640 1 --2- 172.21.15.44:0/4027951438 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f709c0b8d70 0x7f709c0bc460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:28.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.842+0000 7f709bfff640 1 -- 172.21.15.44:0/4027951438 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f709c14e530 msgr2=0x7f709c1e4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:29.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.842+0000 7f709bfff640 1 --2- 172.21.15.44:0/4027951438 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f709c14e530 0x7f709c1e4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:29.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.843+0000 7f709bfff640 1 -- 172.21.15.44:0/4027951438 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f709c0bc9a0 con 0x7f709c0bd440 2024-05-16T22:31:29.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.843+0000 7f70a11e9640 1 --2- 172.21.15.44:0/4027951438 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f709c14e530 0x7f709c1e4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:31:29.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.843+0000 7f709bfff640 1 --2- 172.21.15.44:0/4027951438 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f709c0bd440 0x7f709c1e8080 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f70900098c0 tx=0x7f70900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:31:29.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.843+0000 7f70997fa640 1 -- 172.21.15.44:0/4027951438 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7090037040 con 0x7f709c0bd440 2024-05-16T22:31:29.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.843+0000 7f70997fa640 1 -- 172.21.15.44:0/4027951438 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7090030500 con 0x7f709c0bd440 2024-05-16T22:31:29.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.843+0000 7f70a2c4c640 1 -- 172.21.15.44:0/4027951438 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f709c1e85c0 con 0x7f709c0bd440 2024-05-16T22:31:29.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.843+0000 7f70997fa640 1 -- 172.21.15.44:0/4027951438 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70900308d0 con 0x7f709c0bd440 2024-05-16T22:31:29.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.843+0000 7f70a2c4c640 1 -- 172.21.15.44:0/4027951438 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f709c1e87d0 con 0x7f709c0bd440 2024-05-16T22:31:29.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.844+0000 7f70a2c4c640 1 -- 172.21.15.44:0/4027951438 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f709c050940 con 0x7f709c0bd440 2024-05-16T22:31:29.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.845+0000 7f70997fa640 1 -- 172.21.15.44:0/4027951438 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7090044020 con 0x7f709c0bd440 2024-05-16T22:31:29.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.845+0000 7f70997fa640 1 --2- 172.21.15.44:0/4027951438 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f70880762d0 0x7f70880787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:29.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.845+0000 7f70997fa640 1 -- 172.21.15.44:0/4027951438 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f70900b78e0 con 0x7f709c0bd440 2024-05-16T22:31:29.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.845+0000 7f70a09e8640 1 --2- 172.21.15.44:0/4027951438 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f70880762d0 0x7f70880787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:29.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.846+0000 7f70a09e8640 1 --2- 172.21.15.44:0/4027951438 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f70880762d0 0x7f70880787e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7094005fd0 tx=0x7f7094005bc0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:31:29.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:26.850+0000 7f70997fa640 1 -- 172.21.15.44:0/4027951438 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7090081090 con 0x7f709c0bd440 2024-05-16T22:31:29.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:27.052+0000 7f70a2c4c640 1 -- 172.21.15.44:0/4027951438 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f709c0c0bd0 con 0x7f709c0bd440 2024-05-16T22:31:29.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:27.052+0000 7f70997fa640 1 -- 172.21.15.44:0/4027951438 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) ==== 80+0+0 (secure 0 0 0) 0x7f7090080990 con 0x7f709c0bd440 2024-05-16T22:31:29.819 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2024-05-16T22:31:29.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:27.054+0000 7f70a2c4c640 1 -- 172.21.15.44:0/4027951438 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f70880762d0 msgr2=0x7f70880787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:29.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:27.054+0000 7f70a2c4c640 1 --2- 172.21.15.44:0/4027951438 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f70880762d0 0x7f70880787e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7094005fd0 tx=0x7f7094005bc0 comp rx=0 tx=0).stop 2024-05-16T22:31:30.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:27.054+0000 7f70a2c4c640 1 -- 172.21.15.44:0/4027951438 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f709c0bd440 msgr2=0x7f709c1e8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:30.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:27.054+0000 7f70a2c4c640 1 --2- 172.21.15.44:0/4027951438 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f709c0bd440 0x7f709c1e8080 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f70900098c0 tx=0x7f70900046c0 comp rx=0 tx=0).stop 2024-05-16T22:31:30.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:27.054+0000 7f70a2c4c640 1 -- 172.21.15.44:0/4027951438 shutdown_connections 2024-05-16T22:31:30.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:27.054+0000 7f70a2c4c640 1 --2- 172.21.15.44:0/4027951438 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f70880762d0 0x7f70880787e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:30.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:27.054+0000 7f70a2c4c640 1 --2- 172.21.15.44:0/4027951438 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f709c14e530 0x7f709c1e4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:30.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:27.054+0000 7f70a2c4c640 1 --2- 172.21.15.44:0/4027951438 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f709c0bd440 0x7f709c1e8080 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:30.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:27.054+0000 7f70a2c4c640 1 --2- 172.21.15.44:0/4027951438 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f709c0b8d70 0x7f709c0bc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:30.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:27.054+0000 7f70a2c4c640 1 -- 172.21.15.44:0/4027951438 >> 172.21.15.44:0/4027951438 conn(0x7f709c0c0570 msgr2=0x7f709c068600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:31:30.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:27.054+0000 7f70a2c4c640 1 -- 172.21.15.44:0/4027951438 shutdown_connections 2024-05-16T22:31:30.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:27.054+0000 7f70a2c4c640 1 -- 172.21.15.44:0/4027951438 wait complete. 2024-05-16T22:31:30.536 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-16T22:31:30.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T22:31:30.636 DEBUG:teuthology.orchestra.run.smithi196:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-16T22:31:30.804 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi196.front.sepia.ceph.com 2024-05-16T22:31:30.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T22:31:30.936 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-16T22:31:31.043 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T22:31:31.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.196+0000 7f01fc8e2640 1 Processor -- start 2024-05-16T22:31:31.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.196+0000 7f01fc8e2640 1 -- start start 2024-05-16T22:31:31.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.197+0000 7f01fc8e2640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f01f806c8c0 0x7f01f80bb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:31.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.197+0000 7f01fc8e2640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01f80bb9f0 con 0x7f01f8074a30 2024-05-16T22:31:31.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.197+0000 7f01fc8e2640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01f80bbc80 con 0x7f01f8152180 2024-05-16T22:31:31.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.197+0000 7f01fc8e2640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f01f8151a10 con 0x7f01f806c8c0 2024-05-16T22:31:31.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.197+0000 7f01f659c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f01f806c8c0 0x7f01f80bb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:31.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.197+0000 7f01f6d9d640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f01f8074a30 0x7f01f8158d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:42704/0 (socket says 172.21.15.44:42704) 2024-05-16T22:31:31.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.197+0000 7f01f659c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f01f806c8c0 0x7f01f80bb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58556/0 (socket says 172.21.15.44:58556) 2024-05-16T22:31:31.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.197+0000 7f01f6d9d640 1 -- 172.21.15.44:0/2964207990 learned_addr learned my addr 172.21.15.44:0/2964207990 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:31:31.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.198+0000 7f01f659c640 1 -- 172.21.15.44:0/2964207990 >> v1:172.21.15.70:6789/0 conn(0x7f01f8152180 legacy=0x7f01f8074320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:31.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.198+0000 7f01f659c640 1 -- 172.21.15.44:0/2964207990 >> v1:172.21.15.44:6789/0 conn(0x7f01f8074a30 legacy=0x7f01f8158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:31.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.198+0000 7f01f659c640 1 -- 172.21.15.44:0/2964207990 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01f80bbf60 con 0x7f01f806c8c0 2024-05-16T22:31:31.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.198+0000 7f01f5d9b640 1 -- 172.21.15.44:0/2964207990 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2938773233 0 0) 0x7f01f80bb9f0 con 0x7f01f8074a30 2024-05-16T22:31:31.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.198+0000 7f01f659c640 1 --2- 172.21.15.44:0/2964207990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01f806c8c0 0x7f01f80bb4b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f01e80097a0 tx=0x7f01e802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=686928bb7e3f6c0b server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:31:31.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.199+0000 7f01f5d9b640 1 -- 172.21.15.44:0/2964207990 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e8037070 con 0x7f01f806c8c0 2024-05-16T22:31:32.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.199+0000 7f01f5d9b640 1 -- 172.21.15.44:0/2964207990 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01e8032440 con 0x7f01f806c8c0 2024-05-16T22:31:32.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.199+0000 7f01f5d9b640 1 -- 172.21.15.44:0/2964207990 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e8032810 con 0x7f01f806c8c0 2024-05-16T22:31:32.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.199+0000 7f01fc8e2640 1 -- 172.21.15.44:0/2964207990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01f806c8c0 msgr2=0x7f01f80bb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:32.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.199+0000 7f01fc8e2640 1 --2- 172.21.15.44:0/2964207990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01f806c8c0 0x7f01f80bb4b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f01e80097a0 tx=0x7f01e802a230 comp rx=0 tx=0).stop 2024-05-16T22:31:32.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.199+0000 7f01fc8e2640 1 -- 172.21.15.44:0/2964207990 shutdown_connections 2024-05-16T22:31:32.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.199+0000 7f01fc8e2640 1 --2- 172.21.15.44:0/2964207990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01f806c8c0 0x7f01f80bb4b0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:32.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.199+0000 7f01fc8e2640 1 -- 172.21.15.44:0/2964207990 >> 172.21.15.44:0/2964207990 conn(0x7f01f80bd0f0 msgr2=0x7f01f80bd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:31:32.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.199+0000 7f01fc8e2640 1 -- 172.21.15.44:0/2964207990 shutdown_connections 2024-05-16T22:31:32.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.199+0000 7f01fc8e2640 1 -- 172.21.15.44:0/2964207990 wait complete. 2024-05-16T22:31:32.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.201+0000 7f01fc8e2640 1 Processor -- start 2024-05-16T22:31:32.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.201+0000 7f01fc8e2640 1 -- start start 2024-05-16T22:31:32.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.202+0000 7f01fc8e2640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f01f806c8c0 0x7f01f8150830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:32.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.202+0000 7f01fc8e2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01f8074a30 0x7f01f81e49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:32.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.202+0000 7f01fc8e2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01f8152180 0x7f01f814b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:32.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.202+0000 7f01fc8e2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f01f814e4c0 con 0x7f01f8074a30 2024-05-16T22:31:32.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.202+0000 7f01fc8e2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f01f80bb090 con 0x7f01f8152180 2024-05-16T22:31:32.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.202+0000 7f01fc8e2640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f01f806ccd0 con 0x7f01f806c8c0 2024-05-16T22:31:32.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.202+0000 7f01effff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01f8074a30 0x7f01f81e49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:32.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.202+0000 7f01effff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01f8074a30 0x7f01f81e49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58562/0 (socket says 172.21.15.44:58562) 2024-05-16T22:31:33.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.202+0000 7f01effff640 1 -- 172.21.15.44:0/2774976770 learned_addr learned my addr 172.21.15.44:0/2774976770 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:31:33.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.202+0000 7f01f6d9d640 1 --2- 172.21.15.44:0/2774976770 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01f8152180 0x7f01f814b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:33.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.202+0000 7f01f659c640 1 --2- 172.21.15.44:0/2774976770 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f01f806c8c0 0x7f01f8150830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:33.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.203+0000 7f01effff640 1 -- 172.21.15.44:0/2774976770 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f01f806c8c0 msgr2=0x7f01f8150830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:33.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.203+0000 7f01effff640 1 --2- 172.21.15.44:0/2774976770 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f01f806c8c0 0x7f01f8150830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:33.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.203+0000 7f01effff640 1 -- 172.21.15.44:0/2774976770 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01f8152180 msgr2=0x7f01f814b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:33.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.203+0000 7f01effff640 1 --2- 172.21.15.44:0/2774976770 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01f8152180 0x7f01f814b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:33.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.203+0000 7f01effff640 1 -- 172.21.15.44:0/2774976770 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01f8150d70 con 0x7f01f8074a30 2024-05-16T22:31:33.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.203+0000 7f01f659c640 1 --2- 172.21.15.44:0/2774976770 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f01f806c8c0 0x7f01f8150830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:31:33.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.203+0000 7f01f6d9d640 1 --2- 172.21.15.44:0/2774976770 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01f8152180 0x7f01f814b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:31:33.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.203+0000 7f01effff640 1 --2- 172.21.15.44:0/2774976770 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01f8074a30 0x7f01f81e49d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f01e000c3d0 tx=0x7f01e000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:31:33.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.203+0000 7f01eeffd640 1 -- 172.21.15.44:0/2774976770 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e0017070 con 0x7f01f8074a30 2024-05-16T22:31:33.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.203+0000 7f01eeffd640 1 -- 172.21.15.44:0/2774976770 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01e00052d0 con 0x7f01f8074a30 2024-05-16T22:31:33.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.203+0000 7f01fc8e2640 1 -- 172.21.15.44:0/2774976770 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01f81e4f10 con 0x7f01f8074a30 2024-05-16T22:31:33.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.203+0000 7f01eeffd640 1 -- 172.21.15.44:0/2774976770 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e00037f0 con 0x7f01f8074a30 2024-05-16T22:31:33.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.203+0000 7f01fc8e2640 1 -- 172.21.15.44:0/2774976770 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01f80b5610 con 0x7f01f8074a30 2024-05-16T22:31:33.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.204+0000 7f01fc8e2640 1 -- 172.21.15.44:0/2774976770 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01f80be3f0 con 0x7f01f8074a30 2024-05-16T22:31:33.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.205+0000 7f01eeffd640 1 -- 172.21.15.44:0/2774976770 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f01e001a070 con 0x7f01f8074a30 2024-05-16T22:31:33.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.205+0000 7f01eeffd640 1 --2- 172.21.15.44:0/2774976770 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f01d8076300 0x7f01d8078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:33.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.206+0000 7f01eeffd640 1 -- 172.21.15.44:0/2774976770 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f01e0096810 con 0x7f01f8074a30 2024-05-16T22:31:33.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.206+0000 7f01f659c640 1 --2- 172.21.15.44:0/2774976770 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f01d8076300 0x7f01d8078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:34.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.206+0000 7f01f659c640 1 --2- 172.21.15.44:0/2774976770 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f01d8076300 0x7f01d8078810 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f01e8034000 tx=0x7f01e802e000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:31:34.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.210+0000 7f01eeffd640 1 -- 172.21.15.44:0/2774976770 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f01e005fa80 con 0x7f01f8074a30 2024-05-16T22:31:34.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.444+0000 7f01fc8e2640 1 -- 172.21.15.44:0/2774976770 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f01f8050940 con 0x7f01f8074a30 2024-05-16T22:31:34.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.444+0000 7f01eeffd640 1 -- 172.21.15.44:0/2774976770 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+4357 (secure 0 0 0) 0x7f01e00680c0 con 0x7f01f8074a30 2024-05-16T22:31:34.213 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:31:34.255 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4657,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3963814730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3963814730},{"type":"v1","addr":"172.21.15.70:6835","nonce":3963814730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4672,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/3024807024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3024807024},{"type":"v1","addr":"172.21.15.44:6835","nonce":3024807024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T22:28:26.864128+0000","modified":"2024-05-16T22:28:38.972823+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4728},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4728":{"gid":4728,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.44:6834/2647971069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2647971069},{"type":"v1","addr":"172.21.15.44:6834","nonce":2647971069}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4728,"qdb_cluster":[4728]},"id":2}]} 2024-05-16T22:31:34.323 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 16 2024-05-16T22:31:34.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.447+0000 7f01fc8e2640 1 -- 172.21.15.44:0/2774976770 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f01d8076300 msgr2=0x7f01d8078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:34.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.447+0000 7f01fc8e2640 1 --2- 172.21.15.44:0/2774976770 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f01d8076300 0x7f01d8078810 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f01e8034000 tx=0x7f01e802e000 comp rx=0 tx=0).stop 2024-05-16T22:31:34.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.447+0000 7f01fc8e2640 1 -- 172.21.15.44:0/2774976770 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01f8074a30 msgr2=0x7f01f81e49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:34.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.447+0000 7f01fc8e2640 1 --2- 172.21.15.44:0/2774976770 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01f8074a30 0x7f01f81e49d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f01e000c3d0 tx=0x7f01e000c890 comp rx=0 tx=0).stop 2024-05-16T22:31:34.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.447+0000 7f01fc8e2640 1 -- 172.21.15.44:0/2774976770 shutdown_connections 2024-05-16T22:31:34.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.447+0000 7f01fc8e2640 1 --2- 172.21.15.44:0/2774976770 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f01d8076300 0x7f01d8078810 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:34.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.447+0000 7f01fc8e2640 1 --2- 172.21.15.44:0/2774976770 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01f8152180 0x7f01f814b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:34.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.447+0000 7f01fc8e2640 1 --2- 172.21.15.44:0/2774976770 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01f8074a30 0x7f01f81e49d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:34.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.447+0000 7f01fc8e2640 1 --2- 172.21.15.44:0/2774976770 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f01f806c8c0 0x7f01f8150830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:34.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.447+0000 7f01fc8e2640 1 -- 172.21.15.44:0/2774976770 >> 172.21.15.44:0/2774976770 conn(0x7f01f80bd0f0 msgr2=0x7f01f80be760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:31:34.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.447+0000 7f01fc8e2640 1 -- 172.21.15.44:0/2774976770 shutdown_connections 2024-05-16T22:31:34.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:31.447+0000 7f01fc8e2640 1 -- 172.21.15.44:0/2774976770 wait complete. 2024-05-16T22:31:34.864 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T22:31:35.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.031+0000 7f0725576640 1 Processor -- start 2024-05-16T22:31:35.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.031+0000 7f0725576640 1 -- start start 2024-05-16T22:31:35.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.032+0000 7f0725576640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f07200bc1c0 0x7f07200a0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:35.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.033+0000 7f0725576640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0720071150 con 0x7f072014c8e0 2024-05-16T22:31:35.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.033+0000 7f0725576640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f072014c120 con 0x7f0720146380 2024-05-16T22:31:35.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.033+0000 7f0725576640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f072014c450 con 0x7f07200bc1c0 2024-05-16T22:31:35.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.033+0000 7f071f7fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f072014c8e0 0x7f0720156a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:42708/0 (socket says 172.21.15.44:42708) 2024-05-16T22:31:35.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.033+0000 7f071f7fe640 1 -- 172.21.15.44:0/1796864608 learned_addr learned my addr 172.21.15.44:0/1796864608 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:31:35.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.033+0000 7f071effd640 1 --2- 172.21.15.44:0/1796864608 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f07200bc1c0 0x7f07200a0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:35.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.033+0000 7f071dffb640 1 -- 172.21.15.44:0/1796864608 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2947732127 0 0) 0x7f0710001490 con 0x7f072014c8e0 2024-05-16T22:31:35.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.033+0000 7f071dffb640 1 -- 172.21.15.44:0/1796864608 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0708003520 con 0x7f072014c8e0 2024-05-16T22:31:35.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.033+0000 7f071dffb640 1 -- 172.21.15.44:0/1796864608 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3229508151 0 0) 0x7f072014c120 con 0x7f0720146380 2024-05-16T22:31:35.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.033+0000 7f071dffb640 1 -- 172.21.15.44:0/1796864608 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0710001490 con 0x7f0720146380 2024-05-16T22:31:35.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.033+0000 7f071dffb640 1 -- 172.21.15.44:0/1796864608 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3113967424 0 0) 0x7f0708003520 con 0x7f072014c8e0 2024-05-16T22:31:35.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.033+0000 7f071dffb640 1 -- 172.21.15.44:0/1796864608 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f07200bc1c0 msgr2=0x7f07200a0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:31:35.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.033+0000 7f071dffb640 1 --2- 172.21.15.44:0/1796864608 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f07200bc1c0 0x7f07200a0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:35.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.033+0000 7f071dffb640 1 -- 172.21.15.44:0/1796864608 >> v1:172.21.15.70:6789/0 conn(0x7f0720146380 legacy=0x7f0720070a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:35.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.033+0000 7f071dffb640 1 -- 172.21.15.44:0/1796864608 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0720071e40 con 0x7f072014c8e0 2024-05-16T22:31:35.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.033+0000 7f071dffb640 1 -- 172.21.15.44:0/1796864608 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 568431863 0 0) 0x7f0710001c40 con 0x7f072014c8e0 2024-05-16T22:31:35.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.033+0000 7f071dffb640 1 -- 172.21.15.44:0/1796864608 >> v1:172.21.15.44:6789/0 conn(0x7f072014c8e0 legacy=0x7f0720156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:35.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.033+0000 7f071dffb640 1 --2- 172.21.15.44:0/1796864608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0708003c10 0x7f0708004080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:35.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.033+0000 7f071dffb640 1 --2- 172.21.15.44:0/1796864608 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f07200bc1c0 0x7f0708004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:36.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.033+0000 7f071dffb640 1 --2- 172.21.15.44:0/1796864608 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0708004d90 0x7f0708005240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:36.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.033+0000 7f071dffb640 1 -- 172.21.15.44:0/1796864608 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f072014c450 con 0x7f0708004d90 2024-05-16T22:31:36.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.033+0000 7f071dffb640 1 -- 172.21.15.44:0/1796864608 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f070800bbd0 con 0x7f0708003c10 2024-05-16T22:31:36.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.033+0000 7f071dffb640 1 -- 172.21.15.44:0/1796864608 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f070800bdd0 con 0x7f07200bc1c0 2024-05-16T22:31:36.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.034+0000 7f071f7fe640 1 --2- 172.21.15.44:0/1796864608 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0708004d90 0x7f0708005240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:36.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.034+0000 7f071effd640 1 --2- 172.21.15.44:0/1796864608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0708003c10 0x7f0708004080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:36.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.034+0000 7f071e7fc640 1 --2- 172.21.15.44:0/1796864608 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f07200bc1c0 0x7f0708004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:36.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.034+0000 7f071f7fe640 1 -- 172.21.15.44:0/1796864608 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f07200bc1c0 msgr2=0x7f0708004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:31:36.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.034+0000 7f071f7fe640 1 --2- 172.21.15.44:0/1796864608 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f07200bc1c0 0x7f0708004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:36.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.034+0000 7f071f7fe640 1 -- 172.21.15.44:0/1796864608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0708003c10 msgr2=0x7f0708004080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:31:36.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.034+0000 7f071f7fe640 1 --2- 172.21.15.44:0/1796864608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0708003c10 0x7f0708004080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:36.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.034+0000 7f071f7fe640 1 -- 172.21.15.44:0/1796864608 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0708003520 con 0x7f0708004d90 2024-05-16T22:31:36.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.035+0000 7f071f7fe640 1 --2- 172.21.15.44:0/1796864608 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0708004d90 0x7f0708005240 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f07200bf150 tx=0x7f0708005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cef7977f861b6e24 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:31:36.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.035+0000 7f071dffb640 1 -- 172.21.15.44:0/1796864608 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f071000a600 con 0x7f0708004d90 2024-05-16T22:31:36.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.035+0000 7f071dffb640 1 -- 172.21.15.44:0/1796864608 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f071002f070 con 0x7f0708004d90 2024-05-16T22:31:36.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.035+0000 7f071dffb640 1 -- 172.21.15.44:0/1796864608 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f071002bcf0 con 0x7f0708004d90 2024-05-16T22:31:36.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.035+0000 7f0725576640 1 -- 172.21.15.44:0/1796864608 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0708004d90 msgr2=0x7f0708005240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:36.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.035+0000 7f0725576640 1 --2- 172.21.15.44:0/1796864608 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0708004d90 0x7f0708005240 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f07200bf150 tx=0x7f0708005830 comp rx=0 tx=0).stop 2024-05-16T22:31:36.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.035+0000 7f071f7fe640 1 -- 172.21.15.44:0/1796864608 reap_dead start 2024-05-16T22:31:36.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.036+0000 7f0725576640 1 -- 172.21.15.44:0/1796864608 shutdown_connections 2024-05-16T22:31:36.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.036+0000 7f0725576640 1 -- 172.21.15.44:0/1796864608 >> 172.21.15.44:0/1796864608 conn(0x7f07200c17c0 msgr2=0x7f07200c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:31:36.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.036+0000 7f0725576640 1 -- 172.21.15.44:0/1796864608 shutdown_connections 2024-05-16T22:31:36.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.036+0000 7f0725576640 1 -- 172.21.15.44:0/1796864608 wait complete. 2024-05-16T22:31:37.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.037+0000 7f0725576640 1 Processor -- start 2024-05-16T22:31:37.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.037+0000 7f0725576640 1 -- start start 2024-05-16T22:31:37.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.038+0000 7f0725576640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f072014b260 0x7f07200a4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:37.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.038+0000 7f0725576640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07201e2190 0x7f07201e25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:37.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.039+0000 7f0725576640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f072013f8e0 0x7f072013fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:37.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.039+0000 7f0725576640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0720146790 con 0x7f07201e2190 2024-05-16T22:31:37.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.039+0000 7f0725576640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f07200716b0 con 0x7f072014b260 2024-05-16T22:31:37.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.039+0000 7f0725576640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f07200bd5f0 con 0x7f072013f8e0 2024-05-16T22:31:37.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.039+0000 7f071e7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07201e2190 0x7f07201e25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:37.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.039+0000 7f071e7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07201e2190 0x7f07201e25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58574/0 (socket says 172.21.15.44:58574) 2024-05-16T22:31:37.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.039+0000 7f071e7fc640 1 -- 172.21.15.44:0/1673866490 learned_addr learned my addr 172.21.15.44:0/1673866490 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:31:37.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.039+0000 7f071effd640 1 --2- 172.21.15.44:0/1673866490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f072014b260 0x7f07200a4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:37.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.039+0000 7f071f7fe640 1 --2- 172.21.15.44:0/1673866490 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f072013f8e0 0x7f072013fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:37.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.039+0000 7f071e7fc640 1 -- 172.21.15.44:0/1673866490 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f072013f8e0 msgr2=0x7f072013fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:37.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.039+0000 7f071e7fc640 1 --2- 172.21.15.44:0/1673866490 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f072013f8e0 0x7f072013fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:37.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.039+0000 7f071e7fc640 1 -- 172.21.15.44:0/1673866490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f072014b260 msgr2=0x7f07200a4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:37.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.039+0000 7f071e7fc640 1 --2- 172.21.15.44:0/1673866490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f072014b260 0x7f07200a4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:37.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.039+0000 7f071e7fc640 1 -- 172.21.15.44:0/1673866490 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07200a5400 con 0x7f07201e2190 2024-05-16T22:31:37.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.039+0000 7f071e7fc640 1 --2- 172.21.15.44:0/1673866490 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07201e2190 0x7f07201e25a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f071400f820 tx=0x7f071400fc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:31:37.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.039+0000 7f07077fe640 1 -- 172.21.15.44:0/1673866490 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f071400fe70 con 0x7f07201e2190 2024-05-16T22:31:37.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.039+0000 7f07077fe640 1 -- 172.21.15.44:0/1673866490 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0714018070 con 0x7f07201e2190 2024-05-16T22:31:37.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.039+0000 7f0725576640 1 -- 172.21.15.44:0/1673866490 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07201e2ae0 con 0x7f07201e2190 2024-05-16T22:31:37.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.039+0000 7f07077fe640 1 -- 172.21.15.44:0/1673866490 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f071400d730 con 0x7f07201e2190 2024-05-16T22:31:38.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.039+0000 7f0725576640 1 -- 172.21.15.44:0/1673866490 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07201e5d20 con 0x7f07201e2190 2024-05-16T22:31:38.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.040+0000 7f0725576640 1 -- 172.21.15.44:0/1673866490 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07200bed70 con 0x7f07201e2190 2024-05-16T22:31:38.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.041+0000 7f07077fe640 1 -- 172.21.15.44:0/1673866490 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f071400d8d0 con 0x7f07201e2190 2024-05-16T22:31:38.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.042+0000 7f07077fe640 1 --2- 172.21.15.44:0/1673866490 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f070c0762d0 0x7f070c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:38.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.042+0000 7f07077fe640 1 -- 172.21.15.44:0/1673866490 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f0714097480 con 0x7f07201e2190 2024-05-16T22:31:38.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.042+0000 7f071effd640 1 --2- 172.21.15.44:0/1673866490 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f070c0762d0 0x7f070c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:38.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.043+0000 7f071effd640 1 --2- 172.21.15.44:0/1673866490 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f070c0762d0 0x7f070c0787e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0720141ef0 tx=0x7f0718009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:31:38.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.047+0000 7f07077fe640 1 -- 172.21.15.44:0/1673866490 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0714060d40 con 0x7f07201e2190 2024-05-16T22:31:38.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.277+0000 7f0725576640 1 -- 172.21.15.44:0/1673866490 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0720050940 con 0x7f07201e2190 2024-05-16T22:31:38.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.277+0000 7f07077fe640 1 -- 172.21.15.44:0/1673866490 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+4357 (secure 0 0 0) 0x7f0714060640 con 0x7f07201e2190 2024-05-16T22:31:38.466 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:31:38.508 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4657,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3963814730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3963814730},{"type":"v1","addr":"172.21.15.70:6835","nonce":3963814730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4672,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/3024807024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3024807024},{"type":"v1","addr":"172.21.15.44:6835","nonce":3024807024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T22:28:26.864128+0000","modified":"2024-05-16T22:28:38.972823+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4728},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4728":{"gid":4728,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.44:6834/2647971069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2647971069},{"type":"v1","addr":"172.21.15.44:6834","nonce":2647971069}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4728,"qdb_cluster":[4728]},"id":2}]} 2024-05-16T22:31:38.550 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 16 2024-05-16T22:31:38.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.279+0000 7f0725576640 1 -- 172.21.15.44:0/1673866490 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f070c0762d0 msgr2=0x7f070c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:38.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.279+0000 7f0725576640 1 --2- 172.21.15.44:0/1673866490 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f070c0762d0 0x7f070c0787e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0720141ef0 tx=0x7f0718009190 comp rx=0 tx=0).stop 2024-05-16T22:31:38.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.279+0000 7f0725576640 1 -- 172.21.15.44:0/1673866490 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07201e2190 msgr2=0x7f07201e25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:38.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.279+0000 7f0725576640 1 --2- 172.21.15.44:0/1673866490 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07201e2190 0x7f07201e25a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f071400f820 tx=0x7f071400fc20 comp rx=0 tx=0).stop 2024-05-16T22:31:38.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.279+0000 7f0725576640 1 -- 172.21.15.44:0/1673866490 shutdown_connections 2024-05-16T22:31:38.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.279+0000 7f0725576640 1 --2- 172.21.15.44:0/1673866490 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f070c0762d0 0x7f070c0787e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:38.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.279+0000 7f0725576640 1 --2- 172.21.15.44:0/1673866490 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f072013f8e0 0x7f072013fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:38.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.279+0000 7f0725576640 1 --2- 172.21.15.44:0/1673866490 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07201e2190 0x7f07201e25a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:38.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.279+0000 7f0725576640 1 --2- 172.21.15.44:0/1673866490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f072014b260 0x7f07200a4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:38.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.279+0000 7f0725576640 1 -- 172.21.15.44:0/1673866490 >> 172.21.15.44:0/1673866490 conn(0x7f07200c17c0 msgr2=0x7f0720142160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:31:39.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.279+0000 7f0725576640 1 -- 172.21.15.44:0/1673866490 shutdown_connections 2024-05-16T22:31:39.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:35.279+0000 7f0725576640 1 -- 172.21.15.44:0/1673866490 wait complete. 2024-05-16T22:31:39.109 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-16T22:31:39.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.276+0000 7f4f834f9640 1 Processor -- start 2024-05-16T22:31:39.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.277+0000 7f4f834f9640 1 -- start start 2024-05-16T22:31:39.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.278+0000 7f4f834f9640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4f7c14e530 0x7f4f7c0ba320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:39.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.278+0000 7f4f834f9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4f7c0b8d70 0x7f4f7c0b9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:39.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.278+0000 7f4f834f9640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f7c0ba860 con 0x7f4f7c0bd440 2024-05-16T22:31:39.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.278+0000 7f4f834f9640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f4f7c0b88e0 con 0x7f4f7c0b8d70 2024-05-16T22:31:39.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.278+0000 7f4f834f9640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f4f7c14ece0 con 0x7f4f7c14e530 2024-05-16T22:31:39.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.278+0000 7f4f81a96640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4f7c0b8d70 0x7f4f7c0b9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:39.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.278+0000 7f4f80a94640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f4f7c0bd440 0x7f4f7c0bd850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:42714/0 (socket says 172.21.15.44:42714) 2024-05-16T22:31:39.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.278+0000 7f4f81a96640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4f7c0b8d70 0x7f4f7c0b9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58578/0 (socket says 172.21.15.44:58578) 2024-05-16T22:31:39.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.278+0000 7f4f80a94640 1 -- 172.21.15.44:0/1064523993 learned_addr learned my addr 172.21.15.44:0/1064523993 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:31:39.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.278+0000 7f4f81295640 1 --2- 172.21.15.44:0/1064523993 >> v2:172.21.15.70:3300/0 conn(0x7f4f7c14e530 0x7f4f7c0ba320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:39.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.278+0000 7f4f81a96640 1 -- 172.21.15.44:0/1064523993 >> v2:172.21.15.70:3300/0 conn(0x7f4f7c14e530 msgr2=0x7f4f7c0ba320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:31:39.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.278+0000 7f4f81a96640 1 --2- 172.21.15.44:0/1064523993 >> v2:172.21.15.70:3300/0 conn(0x7f4f7c14e530 0x7f4f7c0ba320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:39.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.278+0000 7f4f81a96640 1 -- 172.21.15.44:0/1064523993 >> v1:172.21.15.44:6789/0 conn(0x7f4f7c0bd440 legacy=0x7f4f7c0bd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:40.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.278+0000 7f4f73fff640 1 -- 172.21.15.44:0/1064523993 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 779104661 0 0) 0x7f4f7c0ba860 con 0x7f4f7c0bd440 2024-05-16T22:31:40.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.278+0000 7f4f81a96640 1 -- 172.21.15.44:0/1064523993 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f7c14efc0 con 0x7f4f7c0b8d70 2024-05-16T22:31:40.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.279+0000 7f4f81a96640 1 --2- 172.21.15.44:0/1064523993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f7c0b8d70 0x7f4f7c0b9180 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c08d0d0 tx=0x7f4f7402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b8539dfa121bf3a server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:31:40.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.279+0000 7f4f73fff640 1 -- 172.21.15.44:0/1064523993 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f74007740 con 0x7f4f7c0b8d70 2024-05-16T22:31:40.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.279+0000 7f4f73fff640 1 -- 172.21.15.44:0/1064523993 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f740078e0 con 0x7f4f7c0b8d70 2024-05-16T22:31:40.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.279+0000 7f4f73fff640 1 -- 172.21.15.44:0/1064523993 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f74007cb0 con 0x7f4f7c0b8d70 2024-05-16T22:31:40.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.280+0000 7f4f834f9640 1 -- 172.21.15.44:0/1064523993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f7c0b8d70 msgr2=0x7f4f7c0b9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:40.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.280+0000 7f4f834f9640 1 --2- 172.21.15.44:0/1064523993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f7c0b8d70 0x7f4f7c0b9180 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c08d0d0 tx=0x7f4f7402a680 comp rx=0 tx=0).stop 2024-05-16T22:31:40.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.280+0000 7f4f834f9640 1 -- 172.21.15.44:0/1064523993 shutdown_connections 2024-05-16T22:31:40.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.280+0000 7f4f834f9640 1 --2- 172.21.15.44:0/1064523993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f7c0b8d70 0x7f4f7c0b9180 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:40.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.280+0000 7f4f834f9640 1 --2- 172.21.15.44:0/1064523993 >> v2:172.21.15.70:3300/0 conn(0x7f4f7c14e530 0x7f4f7c0ba320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:40.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.280+0000 7f4f834f9640 1 -- 172.21.15.44:0/1064523993 >> 172.21.15.44:0/1064523993 conn(0x7f4f7c0c0570 msgr2=0x7f4f7c0c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:31:40.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.280+0000 7f4f834f9640 1 -- 172.21.15.44:0/1064523993 shutdown_connections 2024-05-16T22:31:40.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.280+0000 7f4f834f9640 1 -- 172.21.15.44:0/1064523993 wait complete. 2024-05-16T22:31:40.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.282+0000 7f4f834f9640 1 Processor -- start 2024-05-16T22:31:40.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.282+0000 7f4f834f9640 1 -- start start 2024-05-16T22:31:40.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.283+0000 7f4f834f9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f7c0b8d70 0x7f4f7c140b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:40.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.283+0000 7f4f834f9640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4f7c0bd440 0x7f4f7c1e4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:40.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.283+0000 7f4f834f9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f7c14e530 0x7f4f7c13d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:40.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.283+0000 7f4f834f9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7c0b96c0 con 0x7f4f7c0b8d70 2024-05-16T22:31:40.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.283+0000 7f4f834f9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7c0bbb70 con 0x7f4f7c14e530 2024-05-16T22:31:40.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.283+0000 7f4f834f9640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f4f7c14e940 con 0x7f4f7c0bd440 2024-05-16T22:31:40.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.283+0000 7f4f81295640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f7c0b8d70 0x7f4f7c140b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:41.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.283+0000 7f4f81295640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f7c0b8d70 0x7f4f7c140b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58590/0 (socket says 172.21.15.44:58590) 2024-05-16T22:31:41.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.283+0000 7f4f81295640 1 -- 172.21.15.44:0/2675217402 learned_addr learned my addr 172.21.15.44:0/2675217402 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:31:41.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.283+0000 7f4f80a94640 1 --2- 172.21.15.44:0/2675217402 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4f7c0bd440 0x7f4f7c1e4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:41.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.283+0000 7f4f81a96640 1 --2- 172.21.15.44:0/2675217402 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f7c14e530 0x7f4f7c13d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:41.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.283+0000 7f4f81295640 1 -- 172.21.15.44:0/2675217402 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4f7c0bd440 msgr2=0x7f4f7c1e4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:41.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.283+0000 7f4f81295640 1 --2- 172.21.15.44:0/2675217402 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4f7c0bd440 0x7f4f7c1e4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:41.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.283+0000 7f4f81295640 1 -- 172.21.15.44:0/2675217402 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f7c14e530 msgr2=0x7f4f7c13d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:41.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.283+0000 7f4f81295640 1 --2- 172.21.15.44:0/2675217402 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f7c14e530 0x7f4f7c13d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:41.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.283+0000 7f4f81295640 1 -- 172.21.15.44:0/2675217402 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f7c1410a0 con 0x7f4f7c0b8d70 2024-05-16T22:31:41.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.283+0000 7f4f81295640 1 --2- 172.21.15.44:0/2675217402 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f7c0b8d70 0x7f4f7c140b60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4f7800d800 tx=0x7f4f7800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:31:41.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.284+0000 7f4f71ffb640 1 -- 172.21.15.44:0/2675217402 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f78018020 con 0x7f4f7c0b8d70 2024-05-16T22:31:41.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.284+0000 7f4f71ffb640 1 -- 172.21.15.44:0/2675217402 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f780096c0 con 0x7f4f7c0b8d70 2024-05-16T22:31:41.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.284+0000 7f4f834f9640 1 -- 172.21.15.44:0/2675217402 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f7c14c330 con 0x7f4f7c0b8d70 2024-05-16T22:31:41.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.284+0000 7f4f71ffb640 1 -- 172.21.15.44:0/2675217402 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f78009ab0 con 0x7f4f7c0b8d70 2024-05-16T22:31:41.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.284+0000 7f4f834f9640 1 -- 172.21.15.44:0/2675217402 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f7c13f6b0 con 0x7f4f7c0b8d70 2024-05-16T22:31:41.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.285+0000 7f4f834f9640 1 -- 172.21.15.44:0/2675217402 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f7c14c500 con 0x7f4f7c0b8d70 2024-05-16T22:31:41.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.286+0000 7f4f71ffb640 1 -- 172.21.15.44:0/2675217402 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4f7801b020 con 0x7f4f7c0b8d70 2024-05-16T22:31:41.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.286+0000 7f4f71ffb640 1 --2- 172.21.15.44:0/2675217402 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4f600762d0 0x7f4f600787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:41.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.286+0000 7f4f71ffb640 1 -- 172.21.15.44:0/2675217402 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f4f78097b30 con 0x7f4f7c0b8d70 2024-05-16T22:31:41.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.286+0000 7f4f80a94640 1 --2- 172.21.15.44:0/2675217402 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4f600762d0 0x7f4f600787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:41.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.287+0000 7f4f80a94640 1 --2- 172.21.15.44:0/2675217402 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4f600762d0 0x7f4f600787e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c0c3330 tx=0x7f4f6c007de0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:31:41.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.291+0000 7f4f71ffb640 1 -- 172.21.15.44:0/2675217402 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4f78022020 con 0x7f4f7c0b8d70 2024-05-16T22:31:42.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.483+0000 7f4f834f9640 1 -- 172.21.15.44:0/2675217402 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4f7c0baa30 con 0x7f4f7c0b8d70 2024-05-16T22:31:42.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.485+0000 7f4f71ffb640 1 -- 172.21.15.44:0/2675217402 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16633 (secure 0 0 0) 0x7f4f7c0baa30 con 0x7f4f7c0b8d70 2024-05-16T22:31:42.094 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:31:42.135 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":34,"fsid":"572ab7cc-b103-4548-ae8f-c6614d57f0c8","created":"2024-05-16T22:27:02.216874+0000","modified":"2024-05-16T22:28:26.864181+0000","last_up_change":"2024-05-16T22:27:13.693953+0000","last_in_change":"2024-05-16T22:27:04.455119+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-16T22:27:14.562409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-16T22:28:20.181977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-16T22:28:23.815306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a7003e89-c706-4562-9f25-670bb35ae108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6825","nonce":1074109859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6827","nonce":1074109859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6831","nonce":1074109859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6829","nonce":1074109859}]},"public_addr":"172.21.15.44:6825/1074109859","cluster_addr":"172.21.15.44:6827/1074109859","heartbeat_back_addr":"172.21.15.44:6831/1074109859","heartbeat_front_addr":"172.21.15.44:6829/1074109859","state":["exists","up"]},{"osd":1,"uuid":"a4d5169d-8327-4494-9c7c-58db21b00636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6817","nonce":2909429972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6819","nonce":2909429972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6823","nonce":2909429972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6821","nonce":2909429972}]},"public_addr":"172.21.15.44:6817/2909429972","cluster_addr":"172.21.15.44:6819/2909429972","heartbeat_back_addr":"172.21.15.44:6823/2909429972","heartbeat_front_addr":"172.21.15.44:6821/2909429972","state":["exists","up"]},{"osd":2,"uuid":"d4a834f8-83a5-400f-9814-eb0a25124df4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6801","nonce":2908194156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6803","nonce":2908194156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6807","nonce":2908194156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6805","nonce":2908194156}]},"public_addr":"172.21.15.44:6801/2908194156","cluster_addr":"172.21.15.44:6803/2908194156","heartbeat_back_addr":"172.21.15.44:6807/2908194156","heartbeat_front_addr":"172.21.15.44:6805/2908194156","state":["exists","up"]},{"osd":3,"uuid":"b9d24a56-ad43-4674-a395-5ec24d135ae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6809","nonce":2168695793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6811","nonce":2168695793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6815","nonce":2168695793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6813","nonce":2168695793}]},"public_addr":"172.21.15.44:6809/2168695793","cluster_addr":"172.21.15.44:6811/2168695793","heartbeat_back_addr":"172.21.15.44:6815/2168695793","heartbeat_front_addr":"172.21.15.44:6813/2168695793","state":["exists","up"]},{"osd":4,"uuid":"9bd94af5-3e17-4cbe-995a-8f837a66c653","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6823","nonce":1540297751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6825","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6827","nonce":1540297751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6831","nonce":1540297751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6829","nonce":1540297751}]},"public_addr":"172.21.15.70:6823/1540297751","cluster_addr":"172.21.15.70:6827/1540297751","heartbeat_back_addr":"172.21.15.70:6831/1540297751","heartbeat_front_addr":"172.21.15.70:6829/1540297751","state":["exists","up"]},{"osd":5,"uuid":"a5b0cfa5-b259-48bd-98b6-96b44f5ebabd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6804","nonce":4218901987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6808","nonce":4218901987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6815","nonce":4218901987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6812","nonce":4218901987}]},"public_addr":"172.21.15.70:6804/4218901987","cluster_addr":"172.21.15.70:6808/4218901987","heartbeat_back_addr":"172.21.15.70:6815/4218901987","heartbeat_front_addr":"172.21.15.70:6812/4218901987","state":["exists","up"]},{"osd":6,"uuid":"0b6af6df-1358-4fc6-a62c-ba57e02914ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6801","nonce":2389556489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6805","nonce":2389556489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6813","nonce":2389556489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6807","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6809","nonce":2389556489}]},"public_addr":"172.21.15.70:6801/2389556489","cluster_addr":"172.21.15.70:6805/2389556489","heartbeat_back_addr":"172.21.15.70:6813/2389556489","heartbeat_front_addr":"172.21.15.70:6809/2389556489","state":["exists","up"]},{"osd":7,"uuid":"eb1a2c5d-42cf-47d0-9e03-b9d26944a589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6817","nonce":3619691281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6819","nonce":3619691281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6826","nonce":3619691281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6822","nonce":3619691281}]},"public_addr":"172.21.15.70:6817/3619691281","cluster_addr":"172.21.15.70:6819/3619691281","heartbeat_back_addr":"172.21.15.70:6826/3619691281","heartbeat_front_addr":"172.21.15.70:6822/3619691281","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.652256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.613348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.528454+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.625204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.678845+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.680829+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.556200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.647030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T22:31:42.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.487+0000 7f4f834f9640 1 -- 172.21.15.44:0/2675217402 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4f600762d0 msgr2=0x7f4f600787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:42.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.487+0000 7f4f834f9640 1 --2- 172.21.15.44:0/2675217402 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4f600762d0 0x7f4f600787e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c0c3330 tx=0x7f4f6c007de0 comp rx=0 tx=0).stop 2024-05-16T22:31:42.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.487+0000 7f4f834f9640 1 -- 172.21.15.44:0/2675217402 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f7c0b8d70 msgr2=0x7f4f7c140b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:42.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.487+0000 7f4f834f9640 1 --2- 172.21.15.44:0/2675217402 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f7c0b8d70 0x7f4f7c140b60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4f7800d800 tx=0x7f4f7800dcc0 comp rx=0 tx=0).stop 2024-05-16T22:31:42.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.487+0000 7f4f834f9640 1 -- 172.21.15.44:0/2675217402 shutdown_connections 2024-05-16T22:31:42.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.487+0000 7f4f834f9640 1 --2- 172.21.15.44:0/2675217402 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4f600762d0 0x7f4f600787e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:42.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.487+0000 7f4f834f9640 1 --2- 172.21.15.44:0/2675217402 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4f7c0bd440 0x7f4f7c1e4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:42.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.487+0000 7f4f834f9640 1 --2- 172.21.15.44:0/2675217402 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f7c14e530 0x7f4f7c13d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:42.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.487+0000 7f4f834f9640 1 --2- 172.21.15.44:0/2675217402 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f7c0b8d70 0x7f4f7c140b60 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:42.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.487+0000 7f4f834f9640 1 -- 172.21.15.44:0/2675217402 >> 172.21.15.44:0/2675217402 conn(0x7f4f7c0c0570 msgr2=0x7f4f7c0ba320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:31:42.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.487+0000 7f4f834f9640 1 -- 172.21.15.44:0/2675217402 shutdown_connections 2024-05-16T22:31:42.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:39.487+0000 7f4f834f9640 1 -- 172.21.15.44:0/2675217402 wait complete. 2024-05-16T22:31:42.703 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-16T22:31:42.744 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T22:31:42.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.912+0000 7f9c88ec6640 1 Processor -- start 2024-05-16T22:31:42.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.912+0000 7f9c88ec6640 1 -- start start 2024-05-16T22:31:43.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.913+0000 7f9c88ec6640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9c84151fc0 0x7f9c840bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:43.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.913+0000 7f9c88ec6640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c840c36f0 con 0x7f9c840bf050 2024-05-16T22:31:43.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.913+0000 7f9c88ec6640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c84152530 con 0x7f9c8406da30 2024-05-16T22:31:43.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.913+0000 7f9c88ec6640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f9c840bdc10 con 0x7f9c84151fc0 2024-05-16T22:31:43.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.913+0000 7f9c8259c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9c84151fc0 0x7f9c840bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:43.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.913+0000 7f9c8259c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9c84151fc0 0x7f9c840bd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36238/0 (socket says 172.21.15.44:36238) 2024-05-16T22:31:43.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.913+0000 7f9c8259c640 1 -- 172.21.15.44:0/3665845131 learned_addr learned my addr 172.21.15.44:0/3665845131 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:31:43.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.914+0000 7f9c8259c640 1 -- 172.21.15.44:0/3665845131 >> v1:172.21.15.70:6789/0 conn(0x7f9c8406da30 legacy=0x7f9c840be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:43.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.914+0000 7f9c8259c640 1 -- 172.21.15.44:0/3665845131 >> v1:172.21.15.44:6789/0 conn(0x7f9c840bf050 legacy=0x7f9c84158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:43.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.914+0000 7f9c8259c640 1 -- 172.21.15.44:0/3665845131 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c84152810 con 0x7f9c84151fc0 2024-05-16T22:31:43.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.914+0000 7f9c8159a640 1 -- 172.21.15.44:0/3665845131 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2679333955 0 0) 0x7f9c840c36f0 con 0x7f9c840bf050 2024-05-16T22:31:43.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.915+0000 7f9c8259c640 1 --2- 172.21.15.44:0/3665845131 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c84151fc0 0x7f9c840bd6d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c009870 tx=0x7f9c7c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd69f2ce97e33e62 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:31:43.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.915+0000 7f9c8159a640 1 -- 172.21.15.44:0/3665845131 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c037070 con 0x7f9c84151fc0 2024-05-16T22:31:43.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.915+0000 7f9c8159a640 1 -- 172.21.15.44:0/3665845131 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c7c02ae50 con 0x7f9c84151fc0 2024-05-16T22:31:43.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.915+0000 7f9c8159a640 1 -- 172.21.15.44:0/3665845131 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c032860 con 0x7f9c84151fc0 2024-05-16T22:31:43.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.915+0000 7f9c88ec6640 1 -- 172.21.15.44:0/3665845131 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c84151fc0 msgr2=0x7f9c840bd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:43.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.915+0000 7f9c88ec6640 1 --2- 172.21.15.44:0/3665845131 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c84151fc0 0x7f9c840bd6d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c009870 tx=0x7f9c7c02a300 comp rx=0 tx=0).stop 2024-05-16T22:31:43.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.916+0000 7f9c88ec6640 1 -- 172.21.15.44:0/3665845131 shutdown_connections 2024-05-16T22:31:43.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.916+0000 7f9c88ec6640 1 --2- 172.21.15.44:0/3665845131 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c84151fc0 0x7f9c840bd6d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:43.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.916+0000 7f9c88ec6640 1 -- 172.21.15.44:0/3665845131 >> 172.21.15.44:0/3665845131 conn(0x7f9c840c3d20 msgr2=0x7f9c840c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:31:43.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.916+0000 7f9c88ec6640 1 -- 172.21.15.44:0/3665845131 shutdown_connections 2024-05-16T22:31:43.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.916+0000 7f9c88ec6640 1 -- 172.21.15.44:0/3665845131 wait complete. 2024-05-16T22:31:43.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.917+0000 7f9c88ec6640 1 Processor -- start 2024-05-16T22:31:43.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.917+0000 7f9c88ec6640 1 -- start start 2024-05-16T22:31:43.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.918+0000 7f9c88ec6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c8406da30 0x7f9c841e8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:43.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.918+0000 7f9c88ec6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c840bf050 0x7f9c840b7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:43.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.918+0000 7f9c88ec6640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9c84151fc0 0x7f9c840b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:43.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.918+0000 7f9c88ec6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9c840a3050 con 0x7f9c8406da30 2024-05-16T22:31:44.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.918+0000 7f9c88ec6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9c840a2ed0 con 0x7f9c840bf050 2024-05-16T22:31:44.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.918+0000 7f9c88ec6640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f9c8406de40 con 0x7f9c84151fc0 2024-05-16T22:31:44.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.918+0000 7f9c8259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c8406da30 0x7f9c841e8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:44.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.919+0000 7f9c8259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c8406da30 0x7f9c841e8150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36250/0 (socket says 172.21.15.44:36250) 2024-05-16T22:31:44.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.919+0000 7f9c8259c640 1 -- 172.21.15.44:0/1654197135 learned_addr learned my addr 172.21.15.44:0/1654197135 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:31:44.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.919+0000 7f9c81d9b640 1 --2- 172.21.15.44:0/1654197135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c840bf050 0x7f9c840b7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:44.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.919+0000 7f9c82d9d640 1 --2- 172.21.15.44:0/1654197135 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9c84151fc0 0x7f9c840b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:44.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.919+0000 7f9c8259c640 1 -- 172.21.15.44:0/1654197135 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9c84151fc0 msgr2=0x7f9c840b89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:44.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.919+0000 7f9c8259c640 1 --2- 172.21.15.44:0/1654197135 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9c84151fc0 0x7f9c840b89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:44.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.919+0000 7f9c8259c640 1 -- 172.21.15.44:0/1654197135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c840bf050 msgr2=0x7f9c840b7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:44.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.919+0000 7f9c8259c640 1 --2- 172.21.15.44:0/1654197135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c840bf050 0x7f9c840b7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:44.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.919+0000 7f9c8259c640 1 -- 172.21.15.44:0/1654197135 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c840b7b50 con 0x7f9c8406da30 2024-05-16T22:31:44.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.919+0000 7f9c81d9b640 1 --2- 172.21.15.44:0/1654197135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c840bf050 0x7f9c840b7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:31:44.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.919+0000 7f9c8259c640 1 --2- 172.21.15.44:0/1654197135 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c8406da30 0x7f9c841e8150 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c009870 tx=0x7f9c7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:31:44.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.919+0000 7f9c7affd640 1 -- 172.21.15.44:0/1654197135 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c042070 con 0x7f9c8406da30 2024-05-16T22:31:44.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.919+0000 7f9c7affd640 1 -- 172.21.15.44:0/1654197135 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c7c03e870 con 0x7f9c8406da30 2024-05-16T22:31:44.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.919+0000 7f9c88ec6640 1 -- 172.21.15.44:0/1654197135 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c840b8f20 con 0x7f9c8406da30 2024-05-16T22:31:44.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.919+0000 7f9c7affd640 1 -- 172.21.15.44:0/1654197135 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c037040 con 0x7f9c8406da30 2024-05-16T22:31:44.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.919+0000 7f9c88ec6640 1 -- 172.21.15.44:0/1654197135 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c841e8930 con 0x7f9c8406da30 2024-05-16T22:31:44.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.920+0000 7f9c88ec6640 1 -- 172.21.15.44:0/1654197135 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c840c10e0 con 0x7f9c8406da30 2024-05-16T22:31:44.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.921+0000 7f9c7affd640 1 -- 172.21.15.44:0/1654197135 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9c7c045070 con 0x7f9c8406da30 2024-05-16T22:31:44.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.922+0000 7f9c7affd640 1 --2- 172.21.15.44:0/1654197135 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f9c64076300 0x7f9c64078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:44.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.922+0000 7f9c7affd640 1 -- 172.21.15.44:0/1654197135 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f9c7c0b7db0 con 0x7f9c8406da30 2024-05-16T22:31:44.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.922+0000 7f9c81d9b640 1 --2- 172.21.15.44:0/1654197135 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f9c64076300 0x7f9c64078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:44.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.922+0000 7f9c81d9b640 1 --2- 172.21.15.44:0/1654197135 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f9c64076300 0x7f9c64078810 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c007fd0 tx=0x7f9c6c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:31:45.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:42.926+0000 7f9c7affd640 1 -- 172.21.15.44:0/1654197135 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9c840c10e0 con 0x7f9c8406da30 2024-05-16T22:31:45.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:43.154+0000 7f9c88ec6640 1 -- 172.21.15.44:0/1654197135 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9c8414bf20 con 0x7f9c8406da30 2024-05-16T22:31:45.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:43.155+0000 7f9c7affd640 1 -- 172.21.15.44:0/1654197135 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+4357 (secure 0 0 0) 0x7f9c7c04c070 con 0x7f9c8406da30 2024-05-16T22:31:45.185 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:31:45.224 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4657,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3963814730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3963814730},{"type":"v1","addr":"172.21.15.70:6835","nonce":3963814730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4672,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/3024807024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3024807024},{"type":"v1","addr":"172.21.15.44:6835","nonce":3024807024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T22:28:26.864128+0000","modified":"2024-05-16T22:28:38.972823+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4728},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4728":{"gid":4728,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.44:6834/2647971069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2647971069},{"type":"v1","addr":"172.21.15.44:6834","nonce":2647971069}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4728,"qdb_cluster":[4728]},"id":2}]} 2024-05-16T22:31:45.267 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 16 2024-05-16T22:31:45.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:43.157+0000 7f9c88ec6640 1 -- 172.21.15.44:0/1654197135 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f9c64076300 msgr2=0x7f9c64078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:45.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:43.157+0000 7f9c88ec6640 1 --2- 172.21.15.44:0/1654197135 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f9c64076300 0x7f9c64078810 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c007fd0 tx=0x7f9c6c009040 comp rx=0 tx=0).stop 2024-05-16T22:31:45.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:43.157+0000 7f9c88ec6640 1 -- 172.21.15.44:0/1654197135 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c8406da30 msgr2=0x7f9c841e8150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:45.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:43.157+0000 7f9c88ec6640 1 --2- 172.21.15.44:0/1654197135 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c8406da30 0x7f9c841e8150 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c009870 tx=0x7f9c7c0046c0 comp rx=0 tx=0).stop 2024-05-16T22:31:45.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:43.157+0000 7f9c88ec6640 1 -- 172.21.15.44:0/1654197135 shutdown_connections 2024-05-16T22:31:45.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:43.157+0000 7f9c88ec6640 1 --2- 172.21.15.44:0/1654197135 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f9c64076300 0x7f9c64078810 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:45.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:43.157+0000 7f9c88ec6640 1 --2- 172.21.15.44:0/1654197135 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9c84151fc0 0x7f9c840b89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:45.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:43.157+0000 7f9c88ec6640 1 --2- 172.21.15.44:0/1654197135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c840bf050 0x7f9c840b7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:45.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:43.157+0000 7f9c88ec6640 1 --2- 172.21.15.44:0/1654197135 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c8406da30 0x7f9c841e8150 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:45.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:43.157+0000 7f9c88ec6640 1 -- 172.21.15.44:0/1654197135 >> 172.21.15.44:0/1654197135 conn(0x7f9c840c3d20 msgr2=0x7f9c840c09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:31:45.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:43.157+0000 7f9c88ec6640 1 -- 172.21.15.44:0/1654197135 shutdown_connections 2024-05-16T22:31:45.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:43.157+0000 7f9c88ec6640 1 -- 172.21.15.44:0/1654197135 wait complete. 2024-05-16T22:31:45.833 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T22:31:46.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.006+0000 7fbf30fb7640 1 Processor -- start 2024-05-16T22:31:46.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.006+0000 7fbf30fb7640 1 -- start start 2024-05-16T22:31:46.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.007+0000 7fbf30fb7640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbf2c14e360 0x7fbf2c1522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:46.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.007+0000 7fbf30fb7640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fbf2c148770 0x7fbf2c0c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:46.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.008+0000 7fbf30fb7640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf2c0c0620 con 0x7fbf2c0bf9b0 2024-05-16T22:31:46.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.008+0000 7fbf30fb7640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fbf2c151e40 con 0x7fbf2c148770 2024-05-16T22:31:46.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.008+0000 7fbf30fb7640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fbf2c151ad0 con 0x7fbf2c14e360 2024-05-16T22:31:46.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.008+0000 7fbf2ad9d640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fbf2c0bf9b0 0x7fbf2c0bfdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:36770/0 (socket says 172.21.15.44:36770) 2024-05-16T22:31:46.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.008+0000 7fbf2ad9d640 1 -- 172.21.15.44:0/1294800232 learned_addr learned my addr 172.21.15.44:0/1294800232 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:31:46.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.008+0000 7fbf2a59c640 1 --2- 172.21.15.44:0/1294800232 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbf2c14e360 0x7fbf2c1522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:46.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.008+0000 7fbf29d9b640 1 --2- 172.21.15.44:0/1294800232 >> v2:172.21.15.70:3300/0 conn(0x7fbf2c148770 0x7fbf2c0c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:46.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.008+0000 7fbf2959a640 1 -- 172.21.15.44:0/1294800232 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3700300749 0 0) 0x7fbf2c0c0620 con 0x7fbf2c0bf9b0 2024-05-16T22:31:46.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.008+0000 7fbf2959a640 1 -- 172.21.15.44:0/1294800232 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf14003520 con 0x7fbf2c0bf9b0 2024-05-16T22:31:46.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.008+0000 7fbf2959a640 1 -- 172.21.15.44:0/1294800232 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1136515971 0 0) 0x7fbf14003520 con 0x7fbf2c0bf9b0 2024-05-16T22:31:46.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.008+0000 7fbf2959a640 1 -- 172.21.15.44:0/1294800232 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbf2c14e360 msgr2=0x7fbf2c1522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:31:46.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.008+0000 7fbf2959a640 1 --2- 172.21.15.44:0/1294800232 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbf2c14e360 0x7fbf2c1522d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:46.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.008+0000 7fbf2959a640 1 -- 172.21.15.44:0/1294800232 >> v2:172.21.15.70:3300/0 conn(0x7fbf2c148770 msgr2=0x7fbf2c0c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:31:46.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.008+0000 7fbf2959a640 1 --2- 172.21.15.44:0/1294800232 >> v2:172.21.15.70:3300/0 conn(0x7fbf2c148770 0x7fbf2c0c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:46.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.008+0000 7fbf2959a640 1 -- 172.21.15.44:0/1294800232 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf2c152810 con 0x7fbf2c0bf9b0 2024-05-16T22:31:46.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.008+0000 7fbf2959a640 1 -- 172.21.15.44:0/1294800232 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 568431863 0 0) 0x7fbf1c001a70 con 0x7fbf2c0bf9b0 2024-05-16T22:31:46.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.008+0000 7fbf29d9b640 1 --2- 172.21.15.44:0/1294800232 >> v2:172.21.15.70:3300/0 conn(0x7fbf2c148770 0x7fbf2c0c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:31:46.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.008+0000 7fbf2959a640 1 -- 172.21.15.44:0/1294800232 >> v1:172.21.15.44:6789/0 conn(0x7fbf2c0bf9b0 legacy=0x7fbf2c0bfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:46.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.008+0000 7fbf2959a640 1 --2- 172.21.15.44:0/1294800232 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf14003a00 0x7fbf14003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:46.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.008+0000 7fbf2959a640 1 --2- 172.21.15.44:0/1294800232 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbf2c14e360 0x7fbf14004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:47.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.009+0000 7fbf2959a640 1 --2- 172.21.15.44:0/1294800232 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf14004d40 0x7fbf14005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:47.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.009+0000 7fbf2959a640 1 -- 172.21.15.44:0/1294800232 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbf2c151e40 con 0x7fbf14003a00 2024-05-16T22:31:47.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.009+0000 7fbf2959a640 1 -- 172.21.15.44:0/1294800232 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbf2c151ad0 con 0x7fbf14004d40 2024-05-16T22:31:47.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.009+0000 7fbf2959a640 1 -- 172.21.15.44:0/1294800232 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fbf1400baf0 con 0x7fbf2c14e360 2024-05-16T22:31:47.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.009+0000 7fbf2a59c640 1 --2- 172.21.15.44:0/1294800232 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf14003a00 0x7fbf14003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:47.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.009+0000 7fbf29d9b640 1 --2- 172.21.15.44:0/1294800232 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbf2c14e360 0x7fbf14004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:47.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.009+0000 7fbf2ad9d640 1 --2- 172.21.15.44:0/1294800232 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf14004d40 0x7fbf14005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:47.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.009+0000 7fbf2a59c640 1 -- 172.21.15.44:0/1294800232 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbf2c14e360 msgr2=0x7fbf14004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:31:47.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.009+0000 7fbf2a59c640 1 --2- 172.21.15.44:0/1294800232 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbf2c14e360 0x7fbf14004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:47.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.009+0000 7fbf2a59c640 1 -- 172.21.15.44:0/1294800232 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf14004d40 msgr2=0x7fbf14005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:31:47.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.009+0000 7fbf2a59c640 1 --2- 172.21.15.44:0/1294800232 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf14004d40 0x7fbf14005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:47.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.009+0000 7fbf2a59c640 1 -- 172.21.15.44:0/1294800232 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf14003520 con 0x7fbf14003a00 2024-05-16T22:31:47.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.009+0000 7fbf2ad9d640 1 --2- 172.21.15.44:0/1294800232 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf14004d40 0x7fbf14005150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:31:47.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.010+0000 7fbf2a59c640 1 --2- 172.21.15.44:0/1294800232 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf14003a00 0x7fbf14003e70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbf24009ac0 tx=0x7fbf14005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70e686e199aa1dbc server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:31:47.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.010+0000 7fbf2959a640 1 -- 172.21.15.44:0/1294800232 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf24036070 con 0x7fbf14003a00 2024-05-16T22:31:47.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.010+0000 7fbf2959a640 1 -- 172.21.15.44:0/1294800232 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf24031400 con 0x7fbf14003a00 2024-05-16T22:31:47.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.010+0000 7fbf2959a640 1 -- 172.21.15.44:0/1294800232 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf24009690 con 0x7fbf14003a00 2024-05-16T22:31:47.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.010+0000 7fbf30fb7640 1 -- 172.21.15.44:0/1294800232 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf14003a00 msgr2=0x7fbf14003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:47.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.010+0000 7fbf30fb7640 1 --2- 172.21.15.44:0/1294800232 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf14003a00 0x7fbf14003e70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbf24009ac0 tx=0x7fbf14005830 comp rx=0 tx=0).stop 2024-05-16T22:31:47.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.010+0000 7fbf2ad9d640 1 -- 172.21.15.44:0/1294800232 reap_dead start 2024-05-16T22:31:47.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.011+0000 7fbf30fb7640 1 -- 172.21.15.44:0/1294800232 shutdown_connections 2024-05-16T22:31:47.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.011+0000 7fbf30fb7640 1 -- 172.21.15.44:0/1294800232 >> 172.21.15.44:0/1294800232 conn(0x7fbf2c0c17c0 msgr2=0x7fbf2c0c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:31:48.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.011+0000 7fbf30fb7640 1 -- 172.21.15.44:0/1294800232 shutdown_connections 2024-05-16T22:31:48.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.011+0000 7fbf30fb7640 1 -- 172.21.15.44:0/1294800232 wait complete. 2024-05-16T22:31:48.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.012+0000 7fbf30fb7640 1 Processor -- start 2024-05-16T22:31:48.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.012+0000 7fbf30fb7640 1 -- start start 2024-05-16T22:31:48.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.013+0000 7fbf30fb7640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbf14003a00 0x7fbf2c1e47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:48.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.013+0000 7fbf30fb7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf2c071ca0 0x7fbf2c145920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:48.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.013+0000 7fbf30fb7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf2c145e60 0x7fbf2c1e7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:48.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.013+0000 7fbf30fb7640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbf2c1522d0 con 0x7fbf2c145e60 2024-05-16T22:31:48.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.013+0000 7fbf30fb7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbf2c0c13d0 con 0x7fbf2c071ca0 2024-05-16T22:31:48.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.013+0000 7fbf30fb7640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fbf2c152450 con 0x7fbf14003a00 2024-05-16T22:31:48.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.014+0000 7fbf2ad9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf2c145e60 0x7fbf2c1e7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:48.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.014+0000 7fbf2ad9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf2c145e60 0x7fbf2c1e7cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36268/0 (socket says 172.21.15.44:36268) 2024-05-16T22:31:48.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.014+0000 7fbf2ad9d640 1 -- 172.21.15.44:0/406575603 learned_addr learned my addr 172.21.15.44:0/406575603 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:31:48.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.014+0000 7fbf29d9b640 1 --2- 172.21.15.44:0/406575603 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf2c071ca0 0x7fbf2c145920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:48.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.014+0000 7fbf2a59c640 1 --2- 172.21.15.44:0/406575603 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbf14003a00 0x7fbf2c1e47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:48.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.014+0000 7fbf2ad9d640 1 -- 172.21.15.44:0/406575603 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbf14003a00 msgr2=0x7fbf2c1e47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:48.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.014+0000 7fbf2ad9d640 1 --2- 172.21.15.44:0/406575603 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbf14003a00 0x7fbf2c1e47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:48.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.014+0000 7fbf2ad9d640 1 -- 172.21.15.44:0/406575603 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf2c071ca0 msgr2=0x7fbf2c145920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:48.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.014+0000 7fbf2ad9d640 1 --2- 172.21.15.44:0/406575603 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf2c071ca0 0x7fbf2c145920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:48.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.014+0000 7fbf2ad9d640 1 -- 172.21.15.44:0/406575603 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf2c0bb350 con 0x7fbf2c145e60 2024-05-16T22:31:48.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.014+0000 7fbf2ad9d640 1 --2- 172.21.15.44:0/406575603 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf2c145e60 0x7fbf2c1e7cd0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c000f80 tx=0x7fbf1c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:31:48.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.014+0000 7fbf1affd640 1 -- 172.21.15.44:0/406575603 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c00eda0 con 0x7fbf2c145e60 2024-05-16T22:31:48.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.014+0000 7fbf1affd640 1 -- 172.21.15.44:0/406575603 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf1c014430 con 0x7fbf2c145e60 2024-05-16T22:31:48.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.014+0000 7fbf30fb7640 1 -- 172.21.15.44:0/406575603 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf2c0b8c20 con 0x7fbf2c145e60 2024-05-16T22:31:49.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.014+0000 7fbf1affd640 1 -- 172.21.15.44:0/406575603 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c014820 con 0x7fbf2c145e60 2024-05-16T22:31:49.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.014+0000 7fbf30fb7640 1 -- 172.21.15.44:0/406575603 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf2c0ba650 con 0x7fbf2c145e60 2024-05-16T22:31:49.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.015+0000 7fbf30fb7640 1 -- 172.21.15.44:0/406575603 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf2c0a1140 con 0x7fbf2c145e60 2024-05-16T22:31:49.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.016+0000 7fbf1affd640 1 -- 172.21.15.44:0/406575603 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbf1c0149c0 con 0x7fbf2c145e60 2024-05-16T22:31:49.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.016+0000 7fbf1affd640 1 --2- 172.21.15.44:0/406575603 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fbf0c076300 0x7fbf0c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:49.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.017+0000 7fbf1affd640 1 -- 172.21.15.44:0/406575603 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fbf1c097460 con 0x7fbf2c145e60 2024-05-16T22:31:49.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.017+0000 7fbf2a59c640 1 --2- 172.21.15.44:0/406575603 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fbf0c076300 0x7fbf0c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:49.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.017+0000 7fbf2a59c640 1 --2- 172.21.15.44:0/406575603 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fbf0c076300 0x7fbf0c078810 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbf24009ac0 tx=0x7fbf24008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:31:49.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.021+0000 7fbf1affd640 1 -- 172.21.15.44:0/406575603 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbf1c0606d0 con 0x7fbf2c145e60 2024-05-16T22:31:49.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.249+0000 7fbf30fb7640 1 -- 172.21.15.44:0/406575603 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbf2c0bb180 con 0x7fbf2c145e60 2024-05-16T22:31:49.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.249+0000 7fbf1affd640 1 -- 172.21.15.44:0/406575603 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+4357 (secure 0 0 0) 0x7fbf1c0649d0 con 0x7fbf2c145e60 2024-05-16T22:31:49.527 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:31:49.569 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4657,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3963814730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3963814730},{"type":"v1","addr":"172.21.15.70:6835","nonce":3963814730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4672,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/3024807024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3024807024},{"type":"v1","addr":"172.21.15.44:6835","nonce":3024807024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T22:28:26.864128+0000","modified":"2024-05-16T22:28:38.972823+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4728},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4728":{"gid":4728,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.44:6834/2647971069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2647971069},{"type":"v1","addr":"172.21.15.44:6834","nonce":2647971069}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4728,"qdb_cluster":[4728]},"id":2}]} 2024-05-16T22:31:49.620 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 16 2024-05-16T22:31:49.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.252+0000 7fbf30fb7640 1 -- 172.21.15.44:0/406575603 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fbf0c076300 msgr2=0x7fbf0c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:49.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.252+0000 7fbf30fb7640 1 --2- 172.21.15.44:0/406575603 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fbf0c076300 0x7fbf0c078810 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbf24009ac0 tx=0x7fbf24008030 comp rx=0 tx=0).stop 2024-05-16T22:31:49.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.252+0000 7fbf30fb7640 1 -- 172.21.15.44:0/406575603 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf2c145e60 msgr2=0x7fbf2c1e7cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:49.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.252+0000 7fbf30fb7640 1 --2- 172.21.15.44:0/406575603 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf2c145e60 0x7fbf2c1e7cd0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c000f80 tx=0x7fbf1c00e530 comp rx=0 tx=0).stop 2024-05-16T22:31:49.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.252+0000 7fbf30fb7640 1 -- 172.21.15.44:0/406575603 shutdown_connections 2024-05-16T22:31:49.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.252+0000 7fbf30fb7640 1 --2- 172.21.15.44:0/406575603 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fbf0c076300 0x7fbf0c078810 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:49.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.252+0000 7fbf30fb7640 1 --2- 172.21.15.44:0/406575603 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf2c145e60 0x7fbf2c1e7cd0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:49.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.252+0000 7fbf30fb7640 1 --2- 172.21.15.44:0/406575603 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf2c071ca0 0x7fbf2c145920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:50.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.252+0000 7fbf30fb7640 1 --2- 172.21.15.44:0/406575603 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbf14003a00 0x7fbf2c1e47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:50.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.252+0000 7fbf30fb7640 1 -- 172.21.15.44:0/406575603 >> 172.21.15.44:0/406575603 conn(0x7fbf2c0c17c0 msgr2=0x7fbf2c0be5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:31:50.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.252+0000 7fbf30fb7640 1 -- 172.21.15.44:0/406575603 shutdown_connections 2024-05-16T22:31:50.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:46.252+0000 7fbf30fb7640 1 -- 172.21.15.44:0/406575603 wait complete. 2024-05-16T22:31:50.228 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-16T22:31:50.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.396+0000 7ff585bc5640 1 Processor -- start 2024-05-16T22:31:50.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.396+0000 7ff585bc5640 1 -- start start 2024-05-16T22:31:50.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.398+0000 7ff585bc5640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff5800bb490 0x7ff5800b57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:50.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.398+0000 7ff585bc5640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff5800b9ee0 0x7ff5800a4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:50.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.398+0000 7ff585bc5640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5800bba80 con 0x7ff5800b4500 2024-05-16T22:31:50.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.398+0000 7ff585bc5640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7ff5800bbd60 con 0x7ff5800bb490 2024-05-16T22:31:50.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.398+0000 7ff585bc5640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7ff5800b4ff0 con 0x7ff5800b9ee0 2024-05-16T22:31:50.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.398+0000 7ff57effd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ff5800b4500 0x7ff58006faa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:48806/0 (socket says 172.21.15.44:48806) 2024-05-16T22:31:50.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.398+0000 7ff57effd640 1 -- 172.21.15.44:0/3805162563 learned_addr learned my addr 172.21.15.44:0/3805162563 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:31:50.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.398+0000 7ff57ffff640 1 --2- 172.21.15.44:0/3805162563 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff5800b9ee0 0x7ff5800a4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:50.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.398+0000 7ff57f7fe640 1 --2- 172.21.15.44:0/3805162563 >> v2:172.21.15.70:3300/0 conn(0x7ff5800bb490 0x7ff5800b57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:50.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.398+0000 7ff57e7fc640 1 -- 172.21.15.44:0/3805162563 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3108531550 0 0) 0x7ff5800bba80 con 0x7ff5800b4500 2024-05-16T22:31:51.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.398+0000 7ff57e7fc640 1 -- 172.21.15.44:0/3805162563 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff568003520 con 0x7ff5800b4500 2024-05-16T22:31:51.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.398+0000 7ff57f7fe640 1 -- 172.21.15.44:0/3805162563 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff5800b9ee0 msgr2=0x7ff5800a4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:31:51.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.398+0000 7ff57f7fe640 1 --2- 172.21.15.44:0/3805162563 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff5800b9ee0 0x7ff5800a4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:51.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.398+0000 7ff57f7fe640 1 -- 172.21.15.44:0/3805162563 >> v1:172.21.15.44:6789/0 conn(0x7ff5800b4500 legacy=0x7ff58006faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:51.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.398+0000 7ff57f7fe640 1 -- 172.21.15.44:0/3805162563 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5800b52d0 con 0x7ff5800bb490 2024-05-16T22:31:51.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.398+0000 7ff57ffff640 1 --2- 172.21.15.44:0/3805162563 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff5800b9ee0 0x7ff5800a4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:31:51.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.399+0000 7ff57f7fe640 1 --2- 172.21.15.44:0/3805162563 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5800bb490 0x7ff5800b57f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff5700097a0 tx=0x7ff57002a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36fdca2243ccd12e server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:31:51.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.399+0000 7ff57e7fc640 1 -- 172.21.15.44:0/3805162563 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff570037070 con 0x7ff5800bb490 2024-05-16T22:31:51.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.399+0000 7ff57e7fc640 1 -- 172.21.15.44:0/3805162563 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff57002ae50 con 0x7ff5800bb490 2024-05-16T22:31:51.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.399+0000 7ff57e7fc640 1 -- 172.21.15.44:0/3805162563 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff570032640 con 0x7ff5800bb490 2024-05-16T22:31:51.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.400+0000 7ff585bc5640 1 -- 172.21.15.44:0/3805162563 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5800bb490 msgr2=0x7ff5800b57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:51.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.400+0000 7ff585bc5640 1 --2- 172.21.15.44:0/3805162563 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5800bb490 0x7ff5800b57f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff5700097a0 tx=0x7ff57002a100 comp rx=0 tx=0).stop 2024-05-16T22:31:51.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.400+0000 7ff585bc5640 1 -- 172.21.15.44:0/3805162563 shutdown_connections 2024-05-16T22:31:51.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.400+0000 7ff585bc5640 1 --2- 172.21.15.44:0/3805162563 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff5800b9ee0 0x7ff5800a4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:51.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.400+0000 7ff585bc5640 1 --2- 172.21.15.44:0/3805162563 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5800bb490 0x7ff5800b57f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:51.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.400+0000 7ff585bc5640 1 -- 172.21.15.44:0/3805162563 >> 172.21.15.44:0/3805162563 conn(0x7ff5800a1ac0 msgr2=0x7ff5800bbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:31:51.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.400+0000 7ff585bc5640 1 -- 172.21.15.44:0/3805162563 shutdown_connections 2024-05-16T22:31:51.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.400+0000 7ff585bc5640 1 -- 172.21.15.44:0/3805162563 wait complete. 2024-05-16T22:31:51.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.402+0000 7ff585bc5640 1 Processor -- start 2024-05-16T22:31:51.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.402+0000 7ff585bc5640 1 -- start start 2024-05-16T22:31:51.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.403+0000 7ff585bc5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5800b4500 0x7ff5801438b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:52.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.403+0000 7ff585bc5640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff5800b9ee0 0x7ff5801e5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:52.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.403+0000 7ff585bc5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff5800bb490 0x7ff580140480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:52.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.403+0000 7ff585bc5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff5800a45c0 con 0x7ff5800bb490 2024-05-16T22:31:52.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.403+0000 7ff585bc5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff5800ba2f0 con 0x7ff5800b4500 2024-05-16T22:31:52.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.403+0000 7ff585bc5640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7ff5800a4740 con 0x7ff5800b9ee0 2024-05-16T22:31:52.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.403+0000 7ff57ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff5800bb490 0x7ff580140480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:52.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.403+0000 7ff57ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff5800bb490 0x7ff580140480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45522/0 (socket says 172.21.15.44:45522) 2024-05-16T22:31:52.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.403+0000 7ff57ffff640 1 -- 172.21.15.44:0/805845050 learned_addr learned my addr 172.21.15.44:0/805845050 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:31:52.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.403+0000 7ff57effd640 1 --2- 172.21.15.44:0/805845050 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff5800b9ee0 0x7ff5801e5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:52.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.403+0000 7ff57f7fe640 1 --2- 172.21.15.44:0/805845050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5800b4500 0x7ff5801438b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:52.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.403+0000 7ff57ffff640 1 -- 172.21.15.44:0/805845050 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff5800b9ee0 msgr2=0x7ff5801e5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:52.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.403+0000 7ff57ffff640 1 --2- 172.21.15.44:0/805845050 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff5800b9ee0 0x7ff5801e5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:52.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.403+0000 7ff57ffff640 1 -- 172.21.15.44:0/805845050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5800b4500 msgr2=0x7ff5801438b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:52.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.403+0000 7ff57ffff640 1 --2- 172.21.15.44:0/805845050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5800b4500 0x7ff5801438b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:52.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.404+0000 7ff57ffff640 1 -- 172.21.15.44:0/805845050 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff580143df0 con 0x7ff5800bb490 2024-05-16T22:31:52.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.404+0000 7ff57ffff640 1 --2- 172.21.15.44:0/805845050 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff5800bb490 0x7ff580140480 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff57800efc0 tx=0x7ff57800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:31:52.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.404+0000 7ff567fff640 1 -- 172.21.15.44:0/805845050 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff578018030 con 0x7ff5800bb490 2024-05-16T22:31:52.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.404+0000 7ff567fff640 1 -- 172.21.15.44:0/805845050 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff57800cdf0 con 0x7ff5800bb490 2024-05-16T22:31:52.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.404+0000 7ff585bc5640 1 -- 172.21.15.44:0/805845050 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5801473f0 con 0x7ff5800bb490 2024-05-16T22:31:52.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.404+0000 7ff567fff640 1 -- 172.21.15.44:0/805845050 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff578003bb0 con 0x7ff5800bb490 2024-05-16T22:31:52.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.404+0000 7ff585bc5640 1 -- 172.21.15.44:0/805845050 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5800b9910 con 0x7ff5800bb490 2024-05-16T22:31:53.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.405+0000 7ff585bc5640 1 -- 172.21.15.44:0/805845050 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5800a2690 con 0x7ff5800bb490 2024-05-16T22:31:53.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.406+0000 7ff567fff640 1 -- 172.21.15.44:0/805845050 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff578005d10 con 0x7ff5800bb490 2024-05-16T22:31:53.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.406+0000 7ff567fff640 1 --2- 172.21.15.44:0/805845050 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7ff56c0762d0 0x7ff56c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:53.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.407+0000 7ff567fff640 1 -- 172.21.15.44:0/805845050 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7ff578098060 con 0x7ff5800bb490 2024-05-16T22:31:53.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.407+0000 7ff57f7fe640 1 --2- 172.21.15.44:0/805845050 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7ff56c0762d0 0x7ff56c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:53.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.407+0000 7ff57f7fe640 1 --2- 172.21.15.44:0/805845050 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7ff56c0762d0 0x7ff56c0787e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff570034000 tx=0x7ff57002e000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:31:53.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.412+0000 7ff567fff640 1 -- 172.21.15.44:0/805845050 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff578022070 con 0x7ff5800bb490 2024-05-16T22:31:53.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.604+0000 7ff585bc5640 1 -- 172.21.15.44:0/805845050 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff5800b9720 con 0x7ff5800bb490 2024-05-16T22:31:53.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.605+0000 7ff567fff640 1 -- 172.21.15.44:0/805845050 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16633 (secure 0 0 0) 0x7ff578010040 con 0x7ff5800bb490 2024-05-16T22:31:53.413 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:31:53.454 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":34,"fsid":"572ab7cc-b103-4548-ae8f-c6614d57f0c8","created":"2024-05-16T22:27:02.216874+0000","modified":"2024-05-16T22:28:26.864181+0000","last_up_change":"2024-05-16T22:27:13.693953+0000","last_in_change":"2024-05-16T22:27:04.455119+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-16T22:27:14.562409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-16T22:28:20.181977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-16T22:28:23.815306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a7003e89-c706-4562-9f25-670bb35ae108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6825","nonce":1074109859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6827","nonce":1074109859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6831","nonce":1074109859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6829","nonce":1074109859}]},"public_addr":"172.21.15.44:6825/1074109859","cluster_addr":"172.21.15.44:6827/1074109859","heartbeat_back_addr":"172.21.15.44:6831/1074109859","heartbeat_front_addr":"172.21.15.44:6829/1074109859","state":["exists","up"]},{"osd":1,"uuid":"a4d5169d-8327-4494-9c7c-58db21b00636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6817","nonce":2909429972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6819","nonce":2909429972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6823","nonce":2909429972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6821","nonce":2909429972}]},"public_addr":"172.21.15.44:6817/2909429972","cluster_addr":"172.21.15.44:6819/2909429972","heartbeat_back_addr":"172.21.15.44:6823/2909429972","heartbeat_front_addr":"172.21.15.44:6821/2909429972","state":["exists","up"]},{"osd":2,"uuid":"d4a834f8-83a5-400f-9814-eb0a25124df4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6801","nonce":2908194156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6803","nonce":2908194156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6807","nonce":2908194156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6805","nonce":2908194156}]},"public_addr":"172.21.15.44:6801/2908194156","cluster_addr":"172.21.15.44:6803/2908194156","heartbeat_back_addr":"172.21.15.44:6807/2908194156","heartbeat_front_addr":"172.21.15.44:6805/2908194156","state":["exists","up"]},{"osd":3,"uuid":"b9d24a56-ad43-4674-a395-5ec24d135ae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6809","nonce":2168695793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6811","nonce":2168695793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6815","nonce":2168695793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6813","nonce":2168695793}]},"public_addr":"172.21.15.44:6809/2168695793","cluster_addr":"172.21.15.44:6811/2168695793","heartbeat_back_addr":"172.21.15.44:6815/2168695793","heartbeat_front_addr":"172.21.15.44:6813/2168695793","state":["exists","up"]},{"osd":4,"uuid":"9bd94af5-3e17-4cbe-995a-8f837a66c653","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6823","nonce":1540297751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6825","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6827","nonce":1540297751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6831","nonce":1540297751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6829","nonce":1540297751}]},"public_addr":"172.21.15.70:6823/1540297751","cluster_addr":"172.21.15.70:6827/1540297751","heartbeat_back_addr":"172.21.15.70:6831/1540297751","heartbeat_front_addr":"172.21.15.70:6829/1540297751","state":["exists","up"]},{"osd":5,"uuid":"a5b0cfa5-b259-48bd-98b6-96b44f5ebabd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6804","nonce":4218901987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6808","nonce":4218901987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6815","nonce":4218901987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6812","nonce":4218901987}]},"public_addr":"172.21.15.70:6804/4218901987","cluster_addr":"172.21.15.70:6808/4218901987","heartbeat_back_addr":"172.21.15.70:6815/4218901987","heartbeat_front_addr":"172.21.15.70:6812/4218901987","state":["exists","up"]},{"osd":6,"uuid":"0b6af6df-1358-4fc6-a62c-ba57e02914ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6801","nonce":2389556489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6805","nonce":2389556489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6813","nonce":2389556489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6807","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6809","nonce":2389556489}]},"public_addr":"172.21.15.70:6801/2389556489","cluster_addr":"172.21.15.70:6805/2389556489","heartbeat_back_addr":"172.21.15.70:6813/2389556489","heartbeat_front_addr":"172.21.15.70:6809/2389556489","state":["exists","up"]},{"osd":7,"uuid":"eb1a2c5d-42cf-47d0-9e03-b9d26944a589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6817","nonce":3619691281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6819","nonce":3619691281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6826","nonce":3619691281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6822","nonce":3619691281}]},"public_addr":"172.21.15.70:6817/3619691281","cluster_addr":"172.21.15.70:6819/3619691281","heartbeat_back_addr":"172.21.15.70:6826/3619691281","heartbeat_front_addr":"172.21.15.70:6822/3619691281","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.652256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.613348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.528454+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.625204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.678845+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.680829+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.556200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.647030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T22:31:53.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.607+0000 7ff585bc5640 1 -- 172.21.15.44:0/805845050 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7ff56c0762d0 msgr2=0x7ff56c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:53.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.607+0000 7ff585bc5640 1 --2- 172.21.15.44:0/805845050 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7ff56c0762d0 0x7ff56c0787e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff570034000 tx=0x7ff57002e000 comp rx=0 tx=0).stop 2024-05-16T22:31:53.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.607+0000 7ff585bc5640 1 -- 172.21.15.44:0/805845050 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff5800bb490 msgr2=0x7ff580140480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:53.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.607+0000 7ff585bc5640 1 --2- 172.21.15.44:0/805845050 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff5800bb490 0x7ff580140480 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff57800efc0 tx=0x7ff57800c490 comp rx=0 tx=0).stop 2024-05-16T22:31:53.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.607+0000 7ff585bc5640 1 -- 172.21.15.44:0/805845050 shutdown_connections 2024-05-16T22:31:53.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.607+0000 7ff585bc5640 1 --2- 172.21.15.44:0/805845050 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7ff56c0762d0 0x7ff56c0787e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:53.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.607+0000 7ff585bc5640 1 --2- 172.21.15.44:0/805845050 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff5800b9ee0 0x7ff5801e5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:53.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.607+0000 7ff585bc5640 1 --2- 172.21.15.44:0/805845050 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff5800bb490 0x7ff580140480 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:53.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.607+0000 7ff585bc5640 1 --2- 172.21.15.44:0/805845050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5800b4500 0x7ff5801438b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:53.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.607+0000 7ff585bc5640 1 -- 172.21.15.44:0/805845050 >> 172.21.15.44:0/805845050 conn(0x7ff5800a1ac0 msgr2=0x7ff58006e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:31:53.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.607+0000 7ff585bc5640 1 -- 172.21.15.44:0/805845050 shutdown_connections 2024-05-16T22:31:53.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:50.607+0000 7ff585bc5640 1 -- 172.21.15.44:0/805845050 wait complete. 2024-05-16T22:31:54.031 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-16T22:31:54.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.198+0000 7f1cbee84640 1 Processor -- start 2024-05-16T22:31:54.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.198+0000 7f1cbee84640 1 -- start start 2024-05-16T22:31:54.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.199+0000 7f1cbee84640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1cb8151fc0 0x7f1cb80bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:54.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.199+0000 7f1cbee84640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cb80c36f0 con 0x7f1cb80bf050 2024-05-16T22:31:54.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.199+0000 7f1cbee84640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cb8152530 con 0x7f1cb806da30 2024-05-16T22:31:54.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.199+0000 7f1cbee84640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f1cb80bdc10 con 0x7f1cb8151fc0 2024-05-16T22:31:54.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.199+0000 7f1cbcc20640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1cb8151fc0 0x7f1cb80bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:54.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.200+0000 7f1cbcc20640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1cb8151fc0 0x7f1cb80bd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45534/0 (socket says 172.21.15.44:45534) 2024-05-16T22:31:54.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.200+0000 7f1cbcc20640 1 -- 172.21.15.44:0/4148805834 learned_addr learned my addr 172.21.15.44:0/4148805834 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:31:54.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.200+0000 7f1cbd421640 1 --1- 172.21.15.44:0/4148805834 >> v1:172.21.15.44:6789/0 conn(0x7f1cb80bf050 0x7f1cb8158e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:48814/0 (socket says 172.21.15.44:48814) 2024-05-16T22:31:54.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.200+0000 7f1cbcc20640 1 -- 172.21.15.44:0/4148805834 >> v1:172.21.15.70:6789/0 conn(0x7f1cb806da30 legacy=0x7f1cb80be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:31:54.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.200+0000 7f1cbcc20640 1 -- 172.21.15.44:0/4148805834 >> v1:172.21.15.44:6789/0 conn(0x7f1cb80bf050 legacy=0x7f1cb8158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:54.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.200+0000 7f1cbcc20640 1 -- 172.21.15.44:0/4148805834 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cb8152810 con 0x7f1cb8151fc0 2024-05-16T22:31:54.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.200+0000 7f1cb77fe640 1 -- 172.21.15.44:0/4148805834 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1154040931 0 0) 0x7f1cb80c36f0 con 0x7f1cb80bf050 2024-05-16T22:31:54.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.201+0000 7f1cbcc20640 1 --2- 172.21.15.44:0/4148805834 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1cb8151fc0 0x7f1cb80bd6d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0009870 tx=0x7f1ca002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f91d330ef3954100 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:31:54.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.201+0000 7f1cb77fe640 1 -- 172.21.15.44:0/4148805834 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca0037070 con 0x7f1cb8151fc0 2024-05-16T22:31:54.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.201+0000 7f1cb77fe640 1 -- 172.21.15.44:0/4148805834 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ca002ae50 con 0x7f1cb8151fc0 2024-05-16T22:31:54.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.201+0000 7f1cb77fe640 1 -- 172.21.15.44:0/4148805834 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca0032860 con 0x7f1cb8151fc0 2024-05-16T22:31:55.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.201+0000 7f1cbee84640 1 -- 172.21.15.44:0/4148805834 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1cb8151fc0 msgr2=0x7f1cb80bd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:55.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.201+0000 7f1cbee84640 1 --2- 172.21.15.44:0/4148805834 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1cb8151fc0 0x7f1cb80bd6d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0009870 tx=0x7f1ca002a300 comp rx=0 tx=0).stop 2024-05-16T22:31:55.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.202+0000 7f1cbee84640 1 -- 172.21.15.44:0/4148805834 shutdown_connections 2024-05-16T22:31:55.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.202+0000 7f1cbee84640 1 --2- 172.21.15.44:0/4148805834 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1cb8151fc0 0x7f1cb80bd6d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:55.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.202+0000 7f1cbee84640 1 -- 172.21.15.44:0/4148805834 >> 172.21.15.44:0/4148805834 conn(0x7f1cb80c3d20 msgr2=0x7f1cb80c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:31:55.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.202+0000 7f1cbee84640 1 -- 172.21.15.44:0/4148805834 shutdown_connections 2024-05-16T22:31:55.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.202+0000 7f1cbee84640 1 -- 172.21.15.44:0/4148805834 wait complete. 2024-05-16T22:31:55.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.203+0000 7f1cbee84640 1 Processor -- start 2024-05-16T22:31:55.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.203+0000 7f1cbee84640 1 -- start start 2024-05-16T22:31:55.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.204+0000 7f1cbee84640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1cb806da30 0x7f1cb814ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:55.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.204+0000 7f1cbee84640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1cb80bf050 0x7f1cb814ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:55.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.204+0000 7f1cbee84640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1cb8151fc0 0x7f1cb814cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:55.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.204+0000 7f1cbee84640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb80a3050 con 0x7f1cb80bf050 2024-05-16T22:31:55.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.204+0000 7f1cbee84640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb80a2ed0 con 0x7f1cb806da30 2024-05-16T22:31:55.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.204+0000 7f1cbee84640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f1cb806de40 con 0x7f1cb8151fc0 2024-05-16T22:31:55.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.204+0000 7f1cb7fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1cb80bf050 0x7f1cb814ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:55.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.205+0000 7f1cb7fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1cb80bf050 0x7f1cb814ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45542/0 (socket says 172.21.15.44:45542) 2024-05-16T22:31:55.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.205+0000 7f1cb7fff640 1 -- 172.21.15.44:0/1936562650 learned_addr learned my addr 172.21.15.44:0/1936562650 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:31:55.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.205+0000 7f1cbcc20640 1 --2- 172.21.15.44:0/1936562650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1cb806da30 0x7f1cb814ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:55.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.205+0000 7f1cbd421640 1 --2- 172.21.15.44:0/1936562650 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1cb8151fc0 0x7f1cb814cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:55.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.205+0000 7f1cb7fff640 1 -- 172.21.15.44:0/1936562650 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1cb8151fc0 msgr2=0x7f1cb814cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:55.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.205+0000 7f1cb7fff640 1 --2- 172.21.15.44:0/1936562650 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1cb8151fc0 0x7f1cb814cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:55.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.205+0000 7f1cb7fff640 1 -- 172.21.15.44:0/1936562650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1cb806da30 msgr2=0x7f1cb814ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:55.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.205+0000 7f1cb7fff640 1 --2- 172.21.15.44:0/1936562650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1cb806da30 0x7f1cb814ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:56.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.205+0000 7f1cb7fff640 1 -- 172.21.15.44:0/1936562650 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cb814f340 con 0x7f1cb80bf050 2024-05-16T22:31:56.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.205+0000 7f1cbd421640 1 --2- 172.21.15.44:0/1936562650 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1cb8151fc0 0x7f1cb814cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T22:31:56.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.205+0000 7f1cb7fff640 1 --2- 172.21.15.44:0/1936562650 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1cb80bf050 0x7f1cb814ca40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1ca800c3a0 tx=0x7f1ca800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:31:56.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.205+0000 7f1cb57fa640 1 -- 172.21.15.44:0/1936562650 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca8017070 con 0x7f1cb80bf050 2024-05-16T22:31:56.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.205+0000 7f1cb57fa640 1 -- 172.21.15.44:0/1936562650 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ca80052d0 con 0x7f1cb80bf050 2024-05-16T22:31:56.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.205+0000 7f1cbee84640 1 -- 172.21.15.44:0/1936562650 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cb814c400 con 0x7f1cb80bf050 2024-05-16T22:31:56.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.205+0000 7f1cb57fa640 1 -- 172.21.15.44:0/1936562650 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca80037f0 con 0x7f1cb80bf050 2024-05-16T22:31:56.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.205+0000 7f1cbee84640 1 -- 172.21.15.44:0/1936562650 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cb80b9870 con 0x7f1cb80bf050 2024-05-16T22:31:56.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.207+0000 7f1cbee84640 1 -- 172.21.15.44:0/1936562650 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cb8050940 con 0x7f1cb80bf050 2024-05-16T22:31:56.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.207+0000 7f1cb57fa640 1 -- 172.21.15.44:0/1936562650 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1ca801a070 con 0x7f1cb80bf050 2024-05-16T22:31:56.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.208+0000 7f1cb57fa640 1 --2- 172.21.15.44:0/1936562650 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f1c980762d0 0x7f1c980787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:56.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.208+0000 7f1cb57fa640 1 -- 172.21.15.44:0/1936562650 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f1ca8096900 con 0x7f1cb80bf050 2024-05-16T22:31:56.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.208+0000 7f1cbcc20640 1 --2- 172.21.15.44:0/1936562650 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f1c980762d0 0x7f1c980787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:56.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.208+0000 7f1cbcc20640 1 --2- 172.21.15.44:0/1936562650 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f1c980762d0 0x7f1c980787e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0034000 tx=0x7f1ca002e000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:31:56.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.212+0000 7f1cb57fa640 1 -- 172.21.15.44:0/1936562650 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1cb814c400 con 0x7f1cb80bf050 2024-05-16T22:31:56.607 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:31:56.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.449+0000 7f1cbee84640 1 -- 172.21.15.44:0/1936562650 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f1cb806eb40 con 0x7f1cb80bf050 2024-05-16T22:31:56.682 INFO:tasks.ceph.mon.a.smithi044.stderr:2024-05-16T22:31:54.450+0000 7facbfd75640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-16T22:31:56.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.452+0000 7f1cb57fa640 1 -- 172.21.15.44:0/1936562650 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) ==== 161+0+0 (secure 0 0 0) 0x7f1ca8068250 con 0x7f1cb80bf050 2024-05-16T22:31:56.782 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-16T22:31:56.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.455+0000 7f1cbee84640 1 -- 172.21.15.44:0/1936562650 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f1c980762d0 msgr2=0x7f1c980787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:56.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.455+0000 7f1cbee84640 1 --2- 172.21.15.44:0/1936562650 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f1c980762d0 0x7f1c980787e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0034000 tx=0x7f1ca002e000 comp rx=0 tx=0).stop 2024-05-16T22:31:56.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.455+0000 7f1cbee84640 1 -- 172.21.15.44:0/1936562650 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1cb80bf050 msgr2=0x7f1cb814ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:56.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.455+0000 7f1cbee84640 1 --2- 172.21.15.44:0/1936562650 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1cb80bf050 0x7f1cb814ca40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1ca800c3a0 tx=0x7f1ca800c860 comp rx=0 tx=0).stop 2024-05-16T22:31:56.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.456+0000 7f1cbee84640 1 -- 172.21.15.44:0/1936562650 shutdown_connections 2024-05-16T22:31:57.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.456+0000 7f1cbee84640 1 --2- 172.21.15.44:0/1936562650 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f1c980762d0 0x7f1c980787e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:57.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.456+0000 7f1cbee84640 1 --2- 172.21.15.44:0/1936562650 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1cb8151fc0 0x7f1cb814cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:57.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.456+0000 7f1cbee84640 1 --2- 172.21.15.44:0/1936562650 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1cb80bf050 0x7f1cb814ca40 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:57.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.456+0000 7f1cbee84640 1 --2- 172.21.15.44:0/1936562650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1cb806da30 0x7f1cb814ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:57.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.456+0000 7f1cbee84640 1 -- 172.21.15.44:0/1936562650 >> 172.21.15.44:0/1936562650 conn(0x7f1cb80c3d20 msgr2=0x7f1cb80c09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:31:57.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.456+0000 7f1cbee84640 1 -- 172.21.15.44:0/1936562650 shutdown_connections 2024-05-16T22:31:57.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:54.456+0000 7f1cbee84640 1 -- 172.21.15.44:0/1936562650 wait complete. 2024-05-16T22:31:57.300 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-16T22:31:57.333 INFO:tasks.ceph.mds.c.smithi044.stdout:starting mds.c at 2024-05-16T22:31:57.368 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:31:57.428 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:31:57.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.494+0000 7f9243334640 1 Processor -- start 2024-05-16T22:31:57.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.494+0000 7f9243334640 1 -- start start 2024-05-16T22:31:57.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.495+0000 7f9243334640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f923c0bb940 0x7f923c1462b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:57.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.495+0000 7f9243334640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f923c0a40b0 con 0x7f923c0a3bd0 2024-05-16T22:31:57.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.495+0000 7f9243334640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f923c0a4390 con 0x7f923c14fa20 2024-05-16T22:31:57.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.495+0000 7f9243334640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f923c0a49e0 con 0x7f923c0bb940 2024-05-16T22:31:57.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.495+0000 7f92410d0640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f923c0a3bd0 0x7f923c0bc8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:48842/0 (socket says 172.21.15.44:48842) 2024-05-16T22:31:57.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.495+0000 7f92410d0640 1 -- 172.21.15.44:0/2505509613 learned_addr learned my addr 172.21.15.44:0/2505509613 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:31:57.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.496+0000 7f92408cf640 1 --2- 172.21.15.44:0/2505509613 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f923c0bb940 0x7f923c1462b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:57.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.496+0000 7f9233fff640 1 -- 172.21.15.44:0/2505509613 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3020069652 0 0) 0x7f923c0a40b0 con 0x7f923c0a3bd0 2024-05-16T22:31:57.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.496+0000 7f9233fff640 1 -- 172.21.15.44:0/2505509613 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9228003520 con 0x7f923c0a3bd0 2024-05-16T22:31:57.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.496+0000 7f9233fff640 1 -- 172.21.15.44:0/2505509613 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2999962421 0 0) 0x7f923c0a4390 con 0x7f923c14fa20 2024-05-16T22:31:57.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.496+0000 7f9233fff640 1 -- 172.21.15.44:0/2505509613 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f923c0a40b0 con 0x7f923c14fa20 2024-05-16T22:31:57.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.496+0000 7f9233fff640 1 -- 172.21.15.44:0/2505509613 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 831607457 0 0) 0x7f9228003520 con 0x7f923c0a3bd0 2024-05-16T22:31:58.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.496+0000 7f9233fff640 1 -- 172.21.15.44:0/2505509613 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f923c0bb940 msgr2=0x7f923c1462b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:31:58.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.496+0000 7f9233fff640 1 --2- 172.21.15.44:0/2505509613 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f923c0bb940 0x7f923c1462b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:58.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.496+0000 7f9233fff640 1 -- 172.21.15.44:0/2505509613 >> v1:172.21.15.70:6789/0 conn(0x7f923c14fa20 legacy=0x7f923c14fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:58.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.496+0000 7f9233fff640 1 -- 172.21.15.44:0/2505509613 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f923c0a4670 con 0x7f923c0a3bd0 2024-05-16T22:31:58.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.496+0000 7f9233fff640 1 -- 172.21.15.44:0/2505509613 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 568431863 0 0) 0x7f92380016f0 con 0x7f923c0a3bd0 2024-05-16T22:31:58.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.496+0000 7f92408cf640 1 --2- 172.21.15.44:0/2505509613 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f923c0bb940 0x7f923c1462b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:31:58.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.496+0000 7f9233fff640 1 -- 172.21.15.44:0/2505509613 >> v1:172.21.15.44:6789/0 conn(0x7f923c0a3bd0 legacy=0x7f923c0bc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:58.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.496+0000 7f9233fff640 1 --2- 172.21.15.44:0/2505509613 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9228003c10 0x7f9228004060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:58.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.496+0000 7f9233fff640 1 --2- 172.21.15.44:0/2505509613 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9228004800 0x7f9228004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:58.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.496+0000 7f9233fff640 1 --2- 172.21.15.44:0/2505509613 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f923c0bb940 0x7f9228005280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:58.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.496+0000 7f9233fff640 1 -- 172.21.15.44:0/2505509613 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f923c0a49e0 con 0x7f9228004800 2024-05-16T22:31:58.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.496+0000 7f9233fff640 1 -- 172.21.15.44:0/2505509613 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f922800bb80 con 0x7f9228003c10 2024-05-16T22:31:58.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.496+0000 7f9233fff640 1 -- 172.21.15.44:0/2505509613 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f922800bd80 con 0x7f923c0bb940 2024-05-16T22:31:58.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.496+0000 7f92408cf640 1 --2- 172.21.15.44:0/2505509613 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9228004800 0x7f9228004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:58.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.496+0000 7f92410d0640 1 --2- 172.21.15.44:0/2505509613 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9228003c10 0x7f9228004060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:58.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.496+0000 7f92418d1640 1 --2- 172.21.15.44:0/2505509613 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f923c0bb940 0x7f9228005280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:58.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.497+0000 7f92408cf640 1 -- 172.21.15.44:0/2505509613 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f923c0bb940 msgr2=0x7f9228005280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:31:58.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.497+0000 7f92408cf640 1 --2- 172.21.15.44:0/2505509613 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f923c0bb940 0x7f9228005280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:58.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.497+0000 7f92408cf640 1 -- 172.21.15.44:0/2505509613 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9228003c10 msgr2=0x7f9228004060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:31:58.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.497+0000 7f92408cf640 1 --2- 172.21.15.44:0/2505509613 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9228003c10 0x7f9228004060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:58.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.497+0000 7f92408cf640 1 -- 172.21.15.44:0/2505509613 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9228003520 con 0x7f9228004800 2024-05-16T22:31:58.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.497+0000 7f92408cf640 1 --2- 172.21.15.44:0/2505509613 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9228004800 0x7f9228004c10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f923c06e4d0 tx=0x7f9228005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50f8ec5ec8ea4a1e server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:31:58.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.497+0000 7f9233fff640 1 -- 172.21.15.44:0/2505509613 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f922c009860 con 0x7f9228004800 2024-05-16T22:31:58.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.498+0000 7f9233fff640 1 -- 172.21.15.44:0/2505509613 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f922c004020 con 0x7f9228004800 2024-05-16T22:31:58.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.498+0000 7f9233fff640 1 -- 172.21.15.44:0/2505509613 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f922c0043f0 con 0x7f9228004800 2024-05-16T22:31:58.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.498+0000 7f9243334640 1 -- 172.21.15.44:0/2505509613 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9228004800 msgr2=0x7f9228004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:59.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.498+0000 7f9243334640 1 --2- 172.21.15.44:0/2505509613 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9228004800 0x7f9228004c10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f923c06e4d0 tx=0x7f9228005830 comp rx=0 tx=0).stop 2024-05-16T22:31:59.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.498+0000 7f92418d1640 1 -- 172.21.15.44:0/2505509613 reap_dead start 2024-05-16T22:31:59.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.498+0000 7f9243334640 1 -- 172.21.15.44:0/2505509613 shutdown_connections 2024-05-16T22:31:59.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.498+0000 7f9243334640 1 -- 172.21.15.44:0/2505509613 >> 172.21.15.44:0/2505509613 conn(0x7f923c0a1ac0 msgr2=0x7f923c0bbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:31:59.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.498+0000 7f9243334640 1 -- 172.21.15.44:0/2505509613 shutdown_connections 2024-05-16T22:31:59.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.498+0000 7f9243334640 1 -- 172.21.15.44:0/2505509613 wait complete. 2024-05-16T22:31:59.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.500+0000 7f9243334640 1 Processor -- start 2024-05-16T22:31:59.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.500+0000 7f9243334640 1 -- start start 2024-05-16T22:31:59.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.501+0000 7f9243334640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9228004800 0x7f923c1e4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:59.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.501+0000 7f9243334640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f923c09ff30 0x7f923c1e7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:59.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.501+0000 7f9243334640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f923c1e8510 0x7f923c14e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:31:59.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.501+0000 7f9243334640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f923c0a2a70 con 0x7f923c09ff30 2024-05-16T22:31:59.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.501+0000 7f9243334640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f923c0a28f0 con 0x7f9228004800 2024-05-16T22:31:59.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.501+0000 7f9243334640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f923c1462b0 con 0x7f923c1e8510 2024-05-16T22:31:59.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.501+0000 7f92408cf640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f923c09ff30 0x7f923c1e7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:59.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.501+0000 7f92408cf640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f923c09ff30 0x7f923c1e7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45590/0 (socket says 172.21.15.44:45590) 2024-05-16T22:31:59.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.501+0000 7f92408cf640 1 -- 172.21.15.44:0/211038730 learned_addr learned my addr 172.21.15.44:0/211038730 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:31:59.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.502+0000 7f92410d0640 1 --2- 172.21.15.44:0/211038730 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9228004800 0x7f923c1e4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:59.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.502+0000 7f92418d1640 1 --2- 172.21.15.44:0/211038730 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f923c1e8510 0x7f923c14e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:31:59.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.502+0000 7f92408cf640 1 -- 172.21.15.44:0/211038730 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f923c1e8510 msgr2=0x7f923c14e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:59.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.502+0000 7f92408cf640 1 --2- 172.21.15.44:0/211038730 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f923c1e8510 0x7f923c14e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:31:59.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.502+0000 7f92408cf640 1 -- 172.21.15.44:0/211038730 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9228004800 msgr2=0x7f923c1e4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:31:59.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.502+0000 7f92408cf640 1 --2- 172.21.15.44:0/211038730 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9228004800 0x7f923c1e4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:00.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.502+0000 7f92408cf640 1 -- 172.21.15.44:0/211038730 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f923c14a390 con 0x7f923c09ff30 2024-05-16T22:32:00.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.502+0000 7f92408cf640 1 --2- 172.21.15.44:0/211038730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f923c09ff30 0x7f923c1e7fd0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f922c000c00 tx=0x7f922c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:32:00.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.502+0000 7f9231ffb640 1 -- 172.21.15.44:0/211038730 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f922c040070 con 0x7f923c09ff30 2024-05-16T22:32:00.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.502+0000 7f9231ffb640 1 -- 172.21.15.44:0/211038730 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f922c0093e0 con 0x7f923c09ff30 2024-05-16T22:32:00.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.502+0000 7f9243334640 1 -- 172.21.15.44:0/211038730 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f923c14a590 con 0x7f923c09ff30 2024-05-16T22:32:00.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.502+0000 7f9231ffb640 1 -- 172.21.15.44:0/211038730 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f922c003850 con 0x7f923c09ff30 2024-05-16T22:32:00.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.502+0000 7f9243334640 1 -- 172.21.15.44:0/211038730 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f923c1e45d0 con 0x7f923c09ff30 2024-05-16T22:32:00.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.504+0000 7f9243334640 1 -- 172.21.15.44:0/211038730 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f923c068d10 con 0x7f923c09ff30 2024-05-16T22:32:00.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.504+0000 7f9231ffb640 1 -- 172.21.15.44:0/211038730 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f922c043070 con 0x7f923c09ff30 2024-05-16T22:32:00.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.505+0000 7f9231ffb640 1 --2- 172.21.15.44:0/211038730 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f92200762d0 0x7f92200787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:00.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.505+0000 7f9231ffb640 1 -- 172.21.15.44:0/211038730 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7f922c0b7e20 con 0x7f923c09ff30 2024-05-16T22:32:00.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.505+0000 7f92410d0640 1 --2- 172.21.15.44:0/211038730 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f92200762d0 0x7f92200787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:00.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.506+0000 7f92410d0640 1 --2- 172.21.15.44:0/211038730 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f92200762d0 0x7f92200787e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9238001050 tx=0x7f9238009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:32:00.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.510+0000 7f9231ffb640 1 -- 172.21.15.44:0/211038730 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f923c068d10 con 0x7f923c09ff30 2024-05-16T22:32:00.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.740+0000 7f9243334640 1 -- 172.21.15.44:0/211038730 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f923c14aab0 con 0x7f923c09ff30 2024-05-16T22:32:00.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.871+0000 7f9231ffb640 1 -- 172.21.15.44:0/211038730 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) ==== 104+0+0 (secure 0 0 0) 0x7f923c14a390 con 0x7f923c09ff30 2024-05-16T22:32:00.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.873+0000 7f9243334640 1 -- 172.21.15.44:0/211038730 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f92200762d0 msgr2=0x7f92200787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:00.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.873+0000 7f9243334640 1 --2- 172.21.15.44:0/211038730 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f92200762d0 0x7f92200787e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9238001050 tx=0x7f9238009040 comp rx=0 tx=0).stop 2024-05-16T22:32:00.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.873+0000 7f9243334640 1 -- 172.21.15.44:0/211038730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f923c09ff30 msgr2=0x7f923c1e7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:00.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.873+0000 7f9243334640 1 --2- 172.21.15.44:0/211038730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f923c09ff30 0x7f923c1e7fd0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f922c000c00 tx=0x7f922c004730 comp rx=0 tx=0).stop 2024-05-16T22:32:00.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.873+0000 7f9243334640 1 -- 172.21.15.44:0/211038730 shutdown_connections 2024-05-16T22:32:00.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.873+0000 7f9243334640 1 --2- 172.21.15.44:0/211038730 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f92200762d0 0x7f92200787e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:00.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.873+0000 7f9243334640 1 --2- 172.21.15.44:0/211038730 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f923c1e8510 0x7f923c14e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:01.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.873+0000 7f9243334640 1 --2- 172.21.15.44:0/211038730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f923c09ff30 0x7f923c1e7fd0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:01.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.873+0000 7f9243334640 1 --2- 172.21.15.44:0/211038730 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9228004800 0x7f923c1e4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:01.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.873+0000 7f9243334640 1 -- 172.21.15.44:0/211038730 >> 172.21.15.44:0/211038730 conn(0x7f923c0a1ac0 msgr2=0x7f923c068600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:32:01.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.873+0000 7f9243334640 1 -- 172.21.15.44:0/211038730 shutdown_connections 2024-05-16T22:32:01.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:31:57.873+0000 7f9243334640 1 -- 172.21.15.44:0/211038730 wait complete. 2024-05-16T22:32:01.203 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-16T22:32:01.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.375+0000 7fc3a57f8640 1 Processor -- start 2024-05-16T22:32:01.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.375+0000 7fc3a57f8640 1 -- start start 2024-05-16T22:32:01.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.376+0000 7fc3a57f8640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc3a014cce0 0x7fc3a00716a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:01.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.376+0000 7fc3a57f8640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc3a0071be0 0x7fc3a0156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:01.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.376+0000 7fc3a57f8640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3a00720d0 con 0x7fc3a00be4f0 2024-05-16T22:32:01.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.376+0000 7fc3a57f8640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fc3a00bfa60 con 0x7fc3a014cce0 2024-05-16T22:32:01.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.376+0000 7fc3a57f8640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fc3a0071310 con 0x7fc3a0071be0 2024-05-16T22:32:01.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.376+0000 7fc39effd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc3a00be4f0 0x7fc3a00bfef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:35780/0 (socket says 172.21.15.44:35780) 2024-05-16T22:32:01.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.376+0000 7fc39effd640 1 -- 172.21.15.44:0/344648406 learned_addr learned my addr 172.21.15.44:0/344648406 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:32:01.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.376+0000 7fc397fff640 1 --2- 172.21.15.44:0/344648406 >> v2:172.21.15.44:3300/0 conn(0x7fc3a014cce0 0x7fc3a00716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:01.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.376+0000 7fc39f7fe640 1 --2- 172.21.15.44:0/344648406 >> v2:172.21.15.70:3300/0 conn(0x7fc3a0071be0 0x7fc3a0156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:01.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.377+0000 7fc39e7fc640 1 -- 172.21.15.44:0/344648406 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2801373449 0 0) 0x7fc3a00720d0 con 0x7fc3a00be4f0 2024-05-16T22:32:01.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.377+0000 7fc39e7fc640 1 -- 172.21.15.44:0/344648406 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc38c003520 con 0x7fc3a00be4f0 2024-05-16T22:32:01.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.377+0000 7fc397fff640 1 -- 172.21.15.44:0/344648406 >> v2:172.21.15.70:3300/0 conn(0x7fc3a0071be0 msgr2=0x7fc3a0156cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:32:01.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.377+0000 7fc397fff640 1 --2- 172.21.15.44:0/344648406 >> v2:172.21.15.70:3300/0 conn(0x7fc3a0071be0 0x7fc3a0156cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:01.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.377+0000 7fc397fff640 1 -- 172.21.15.44:0/344648406 >> v1:172.21.15.44:6789/0 conn(0x7fc3a00be4f0 legacy=0x7fc3a00bfef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:02.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.377+0000 7fc397fff640 1 -- 172.21.15.44:0/344648406 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3a00bf6f0 con 0x7fc3a014cce0 2024-05-16T22:32:02.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.377+0000 7fc397fff640 1 --2- 172.21.15.44:0/344648406 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3a014cce0 0x7fc3a00716a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc3a00a12c0 tx=0x7fc38802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feb7678cfb04ed2b server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:32:02.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.378+0000 7fc39e7fc640 1 -- 172.21.15.44:0/344648406 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc388037070 con 0x7fc3a014cce0 2024-05-16T22:32:02.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.378+0000 7fc39e7fc640 1 -- 172.21.15.44:0/344648406 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc388032440 con 0x7fc3a014cce0 2024-05-16T22:32:02.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.378+0000 7fc39e7fc640 1 -- 172.21.15.44:0/344648406 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc38802ae60 con 0x7fc3a014cce0 2024-05-16T22:32:02.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.378+0000 7fc3a57f8640 1 -- 172.21.15.44:0/344648406 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3a014cce0 msgr2=0x7fc3a00716a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:02.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.378+0000 7fc3a57f8640 1 --2- 172.21.15.44:0/344648406 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3a014cce0 0x7fc3a00716a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc3a00a12c0 tx=0x7fc38802a110 comp rx=0 tx=0).stop 2024-05-16T22:32:02.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.378+0000 7fc3a57f8640 1 -- 172.21.15.44:0/344648406 shutdown_connections 2024-05-16T22:32:02.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.378+0000 7fc3a57f8640 1 --2- 172.21.15.44:0/344648406 >> v2:172.21.15.70:3300/0 conn(0x7fc3a0071be0 0x7fc3a0156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:02.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.378+0000 7fc3a57f8640 1 --2- 172.21.15.44:0/344648406 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3a014cce0 0x7fc3a00716a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:02.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.378+0000 7fc3a57f8640 1 -- 172.21.15.44:0/344648406 >> 172.21.15.44:0/344648406 conn(0x7fc3a00c17c0 msgr2=0x7fc3a00c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:32:02.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.378+0000 7fc3a57f8640 1 -- 172.21.15.44:0/344648406 shutdown_connections 2024-05-16T22:32:02.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.378+0000 7fc3a57f8640 1 -- 172.21.15.44:0/344648406 wait complete. 2024-05-16T22:32:02.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.380+0000 7fc3a57f8640 1 Processor -- start 2024-05-16T22:32:02.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.380+0000 7fc3a57f8640 1 -- start start 2024-05-16T22:32:02.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.381+0000 7fc3a57f8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3a0071be0 0x7fc3a009ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:02.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.381+0000 7fc3a57f8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3a00be4f0 0x7fc3a01d49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:02.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.381+0000 7fc3a57f8640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc3a014cce0 0x7fc3a0149a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:02.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.381+0000 7fc3a57f8640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a00a6c90 con 0x7fc3a0071be0 2024-05-16T22:32:02.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.381+0000 7fc3a57f8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a00723b0 con 0x7fc3a00be4f0 2024-05-16T22:32:02.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.381+0000 7fc3a57f8640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fc3a00bc1c0 con 0x7fc3a014cce0 2024-05-16T22:32:02.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.381+0000 7fc39effd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3a0071be0 0x7fc3a009ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:03.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.381+0000 7fc39effd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3a0071be0 0x7fc3a009ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43330/0 (socket says 172.21.15.44:43330) 2024-05-16T22:32:03.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.381+0000 7fc39effd640 1 -- 172.21.15.44:0/748234801 learned_addr learned my addr 172.21.15.44:0/748234801 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:32:03.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.381+0000 7fc397fff640 1 --2- 172.21.15.44:0/748234801 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3a00be4f0 0x7fc3a01d49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:03.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.381+0000 7fc39f7fe640 1 --2- 172.21.15.44:0/748234801 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc3a014cce0 0x7fc3a0149a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:03.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.382+0000 7fc39effd640 1 -- 172.21.15.44:0/748234801 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc3a014cce0 msgr2=0x7fc3a0149a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:03.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.382+0000 7fc39effd640 1 --2- 172.21.15.44:0/748234801 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc3a014cce0 0x7fc3a0149a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:03.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.382+0000 7fc39effd640 1 -- 172.21.15.44:0/748234801 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3a00be4f0 msgr2=0x7fc3a01d49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:03.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.382+0000 7fc39effd640 1 --2- 172.21.15.44:0/748234801 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3a00be4f0 0x7fc3a01d49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:03.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.382+0000 7fc39effd640 1 -- 172.21.15.44:0/748234801 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3a00a0470 con 0x7fc3a0071be0 2024-05-16T22:32:03.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.382+0000 7fc39effd640 1 --2- 172.21.15.44:0/748234801 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3a0071be0 0x7fc3a009ff30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc39000c410 tx=0x7fc39000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:32:03.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.382+0000 7fc3977fe640 1 -- 172.21.15.44:0/748234801 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc390017070 con 0x7fc3a0071be0 2024-05-16T22:32:03.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.382+0000 7fc3977fe640 1 -- 172.21.15.44:0/748234801 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc390005ce0 con 0x7fc3a0071be0 2024-05-16T22:32:03.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.382+0000 7fc3a57f8640 1 -- 172.21.15.44:0/748234801 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3a01d4f00 con 0x7fc3a0071be0 2024-05-16T22:32:03.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.382+0000 7fc3977fe640 1 -- 172.21.15.44:0/748234801 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3900072d0 con 0x7fc3a0071be0 2024-05-16T22:32:03.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.382+0000 7fc3a57f8640 1 -- 172.21.15.44:0/748234801 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3a01d3990 con 0x7fc3a0071be0 2024-05-16T22:32:03.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.383+0000 7fc3a57f8640 1 -- 172.21.15.44:0/748234801 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3a00bf020 con 0x7fc3a0071be0 2024-05-16T22:32:03.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.384+0000 7fc3977fe640 1 -- 172.21.15.44:0/748234801 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc39001a070 con 0x7fc3a0071be0 2024-05-16T22:32:03.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.384+0000 7fc3977fe640 1 --2- 172.21.15.44:0/748234801 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fc380076300 0x7fc380078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:03.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.384+0000 7fc3977fe640 1 -- 172.21.15.44:0/748234801 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7fc390096980 con 0x7fc3a0071be0 2024-05-16T22:32:03.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.385+0000 7fc397fff640 1 --2- 172.21.15.44:0/748234801 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fc380076300 0x7fc380078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:03.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.385+0000 7fc397fff640 1 --2- 172.21.15.44:0/748234801 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fc380076300 0x7fc380078810 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc388034000 tx=0x7fc38802e000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:32:03.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.389+0000 7fc3977fe640 1 -- 172.21.15.44:0/748234801 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc39005fb00 con 0x7fc3a0071be0 2024-05-16T22:32:03.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.579+0000 7fc3a57f8640 1 -- 172.21.15.44:0/748234801 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc3a0050940 con 0x7fc3a0071be0 2024-05-16T22:32:04.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.885+0000 7fc3977fe640 1 -- 172.21.15.44:0/748234801 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v36) ==== 181+0+0 (secure 0 0 0) 0x7fc390063e00 con 0x7fc3a0071be0 2024-05-16T22:32:04.063 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' removed 2024-05-16T22:32:04.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.888+0000 7fc3a57f8640 1 -- 172.21.15.44:0/748234801 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fc380076300 msgr2=0x7fc380078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:04.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.888+0000 7fc3a57f8640 1 --2- 172.21.15.44:0/748234801 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fc380076300 0x7fc380078810 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc388034000 tx=0x7fc38802e000 comp rx=0 tx=0).stop 2024-05-16T22:32:04.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.888+0000 7fc3a57f8640 1 -- 172.21.15.44:0/748234801 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3a0071be0 msgr2=0x7fc3a009ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:04.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.888+0000 7fc3a57f8640 1 --2- 172.21.15.44:0/748234801 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3a0071be0 0x7fc3a009ff30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc39000c410 tx=0x7fc39000c8d0 comp rx=0 tx=0).stop 2024-05-16T22:32:04.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.889+0000 7fc3a57f8640 1 -- 172.21.15.44:0/748234801 shutdown_connections 2024-05-16T22:32:04.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.889+0000 7fc3a57f8640 1 --2- 172.21.15.44:0/748234801 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fc380076300 0x7fc380078810 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:04.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.889+0000 7fc3a57f8640 1 --2- 172.21.15.44:0/748234801 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc3a014cce0 0x7fc3a0149a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:04.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.889+0000 7fc3a57f8640 1 --2- 172.21.15.44:0/748234801 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3a00be4f0 0x7fc3a01d49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:04.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.889+0000 7fc3a57f8640 1 --2- 172.21.15.44:0/748234801 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3a0071be0 0x7fc3a009ff30 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:04.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.889+0000 7fc3a57f8640 1 -- 172.21.15.44:0/748234801 >> 172.21.15.44:0/748234801 conn(0x7fc3a00c17c0 msgr2=0x7fc3a00a55f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:32:04.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.889+0000 7fc3a57f8640 1 -- 172.21.15.44:0/748234801 shutdown_connections 2024-05-16T22:32:04.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:01.889+0000 7fc3a57f8640 1 -- 172.21.15.44:0/748234801 wait complete. 2024-05-16T22:32:04.630 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-16T22:32:04.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.802+0000 7ffa5f0e0640 1 Processor -- start 2024-05-16T22:32:04.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.802+0000 7ffa5f0e0640 1 -- start start 2024-05-16T22:32:04.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.803+0000 7ffa5f0e0640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa58151fc0 0x7ffa580bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:04.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.803+0000 7ffa5f0e0640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ffa5806da30 0x7ffa580be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:05.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.803+0000 7ffa5f0e0640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa580c36f0 con 0x7ffa5806de40 2024-05-16T22:32:05.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.803+0000 7ffa5f0e0640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7ffa580bdc10 con 0x7ffa5806da30 2024-05-16T22:32:05.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.803+0000 7ffa5f0e0640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7ffa58152530 con 0x7ffa58151fc0 2024-05-16T22:32:05.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.803+0000 7ffa4ffff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ffa5806da30 0x7ffa580be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:05.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.803+0000 7ffa4ffff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ffa5806da30 0x7ffa580be940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43336/0 (socket says 172.21.15.44:43336) 2024-05-16T22:32:05.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.803+0000 7ffa4ffff640 1 -- 172.21.15.44:0/167774634 learned_addr learned my addr 172.21.15.44:0/167774634 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:32:05.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.803+0000 7ffa5ce7c640 1 --2- 172.21.15.44:0/167774634 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa58151fc0 0x7ffa580bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:05.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.803+0000 7ffa4ffff640 1 -- 172.21.15.44:0/167774634 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa58151fc0 msgr2=0x7ffa580bd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:32:05.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.803+0000 7ffa4ffff640 1 --2- 172.21.15.44:0/167774634 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa58151fc0 0x7ffa580bd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:05.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.803+0000 7ffa4ffff640 1 -- 172.21.15.44:0/167774634 >> v1:172.21.15.44:6789/0 conn(0x7ffa5806de40 legacy=0x7ffa5814e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:05.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.803+0000 7ffa4ffff640 1 -- 172.21.15.44:0/167774634 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa58152810 con 0x7ffa5806da30 2024-05-16T22:32:05.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.803+0000 7ffa4f7fe640 1 -- 172.21.15.44:0/167774634 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1004623518 0 0) 0x7ffa580c36f0 con 0x7ffa5806de40 2024-05-16T22:32:05.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.804+0000 7ffa4ffff640 1 --2- 172.21.15.44:0/167774634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa5806da30 0x7ffa580be940 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ffa48009870 tx=0x7ffa4802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d923c9fc14d815d server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:32:05.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.804+0000 7ffa4f7fe640 1 -- 172.21.15.44:0/167774634 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa48037070 con 0x7ffa5806da30 2024-05-16T22:32:05.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.804+0000 7ffa4f7fe640 1 -- 172.21.15.44:0/167774634 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa48032440 con 0x7ffa5806da30 2024-05-16T22:32:05.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.804+0000 7ffa4f7fe640 1 -- 172.21.15.44:0/167774634 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa48032810 con 0x7ffa5806da30 2024-05-16T22:32:05.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.805+0000 7ffa5f0e0640 1 -- 172.21.15.44:0/167774634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa5806da30 msgr2=0x7ffa580be940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:05.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.805+0000 7ffa5f0e0640 1 --2- 172.21.15.44:0/167774634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa5806da30 0x7ffa580be940 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ffa48009870 tx=0x7ffa4802a270 comp rx=0 tx=0).stop 2024-05-16T22:32:05.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.805+0000 7ffa5f0e0640 1 -- 172.21.15.44:0/167774634 shutdown_connections 2024-05-16T22:32:05.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.805+0000 7ffa5f0e0640 1 --2- 172.21.15.44:0/167774634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa5806da30 0x7ffa580be940 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:05.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.805+0000 7ffa5f0e0640 1 --2- 172.21.15.44:0/167774634 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa58151fc0 0x7ffa580bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:05.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.805+0000 7ffa5f0e0640 1 -- 172.21.15.44:0/167774634 >> 172.21.15.44:0/167774634 conn(0x7ffa580c3d20 msgr2=0x7ffa580c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:32:05.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.805+0000 7ffa5f0e0640 1 -- 172.21.15.44:0/167774634 shutdown_connections 2024-05-16T22:32:06.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.805+0000 7ffa5f0e0640 1 -- 172.21.15.44:0/167774634 wait complete. 2024-05-16T22:32:06.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.807+0000 7ffa5f0e0640 1 Processor -- start 2024-05-16T22:32:06.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.807+0000 7ffa5f0e0640 1 -- start start 2024-05-16T22:32:06.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.808+0000 7ffa5f0e0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa5806da30 0x7ffa581db220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:06.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.808+0000 7ffa5f0e0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa5806de40 0x7ffa580b5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:06.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.808+0000 7ffa5f0e0640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa58151fc0 0x7ffa580b6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:06.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.808+0000 7ffa5f0e0640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ffa580a3050 con 0x7ffa5806de40 2024-05-16T22:32:06.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.808+0000 7ffa5f0e0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ffa580a2ed0 con 0x7ffa5806da30 2024-05-16T22:32:06.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.808+0000 7ffa5f0e0640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7ffa580bee80 con 0x7ffa58151fc0 2024-05-16T22:32:06.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.808+0000 7ffa4ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa5806de40 0x7ffa580b5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:06.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.808+0000 7ffa4ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa5806de40 0x7ffa580b5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43352/0 (socket says 172.21.15.44:43352) 2024-05-16T22:32:06.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.808+0000 7ffa4ffff640 1 -- 172.21.15.44:0/1865117750 learned_addr learned my addr 172.21.15.44:0/1865117750 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:32:06.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.808+0000 7ffa5ce7c640 1 --2- 172.21.15.44:0/1865117750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa5806da30 0x7ffa581db220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:06.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.808+0000 7ffa5d67d640 1 --2- 172.21.15.44:0/1865117750 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa58151fc0 0x7ffa580b6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:06.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.809+0000 7ffa4ffff640 1 -- 172.21.15.44:0/1865117750 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa58151fc0 msgr2=0x7ffa580b6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:06.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.809+0000 7ffa4ffff640 1 --2- 172.21.15.44:0/1865117750 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa58151fc0 0x7ffa580b6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:06.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.809+0000 7ffa4ffff640 1 -- 172.21.15.44:0/1865117750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa5806da30 msgr2=0x7ffa581db220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:06.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.809+0000 7ffa4ffff640 1 --2- 172.21.15.44:0/1865117750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa5806da30 0x7ffa581db220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:06.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.809+0000 7ffa4ffff640 1 -- 172.21.15.44:0/1865117750 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa581db760 con 0x7ffa5806de40 2024-05-16T22:32:06.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.809+0000 7ffa5d67d640 1 --2- 172.21.15.44:0/1865117750 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa58151fc0 0x7ffa580b6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:32:06.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.809+0000 7ffa4ffff640 1 --2- 172.21.15.44:0/1865117750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa5806de40 0x7ffa580b5fc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ffa48035040 tx=0x7ffa480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:32:06.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.809+0000 7ffa4d7fa640 1 -- 172.21.15.44:0/1865117750 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa48037040 con 0x7ffa5806de40 2024-05-16T22:32:07.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.809+0000 7ffa4d7fa640 1 -- 172.21.15.44:0/1865117750 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa48004030 con 0x7ffa5806de40 2024-05-16T22:32:07.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.809+0000 7ffa5f0e0640 1 -- 172.21.15.44:0/1865117750 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa580b78e0 con 0x7ffa5806de40 2024-05-16T22:32:07.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.809+0000 7ffa4d7fa640 1 -- 172.21.15.44:0/1865117750 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa48004420 con 0x7ffa5806de40 2024-05-16T22:32:07.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.809+0000 7ffa5f0e0640 1 -- 172.21.15.44:0/1865117750 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa580b7af0 con 0x7ffa5806de40 2024-05-16T22:32:07.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.810+0000 7ffa5f0e0640 1 -- 172.21.15.44:0/1865117750 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa580c11b0 con 0x7ffa5806de40 2024-05-16T22:32:07.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.811+0000 7ffa4d7fa640 1 -- 172.21.15.44:0/1865117750 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ffa4803a070 con 0x7ffa5806de40 2024-05-16T22:32:07.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.811+0000 7ffa4d7fa640 1 --2- 172.21.15.44:0/1865117750 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7ffa440762d0 0x7ffa440787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:07.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.811+0000 7ffa4d7fa640 1 -- 172.21.15.44:0/1865117750 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5357+0+0 (secure 0 0 0) 0x7ffa480b79a0 con 0x7ffa5806de40 2024-05-16T22:32:07.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.811+0000 7ffa5ce7c640 1 --2- 172.21.15.44:0/1865117750 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7ffa440762d0 0x7ffa440787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:07.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.812+0000 7ffa5ce7c640 1 --2- 172.21.15.44:0/1865117750 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7ffa440762d0 0x7ffa440787e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ffa540079a0 tx=0x7ffa54008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:32:07.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:04.816+0000 7ffa4d7fa640 1 -- 172.21.15.44:0/1865117750 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ffa580c11b0 con 0x7ffa5806de40 2024-05-16T22:32:07.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:05.007+0000 7ffa5f0e0640 1 -- 172.21.15.44:0/1865117750 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7ffa58151c80 con 0x7ffa5806de40 2024-05-16T22:32:07.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:05.914+0000 7ffa4d7fa640 1 -- 172.21.15.44:0/1865117750 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v37) ==== 169+0+0 (secure 0 0 0) 0x7ffa48041020 con 0x7ffa5806de40 2024-05-16T22:32:07.616 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' removed 2024-05-16T22:32:07.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:05.918+0000 7ffa5f0e0640 1 -- 172.21.15.44:0/1865117750 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7ffa440762d0 msgr2=0x7ffa440787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:07.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:05.918+0000 7ffa5f0e0640 1 --2- 172.21.15.44:0/1865117750 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7ffa440762d0 0x7ffa440787e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ffa540079a0 tx=0x7ffa54008040 comp rx=0 tx=0).stop 2024-05-16T22:32:07.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:05.918+0000 7ffa5f0e0640 1 -- 172.21.15.44:0/1865117750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa5806de40 msgr2=0x7ffa580b5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:07.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:05.918+0000 7ffa5f0e0640 1 --2- 172.21.15.44:0/1865117750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa5806de40 0x7ffa580b5fc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ffa48035040 tx=0x7ffa480046c0 comp rx=0 tx=0).stop 2024-05-16T22:32:07.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:05.919+0000 7ffa5f0e0640 1 -- 172.21.15.44:0/1865117750 shutdown_connections 2024-05-16T22:32:07.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:05.919+0000 7ffa5f0e0640 1 --2- 172.21.15.44:0/1865117750 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7ffa440762d0 0x7ffa440787e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:07.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:05.919+0000 7ffa5f0e0640 1 --2- 172.21.15.44:0/1865117750 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa58151fc0 0x7ffa580b6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:08.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:05.919+0000 7ffa5f0e0640 1 --2- 172.21.15.44:0/1865117750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa5806de40 0x7ffa580b5fc0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:08.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:05.919+0000 7ffa5f0e0640 1 --2- 172.21.15.44:0/1865117750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa5806da30 0x7ffa581db220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:08.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:05.919+0000 7ffa5f0e0640 1 -- 172.21.15.44:0/1865117750 >> 172.21.15.44:0/1865117750 conn(0x7ffa580c3d20 msgr2=0x7ffa580c0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:32:08.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:05.919+0000 7ffa5f0e0640 1 -- 172.21.15.44:0/1865117750 shutdown_connections 2024-05-16T22:32:08.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:05.919+0000 7ffa5f0e0640 1 -- 172.21.15.44:0/1865117750 wait complete. 2024-05-16T22:32:08.367 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-16T22:32:08.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.544+0000 7fcf1a99d640 1 Processor -- start 2024-05-16T22:32:08.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.545+0000 7fcf1a99d640 1 -- start start 2024-05-16T22:32:08.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.546+0000 7fcf1a99d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf140be9a0 0x7fcf140bd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:08.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.546+0000 7fcf1a99d640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf140c3410 con 0x7fcf1414e360 2024-05-16T22:32:08.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.546+0000 7fcf1a99d640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf1414e8f0 con 0x7fcf140bd190 2024-05-16T22:32:08.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.546+0000 7fcf1a99d640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fcf1414ebd0 con 0x7fcf140be9a0 2024-05-16T22:32:08.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.546+0000 7fcf1999b640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fcf1414e360 0x7fcf1406d8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:35798/0 (socket says 172.21.15.44:35798) 2024-05-16T22:32:08.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.546+0000 7fcf1999b640 1 -- 172.21.15.44:0/4125350939 learned_addr learned my addr 172.21.15.44:0/4125350939 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:32:08.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.546+0000 7fcf1a19c640 1 --2- 172.21.15.44:0/4125350939 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf140be9a0 0x7fcf140bd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:08.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.546+0000 7fcf18999640 1 -- 172.21.15.44:0/4125350939 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 361958936 0 0) 0x7fcf140c3410 con 0x7fcf1414e360 2024-05-16T22:32:09.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.546+0000 7fcf18999640 1 -- 172.21.15.44:0/4125350939 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcefc003520 con 0x7fcf1414e360 2024-05-16T22:32:09.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.546+0000 7fcf18999640 1 -- 172.21.15.44:0/4125350939 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 868395852 0 0) 0x7fcf1414e8f0 con 0x7fcf140bd190 2024-05-16T22:32:09.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.546+0000 7fcf18999640 1 -- 172.21.15.44:0/4125350939 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf140c3410 con 0x7fcf140bd190 2024-05-16T22:32:09.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.546+0000 7fcf18999640 1 -- 172.21.15.44:0/4125350939 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 814828213 0 0) 0x7fcefc003520 con 0x7fcf1414e360 2024-05-16T22:32:09.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.547+0000 7fcf18999640 1 -- 172.21.15.44:0/4125350939 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf140be9a0 msgr2=0x7fcf140bd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:32:09.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.547+0000 7fcf18999640 1 --2- 172.21.15.44:0/4125350939 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf140be9a0 0x7fcf140bd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:09.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.547+0000 7fcf18999640 1 -- 172.21.15.44:0/4125350939 >> v1:172.21.15.70:6789/0 conn(0x7fcf140bd190 legacy=0x7fcf140be290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:09.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.547+0000 7fcf18999640 1 -- 172.21.15.44:0/4125350939 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf1414eeb0 con 0x7fcf1414e360 2024-05-16T22:32:09.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.547+0000 7fcf18999640 1 -- 172.21.15.44:0/4125350939 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 568431863 0 0) 0x7fcf0c0016f0 con 0x7fcf1414e360 2024-05-16T22:32:09.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.547+0000 7fcf18999640 1 -- 172.21.15.44:0/4125350939 >> v1:172.21.15.44:6789/0 conn(0x7fcf1414e360 legacy=0x7fcf1406d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:09.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.547+0000 7fcf18999640 1 --2- 172.21.15.44:0/4125350939 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcefc003c60 0x7fcefc0040b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:09.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.547+0000 7fcf18999640 1 --2- 172.21.15.44:0/4125350939 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcefc004800 0x7fcefc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:09.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.547+0000 7fcf18999640 1 --2- 172.21.15.44:0/4125350939 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf140be9a0 0x7fcefc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:09.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.547+0000 7fcf18999640 1 -- 172.21.15.44:0/4125350939 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcf1414ebd0 con 0x7fcefc003c60 2024-05-16T22:32:09.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.547+0000 7fcf18999640 1 -- 172.21.15.44:0/4125350939 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcefc005520 con 0x7fcefc004800 2024-05-16T22:32:09.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.547+0000 7fcf18999640 1 -- 172.21.15.44:0/4125350939 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fcefc00bf00 con 0x7fcf140be9a0 2024-05-16T22:32:09.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.547+0000 7fcf1999b640 1 --2- 172.21.15.44:0/4125350939 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcefc003c60 0x7fcefc0040b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:09.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.547+0000 7fcf1a19c640 1 --2- 172.21.15.44:0/4125350939 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf140be9a0 0x7fcefc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:09.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.547+0000 7fcf1919a640 1 --2- 172.21.15.44:0/4125350939 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcefc004800 0x7fcefc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:10.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.547+0000 7fcf1999b640 1 -- 172.21.15.44:0/4125350939 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf140be9a0 msgr2=0x7fcefc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:32:10.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.547+0000 7fcf1999b640 1 --2- 172.21.15.44:0/4125350939 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf140be9a0 0x7fcefc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:10.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.547+0000 7fcf1999b640 1 -- 172.21.15.44:0/4125350939 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcefc004800 msgr2=0x7fcefc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:32:10.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.547+0000 7fcf1999b640 1 --2- 172.21.15.44:0/4125350939 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcefc004800 0x7fcefc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:10.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.547+0000 7fcf1999b640 1 -- 172.21.15.44:0/4125350939 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcefc003520 con 0x7fcefc003c60 2024-05-16T22:32:10.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.547+0000 7fcf1a19c640 1 --2- 172.21.15.44:0/4125350939 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf140be9a0 0x7fcefc00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:32:10.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.548+0000 7fcf1999b640 1 --2- 172.21.15.44:0/4125350939 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcefc003c60 0x7fcefc0040b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c00c0e0 tx=0x7fcefc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9df13f401b1cb7b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:32:10.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.548+0000 7fcf18999640 1 -- 172.21.15.44:0/4125350939 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf0c007c00 con 0x7fcefc003c60 2024-05-16T22:32:10.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.548+0000 7fcf18999640 1 -- 172.21.15.44:0/4125350939 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf0c005af0 con 0x7fcefc003c60 2024-05-16T22:32:10.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.548+0000 7fcf18999640 1 -- 172.21.15.44:0/4125350939 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf0c007070 con 0x7fcefc003c60 2024-05-16T22:32:10.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.549+0000 7fcf1a99d640 1 -- 172.21.15.44:0/4125350939 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcefc003c60 msgr2=0x7fcefc0040b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:10.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.549+0000 7fcf1a99d640 1 --2- 172.21.15.44:0/4125350939 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcefc003c60 0x7fcefc0040b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c00c0e0 tx=0x7fcefc005830 comp rx=0 tx=0).stop 2024-05-16T22:32:10.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.549+0000 7fcf1a19c640 1 -- 172.21.15.44:0/4125350939 reap_dead start 2024-05-16T22:32:10.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.549+0000 7fcf1a99d640 1 -- 172.21.15.44:0/4125350939 shutdown_connections 2024-05-16T22:32:10.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.549+0000 7fcf1a99d640 1 -- 172.21.15.44:0/4125350939 >> 172.21.15.44:0/4125350939 conn(0x7fcf140c3a50 msgr2=0x7fcf140c3e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:32:10.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.549+0000 7fcf1a99d640 1 -- 172.21.15.44:0/4125350939 shutdown_connections 2024-05-16T22:32:10.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.549+0000 7fcf1a99d640 1 -- 172.21.15.44:0/4125350939 wait complete. 2024-05-16T22:32:10.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.550+0000 7fcf1a99d640 1 Processor -- start 2024-05-16T22:32:10.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.550+0000 7fcf1a99d640 1 -- start start 2024-05-16T22:32:11.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.551+0000 7fcf1a99d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcefc003c60 0x7fcf141d4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:11.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.551+0000 7fcf1a99d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf140b8ee0 0x7fcf141d5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:11.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.551+0000 7fcf1a99d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf141e7f00 0x7fcf141e8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:11.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.551+0000 7fcf1a99d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcf140a2c00 con 0x7fcefc003c60 2024-05-16T22:32:11.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.552+0000 7fcf1a99d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcf140bfda0 con 0x7fcf141e7f00 2024-05-16T22:32:11.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.552+0000 7fcf1a99d640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fcf140a2d80 con 0x7fcf140b8ee0 2024-05-16T22:32:11.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.552+0000 7fcf1999b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcefc003c60 0x7fcf141d4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:11.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.552+0000 7fcf1999b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcefc003c60 0x7fcf141d4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43370/0 (socket says 172.21.15.44:43370) 2024-05-16T22:32:11.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.552+0000 7fcf1999b640 1 -- 172.21.15.44:0/2403075707 learned_addr learned my addr 172.21.15.44:0/2403075707 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:32:11.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.552+0000 7fcf1919a640 1 --2- 172.21.15.44:0/2403075707 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf140b8ee0 0x7fcf141d5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:11.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.552+0000 7fcf1a19c640 1 --2- 172.21.15.44:0/2403075707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf141e7f00 0x7fcf141e8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:11.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.552+0000 7fcf1999b640 1 -- 172.21.15.44:0/2403075707 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf140b8ee0 msgr2=0x7fcf141d5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:11.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.552+0000 7fcf1999b640 1 --2- 172.21.15.44:0/2403075707 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf140b8ee0 0x7fcf141d5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:11.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.552+0000 7fcf1999b640 1 -- 172.21.15.44:0/2403075707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf141e7f00 msgr2=0x7fcf141e8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:11.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.552+0000 7fcf1999b640 1 --2- 172.21.15.44:0/2403075707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf141e7f00 0x7fcf141e8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:11.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.552+0000 7fcf1999b640 1 -- 172.21.15.44:0/2403075707 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf141e4aa0 con 0x7fcefc003c60 2024-05-16T22:32:11.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.552+0000 7fcf1999b640 1 --2- 172.21.15.44:0/2403075707 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcefc003c60 0x7fcf141d4bd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c001240 tx=0x7fcf1414eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:32:11.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.552+0000 7fcf127fc640 1 -- 172.21.15.44:0/2403075707 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf0c043070 con 0x7fcefc003c60 2024-05-16T22:32:11.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.552+0000 7fcf127fc640 1 -- 172.21.15.44:0/2403075707 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf0c038040 con 0x7fcefc003c60 2024-05-16T22:32:11.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.552+0000 7fcf1a99d640 1 -- 172.21.15.44:0/2403075707 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf141e4d10 con 0x7fcefc003c60 2024-05-16T22:32:11.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.552+0000 7fcf127fc640 1 -- 172.21.15.44:0/2403075707 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf0c0016f0 con 0x7fcefc003c60 2024-05-16T22:32:11.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.552+0000 7fcf1a99d640 1 -- 172.21.15.44:0/2403075707 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf141d6240 con 0x7fcefc003c60 2024-05-16T22:32:12.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.554+0000 7fcf1a99d640 1 -- 172.21.15.44:0/2403075707 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf14050860 con 0x7fcefc003c60 2024-05-16T22:32:12.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.554+0000 7fcf127fc640 1 -- 172.21.15.44:0/2403075707 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcf0c007270 con 0x7fcefc003c60 2024-05-16T22:32:12.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.554+0000 7fcf127fc640 1 --2- 172.21.15.44:0/2403075707 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fcf000762d0 0x7fcf000787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:12.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.555+0000 7fcf127fc640 1 -- 172.21.15.44:0/2403075707 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fcf0c0b7000 con 0x7fcefc003c60 2024-05-16T22:32:12.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.555+0000 7fcf1919a640 1 --2- 172.21.15.44:0/2403075707 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fcf000762d0 0x7fcf000787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:12.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.555+0000 7fcf1919a640 1 --2- 172.21.15.44:0/2403075707 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fcf000762d0 0x7fcf000787e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcf140bd8f0 tx=0x7fcf08009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:32:12.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.559+0000 7fcf127fc640 1 -- 172.21.15.44:0/2403075707 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fcf0c080cf0 con 0x7fcefc003c60 2024-05-16T22:32:12.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.750+0000 7fcf1a99d640 1 -- 172.21.15.44:0/2403075707 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fcf140bcf70 con 0x7fcefc003c60 2024-05-16T22:32:12.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.754+0000 7fcf127fc640 1 -- 172.21.15.44:0/2403075707 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7fcf0c0805f0 con 0x7fcefc003c60 2024-05-16T22:32:12.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.756+0000 7fcf1a99d640 1 -- 172.21.15.44:0/2403075707 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fcf000762d0 msgr2=0x7fcf000787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:12.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.756+0000 7fcf1a99d640 1 --2- 172.21.15.44:0/2403075707 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fcf000762d0 0x7fcf000787e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcf140bd8f0 tx=0x7fcf08009040 comp rx=0 tx=0).stop 2024-05-16T22:32:12.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.756+0000 7fcf1a99d640 1 -- 172.21.15.44:0/2403075707 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcefc003c60 msgr2=0x7fcf141d4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:12.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.756+0000 7fcf1a99d640 1 --2- 172.21.15.44:0/2403075707 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcefc003c60 0x7fcf141d4bd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c001240 tx=0x7fcf1414eda0 comp rx=0 tx=0).stop 2024-05-16T22:32:12.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.756+0000 7fcf1a99d640 1 -- 172.21.15.44:0/2403075707 shutdown_connections 2024-05-16T22:32:12.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.756+0000 7fcf1a99d640 1 --2- 172.21.15.44:0/2403075707 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fcf000762d0 0x7fcf000787e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:12.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.756+0000 7fcf1a99d640 1 --2- 172.21.15.44:0/2403075707 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf140b8ee0 0x7fcf141d5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:12.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.756+0000 7fcf1a99d640 1 --2- 172.21.15.44:0/2403075707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf141e7f00 0x7fcf141e8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:12.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.756+0000 7fcf1a99d640 1 --2- 172.21.15.44:0/2403075707 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcefc003c60 0x7fcf141d4bd0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:12.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.756+0000 7fcf1a99d640 1 -- 172.21.15.44:0/2403075707 >> 172.21.15.44:0/2403075707 conn(0x7fcf140c3a50 msgr2=0x7fcf1414b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:32:12.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.756+0000 7fcf1a99d640 1 -- 172.21.15.44:0/2403075707 shutdown_connections 2024-05-16T22:32:12.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:08.756+0000 7fcf1a99d640 1 -- 172.21.15.44:0/2403075707 wait complete. 2024-05-16T22:32:12.972 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_fscrypt.TestFSCrypt.test_fscrypt_basic_mount' 2024-05-16T22:32:13.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.138+0000 7f860dce2640 1 Processor -- start 2024-05-16T22:32:13.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.139+0000 7f860dce2640 1 -- start start 2024-05-16T22:32:13.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.140+0000 7f860dce2640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f860814e360 0x7f86081522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:13.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.140+0000 7f860dce2640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8608148770 0x7f86080c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:13.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.140+0000 7f860dce2640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f86080bf9b0 0x7f86080bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:13.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.140+0000 7f860dce2640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f8608151e40 con 0x7f8608148770 2024-05-16T22:32:13.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.140+0000 7f860dce2640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f86080c0620 con 0x7f86080bf9b0 2024-05-16T22:32:13.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.140+0000 7f860dce2640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f8608151ad0 con 0x7f860814e360 2024-05-16T22:32:13.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.140+0000 7f8606ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8608148770 0x7f86080c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:13.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.140+0000 7f8606ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8608148770 0x7f86080c0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36806/0 (socket says 172.21.15.44:36806) 2024-05-16T22:32:13.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.140+0000 7f8606ffd640 1 -- 172.21.15.44:0/3193635686 learned_addr learned my addr 172.21.15.44:0/3193635686 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:32:13.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.140+0000 7f8607fff640 1 --2- 172.21.15.44:0/3193635686 >> v2:172.21.15.70:3300/0 conn(0x7f86080bf9b0 0x7f86080bfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:13.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.140+0000 7f86077fe640 1 --2- 172.21.15.44:0/3193635686 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f860814e360 0x7f86081522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:13.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.140+0000 7f8606ffd640 1 -- 172.21.15.44:0/3193635686 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f860814e360 msgr2=0x7f86081522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:32:13.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.140+0000 7f8606ffd640 1 --2- 172.21.15.44:0/3193635686 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f860814e360 0x7f86081522d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:13.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.140+0000 7f8606ffd640 1 -- 172.21.15.44:0/3193635686 >> v2:172.21.15.70:3300/0 conn(0x7f86080bf9b0 msgr2=0x7f86080bfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:32:13.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.140+0000 7f8606ffd640 1 --2- 172.21.15.44:0/3193635686 >> v2:172.21.15.70:3300/0 conn(0x7f86080bf9b0 0x7f86080bfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:13.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.140+0000 7f8606ffd640 1 -- 172.21.15.44:0/3193635686 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8608152810 con 0x7f8608148770 2024-05-16T22:32:14.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.141+0000 7f8606ffd640 1 --2- 172.21.15.44:0/3193635686 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8608148770 0x7f86080c0c80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f85fc009870 tx=0x7f85fc02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52bf7b45e76fcfb6 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:32:14.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.141+0000 7f86067fc640 1 -- 172.21.15.44:0/3193635686 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85fc037070 con 0x7f8608148770 2024-05-16T22:32:14.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.141+0000 7f86067fc640 1 -- 172.21.15.44:0/3193635686 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85fc032440 con 0x7f8608148770 2024-05-16T22:32:14.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.141+0000 7f86067fc640 1 -- 172.21.15.44:0/3193635686 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85fc032810 con 0x7f8608148770 2024-05-16T22:32:14.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.142+0000 7f860dce2640 1 -- 172.21.15.44:0/3193635686 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8608148770 msgr2=0x7f86080c0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:14.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.142+0000 7f860dce2640 1 --2- 172.21.15.44:0/3193635686 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8608148770 0x7f86080c0c80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f85fc009870 tx=0x7f85fc02a2a0 comp rx=0 tx=0).stop 2024-05-16T22:32:14.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.142+0000 7f860dce2640 1 -- 172.21.15.44:0/3193635686 shutdown_connections 2024-05-16T22:32:14.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.142+0000 7f860dce2640 1 --2- 172.21.15.44:0/3193635686 >> v2:172.21.15.70:3300/0 conn(0x7f86080bf9b0 0x7f86080bfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:14.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.142+0000 7f860dce2640 1 --2- 172.21.15.44:0/3193635686 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8608148770 0x7f86080c0c80 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:14.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.142+0000 7f860dce2640 1 --2- 172.21.15.44:0/3193635686 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f860814e360 0x7f86081522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:14.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.142+0000 7f860dce2640 1 -- 172.21.15.44:0/3193635686 >> 172.21.15.44:0/3193635686 conn(0x7f86080c17c0 msgr2=0x7f86080c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:32:14.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.142+0000 7f860dce2640 1 -- 172.21.15.44:0/3193635686 shutdown_connections 2024-05-16T22:32:14.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.142+0000 7f860dce2640 1 -- 172.21.15.44:0/3193635686 wait complete. 2024-05-16T22:32:14.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.143+0000 7f860dce2640 1 Processor -- start 2024-05-16T22:32:14.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.144+0000 7f860dce2640 1 -- start start 2024-05-16T22:32:14.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.145+0000 7f860dce2640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f86080bf9b0 0x7f86080a6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:14.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.145+0000 7f860dce2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8608148770 0x7f8608145560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:14.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.145+0000 7f860dce2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f860814e360 0x7f86081e7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:14.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.145+0000 7f860dce2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f86080c1340 con 0x7f860814e360 2024-05-16T22:32:15.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.145+0000 7f860dce2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f86080c11c0 con 0x7f8608148770 2024-05-16T22:32:15.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.145+0000 7f860dce2640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f860809fd50 con 0x7f86080bf9b0 2024-05-16T22:32:15.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.145+0000 7f8607fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f860814e360 0x7f86081e7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:15.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.145+0000 7f8607fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f860814e360 0x7f86081e7670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36810/0 (socket says 172.21.15.44:36810) 2024-05-16T22:32:15.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.145+0000 7f8607fff640 1 -- 172.21.15.44:0/2634468524 learned_addr learned my addr 172.21.15.44:0/2634468524 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:32:15.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.145+0000 7f86077fe640 1 --2- 172.21.15.44:0/2634468524 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f86080bf9b0 0x7f86080a6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:15.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.145+0000 7f8606ffd640 1 --2- 172.21.15.44:0/2634468524 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8608148770 0x7f8608145560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:15.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.145+0000 7f8607fff640 1 -- 172.21.15.44:0/2634468524 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f86080bf9b0 msgr2=0x7f86080a6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:15.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.145+0000 7f8607fff640 1 --2- 172.21.15.44:0/2634468524 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f86080bf9b0 0x7f86080a6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:15.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.145+0000 7f8607fff640 1 -- 172.21.15.44:0/2634468524 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8608148770 msgr2=0x7f8608145560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:15.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.145+0000 7f8607fff640 1 --2- 172.21.15.44:0/2634468524 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8608148770 0x7f8608145560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:15.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.145+0000 7f8607fff640 1 -- 172.21.15.44:0/2634468524 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86080baa10 con 0x7f860814e360 2024-05-16T22:32:15.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.146+0000 7f8607fff640 1 --2- 172.21.15.44:0/2634468524 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f860814e360 0x7f86081e7670 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8600007d40 tx=0x7f860000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:32:15.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.146+0000 7f85effff640 1 -- 172.21.15.44:0/2634468524 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8600014420 con 0x7f860814e360 2024-05-16T22:32:15.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.146+0000 7f85effff640 1 -- 172.21.15.44:0/2634468524 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8600019070 con 0x7f860814e360 2024-05-16T22:32:15.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.146+0000 7f860dce2640 1 -- 172.21.15.44:0/2634468524 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86080baf40 con 0x7f860814e360 2024-05-16T22:32:15.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.146+0000 7f85effff640 1 -- 172.21.15.44:0/2634468524 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8600014800 con 0x7f860814e360 2024-05-16T22:32:15.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.146+0000 7f860dce2640 1 -- 172.21.15.44:0/2634468524 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86080ba730 con 0x7f860814e360 2024-05-16T22:32:15.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.147+0000 7f860dce2640 1 -- 172.21.15.44:0/2634468524 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8608050940 con 0x7f860814e360 2024-05-16T22:32:15.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.148+0000 7f85effff640 1 -- 172.21.15.44:0/2634468524 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f86000149a0 con 0x7f860814e360 2024-05-16T22:32:16.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.148+0000 7f85effff640 1 --2- 172.21.15.44:0/2634468524 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f85f40762d0 0x7f85f40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:16.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.148+0000 7f85effff640 1 -- 172.21.15.44:0/2634468524 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f86000978e0 con 0x7f860814e360 2024-05-16T22:32:16.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.149+0000 7f86077fe640 1 --2- 172.21.15.44:0/2634468524 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f85f40762d0 0x7f85f40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:16.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.149+0000 7f86077fe640 1 --2- 172.21.15.44:0/2634468524 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f85f40762d0 0x7f85f40787e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f85f80079a0 tx=0x7f85f8008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:32:16.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.153+0000 7f85effff640 1 -- 172.21.15.44:0/2634468524 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8600060ef0 con 0x7f860814e360 2024-05-16T22:32:16.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.419+0000 7f860dce2640 1 -- 172.21.15.44:0/2634468524 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_fscrypt.TestFSCrypt.test_fscrypt_basic_mount"]} v 0) -- 0x7f86080bf790 con 0x7f860814e360 2024-05-16T22:32:16.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.935+0000 7f85effff640 1 -- 172.21.15.44:0/2634468524 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_fscrypt.TestFSCrypt.test_fscrypt_basic_mount"]}]=0 v206) ==== 141+0+0 (secure 0 0 0) 0x7f86000651f0 con 0x7f860814e360 2024-05-16T22:32:16.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.937+0000 7f860dce2640 1 -- 172.21.15.44:0/2634468524 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f85f40762d0 msgr2=0x7f85f40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:16.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.938+0000 7f860dce2640 1 --2- 172.21.15.44:0/2634468524 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f85f40762d0 0x7f85f40787e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f85f80079a0 tx=0x7f85f8008040 comp rx=0 tx=0).stop 2024-05-16T22:32:16.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.938+0000 7f860dce2640 1 -- 172.21.15.44:0/2634468524 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f860814e360 msgr2=0x7f86081e7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:16.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.938+0000 7f860dce2640 1 --2- 172.21.15.44:0/2634468524 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f860814e360 0x7f86081e7670 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8600007d40 tx=0x7f860000e4b0 comp rx=0 tx=0).stop 2024-05-16T22:32:16.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.938+0000 7f860dce2640 1 -- 172.21.15.44:0/2634468524 shutdown_connections 2024-05-16T22:32:16.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.938+0000 7f860dce2640 1 --2- 172.21.15.44:0/2634468524 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f85f40762d0 0x7f85f40787e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:16.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.938+0000 7f860dce2640 1 --2- 172.21.15.44:0/2634468524 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f860814e360 0x7f86081e7670 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:16.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.938+0000 7f860dce2640 1 --2- 172.21.15.44:0/2634468524 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8608148770 0x7f8608145560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:16.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.938+0000 7f860dce2640 1 --2- 172.21.15.44:0/2634468524 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f86080bf9b0 0x7f86080a6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:16.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.938+0000 7f860dce2640 1 -- 172.21.15.44:0/2634468524 >> 172.21.15.44:0/2634468524 conn(0x7f86080c17c0 msgr2=0x7f8608147a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:32:16.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.938+0000 7f860dce2640 1 -- 172.21.15.44:0/2634468524 shutdown_connections 2024-05-16T22:32:16.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:13.938+0000 7f860dce2640 1 -- 172.21.15.44:0/2634468524 wait complete. 2024-05-16T22:32:17.031 INFO:tasks.cephfs_test_runner:That fscrypt can be setup and ingest files. ... ok 2024-05-16T22:32:17.081 INFO:tasks.cephfs_test_runner:Starting test: test_fscrypt_journal_recovery (tasks.cephfs.test_fscrypt.TestFSCryptRecovery) That alternate_name can be recovered from the journal. 2024-05-16T22:32:17.131 INFO:tasks.cephfs_test_runner:test_fscrypt_journal_recovery (tasks.cephfs.test_fscrypt.TestFSCryptRecovery) 2024-05-16T22:32:17.206 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-16T22:32:17.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.382+0000 7f7fd8449640 1 Processor -- start 2024-05-16T22:32:17.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.382+0000 7f7fd8449640 1 -- start start 2024-05-16T22:32:17.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.383+0000 7f7fd8449640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7fd00bd6d0 0x7f7fd00be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:17.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.383+0000 7f7fd8449640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7fd00bee80 0x7f7fd0158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:17.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.383+0000 7f7fd8449640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fd006e140 con 0x7f7fd0151fc0 2024-05-16T22:32:17.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.383+0000 7f7fd8449640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f7fd00c36f0 con 0x7f7fd00bd6d0 2024-05-16T22:32:17.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.383+0000 7f7fd8449640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f7fd0152530 con 0x7f7fd00bee80 2024-05-16T22:32:17.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.383+0000 7f7fd61e5640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f7fd0151fc0 0x7f7fd006da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:56200/0 (socket says 172.21.15.44:56200) 2024-05-16T22:32:17.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.384+0000 7f7fd61e5640 1 -- 172.21.15.44:0/2955295301 learned_addr learned my addr 172.21.15.44:0/2955295301 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:32:17.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.384+0000 7f7fd59e4640 1 --2- 172.21.15.44:0/2955295301 >> v2:172.21.15.70:3300/0 conn(0x7f7fd00bd6d0 0x7f7fd00be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:17.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.384+0000 7f7fd69e6640 1 --2- 172.21.15.44:0/2955295301 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7fd00bee80 0x7f7fd0158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:17.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.384+0000 7f7fd51e3640 1 -- 172.21.15.44:0/2955295301 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3367759662 0 0) 0x7f7fcc001110 con 0x7f7fd0151fc0 2024-05-16T22:32:18.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.384+0000 7f7fd51e3640 1 -- 172.21.15.44:0/2955295301 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fbc003520 con 0x7f7fd0151fc0 2024-05-16T22:32:18.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.384+0000 7f7fd51e3640 1 -- 172.21.15.44:0/2955295301 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2149846761 0 0) 0x7f7fbc003520 con 0x7f7fd0151fc0 2024-05-16T22:32:18.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.384+0000 7f7fd69e6640 1 -- 172.21.15.44:0/2955295301 >> v2:172.21.15.70:3300/0 conn(0x7f7fd00bd6d0 msgr2=0x7f7fd00be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:32:18.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.384+0000 7f7fd69e6640 1 --2- 172.21.15.44:0/2955295301 >> v2:172.21.15.70:3300/0 conn(0x7f7fd00bd6d0 0x7f7fd00be940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:18.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.384+0000 7f7fd69e6640 1 -- 172.21.15.44:0/2955295301 >> v1:172.21.15.44:6789/0 conn(0x7f7fd0151fc0 legacy=0x7f7fd006da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:18.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.384+0000 7f7fd69e6640 1 -- 172.21.15.44:0/2955295301 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fd0152810 con 0x7f7fd00bee80 2024-05-16T22:32:18.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.384+0000 7f7fd59e4640 1 --2- 172.21.15.44:0/2955295301 >> v2:172.21.15.70:3300/0 conn(0x7f7fd00bd6d0 0x7f7fd00be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:32:18.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.385+0000 7f7fd69e6640 1 --2- 172.21.15.44:0/2955295301 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7fd00bee80 0x7f7fd0158e90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8009d90 tx=0x7f7fc802a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=134f61e23409886f server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:32:18.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.385+0000 7f7fd51e3640 1 -- 172.21.15.44:0/2955295301 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc0018c0 con 0x7f7fd00bee80 2024-05-16T22:32:18.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.385+0000 7f7fd51e3640 1 -- 172.21.15.44:0/2955295301 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fc8007540 con 0x7f7fd00bee80 2024-05-16T22:32:18.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.385+0000 7f7fd51e3640 1 -- 172.21.15.44:0/2955295301 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc8007910 con 0x7f7fd00bee80 2024-05-16T22:32:18.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.386+0000 7f7fd8449640 1 -- 172.21.15.44:0/2955295301 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7fd00bee80 msgr2=0x7f7fd0158e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:18.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.386+0000 7f7fd8449640 1 --2- 172.21.15.44:0/2955295301 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7fd00bee80 0x7f7fd0158e90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8009d90 tx=0x7f7fc802a5f0 comp rx=0 tx=0).stop 2024-05-16T22:32:18.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.386+0000 7f7fd8449640 1 -- 172.21.15.44:0/2955295301 shutdown_connections 2024-05-16T22:32:18.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.386+0000 7f7fd8449640 1 --2- 172.21.15.44:0/2955295301 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7fd00bee80 0x7f7fd0158e90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:18.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.386+0000 7f7fd8449640 1 --2- 172.21.15.44:0/2955295301 >> v2:172.21.15.70:3300/0 conn(0x7f7fd00bd6d0 0x7f7fd00be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:18.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.386+0000 7f7fd8449640 1 -- 172.21.15.44:0/2955295301 >> 172.21.15.44:0/2955295301 conn(0x7f7fd00c3d20 msgr2=0x7f7fd00c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:32:18.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.386+0000 7f7fd8449640 1 -- 172.21.15.44:0/2955295301 shutdown_connections 2024-05-16T22:32:18.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.386+0000 7f7fd8449640 1 -- 172.21.15.44:0/2955295301 wait complete. 2024-05-16T22:32:19.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.388+0000 7f7fd8449640 1 Processor -- start 2024-05-16T22:32:19.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.388+0000 7f7fd8449640 1 -- start start 2024-05-16T22:32:19.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.389+0000 7f7fd8449640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7fd00bd6d0 0x7f7fd00b9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:19.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.389+0000 7f7fd8449640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7fd00bee80 0x7f7fd00b8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:19.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.389+0000 7f7fd8449640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7fd0151fc0 0x7f7fd014ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:19.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.389+0000 7f7fd8449640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd00bdae0 con 0x7f7fd00bee80 2024-05-16T22:32:19.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.389+0000 7f7fd8449640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd00c0070 con 0x7f7fd00bd6d0 2024-05-16T22:32:19.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.389+0000 7f7fd8449640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f7fd00a2ed0 con 0x7f7fd0151fc0 2024-05-16T22:32:19.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.389+0000 7f7fd59e4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7fd00bee80 0x7f7fd00b8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:19.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.389+0000 7f7fd59e4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7fd00bee80 0x7f7fd00b8d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36824/0 (socket says 172.21.15.44:36824) 2024-05-16T22:32:19.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.389+0000 7f7fd59e4640 1 -- 172.21.15.44:0/1991779520 learned_addr learned my addr 172.21.15.44:0/1991779520 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:32:19.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.389+0000 7f7fd69e6640 1 --2- 172.21.15.44:0/1991779520 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7fd0151fc0 0x7f7fd014ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:19.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.389+0000 7f7fd61e5640 1 --2- 172.21.15.44:0/1991779520 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7fd00bd6d0 0x7f7fd00b9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:19.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.389+0000 7f7fd59e4640 1 -- 172.21.15.44:0/1991779520 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7fd0151fc0 msgr2=0x7f7fd014ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:19.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.389+0000 7f7fd59e4640 1 --2- 172.21.15.44:0/1991779520 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7fd0151fc0 0x7f7fd014ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:19.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.389+0000 7f7fd59e4640 1 -- 172.21.15.44:0/1991779520 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7fd00bd6d0 msgr2=0x7f7fd00b9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:19.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.389+0000 7f7fd59e4640 1 --2- 172.21.15.44:0/1991779520 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7fd00bd6d0 0x7f7fd00b9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:19.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.389+0000 7f7fd59e4640 1 -- 172.21.15.44:0/1991779520 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fd00b9270 con 0x7f7fd00bee80 2024-05-16T22:32:19.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.389+0000 7f7fd69e6640 1 --2- 172.21.15.44:0/1991779520 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7fd0151fc0 0x7f7fd014ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:32:19.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.389+0000 7f7fd61e5640 1 --2- 172.21.15.44:0/1991779520 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7fd00bd6d0 0x7f7fd00b9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:32:20.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.389+0000 7f7fd59e4640 1 --2- 172.21.15.44:0/1991779520 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7fd00bee80 0x7f7fd00b8d30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7fc000e900 tx=0x7f7fc000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:32:20.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.390+0000 7f7fc6ffd640 1 -- 172.21.15.44:0/1991779520 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc0017070 con 0x7f7fd00bee80 2024-05-16T22:32:20.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.390+0000 7f7fc6ffd640 1 -- 172.21.15.44:0/1991779520 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fc000c9a0 con 0x7f7fd00bee80 2024-05-16T22:32:20.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.390+0000 7f7fd8449640 1 -- 172.21.15.44:0/1991779520 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fd014cf80 con 0x7f7fd00bee80 2024-05-16T22:32:20.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.390+0000 7f7fc6ffd640 1 -- 172.21.15.44:0/1991779520 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc000cd90 con 0x7f7fd00bee80 2024-05-16T22:32:20.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.390+0000 7f7fd8449640 1 -- 172.21.15.44:0/1991779520 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fd00b79e0 con 0x7f7fd00bee80 2024-05-16T22:32:20.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.391+0000 7f7fd8449640 1 -- 172.21.15.44:0/1991779520 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fd0050940 con 0x7f7fd00bee80 2024-05-16T22:32:20.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.391+0000 7f7fc6ffd640 1 -- 172.21.15.44:0/1991779520 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7fc001a070 con 0x7f7fd00bee80 2024-05-16T22:32:20.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.392+0000 7f7fc6ffd640 1 --2- 172.21.15.44:0/1991779520 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f7fb40762d0 0x7f7fb40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:20.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.392+0000 7f7fc6ffd640 1 -- 172.21.15.44:0/1991779520 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f7fc00970c0 con 0x7f7fd00bee80 2024-05-16T22:32:20.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.392+0000 7f7fd61e5640 1 --2- 172.21.15.44:0/1991779520 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f7fb40762d0 0x7f7fb40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:20.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.393+0000 7f7fd61e5640 1 --2- 172.21.15.44:0/1991779520 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f7fb40762d0 0x7f7fb40787e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc0078f0 tx=0x7f7fcc009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:32:20.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.397+0000 7f7fc6ffd640 1 -- 172.21.15.44:0/1991779520 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7fc0060db0 con 0x7f7fd00bee80 2024-05-16T22:32:20.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.591+0000 7f7fd8449640 1 -- 172.21.15.44:0/1991779520 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7fd014e740 con 0x7f7fd00bee80 2024-05-16T22:32:20.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.592+0000 7f7fc6ffd640 1 -- 172.21.15.44:0/1991779520 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+12984 (secure 0 0 0) 0x7f7fc00606b0 con 0x7f7fd00bee80 2024-05-16T22:32:20.908 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:32:20.958 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":37,"fsid":"572ab7cc-b103-4548-ae8f-c6614d57f0c8","created":"2024-05-16T22:27:02.216874+0000","modified":"2024-05-16T22:32:05.911484+0000","last_up_change":"2024-05-16T22:27:13.693953+0000","last_in_change":"2024-05-16T22:27:04.455119+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-16T22:27:14.562409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a7003e89-c706-4562-9f25-670bb35ae108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6825","nonce":1074109859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6827","nonce":1074109859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6831","nonce":1074109859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6829","nonce":1074109859}]},"public_addr":"172.21.15.44:6825/1074109859","cluster_addr":"172.21.15.44:6827/1074109859","heartbeat_back_addr":"172.21.15.44:6831/1074109859","heartbeat_front_addr":"172.21.15.44:6829/1074109859","state":["exists","up"]},{"osd":1,"uuid":"a4d5169d-8327-4494-9c7c-58db21b00636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6817","nonce":2909429972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6819","nonce":2909429972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6823","nonce":2909429972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6821","nonce":2909429972}]},"public_addr":"172.21.15.44:6817/2909429972","cluster_addr":"172.21.15.44:6819/2909429972","heartbeat_back_addr":"172.21.15.44:6823/2909429972","heartbeat_front_addr":"172.21.15.44:6821/2909429972","state":["exists","up"]},{"osd":2,"uuid":"d4a834f8-83a5-400f-9814-eb0a25124df4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6801","nonce":2908194156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6803","nonce":2908194156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6807","nonce":2908194156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6805","nonce":2908194156}]},"public_addr":"172.21.15.44:6801/2908194156","cluster_addr":"172.21.15.44:6803/2908194156","heartbeat_back_addr":"172.21.15.44:6807/2908194156","heartbeat_front_addr":"172.21.15.44:6805/2908194156","state":["exists","up"]},{"osd":3,"uuid":"b9d24a56-ad43-4674-a395-5ec24d135ae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6809","nonce":2168695793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6811","nonce":2168695793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6815","nonce":2168695793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6813","nonce":2168695793}]},"public_addr":"172.21.15.44:6809/2168695793","cluster_addr":"172.21.15.44:6811/2168695793","heartbeat_back_addr":"172.21.15.44:6815/2168695793","heartbeat_front_addr":"172.21.15.44:6813/2168695793","state":["exists","up"]},{"osd":4,"uuid":"9bd94af5-3e17-4cbe-995a-8f837a66c653","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6823","nonce":1540297751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6825","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6827","nonce":1540297751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6831","nonce":1540297751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6829","nonce":1540297751}]},"public_addr":"172.21.15.70:6823/1540297751","cluster_addr":"172.21.15.70:6827/1540297751","heartbeat_back_addr":"172.21.15.70:6831/1540297751","heartbeat_front_addr":"172.21.15.70:6829/1540297751","state":["exists","up"]},{"osd":5,"uuid":"a5b0cfa5-b259-48bd-98b6-96b44f5ebabd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6804","nonce":4218901987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6808","nonce":4218901987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6815","nonce":4218901987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6812","nonce":4218901987}]},"public_addr":"172.21.15.70:6804/4218901987","cluster_addr":"172.21.15.70:6808/4218901987","heartbeat_back_addr":"172.21.15.70:6815/4218901987","heartbeat_front_addr":"172.21.15.70:6812/4218901987","state":["exists","up"]},{"osd":6,"uuid":"0b6af6df-1358-4fc6-a62c-ba57e02914ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6801","nonce":2389556489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6805","nonce":2389556489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6813","nonce":2389556489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6807","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6809","nonce":2389556489}]},"public_addr":"172.21.15.70:6801/2389556489","cluster_addr":"172.21.15.70:6805/2389556489","heartbeat_back_addr":"172.21.15.70:6813/2389556489","heartbeat_front_addr":"172.21.15.70:6809/2389556489","state":["exists","up"]},{"osd":7,"uuid":"eb1a2c5d-42cf-47d0-9e03-b9d26944a589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6817","nonce":3619691281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6819","nonce":3619691281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6826","nonce":3619691281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6822","nonce":3619691281}]},"public_addr":"172.21.15.70:6817/3619691281","cluster_addr":"172.21.15.70:6819/3619691281","heartbeat_back_addr":"172.21.15.70:6826/3619691281","heartbeat_front_addr":"172.21.15.70:6822/3619691281","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.652256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.613348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.528454+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.625204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.678845+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.680829+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.556200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.647030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6834/2647971069":"2024-05-17T22:31:54.450997+0000","172.21.15.44:6833/2647971069":"2024-05-17T22:31:54.450997+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T22:32:21.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.594+0000 7f7fd8449640 1 -- 172.21.15.44:0/1991779520 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f7fb40762d0 msgr2=0x7f7fb40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:21.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.594+0000 7f7fd8449640 1 --2- 172.21.15.44:0/1991779520 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f7fb40762d0 0x7f7fb40787e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc0078f0 tx=0x7f7fcc009040 comp rx=0 tx=0).stop 2024-05-16T22:32:21.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.594+0000 7f7fd8449640 1 -- 172.21.15.44:0/1991779520 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7fd00bee80 msgr2=0x7f7fd00b8d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:21.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.594+0000 7f7fd8449640 1 --2- 172.21.15.44:0/1991779520 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7fd00bee80 0x7f7fd00b8d30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7fc000e900 tx=0x7f7fc000edc0 comp rx=0 tx=0).stop 2024-05-16T22:32:21.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.594+0000 7f7fd8449640 1 -- 172.21.15.44:0/1991779520 shutdown_connections 2024-05-16T22:32:21.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.594+0000 7f7fd8449640 1 --2- 172.21.15.44:0/1991779520 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f7fb40762d0 0x7f7fb40787e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:21.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.594+0000 7f7fd8449640 1 --2- 172.21.15.44:0/1991779520 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7fd0151fc0 0x7f7fd014ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:21.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.594+0000 7f7fd8449640 1 --2- 172.21.15.44:0/1991779520 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7fd00bee80 0x7f7fd00b8d30 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:21.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.594+0000 7f7fd8449640 1 --2- 172.21.15.44:0/1991779520 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7fd00bd6d0 0x7f7fd00b9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:21.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.594+0000 7f7fd8449640 1 -- 172.21.15.44:0/1991779520 >> 172.21.15.44:0/1991779520 conn(0x7f7fd00c3d20 msgr2=0x7f7fd00a4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:32:21.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.594+0000 7f7fd8449640 1 -- 172.21.15.44:0/1991779520 shutdown_connections 2024-05-16T22:32:21.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:17.594+0000 7f7fd8449640 1 -- 172.21.15.44:0/1991779520 wait complete. 2024-05-16T22:32:21.667 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-16T22:27:14.562409+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-16T22:32:21.717 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-16T22:32:21.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.896+0000 7f25cdcaa640 1 Processor -- start 2024-05-16T22:32:21.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.896+0000 7f25cdcaa640 1 -- start start 2024-05-16T22:32:22.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.897+0000 7f25cdcaa640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f25c8074b00 0x7f25c806c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:22.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.897+0000 7f25cdcaa640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25c806ce00 con 0x7f25c814fad0 2024-05-16T22:32:22.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.897+0000 7f25cdcaa640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25c814d230 con 0x7f25c80be3f0 2024-05-16T22:32:22.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.897+0000 7f25cdcaa640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f25c80bb470 con 0x7f25c8074b00 2024-05-16T22:32:22.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.897+0000 7f25c7fff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f25c814fad0 0x7f25c814fee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41112/0 (socket says 172.21.15.44:41112) 2024-05-16T22:32:22.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.897+0000 7f25c7fff640 1 -- 172.21.15.44:0/3712142184 learned_addr learned my addr 172.21.15.44:0/3712142184 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:32:22.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.898+0000 7f25c77fe640 1 --2- 172.21.15.44:0/3712142184 >> v2:172.21.15.70:3300/0 conn(0x7f25c8074b00 0x7f25c806c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:22.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.898+0000 7f25c67fc640 1 -- 172.21.15.44:0/3712142184 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 352591154 0 0) 0x7f25c806ce00 con 0x7f25c814fad0 2024-05-16T22:32:22.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.898+0000 7f25c67fc640 1 -- 172.21.15.44:0/3712142184 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f25b0003520 con 0x7f25c814fad0 2024-05-16T22:32:22.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.898+0000 7f25c67fc640 1 -- 172.21.15.44:0/3712142184 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1476861957 0 0) 0x7f25c814d230 con 0x7f25c80be3f0 2024-05-16T22:32:22.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.898+0000 7f25c67fc640 1 -- 172.21.15.44:0/3712142184 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f25c806ce00 con 0x7f25c80be3f0 2024-05-16T22:32:22.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.898+0000 7f25c67fc640 1 -- 172.21.15.44:0/3712142184 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4005970865 0 0) 0x7f25b0003520 con 0x7f25c814fad0 2024-05-16T22:32:22.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.898+0000 7f25c77fe640 1 -- 172.21.15.44:0/3712142184 >> v1:172.21.15.70:6789/0 conn(0x7f25c80be3f0 legacy=0x7f25c814cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:22.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.898+0000 7f25c77fe640 1 -- 172.21.15.44:0/3712142184 >> v1:172.21.15.44:6789/0 conn(0x7f25c814fad0 legacy=0x7f25c814fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:22.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.898+0000 7f25c77fe640 1 -- 172.21.15.44:0/3712142184 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25c80bb890 con 0x7f25c8074b00 2024-05-16T22:32:22.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.899+0000 7f25c77fe640 1 --2- 172.21.15.44:0/3712142184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f25c8074b00 0x7f25c806c8c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f25b80097a0 tx=0x7f25b802a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=368af5cadff2a8ed server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:32:22.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.899+0000 7f25c67fc640 1 -- 172.21.15.44:0/3712142184 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b8037070 con 0x7f25c8074b00 2024-05-16T22:32:22.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.899+0000 7f25c67fc640 1 -- 172.21.15.44:0/3712142184 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25b802abc0 con 0x7f25c8074b00 2024-05-16T22:32:22.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.899+0000 7f25c67fc640 1 -- 172.21.15.44:0/3712142184 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c0001a70 con 0x7f25c8074b00 2024-05-16T22:32:22.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.900+0000 7f25cdcaa640 1 -- 172.21.15.44:0/3712142184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f25c8074b00 msgr2=0x7f25c806c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:23.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.900+0000 7f25cdcaa640 1 --2- 172.21.15.44:0/3712142184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f25c8074b00 0x7f25c806c8c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f25b80097a0 tx=0x7f25b802a130 comp rx=0 tx=0).stop 2024-05-16T22:32:23.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.900+0000 7f25cdcaa640 1 -- 172.21.15.44:0/3712142184 shutdown_connections 2024-05-16T22:32:23.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.900+0000 7f25cdcaa640 1 --2- 172.21.15.44:0/3712142184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f25c8074b00 0x7f25c806c8c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:23.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.900+0000 7f25cdcaa640 1 -- 172.21.15.44:0/3712142184 >> 172.21.15.44:0/3712142184 conn(0x7f25c80bd0f0 msgr2=0x7f25c80bd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:32:23.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.900+0000 7f25cdcaa640 1 -- 172.21.15.44:0/3712142184 shutdown_connections 2024-05-16T22:32:23.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.900+0000 7f25cdcaa640 1 -- 172.21.15.44:0/3712142184 wait complete. 2024-05-16T22:32:23.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.901+0000 7f25cdcaa640 1 Processor -- start 2024-05-16T22:32:23.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.902+0000 7f25cdcaa640 1 -- start start 2024-05-16T22:32:23.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.903+0000 7f25cdcaa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f25c8074b00 0x7f25c81d7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:23.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.903+0000 7f25cdcaa640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25c80be3f0 0x7f25c81d5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:23.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.903+0000 7f25cdcaa640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f25c814fad0 0x7f25c809e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:23.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.903+0000 7f25cdcaa640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f25c80bc0f0 con 0x7f25c80be3f0 2024-05-16T22:32:23.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.903+0000 7f25cdcaa640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f25c80bbe10 con 0x7f25c8074b00 2024-05-16T22:32:23.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.903+0000 7f25cdcaa640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f25c80bc3d0 con 0x7f25c814fad0 2024-05-16T22:32:23.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.903+0000 7f25c6ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25c80be3f0 0x7f25c81d5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:23.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.903+0000 7f25c6ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25c80be3f0 0x7f25c81d5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35940/0 (socket says 172.21.15.44:35940) 2024-05-16T22:32:23.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.903+0000 7f25c6ffd640 1 -- 172.21.15.44:0/1560319881 learned_addr learned my addr 172.21.15.44:0/1560319881 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:32:23.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.903+0000 7f25c7fff640 1 --2- 172.21.15.44:0/1560319881 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f25c814fad0 0x7f25c809e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:23.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.903+0000 7f25c77fe640 1 --2- 172.21.15.44:0/1560319881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f25c8074b00 0x7f25c81d7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:24.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.903+0000 7f25c6ffd640 1 -- 172.21.15.44:0/1560319881 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f25c814fad0 msgr2=0x7f25c809e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:24.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.903+0000 7f25c6ffd640 1 --2- 172.21.15.44:0/1560319881 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f25c814fad0 0x7f25c809e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:24.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.903+0000 7f25c6ffd640 1 -- 172.21.15.44:0/1560319881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f25c8074b00 msgr2=0x7f25c81d7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:24.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.903+0000 7f25c6ffd640 1 --2- 172.21.15.44:0/1560319881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f25c8074b00 0x7f25c81d7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:24.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.903+0000 7f25c6ffd640 1 -- 172.21.15.44:0/1560319881 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25c81d7bd0 con 0x7f25c80be3f0 2024-05-16T22:32:24.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.903+0000 7f25c7fff640 1 --2- 172.21.15.44:0/1560319881 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f25c814fad0 0x7f25c809e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:32:24.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.903+0000 7f25c77fe640 1 --2- 172.21.15.44:0/1560319881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f25c8074b00 0x7f25c81d7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:32:24.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.903+0000 7f25c6ffd640 1 --2- 172.21.15.44:0/1560319881 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25c80be3f0 0x7f25c81d5bb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f25bc00c390 tx=0x7f25bc00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:32:24.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.903+0000 7f25affff640 1 -- 172.21.15.44:0/1560319881 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25bc017070 con 0x7f25c80be3f0 2024-05-16T22:32:24.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.903+0000 7f25affff640 1 -- 172.21.15.44:0/1560319881 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25bc0052d0 con 0x7f25c80be3f0 2024-05-16T22:32:24.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.903+0000 7f25cdcaa640 1 -- 172.21.15.44:0/1560319881 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25c81e1fa0 con 0x7f25c80be3f0 2024-05-16T22:32:24.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.903+0000 7f25affff640 1 -- 172.21.15.44:0/1560319881 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25bc003830 con 0x7f25c80be3f0 2024-05-16T22:32:24.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.904+0000 7f25cdcaa640 1 -- 172.21.15.44:0/1560319881 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25c81e21a0 con 0x7f25c80be3f0 2024-05-16T22:32:24.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.904+0000 7f25cdcaa640 1 -- 172.21.15.44:0/1560319881 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25c8050940 con 0x7f25c80be3f0 2024-05-16T22:32:24.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.905+0000 7f25affff640 1 -- 172.21.15.44:0/1560319881 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f25bc01a070 con 0x7f25c80be3f0 2024-05-16T22:32:24.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.906+0000 7f25affff640 1 --2- 172.21.15.44:0/1560319881 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f25b4076300 0x7f25b4078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:24.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.906+0000 7f25affff640 1 -- 172.21.15.44:0/1560319881 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f25bc0965d0 con 0x7f25c80be3f0 2024-05-16T22:32:24.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.906+0000 7f25c77fe640 1 --2- 172.21.15.44:0/1560319881 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f25b4076300 0x7f25b4078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:24.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.907+0000 7f25c77fe640 1 --2- 172.21.15.44:0/1560319881 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f25b4076300 0x7f25b4078810 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f25b8034000 tx=0x7f25b802e000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:32:25.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:21.911+0000 7f25affff640 1 -- 172.21.15.44:0/1560319881 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f25c81e1fa0 con 0x7f25c80be3f0 2024-05-16T22:32:25.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:22.100+0000 7f25cdcaa640 1 -- 172.21.15.44:0/1560319881 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f25c80742e0 con 0x7f25c80be3f0 2024-05-16T22:32:25.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:22.101+0000 7f25affff640 1 -- 172.21.15.44:0/1560319881 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) ==== 93+0+10 (secure 0 0 0) 0x7f25bc060230 con 0x7f25c80be3f0 2024-05-16T22:32:25.227 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-05-16T22:32:25.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:22.103+0000 7f25cdcaa640 1 -- 172.21.15.44:0/1560319881 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f25b4076300 msgr2=0x7f25b4078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:25.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:22.103+0000 7f25cdcaa640 1 --2- 172.21.15.44:0/1560319881 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f25b4076300 0x7f25b4078810 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f25b8034000 tx=0x7f25b802e000 comp rx=0 tx=0).stop 2024-05-16T22:32:25.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:22.103+0000 7f25cdcaa640 1 -- 172.21.15.44:0/1560319881 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25c80be3f0 msgr2=0x7f25c81d5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:25.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:22.103+0000 7f25cdcaa640 1 --2- 172.21.15.44:0/1560319881 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25c80be3f0 0x7f25c81d5bb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f25bc00c390 tx=0x7f25bc00c850 comp rx=0 tx=0).stop 2024-05-16T22:32:25.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:22.103+0000 7f25cdcaa640 1 -- 172.21.15.44:0/1560319881 shutdown_connections 2024-05-16T22:32:25.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:22.103+0000 7f25cdcaa640 1 --2- 172.21.15.44:0/1560319881 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f25b4076300 0x7f25b4078810 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:25.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:22.103+0000 7f25cdcaa640 1 --2- 172.21.15.44:0/1560319881 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f25c814fad0 0x7f25c809e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:25.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:22.103+0000 7f25cdcaa640 1 --2- 172.21.15.44:0/1560319881 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25c80be3f0 0x7f25c81d5bb0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:25.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:22.103+0000 7f25cdcaa640 1 --2- 172.21.15.44:0/1560319881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f25c8074b00 0x7f25c81d7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:25.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:22.103+0000 7f25cdcaa640 1 -- 172.21.15.44:0/1560319881 >> 172.21.15.44:0/1560319881 conn(0x7f25c80bd0f0 msgr2=0x7f25c814fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:32:25.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:22.103+0000 7f25cdcaa640 1 -- 172.21.15.44:0/1560319881 shutdown_connections 2024-05-16T22:32:25.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:22.103+0000 7f25cdcaa640 1 -- 172.21.15.44:0/1560319881 wait complete. 2024-05-16T22:32:25.878 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_fscrypt.TestFSCryptRecovery.test_fscrypt_journal_recovery' 2024-05-16T22:32:26.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.080+0000 7fa7328c8640 1 Processor -- start 2024-05-16T22:32:26.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.080+0000 7fa7328c8640 1 -- start start 2024-05-16T22:32:26.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.081+0000 7fa7328c8640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa72c151fc0 0x7fa72c0bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:26.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.081+0000 7fa7328c8640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa72c0c36f0 con 0x7fa72c0bf050 2024-05-16T22:32:26.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.081+0000 7fa7328c8640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa72c152530 con 0x7fa72c06da30 2024-05-16T22:32:26.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.081+0000 7fa7328c8640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fa72c0bdc10 con 0x7fa72c151fc0 2024-05-16T22:32:26.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.081+0000 7fa730e65640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fa72c0bf050 0x7fa72c158e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:41124/0 (socket says 172.21.15.44:41124) 2024-05-16T22:32:26.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.081+0000 7fa730e65640 1 -- 172.21.15.44:0/2310840611 learned_addr learned my addr 172.21.15.44:0/2310840611 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:32:26.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.082+0000 7fa72bfff640 1 --2- 172.21.15.44:0/2310840611 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa72c151fc0 0x7fa72c0bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:26.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.082+0000 7fa72affd640 1 -- 172.21.15.44:0/2310840611 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 531128734 0 0) 0x7fa72c0c36f0 con 0x7fa72c0bf050 2024-05-16T22:32:26.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.082+0000 7fa72affd640 1 -- 172.21.15.44:0/2310840611 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa714003520 con 0x7fa72c0bf050 2024-05-16T22:32:26.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.082+0000 7fa72affd640 1 -- 172.21.15.44:0/2310840611 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2990579334 0 0) 0x7fa72c152530 con 0x7fa72c06da30 2024-05-16T22:32:26.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.082+0000 7fa72affd640 1 -- 172.21.15.44:0/2310840611 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa72c0c36f0 con 0x7fa72c06da30 2024-05-16T22:32:26.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.082+0000 7fa72bfff640 1 -- 172.21.15.44:0/2310840611 >> v1:172.21.15.70:6789/0 conn(0x7fa72c06da30 legacy=0x7fa72c0be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:26.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.082+0000 7fa72bfff640 1 -- 172.21.15.44:0/2310840611 >> v1:172.21.15.44:6789/0 conn(0x7fa72c0bf050 legacy=0x7fa72c158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:26.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.082+0000 7fa72bfff640 1 -- 172.21.15.44:0/2310840611 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa72c152810 con 0x7fa72c151fc0 2024-05-16T22:32:26.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.083+0000 7fa72bfff640 1 --2- 172.21.15.44:0/2310840611 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa72c151fc0 0x7fa72c0bd6d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa7200097d0 tx=0x7fa72002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a961339fb39a048 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:32:27.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.083+0000 7fa72affd640 1 -- 172.21.15.44:0/2310840611 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa720037070 con 0x7fa72c151fc0 2024-05-16T22:32:27.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.083+0000 7fa72affd640 1 -- 172.21.15.44:0/2310840611 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa720032440 con 0x7fa72c151fc0 2024-05-16T22:32:27.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.083+0000 7fa72affd640 1 -- 172.21.15.44:0/2310840611 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa720032810 con 0x7fa72c151fc0 2024-05-16T22:32:27.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.084+0000 7fa7328c8640 1 -- 172.21.15.44:0/2310840611 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa72c151fc0 msgr2=0x7fa72c0bd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:27.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.084+0000 7fa7328c8640 1 --2- 172.21.15.44:0/2310840611 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa72c151fc0 0x7fa72c0bd6d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa7200097d0 tx=0x7fa72002a180 comp rx=0 tx=0).stop 2024-05-16T22:32:27.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.084+0000 7fa7328c8640 1 -- 172.21.15.44:0/2310840611 shutdown_connections 2024-05-16T22:32:27.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.084+0000 7fa7328c8640 1 --2- 172.21.15.44:0/2310840611 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa72c151fc0 0x7fa72c0bd6d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:27.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.084+0000 7fa7328c8640 1 -- 172.21.15.44:0/2310840611 >> 172.21.15.44:0/2310840611 conn(0x7fa72c0c3d20 msgr2=0x7fa72c0c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:32:27.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.084+0000 7fa7328c8640 1 -- 172.21.15.44:0/2310840611 shutdown_connections 2024-05-16T22:32:27.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.084+0000 7fa7328c8640 1 -- 172.21.15.44:0/2310840611 wait complete. 2024-05-16T22:32:27.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.085+0000 7fa7328c8640 1 Processor -- start 2024-05-16T22:32:27.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.086+0000 7fa7328c8640 1 -- start start 2024-05-16T22:32:27.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.087+0000 7fa7328c8640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa72c06da30 0x7fa72c0b8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:27.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.087+0000 7fa7328c8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa72c0bf050 0x7fa72c1e8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:27.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.087+0000 7fa7328c8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa72c151fc0 0x7fa72c0a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:27.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.087+0000 7fa7328c8640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa72c0a3050 con 0x7fa72c151fc0 2024-05-16T22:32:27.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.087+0000 7fa7328c8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa72c0a2ed0 con 0x7fa72c0bf050 2024-05-16T22:32:28.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.087+0000 7fa7328c8640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fa72c06de40 con 0x7fa72c06da30 2024-05-16T22:32:28.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.087+0000 7fa730e65640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa72c151fc0 0x7fa72c0a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:28.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.087+0000 7fa730e65640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa72c151fc0 0x7fa72c0a1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35946/0 (socket says 172.21.15.44:35946) 2024-05-16T22:32:28.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.087+0000 7fa730e65640 1 -- 172.21.15.44:0/3354110848 learned_addr learned my addr 172.21.15.44:0/3354110848 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:32:28.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.087+0000 7fa72bfff640 1 --2- 172.21.15.44:0/3354110848 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa72c06da30 0x7fa72c0b8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:28.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.087+0000 7fa72b7fe640 1 --2- 172.21.15.44:0/3354110848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa72c0bf050 0x7fa72c1e8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:28.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.087+0000 7fa730e65640 1 -- 172.21.15.44:0/3354110848 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa72c06da30 msgr2=0x7fa72c0b8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:28.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.087+0000 7fa730e65640 1 --2- 172.21.15.44:0/3354110848 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa72c06da30 0x7fa72c0b8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:28.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.087+0000 7fa730e65640 1 -- 172.21.15.44:0/3354110848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa72c0bf050 msgr2=0x7fa72c1e8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:28.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.087+0000 7fa730e65640 1 --2- 172.21.15.44:0/3354110848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa72c0bf050 0x7fa72c1e8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:28.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.087+0000 7fa730e65640 1 -- 172.21.15.44:0/3354110848 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa72c0b94f0 con 0x7fa72c151fc0 2024-05-16T22:32:28.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.087+0000 7fa730e65640 1 --2- 172.21.15.44:0/3354110848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa72c151fc0 0x7fa72c0a1e50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa72400cb20 tx=0x7fa72400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:32:28.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.087+0000 7fa728ff9640 1 -- 172.21.15.44:0/3354110848 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa72400ac40 con 0x7fa72c151fc0 2024-05-16T22:32:28.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.088+0000 7fa728ff9640 1 -- 172.21.15.44:0/3354110848 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa72400ade0 con 0x7fa72c151fc0 2024-05-16T22:32:28.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.088+0000 7fa7328c8640 1 -- 172.21.15.44:0/3354110848 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa72c0ba470 con 0x7fa72c151fc0 2024-05-16T22:32:28.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.088+0000 7fa728ff9640 1 -- 172.21.15.44:0/3354110848 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa724012600 con 0x7fa72c151fc0 2024-05-16T22:32:28.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.088+0000 7fa7328c8640 1 -- 172.21.15.44:0/3354110848 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa72c1e4ea0 con 0x7fa72c151fc0 2024-05-16T22:32:28.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.089+0000 7fa7328c8640 1 -- 172.21.15.44:0/3354110848 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa72c0c10e0 con 0x7fa72c151fc0 2024-05-16T22:32:28.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.089+0000 7fa728ff9640 1 -- 172.21.15.44:0/3354110848 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa7240127a0 con 0x7fa72c151fc0 2024-05-16T22:32:29.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.090+0000 7fa728ff9640 1 --2- 172.21.15.44:0/3354110848 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fa718076300 0x7fa718078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:29.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.090+0000 7fa728ff9640 1 -- 172.21.15.44:0/3354110848 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fa7240977e0 con 0x7fa72c151fc0 2024-05-16T22:32:29.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.090+0000 7fa72bfff640 1 --2- 172.21.15.44:0/3354110848 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fa718076300 0x7fa718078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:29.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.090+0000 7fa72bfff640 1 --2- 172.21.15.44:0/3354110848 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fa718076300 0x7fa718078810 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa720034000 tx=0x7fa72002e000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:32:29.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.095+0000 7fa728ff9640 1 -- 172.21.15.44:0/3354110848 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa72c0c10e0 con 0x7fa72c151fc0 2024-05-16T22:32:29.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.361+0000 7fa7328c8640 1 -- 172.21.15.44:0/3354110848 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFSCryptRecovery.test_fscrypt_journal_recovery"]} v 0) -- 0x7fa72c0bd2d0 con 0x7fa72c151fc0 2024-05-16T22:32:29.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.966+0000 7fa728ff9640 1 -- 172.21.15.44:0/3354110848 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFSCryptRecovery.test_fscrypt_journal_recovery"]}]=0 v215) ==== 157+0+0 (secure 0 0 0) 0x7fa724060d60 con 0x7fa72c151fc0 2024-05-16T22:32:29.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.971+0000 7fa7328c8640 1 -- 172.21.15.44:0/3354110848 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fa718076300 msgr2=0x7fa718078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:29.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.971+0000 7fa7328c8640 1 --2- 172.21.15.44:0/3354110848 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fa718076300 0x7fa718078810 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa720034000 tx=0x7fa72002e000 comp rx=0 tx=0).stop 2024-05-16T22:32:29.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.971+0000 7fa7328c8640 1 -- 172.21.15.44:0/3354110848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa72c151fc0 msgr2=0x7fa72c0a1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:29.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.971+0000 7fa7328c8640 1 --2- 172.21.15.44:0/3354110848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa72c151fc0 0x7fa72c0a1e50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa72400cb20 tx=0x7fa72400a060 comp rx=0 tx=0).stop 2024-05-16T22:32:29.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.971+0000 7fa7328c8640 1 -- 172.21.15.44:0/3354110848 shutdown_connections 2024-05-16T22:32:29.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.971+0000 7fa7328c8640 1 --2- 172.21.15.44:0/3354110848 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fa718076300 0x7fa718078810 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:29.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.971+0000 7fa7328c8640 1 --2- 172.21.15.44:0/3354110848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa72c151fc0 0x7fa72c0a1e50 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:29.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.971+0000 7fa7328c8640 1 --2- 172.21.15.44:0/3354110848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa72c0bf050 0x7fa72c1e8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:29.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.971+0000 7fa7328c8640 1 --2- 172.21.15.44:0/3354110848 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa72c06da30 0x7fa72c0b8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:29.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.971+0000 7fa7328c8640 1 -- 172.21.15.44:0/3354110848 >> 172.21.15.44:0/3354110848 conn(0x7fa72c0c3d20 msgr2=0x7fa72c0c09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:32:29.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.971+0000 7fa7328c8640 1 -- 172.21.15.44:0/3354110848 shutdown_connections 2024-05-16T22:32:29.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:26.971+0000 7fa7328c8640 1 -- 172.21.15.44:0/3354110848 wait complete. 2024-05-16T22:32:30.030 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-16T22:32:30.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.210+0000 7fc23d20c640 1 Processor -- start 2024-05-16T22:32:30.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.210+0000 7fc23d20c640 1 -- start start 2024-05-16T22:32:30.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.211+0000 7fc23d20c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc238148770 0x7fc2380c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:30.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.211+0000 7fc23d20c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc2380bf9b0 0x7fc2380bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:30.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.211+0000 7fc23d20c640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2380c0620 con 0x7fc23814e360 2024-05-16T22:32:30.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.211+0000 7fc23d20c640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fc238151e40 con 0x7fc238148770 2024-05-16T22:32:30.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.211+0000 7fc23d20c640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fc238151ad0 con 0x7fc2380bf9b0 2024-05-16T22:32:30.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.211+0000 7fc23759e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc2380bf9b0 0x7fc2380bfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:30.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.211+0000 7fc22ffff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc238148770 0x7fc2380c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:30.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.211+0000 7fc236d9d640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fc23814e360 0x7fc2381522d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.44:46838/0 (socket says 172.21.15.44:46838) 2024-05-16T22:32:30.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.211+0000 7fc236d9d640 1 -- 172.21.15.44:0/1743742942 learned_addr learned my addr 172.21.15.44:0/1743742942 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:32:30.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.212+0000 7fc22ffff640 1 -- 172.21.15.44:0/1743742942 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc2380bf9b0 msgr2=0x7fc2380bfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:32:30.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.212+0000 7fc22ffff640 1 --2- 172.21.15.44:0/1743742942 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc2380bf9b0 0x7fc2380bfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:30.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.212+0000 7fc22ffff640 1 -- 172.21.15.44:0/1743742942 >> v1:172.21.15.70:6789/0 conn(0x7fc23814e360 legacy=0x7fc2381522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:30.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.212+0000 7fc22ffff640 1 -- 172.21.15.44:0/1743742942 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2380c0300 con 0x7fc238148770 2024-05-16T22:32:30.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.212+0000 7fc23759e640 1 --2- 172.21.15.44:0/1743742942 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc2380bf9b0 0x7fc2380bfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:32:31.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.213+0000 7fc22ffff640 1 --2- 172.21.15.44:0/1743742942 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc238148770 0x7fc2380c0c80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc2200097a0 tx=0x7fc22002a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f24cf5586bceffc2 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:32:31.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.213+0000 7fc23659c640 1 -- 172.21.15.44:0/1743742942 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc220037070 con 0x7fc238148770 2024-05-16T22:32:31.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.213+0000 7fc23659c640 1 -- 172.21.15.44:0/1743742942 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc22002ada0 con 0x7fc238148770 2024-05-16T22:32:31.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.213+0000 7fc23659c640 1 -- 172.21.15.44:0/1743742942 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc220032660 con 0x7fc238148770 2024-05-16T22:32:31.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.214+0000 7fc23d20c640 1 -- 172.21.15.44:0/1743742942 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc238148770 msgr2=0x7fc2380c0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:31.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.214+0000 7fc23d20c640 1 --2- 172.21.15.44:0/1743742942 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc238148770 0x7fc2380c0c80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc2200097a0 tx=0x7fc22002a110 comp rx=0 tx=0).stop 2024-05-16T22:32:31.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.214+0000 7fc23d20c640 1 -- 172.21.15.44:0/1743742942 shutdown_connections 2024-05-16T22:32:31.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.214+0000 7fc23d20c640 1 --2- 172.21.15.44:0/1743742942 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc2380bf9b0 0x7fc2380bfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:31.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.214+0000 7fc23d20c640 1 --2- 172.21.15.44:0/1743742942 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc238148770 0x7fc2380c0c80 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:31.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.214+0000 7fc23d20c640 1 -- 172.21.15.44:0/1743742942 >> 172.21.15.44:0/1743742942 conn(0x7fc2380c17c0 msgr2=0x7fc2380c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:32:31.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.214+0000 7fc23d20c640 1 -- 172.21.15.44:0/1743742942 shutdown_connections 2024-05-16T22:32:31.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.214+0000 7fc23d20c640 1 -- 172.21.15.44:0/1743742942 wait complete. 2024-05-16T22:32:31.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.215+0000 7fc23d20c640 1 Processor -- start 2024-05-16T22:32:31.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.215+0000 7fc23d20c640 1 -- start start 2024-05-16T22:32:31.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.216+0000 7fc23d20c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc2380bf9b0 0x7fc238146380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:31.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.216+0000 7fc23d20c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc238148770 0x7fc2381e8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:31.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.216+0000 7fc23d20c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc23814e360 0x7fc2381de020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:31.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.216+0000 7fc23d20c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc238158cc0 con 0x7fc238148770 2024-05-16T22:32:31.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.216+0000 7fc23d20c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc2380c13d0 con 0x7fc23814e360 2024-05-16T22:32:32.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.216+0000 7fc23d20c640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fc238158e40 con 0x7fc2380bf9b0 2024-05-16T22:32:32.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.217+0000 7fc22ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc238148770 0x7fc2381e8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:32.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.217+0000 7fc22ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc238148770 0x7fc2381e8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44648/0 (socket says 172.21.15.44:44648) 2024-05-16T22:32:32.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.217+0000 7fc22ffff640 1 -- 172.21.15.44:0/485305294 learned_addr learned my addr 172.21.15.44:0/485305294 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:32:32.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.217+0000 7fc23759e640 1 --2- 172.21.15.44:0/485305294 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc23814e360 0x7fc2381de020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:32.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.217+0000 7fc236d9d640 1 --2- 172.21.15.44:0/485305294 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc2380bf9b0 0x7fc238146380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:32.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.217+0000 7fc22ffff640 1 -- 172.21.15.44:0/485305294 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc2380bf9b0 msgr2=0x7fc238146380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:32.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.217+0000 7fc22ffff640 1 --2- 172.21.15.44:0/485305294 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc2380bf9b0 0x7fc238146380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:32.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.217+0000 7fc22ffff640 1 -- 172.21.15.44:0/485305294 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc23814e360 msgr2=0x7fc2381de020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:32.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.217+0000 7fc22ffff640 1 --2- 172.21.15.44:0/485305294 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc23814e360 0x7fc2381de020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:32.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.217+0000 7fc22ffff640 1 -- 172.21.15.44:0/485305294 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2380a1a80 con 0x7fc238148770 2024-05-16T22:32:32.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.217+0000 7fc22ffff640 1 --2- 172.21.15.44:0/485305294 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc238148770 0x7fc2381e8560 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc2200098c0 tx=0x7fc2200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:32:32.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.217+0000 7fc22f7fe640 1 -- 172.21.15.44:0/485305294 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc220037040 con 0x7fc238148770 2024-05-16T22:32:32.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.217+0000 7fc22f7fe640 1 -- 172.21.15.44:0/485305294 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc220004030 con 0x7fc238148770 2024-05-16T22:32:32.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.217+0000 7fc23d20c640 1 -- 172.21.15.44:0/485305294 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2380727e0 con 0x7fc238148770 2024-05-16T22:32:32.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.217+0000 7fc22f7fe640 1 -- 172.21.15.44:0/485305294 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc220006e10 con 0x7fc238148770 2024-05-16T22:32:32.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.218+0000 7fc23d20c640 1 -- 172.21.15.44:0/485305294 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc238151180 con 0x7fc238148770 2024-05-16T22:32:32.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.218+0000 7fc23d20c640 1 -- 172.21.15.44:0/485305294 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc238069c60 con 0x7fc238148770 2024-05-16T22:32:32.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.219+0000 7fc22f7fe640 1 -- 172.21.15.44:0/485305294 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc220003610 con 0x7fc238148770 2024-05-16T22:32:33.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.220+0000 7fc22f7fe640 1 --2- 172.21.15.44:0/485305294 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fc218076300 0x7fc218078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:33.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.220+0000 7fc22f7fe640 1 -- 172.21.15.44:0/485305294 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fc2200b7570 con 0x7fc238148770 2024-05-16T22:32:33.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.220+0000 7fc236d9d640 1 --2- 172.21.15.44:0/485305294 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fc218076300 0x7fc218078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:33.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.221+0000 7fc236d9d640 1 --2- 172.21.15.44:0/485305294 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fc218076300 0x7fc218078810 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc228000f60 tx=0x7fc228009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:32:33.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.225+0000 7fc22f7fe640 1 -- 172.21.15.44:0/485305294 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc2200810e0 con 0x7fc238148770 2024-05-16T22:32:33.283 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:32:33.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.416+0000 7fc23d20c640 1 -- 172.21.15.44:0/485305294 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fc238150c90 con 0x7fc238148770 2024-05-16T22:32:33.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.420+0000 7fc22f7fe640 1 -- 172.21.15.44:0/485305294 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7fc220089160 con 0x7fc238148770 2024-05-16T22:32:33.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.422+0000 7fc23d20c640 1 -- 172.21.15.44:0/485305294 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fc218076300 msgr2=0x7fc218078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:33.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.422+0000 7fc23d20c640 1 --2- 172.21.15.44:0/485305294 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fc218076300 0x7fc218078810 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc228000f60 tx=0x7fc228009040 comp rx=0 tx=0).stop 2024-05-16T22:32:33.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.422+0000 7fc23d20c640 1 -- 172.21.15.44:0/485305294 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc238148770 msgr2=0x7fc2381e8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:33.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.422+0000 7fc23d20c640 1 --2- 172.21.15.44:0/485305294 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc238148770 0x7fc2381e8560 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc2200098c0 tx=0x7fc2200046c0 comp rx=0 tx=0).stop 2024-05-16T22:32:33.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.422+0000 7fc23d20c640 1 -- 172.21.15.44:0/485305294 shutdown_connections 2024-05-16T22:32:33.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.422+0000 7fc23d20c640 1 --2- 172.21.15.44:0/485305294 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fc218076300 0x7fc218078810 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:33.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.422+0000 7fc23d20c640 1 --2- 172.21.15.44:0/485305294 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc23814e360 0x7fc2381de020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:33.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.422+0000 7fc23d20c640 1 --2- 172.21.15.44:0/485305294 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc238148770 0x7fc2381e8560 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:33.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.422+0000 7fc23d20c640 1 --2- 172.21.15.44:0/485305294 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc2380bf9b0 0x7fc238146380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:33.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.422+0000 7fc23d20c640 1 -- 172.21.15.44:0/485305294 >> 172.21.15.44:0/485305294 conn(0x7fc2380c17c0 msgr2=0x7fc2380c0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:32:33.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.422+0000 7fc23d20c640 1 -- 172.21.15.44:0/485305294 shutdown_connections 2024-05-16T22:32:34.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:30.422+0000 7fc23d20c640 1 -- 172.21.15.44:0/485305294 wait complete. 2024-05-16T22:32:34.183 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-16T22:32:34.232 DEBUG:teuthology.orchestra.run.smithi044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-16T22:32:34.283 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:32:34.335 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:32:34.404 DEBUG:teuthology.orchestra.run.smithi070:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-16T22:32:34.462 DEBUG:teuthology.orchestra.run.smithi196:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-16T22:32:34.614 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-16T22:32:34.674 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-16T22:32:34.724 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-16T22:32:34.836 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-05-16T22:32:34.865 INFO:tasks.cephfs.cephfs_test_case:[] 2024-05-16T22:32:34.916 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T22:32:35.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.091+0000 7f043a738640 1 Processor -- start 2024-05-16T22:32:35.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.091+0000 7f043a738640 1 -- start start 2024-05-16T22:32:35.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.092+0000 7f043a738640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f043414e360 0x7f04341522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:35.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.092+0000 7f043a738640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f04340bf9b0 0x7f04340bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:35.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.092+0000 7f043a738640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04340c1390 con 0x7f0434148770 2024-05-16T22:32:35.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.092+0000 7f043a738640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f0434151e40 con 0x7f043414e360 2024-05-16T22:32:35.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.092+0000 7f043a738640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f04340c0620 con 0x7f04340bf9b0 2024-05-16T22:32:35.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.092+0000 7f04337fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f0434148770 0x7f04340c0c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:53270/0 (socket says 172.21.15.44:53270) 2024-05-16T22:32:35.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.092+0000 7f04337fe640 1 -- 172.21.15.44:0/3412330891 learned_addr learned my addr 172.21.15.44:0/3412330891 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:32:35.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.092+0000 7f0438cd5640 1 --2- 172.21.15.44:0/3412330891 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f04340bf9b0 0x7f04340bfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:35.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.092+0000 7f0433fff640 1 --2- 172.21.15.44:0/3412330891 >> v2:172.21.15.70:3300/0 conn(0x7f043414e360 0x7f04341522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:35.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.093+0000 7f0432ffd640 1 -- 172.21.15.44:0/3412330891 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3683900672 0 0) 0x7f0424001110 con 0x7f0434148770 2024-05-16T22:32:35.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.093+0000 7f0432ffd640 1 -- 172.21.15.44:0/3412330891 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0420003520 con 0x7f0434148770 2024-05-16T22:32:35.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.093+0000 7f0432ffd640 1 -- 172.21.15.44:0/3412330891 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1483207558 0 0) 0x7f0420003520 con 0x7f0434148770 2024-05-16T22:32:35.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.093+0000 7f0438cd5640 1 -- 172.21.15.44:0/3412330891 >> v2:172.21.15.70:3300/0 conn(0x7f043414e360 msgr2=0x7f04341522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:32:35.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.093+0000 7f0438cd5640 1 --2- 172.21.15.44:0/3412330891 >> v2:172.21.15.70:3300/0 conn(0x7f043414e360 0x7f04341522d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:35.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.093+0000 7f0438cd5640 1 -- 172.21.15.44:0/3412330891 >> v1:172.21.15.44:6789/0 conn(0x7f0434148770 legacy=0x7f04340c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:35.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.093+0000 7f0438cd5640 1 -- 172.21.15.44:0/3412330891 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0434151ad0 con 0x7f04340bf9b0 2024-05-16T22:32:35.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.093+0000 7f0433fff640 1 --2- 172.21.15.44:0/3412330891 >> v2:172.21.15.70:3300/0 conn(0x7f043414e360 0x7f04341522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:32:35.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.094+0000 7f0438cd5640 1 --2- 172.21.15.44:0/3412330891 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f04340bf9b0 0x7f04340bfdc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f042c009d90 tx=0x7f042c02a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=105176ce6758d8f server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:32:35.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.094+0000 7f0432ffd640 1 -- 172.21.15.44:0/3412330891 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04240018e0 con 0x7f04340bf9b0 2024-05-16T22:32:35.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.094+0000 7f0432ffd640 1 -- 172.21.15.44:0/3412330891 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f042c007540 con 0x7f04340bf9b0 2024-05-16T22:32:36.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.094+0000 7f0432ffd640 1 -- 172.21.15.44:0/3412330891 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042c0078f0 con 0x7f04340bf9b0 2024-05-16T22:32:36.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.095+0000 7f043a738640 1 -- 172.21.15.44:0/3412330891 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f04340bf9b0 msgr2=0x7f04340bfdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:36.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.095+0000 7f043a738640 1 --2- 172.21.15.44:0/3412330891 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f04340bf9b0 0x7f04340bfdc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f042c009d90 tx=0x7f042c02a680 comp rx=0 tx=0).stop 2024-05-16T22:32:36.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.095+0000 7f043a738640 1 -- 172.21.15.44:0/3412330891 shutdown_connections 2024-05-16T22:32:36.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.095+0000 7f043a738640 1 --2- 172.21.15.44:0/3412330891 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f04340bf9b0 0x7f04340bfdc0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:36.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.095+0000 7f043a738640 1 --2- 172.21.15.44:0/3412330891 >> v2:172.21.15.70:3300/0 conn(0x7f043414e360 0x7f04341522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:36.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.095+0000 7f043a738640 1 -- 172.21.15.44:0/3412330891 >> 172.21.15.44:0/3412330891 conn(0x7f04340c17c0 msgr2=0x7f04340c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:32:36.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.095+0000 7f043a738640 1 -- 172.21.15.44:0/3412330891 shutdown_connections 2024-05-16T22:32:36.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.095+0000 7f043a738640 1 -- 172.21.15.44:0/3412330891 wait complete. 2024-05-16T22:32:36.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.096+0000 7f043a738640 1 Processor -- start 2024-05-16T22:32:36.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.096+0000 7f043a738640 1 -- start start 2024-05-16T22:32:36.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.097+0000 7f043a738640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04340bf9b0 0x7f04340a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:36.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.097+0000 7f043a738640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0434148770 0x7f0434143440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:36.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.098+0000 7f043a738640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f043414e360 0x7f043413dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:36.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.098+0000 7f043a738640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0434158cc0 con 0x7f0434148770 2024-05-16T22:32:36.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.098+0000 7f043a738640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f04340c0300 con 0x7f04340bf9b0 2024-05-16T22:32:36.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.098+0000 7f043a738640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f0434158e40 con 0x7f043414e360 2024-05-16T22:32:36.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.098+0000 7f04337fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0434148770 0x7f0434143440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:36.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.098+0000 7f04337fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0434148770 0x7f0434143440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44650/0 (socket says 172.21.15.44:44650) 2024-05-16T22:32:36.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.098+0000 7f04337fe640 1 -- 172.21.15.44:0/3027952238 learned_addr learned my addr 172.21.15.44:0/3027952238 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:32:36.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.098+0000 7f0438cd5640 1 --2- 172.21.15.44:0/3027952238 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f043414e360 0x7f043413dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:36.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.098+0000 7f0433fff640 1 --2- 172.21.15.44:0/3027952238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04340bf9b0 0x7f04340a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:36.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.098+0000 7f04337fe640 1 -- 172.21.15.44:0/3027952238 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f043414e360 msgr2=0x7f043413dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:36.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.098+0000 7f04337fe640 1 --2- 172.21.15.44:0/3027952238 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f043414e360 0x7f043413dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:36.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.098+0000 7f04337fe640 1 -- 172.21.15.44:0/3027952238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04340bf9b0 msgr2=0x7f04340a50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:36.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.098+0000 7f04337fe640 1 --2- 172.21.15.44:0/3027952238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04340bf9b0 0x7f04340a50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:37.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.098+0000 7f04337fe640 1 -- 172.21.15.44:0/3027952238 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04340a6180 con 0x7f0434148770 2024-05-16T22:32:37.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.098+0000 7f04337fe640 1 --2- 172.21.15.44:0/3027952238 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0434148770 0x7f0434143440 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f042400c4b0 tx=0x7f042400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:32:37.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.098+0000 7f0430ff9640 1 -- 172.21.15.44:0/3027952238 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0424018070 con 0x7f0434148770 2024-05-16T22:32:37.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.098+0000 7f0430ff9640 1 -- 172.21.15.44:0/3027952238 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04240074e0 con 0x7f0434148770 2024-05-16T22:32:37.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.098+0000 7f043a738640 1 -- 172.21.15.44:0/3027952238 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04340a6460 con 0x7f0434148770 2024-05-16T22:32:37.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.098+0000 7f0430ff9640 1 -- 172.21.15.44:0/3027952238 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0424004a20 con 0x7f0434148770 2024-05-16T22:32:37.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.099+0000 7f043a738640 1 -- 172.21.15.44:0/3027952238 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0434150860 con 0x7f0434148770 2024-05-16T22:32:37.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.099+0000 7f043a738640 1 -- 172.21.15.44:0/3027952238 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0434050940 con 0x7f0434148770 2024-05-16T22:32:37.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.100+0000 7f0430ff9640 1 -- 172.21.15.44:0/3027952238 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f042401b070 con 0x7f0434148770 2024-05-16T22:32:37.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.101+0000 7f0430ff9640 1 --2- 172.21.15.44:0/3027952238 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0414076300 0x7f0414078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:37.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.101+0000 7f0430ff9640 1 -- 172.21.15.44:0/3027952238 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f04240964d0 con 0x7f0434148770 2024-05-16T22:32:37.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.101+0000 7f0433fff640 1 --2- 172.21.15.44:0/3027952238 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0414076300 0x7f0414078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:37.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.101+0000 7f0433fff640 1 --2- 172.21.15.44:0/3027952238 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0414076300 0x7f0414078810 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f041c009560 tx=0x7f041c009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:32:37.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.106+0000 7f0430ff9640 1 -- 172.21.15.44:0/3027952238 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f04340c1390 con 0x7f0434148770 2024-05-16T22:32:37.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.338+0000 7f043a738640 1 -- 172.21.15.44:0/3027952238 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f04340bf790 con 0x7f0434148770 2024-05-16T22:32:37.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.338+0000 7f0430ff9640 1 -- 172.21.15.44:0/3027952238 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+3044 (secure 0 0 0) 0x7f042405fb70 con 0x7f0434148770 2024-05-16T22:32:37.633 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:32:37.708 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4657,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3963814730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3963814730},{"type":"v1","addr":"172.21.15.70:6835","nonce":3963814730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4672,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/3024807024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3024807024},{"type":"v1","addr":"172.21.15.44:6835","nonce":3024807024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4971,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/1710288967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":1710288967},{"type":"v1","addr":"172.21.15.44:6834","nonce":1710288967}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[]} 2024-05-16T22:32:37.768 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 19 2024-05-16T22:32:37.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.340+0000 7f043a738640 1 -- 172.21.15.44:0/3027952238 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0414076300 msgr2=0x7f0414078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:37.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.340+0000 7f043a738640 1 --2- 172.21.15.44:0/3027952238 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0414076300 0x7f0414078810 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f041c009560 tx=0x7f041c009190 comp rx=0 tx=0).stop 2024-05-16T22:32:37.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.340+0000 7f043a738640 1 -- 172.21.15.44:0/3027952238 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0434148770 msgr2=0x7f0434143440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:37.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.340+0000 7f043a738640 1 --2- 172.21.15.44:0/3027952238 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0434148770 0x7f0434143440 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f042400c4b0 tx=0x7f042400c970 comp rx=0 tx=0).stop 2024-05-16T22:32:37.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.340+0000 7f043a738640 1 -- 172.21.15.44:0/3027952238 shutdown_connections 2024-05-16T22:32:38.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.340+0000 7f043a738640 1 --2- 172.21.15.44:0/3027952238 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0414076300 0x7f0414078810 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:38.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.340+0000 7f043a738640 1 --2- 172.21.15.44:0/3027952238 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f043414e360 0x7f043413dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:38.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.340+0000 7f043a738640 1 --2- 172.21.15.44:0/3027952238 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0434148770 0x7f0434143440 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:38.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.340+0000 7f043a738640 1 --2- 172.21.15.44:0/3027952238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04340bf9b0 0x7f04340a50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:38.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.340+0000 7f043a738640 1 -- 172.21.15.44:0/3027952238 >> 172.21.15.44:0/3027952238 conn(0x7f04340c17c0 msgr2=0x7f04340c0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:32:38.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.340+0000 7f043a738640 1 -- 172.21.15.44:0/3027952238 shutdown_connections 2024-05-16T22:32:38.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:35.340+0000 7f043a738640 1 -- 172.21.15.44:0/3027952238 wait complete. 2024-05-16T22:32:38.301 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-16T22:32:38.342 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-16T22:32:38.386 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-16T22:32:38.442 INFO:teuthology.orchestra.run:waiting for 300 2024-05-16T22:32:38.493 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-16T22:32:38.534 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-16T22:32:38.588 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-16T22:32:38.625 INFO:teuthology.orchestra.run:waiting for 300 2024-05-16T22:32:38.667 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-16T22:32:38.709 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-16T22:32:38.751 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-16T22:32:38.792 INFO:teuthology.orchestra.run:waiting for 300 2024-05-16T22:32:38.836 INFO:tasks.ceph.mds.b:Stopped 2024-05-16T22:32:38.876 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-16T22:32:38.920 INFO:tasks.ceph.mds.b:Started 2024-05-16T22:32:38.959 DEBUG:teuthology.parallel:result is None 2024-05-16T22:32:39.013 INFO:tasks.ceph.mds.b.smithi070.stdout:starting mds.b at 2024-05-16T22:32:41.014 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-05-16T22:32:41.076 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-05-16T22:32:44.836 INFO:tasks.ceph.mds.a:Stopped 2024-05-16T22:32:44.900 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-16T22:32:44.943 INFO:tasks.ceph.mds.c:Stopped 2024-05-16T22:32:44.983 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-16T22:32:45.045 INFO:tasks.ceph.mds.a:Started 2024-05-16T22:32:45.084 DEBUG:teuthology.parallel:result is None 2024-05-16T22:32:45.126 INFO:tasks.ceph.mds.c:Started 2024-05-16T22:32:45.167 DEBUG:teuthology.parallel:result is None 2024-05-16T22:32:45.209 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-16T22:32:45.251 INFO:tasks.ceph.mds.a.smithi044.stdout:starting mds.a at 2024-05-16T22:32:45.292 INFO:tasks.ceph.mds.c.smithi044.stdout:starting mds.c at 2024-05-16T22:32:45.353 INFO:tasks.ceph.mds.c.smithi044.stderr:2024-05-16T22:32:45.145+0000 7f832d43a640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-05-16T22:32:45.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.515+0000 7fe68d59d640 1 Processor -- start 2024-05-16T22:32:45.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.515+0000 7fe68d59d640 1 -- start start 2024-05-16T22:32:45.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.516+0000 7fe68d59d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe68808d130 0x7fe6880bd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:45.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.516+0000 7fe68d59d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe68814e900 0x7fe68814ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:45.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.516+0000 7fe68d59d640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6880c0eb0 con 0x7fe6880be330 2024-05-16T22:32:45.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.516+0000 7fe68d59d640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fe68814e470 con 0x7fe68814e900 2024-05-16T22:32:45.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.516+0000 7fe68d59d640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fe68814f250 con 0x7fe68808d130 2024-05-16T22:32:45.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.516+0000 7fe68cd9c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe68814e900 0x7fe68814ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:45.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.516+0000 7fe68cd9c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe68814e900 0x7fe68814ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40048/0 (socket says 172.21.15.44:40048) 2024-05-16T22:32:45.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.516+0000 7fe68cd9c640 1 -- 172.21.15.44:0/2222582155 learned_addr learned my addr 172.21.15.44:0/2222582155 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:32:45.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.516+0000 7fe6877fe640 1 --2- 172.21.15.44:0/2222582155 >> v2:172.21.15.70:3300/0 conn(0x7fe68808d130 0x7fe6880bd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:45.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.517+0000 7fe68cd9c640 1 -- 172.21.15.44:0/2222582155 >> v2:172.21.15.70:3300/0 conn(0x7fe68808d130 msgr2=0x7fe6880bd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:32:46.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.517+0000 7fe68cd9c640 1 --2- 172.21.15.44:0/2222582155 >> v2:172.21.15.70:3300/0 conn(0x7fe68808d130 0x7fe6880bd4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:46.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.517+0000 7fe68cd9c640 1 -- 172.21.15.44:0/2222582155 >> v1:172.21.15.70:6789/0 conn(0x7fe6880be330 legacy=0x7fe6880c07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:46.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.517+0000 7fe68cd9c640 1 -- 172.21.15.44:0/2222582155 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6880beed0 con 0x7fe68814e900 2024-05-16T22:32:46.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.517+0000 7fe686ffd640 1 -- 172.21.15.44:0/2222582155 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1510210043 0 0) 0x7fe670001110 con 0x7fe6880be330 2024-05-16T22:32:46.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.517+0000 7fe68cd9c640 1 --2- 172.21.15.44:0/2222582155 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe68814e900 0x7fe68814ed10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe6880bf630 tx=0x7fe68002a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88ae381fa916af59 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:32:46.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.518+0000 7fe686ffd640 1 -- 172.21.15.44:0/2222582155 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe680036070 con 0x7fe68814e900 2024-05-16T22:32:46.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.518+0000 7fe686ffd640 1 -- 172.21.15.44:0/2222582155 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe680031600 con 0x7fe68814e900 2024-05-16T22:32:46.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.518+0000 7fe686ffd640 1 -- 172.21.15.44:0/2222582155 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6800319f0 con 0x7fe68814e900 2024-05-16T22:32:46.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.518+0000 7fe68d59d640 1 -- 172.21.15.44:0/2222582155 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe68814e900 msgr2=0x7fe68814ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:46.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.518+0000 7fe68d59d640 1 --2- 172.21.15.44:0/2222582155 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe68814e900 0x7fe68814ed10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe6880bf630 tx=0x7fe68002a7c0 comp rx=0 tx=0).stop 2024-05-16T22:32:46.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.518+0000 7fe68d59d640 1 -- 172.21.15.44:0/2222582155 shutdown_connections 2024-05-16T22:32:46.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.518+0000 7fe68d59d640 1 --2- 172.21.15.44:0/2222582155 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe68814e900 0x7fe68814ed10 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:46.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.518+0000 7fe68d59d640 1 --2- 172.21.15.44:0/2222582155 >> v2:172.21.15.70:3300/0 conn(0x7fe68808d130 0x7fe6880bd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:46.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.518+0000 7fe68d59d640 1 -- 172.21.15.44:0/2222582155 >> 172.21.15.44:0/2222582155 conn(0x7fe6880c3c40 msgr2=0x7fe6880c0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:32:46.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.518+0000 7fe68d59d640 1 -- 172.21.15.44:0/2222582155 shutdown_connections 2024-05-16T22:32:46.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.518+0000 7fe68d59d640 1 -- 172.21.15.44:0/2222582155 wait complete. 2024-05-16T22:32:46.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.520+0000 7fe68d59d640 1 Processor -- start 2024-05-16T22:32:46.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.520+0000 7fe68d59d640 1 -- start start 2024-05-16T22:32:46.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.521+0000 7fe68d59d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe68808d130 0x7fe6880bb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:46.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.521+0000 7fe68d59d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6880be330 0x7fe68814b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:46.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.521+0000 7fe68d59d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe68814e900 0x7fe6880a89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:46.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.521+0000 7fe68d59d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe688158b70 con 0x7fe6880be330 2024-05-16T22:32:46.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.521+0000 7fe68d59d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe6880bebf0 con 0x7fe68808d130 2024-05-16T22:32:46.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.521+0000 7fe68d59d640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fe688158cf0 con 0x7fe68814e900 2024-05-16T22:32:46.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.521+0000 7fe6877fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6880be330 0x7fe68814b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:46.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.521+0000 7fe6877fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6880be330 0x7fe68814b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40054/0 (socket says 172.21.15.44:40054) 2024-05-16T22:32:46.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.521+0000 7fe6877fe640 1 -- 172.21.15.44:0/3913779591 learned_addr learned my addr 172.21.15.44:0/3913779591 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:32:47.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.521+0000 7fe687fff640 1 --2- 172.21.15.44:0/3913779591 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe68808d130 0x7fe6880bb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:47.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.521+0000 7fe68cd9c640 1 --2- 172.21.15.44:0/3913779591 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe68814e900 0x7fe6880a89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:47.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.522+0000 7fe6877fe640 1 -- 172.21.15.44:0/3913779591 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe68814e900 msgr2=0x7fe6880a89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:47.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.522+0000 7fe6877fe640 1 --2- 172.21.15.44:0/3913779591 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe68814e900 0x7fe6880a89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:47.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.522+0000 7fe6877fe640 1 -- 172.21.15.44:0/3913779591 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe68808d130 msgr2=0x7fe6880bb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:47.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.522+0000 7fe6877fe640 1 --2- 172.21.15.44:0/3913779591 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe68808d130 0x7fe6880bb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:47.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.522+0000 7fe6877fe640 1 -- 172.21.15.44:0/3913779591 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe688144710 con 0x7fe6880be330 2024-05-16T22:32:47.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.522+0000 7fe6877fe640 1 --2- 172.21.15.44:0/3913779591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6880be330 0x7fe68814b1e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe67800e8a0 tx=0x7fe67800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:32:47.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.522+0000 7fe684ff9640 1 -- 172.21.15.44:0/3913779591 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe678017070 con 0x7fe6880be330 2024-05-16T22:32:47.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.522+0000 7fe684ff9640 1 -- 172.21.15.44:0/3913779591 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe67800c940 con 0x7fe6880be330 2024-05-16T22:32:47.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.522+0000 7fe684ff9640 1 -- 172.21.15.44:0/3913779591 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe67800cd30 con 0x7fe6880be330 2024-05-16T22:32:47.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.522+0000 7fe68d59d640 1 -- 172.21.15.44:0/3913779591 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6880bac80 con 0x7fe6880be330 2024-05-16T22:32:47.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.522+0000 7fe68d59d640 1 -- 172.21.15.44:0/3913779591 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6880bc7a0 con 0x7fe6880be330 2024-05-16T22:32:47.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.523+0000 7fe68d59d640 1 -- 172.21.15.44:0/3913779591 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6880c1b90 con 0x7fe6880be330 2024-05-16T22:32:47.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.524+0000 7fe684ff9640 1 -- 172.21.15.44:0/3913779591 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe67801a070 con 0x7fe6880be330 2024-05-16T22:32:47.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.524+0000 7fe684ff9640 1 --2- 172.21.15.44:0/3913779591 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fe668076300 0x7fe668078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:47.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.524+0000 7fe684ff9640 1 -- 172.21.15.44:0/3913779591 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7fe678097160 con 0x7fe6880be330 2024-05-16T22:32:47.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.525+0000 7fe687fff640 1 --2- 172.21.15.44:0/3913779591 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fe668076300 0x7fe668078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:47.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.525+0000 7fe687fff640 1 --2- 172.21.15.44:0/3913779591 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fe668076300 0x7fe668078810 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe670007fd0 tx=0x7fe670009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:32:47.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.529+0000 7fe684ff9640 1 -- 172.21.15.44:0/3913779591 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe6880c1b90 con 0x7fe6880be330 2024-05-16T22:32:47.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:45.732+0000 7fe68d59d640 1 -- 172.21.15.44:0/3913779591 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fe688069030 con 0x7fe6880be330 2024-05-16T22:32:47.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:46.724+0000 7fe684ff9640 1 -- 172.21.15.44:0/3913779591 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v41) ==== 97+0+0 (secure 0 0 0) 0x7fe688069030 con 0x7fe6880be330 2024-05-16T22:32:47.835 INFO:teuthology.orchestra.run.smithi044.stderr: removed all blocklist entries 2024-05-16T22:32:47.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:46.727+0000 7fe68d59d640 1 -- 172.21.15.44:0/3913779591 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fe668076300 msgr2=0x7fe668078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:47.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:46.727+0000 7fe68d59d640 1 --2- 172.21.15.44:0/3913779591 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fe668076300 0x7fe668078810 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe670007fd0 tx=0x7fe670009040 comp rx=0 tx=0).stop 2024-05-16T22:32:47.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:46.727+0000 7fe68d59d640 1 -- 172.21.15.44:0/3913779591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6880be330 msgr2=0x7fe68814b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:47.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:46.727+0000 7fe68d59d640 1 --2- 172.21.15.44:0/3913779591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6880be330 0x7fe68814b1e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe67800e8a0 tx=0x7fe67800ed60 comp rx=0 tx=0).stop 2024-05-16T22:32:48.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:46.727+0000 7fe68d59d640 1 -- 172.21.15.44:0/3913779591 shutdown_connections 2024-05-16T22:32:48.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:46.727+0000 7fe68d59d640 1 --2- 172.21.15.44:0/3913779591 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fe668076300 0x7fe668078810 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:48.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:46.727+0000 7fe68d59d640 1 --2- 172.21.15.44:0/3913779591 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe68814e900 0x7fe6880a89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:48.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:46.727+0000 7fe68d59d640 1 --2- 172.21.15.44:0/3913779591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6880be330 0x7fe68814b1e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:48.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:46.727+0000 7fe68d59d640 1 --2- 172.21.15.44:0/3913779591 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe68808d130 0x7fe6880bb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:48.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:46.727+0000 7fe68d59d640 1 -- 172.21.15.44:0/3913779591 >> 172.21.15.44:0/3913779591 conn(0x7fe6880c3c40 msgr2=0x7fe6880c1480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:32:48.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:46.727+0000 7fe68d59d640 1 -- 172.21.15.44:0/3913779591 shutdown_connections 2024-05-16T22:32:48.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:46.727+0000 7fe68d59d640 1 -- 172.21.15.44:0/3913779591 wait complete. 2024-05-16T22:32:48.344 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-16T22:32:48.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.504+0000 7fe4ed5b7640 1 Processor -- start 2024-05-16T22:32:48.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.505+0000 7fe4ed5b7640 1 -- start start 2024-05-16T22:32:48.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.506+0000 7fe4ed5b7640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe4e80a0ba0 0x7fe4e8146380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:48.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.506+0000 7fe4ed5b7640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe4e814c8e0 0x7fe4e814ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:48.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.506+0000 7fe4ed5b7640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4e8071150 con 0x7fe4e80bc1c0 2024-05-16T22:32:48.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.506+0000 7fe4ed5b7640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fe4e814c450 con 0x7fe4e80a0ba0 2024-05-16T22:32:48.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.506+0000 7fe4ed5b7640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fe4e814c120 con 0x7fe4e814c8e0 2024-05-16T22:32:48.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.506+0000 7fe4e67fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe4e80a0ba0 0x7fe4e8146380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:48.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.506+0000 7fe4e67fc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe4e80a0ba0 0x7fe4e8146380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40062/0 (socket says 172.21.15.44:40062) 2024-05-16T22:32:48.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.506+0000 7fe4e6ffd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fe4e80bc1c0 0x7fe4e8070a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:33208/0 (socket says 172.21.15.44:33208) 2024-05-16T22:32:48.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.506+0000 7fe4e67fc640 1 -- 172.21.15.44:0/3464251581 learned_addr learned my addr 172.21.15.44:0/3464251581 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:32:48.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.506+0000 7fe4e77fe640 1 --2- 172.21.15.44:0/3464251581 >> v2:172.21.15.70:3300/0 conn(0x7fe4e814c8e0 0x7fe4e814ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:48.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.506+0000 7fe4e67fc640 1 -- 172.21.15.44:0/3464251581 >> v2:172.21.15.70:3300/0 conn(0x7fe4e814c8e0 msgr2=0x7fe4e814ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:32:49.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.506+0000 7fe4e67fc640 1 --2- 172.21.15.44:0/3464251581 >> v2:172.21.15.70:3300/0 conn(0x7fe4e814c8e0 0x7fe4e814ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:49.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.506+0000 7fe4e67fc640 1 -- 172.21.15.44:0/3464251581 >> v1:172.21.15.44:6789/0 conn(0x7fe4e80bc1c0 legacy=0x7fe4e8070a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:49.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.506+0000 7fe4e67fc640 1 -- 172.21.15.44:0/3464251581 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4e8071e40 con 0x7fe4e80a0ba0 2024-05-16T22:32:49.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.507+0000 7fe4e67fc640 1 --2- 172.21.15.44:0/3464251581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4e80a0ba0 0x7fe4e8146380 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe4e814c5d0 tx=0x7fe4dc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61f8f9083968c10d server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:32:49.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.507+0000 7fe4e5ffb640 1 -- 172.21.15.44:0/3464251581 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4dc037070 con 0x7fe4e80a0ba0 2024-05-16T22:32:49.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.507+0000 7fe4e5ffb640 1 -- 172.21.15.44:0/3464251581 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4dc032440 con 0x7fe4e80a0ba0 2024-05-16T22:32:49.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.507+0000 7fe4e5ffb640 1 -- 172.21.15.44:0/3464251581 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4dc032810 con 0x7fe4e80a0ba0 2024-05-16T22:32:49.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.508+0000 7fe4ed5b7640 1 -- 172.21.15.44:0/3464251581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4e80a0ba0 msgr2=0x7fe4e8146380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:49.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.508+0000 7fe4ed5b7640 1 --2- 172.21.15.44:0/3464251581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4e80a0ba0 0x7fe4e8146380 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe4e814c5d0 tx=0x7fe4dc02a270 comp rx=0 tx=0).stop 2024-05-16T22:32:49.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.508+0000 7fe4ed5b7640 1 -- 172.21.15.44:0/3464251581 shutdown_connections 2024-05-16T22:32:49.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.508+0000 7fe4ed5b7640 1 --2- 172.21.15.44:0/3464251581 >> v2:172.21.15.70:3300/0 conn(0x7fe4e814c8e0 0x7fe4e814ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:49.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.508+0000 7fe4ed5b7640 1 --2- 172.21.15.44:0/3464251581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4e80a0ba0 0x7fe4e8146380 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:49.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.508+0000 7fe4ed5b7640 1 -- 172.21.15.44:0/3464251581 >> 172.21.15.44:0/3464251581 conn(0x7fe4e80c17c0 msgr2=0x7fe4e80c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:32:49.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.508+0000 7fe4ed5b7640 1 -- 172.21.15.44:0/3464251581 shutdown_connections 2024-05-16T22:32:49.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.508+0000 7fe4ed5b7640 1 -- 172.21.15.44:0/3464251581 wait complete. 2024-05-16T22:32:49.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.509+0000 7fe4ed5b7640 1 Processor -- start 2024-05-16T22:32:49.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.510+0000 7fe4ed5b7640 1 -- start start 2024-05-16T22:32:49.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.511+0000 7fe4ed5b7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4e80a0ba0 0x7fe4e81e4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:49.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.511+0000 7fe4ed5b7640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe4e80bc1c0 0x7fe4e814fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:49.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.511+0000 7fe4ed5b7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4e814c8e0 0x7fe4e81e7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:49.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.511+0000 7fe4ed5b7640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e80a0fb0 con 0x7fe4e814c8e0 2024-05-16T22:32:49.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.511+0000 7fe4ed5b7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e80716b0 con 0x7fe4e80a0ba0 2024-05-16T22:32:49.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.511+0000 7fe4ed5b7640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fe4e80bd5f0 con 0x7fe4e80bc1c0 2024-05-16T22:32:49.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.511+0000 7fe4e77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4e814c8e0 0x7fe4e81e7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:49.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.511+0000 7fe4e77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4e814c8e0 0x7fe4e81e7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40074/0 (socket says 172.21.15.44:40074) 2024-05-16T22:32:49.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.511+0000 7fe4e77fe640 1 -- 172.21.15.44:0/2117061912 learned_addr learned my addr 172.21.15.44:0/2117061912 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:32:50.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.511+0000 7fe4e6ffd640 1 --2- 172.21.15.44:0/2117061912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4e80a0ba0 0x7fe4e81e4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:50.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.511+0000 7fe4e67fc640 1 --2- 172.21.15.44:0/2117061912 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe4e80bc1c0 0x7fe4e814fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:50.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.511+0000 7fe4e77fe640 1 -- 172.21.15.44:0/2117061912 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe4e80bc1c0 msgr2=0x7fe4e814fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:50.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.511+0000 7fe4e77fe640 1 --2- 172.21.15.44:0/2117061912 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe4e80bc1c0 0x7fe4e814fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:50.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.511+0000 7fe4e77fe640 1 -- 172.21.15.44:0/2117061912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4e80a0ba0 msgr2=0x7fe4e81e4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:50.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.511+0000 7fe4e77fe640 1 --2- 172.21.15.44:0/2117061912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4e80a0ba0 0x7fe4e81e4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:50.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.511+0000 7fe4e77fe640 1 -- 172.21.15.44:0/2117061912 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4e81e5150 con 0x7fe4e814c8e0 2024-05-16T22:32:50.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.511+0000 7fe4e67fc640 1 --2- 172.21.15.44:0/2117061912 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe4e80bc1c0 0x7fe4e814fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T22:32:50.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.511+0000 7fe4e6ffd640 1 --2- 172.21.15.44:0/2117061912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4e80a0ba0 0x7fe4e81e4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:32:50.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.511+0000 7fe4e77fe640 1 --2- 172.21.15.44:0/2117061912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4e814c8e0 0x7fe4e81e7af0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8007e90 tx=0x7fe4d800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:32:50.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.511+0000 7fe4cf7fe640 1 -- 172.21.15.44:0/2117061912 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d8014420 con 0x7fe4e814c8e0 2024-05-16T22:32:50.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.511+0000 7fe4cf7fe640 1 -- 172.21.15.44:0/2117061912 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4d8019070 con 0x7fe4e814c8e0 2024-05-16T22:32:50.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.511+0000 7fe4cf7fe640 1 -- 172.21.15.44:0/2117061912 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d8014800 con 0x7fe4e814c8e0 2024-05-16T22:32:50.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.511+0000 7fe4ed5b7640 1 -- 172.21.15.44:0/2117061912 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4e80a3e90 con 0x7fe4e814c8e0 2024-05-16T22:32:50.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.512+0000 7fe4ed5b7640 1 -- 172.21.15.44:0/2117061912 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4e80a1830 con 0x7fe4e814c8e0 2024-05-16T22:32:50.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.513+0000 7fe4ed5b7640 1 -- 172.21.15.44:0/2117061912 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4e8149b20 con 0x7fe4e814c8e0 2024-05-16T22:32:50.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.513+0000 7fe4cf7fe640 1 -- 172.21.15.44:0/2117061912 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe4d80149a0 con 0x7fe4e814c8e0 2024-05-16T22:32:50.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.514+0000 7fe4cf7fe640 1 --2- 172.21.15.44:0/2117061912 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fe4d40762d0 0x7fe4d40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:50.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.514+0000 7fe4cf7fe640 1 -- 172.21.15.44:0/2117061912 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4857+0+0 (secure 0 0 0) 0x7fe4d8097a90 con 0x7fe4e814c8e0 2024-05-16T22:32:50.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.514+0000 7fe4e6ffd640 1 --2- 172.21.15.44:0/2117061912 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fe4d40762d0 0x7fe4d40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:50.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.515+0000 7fe4e6ffd640 1 --2- 172.21.15.44:0/2117061912 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fe4d40762d0 0x7fe4d40787e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0007fd0 tx=0x7fe4e0007d40 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:32:50.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.519+0000 7fe4cf7fe640 1 -- 172.21.15.44:0/2117061912 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe4d80610f0 con 0x7fe4e814c8e0 2024-05-16T22:32:50.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.787+0000 7fe4ed5b7640 1 -- 172.21.15.44:0/2117061912 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fe4e8050940 con 0x7fe4e814c8e0 2024-05-16T22:32:50.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.787+0000 7fe4cf7fe640 1 -- 172.21.15.44:0/2117061912 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) ==== 80+0+4150 (secure 0 0 0) 0x7fe4d80653f0 con 0x7fe4e814c8e0 2024-05-16T22:32:50.947 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:32:50.988 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-05-16T22:32:51.022 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_dump": [ 2024-05-16T22:32:51.055 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-05-16T22:32:51.122 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.a", 2024-05-16T22:32:51.163 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAWiEZmxekLORAA65NIhbDezFAP1GVT9W/2RA==", 2024-05-16T22:32:51.197 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-05-16T22:32:51.233 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-05-16T22:32:51.272 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-05-16T22:32:51.305 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-05-16T22:32:51.339 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-05-16T22:32:51.439 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-05-16T22:32:51.472 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-05-16T22:32:51.514 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-05-16T22:32:51.547 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.b", 2024-05-16T22:32:51.580 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAXiEZmurcoChAAJiwILq5JEI80q8OpClacbw==", 2024-05-16T22:32:51.614 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-05-16T22:32:51.647 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-05-16T22:32:51.681 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-05-16T22:32:51.714 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-05-16T22:32:51.747 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-05-16T22:32:51.781 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-05-16T22:32:51.814 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-05-16T22:32:51.848 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-05-16T22:32:51.889 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.c", 2024-05-16T22:32:51.931 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAXiEZmtUcJBRAASN/71ONwgQ6oUKwSgrptjw==", 2024-05-16T22:32:51.964 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-05-16T22:32:52.023 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-05-16T22:32:52.064 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-05-16T22:32:52.098 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-05-16T22:32:52.139 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-05-16T22:32:52.181 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-05-16T22:32:52.223 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-05-16T22:32:52.265 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-05-16T22:32:52.307 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.0", 2024-05-16T22:32:52.348 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAaiEZm+8xUJRAA9xLLdiQFRJCz2p87HaNmyA==", 2024-05-16T22:32:52.390 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-05-16T22:32:52.432 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-05-16T22:32:52.473 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-05-16T22:32:52.515 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-05-16T22:32:52.557 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-05-16T22:32:52.600 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-05-16T22:32:52.640 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-05-16T22:32:52.707 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.1", 2024-05-16T22:32:52.748 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAdiEZmmMAaJRAArJoDZU7bZnxdQigZzd0YVg==", 2024-05-16T22:32:52.790 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-05-16T22:32:52.832 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-05-16T22:32:52.873 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-05-16T22:32:52.915 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-05-16T22:32:52.957 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-05-16T22:32:52.998 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-05-16T22:32:53.040 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-05-16T22:32:53.082 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.2", 2024-05-16T22:32:53.124 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAgiEZmPjYbJBAAHAcCdSqGENz8izm4WRgL+A==", 2024-05-16T22:32:53.165 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-05-16T22:32:53.207 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-05-16T22:32:53.249 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-05-16T22:32:53.291 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-05-16T22:32:53.333 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-05-16T22:32:53.391 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-05-16T22:32:53.432 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-05-16T22:32:53.474 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.3", 2024-05-16T22:32:53.516 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAjiEZmEtkSJBAAyLOddh7tm2/aH5Kg1vEAyg==", 2024-05-16T22:32:53.557 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-05-16T22:32:53.599 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-05-16T22:32:53.641 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-05-16T22:32:53.682 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-05-16T22:32:53.724 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-05-16T22:32:53.766 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-05-16T22:32:53.808 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-05-16T22:32:53.849 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.4", 2024-05-16T22:32:53.891 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAniEZm1f01LBAAl7Okxq8NCE6pNDSpffrHNQ==", 2024-05-16T22:32:53.933 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-05-16T22:32:53.975 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-05-16T22:32:54.016 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-05-16T22:32:54.091 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-05-16T22:32:54.142 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-05-16T22:32:54.183 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-05-16T22:32:54.225 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-05-16T22:32:54.266 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.5", 2024-05-16T22:32:54.308 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAqiEZmL9yZKhAAHdy+cA/TusLioV8AuJLMzg==", 2024-05-16T22:32:54.350 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-05-16T22:32:54.416 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-05-16T22:32:54.458 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-05-16T22:32:54.500 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-05-16T22:32:54.541 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-05-16T22:32:54.583 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-05-16T22:32:54.625 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-05-16T22:32:54.658 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.6", 2024-05-16T22:32:54.700 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAtiEZm+r/pKBAA1P18UVMTaPbPfz0x+n+rcA==", 2024-05-16T22:32:54.742 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-05-16T22:32:54.808 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-05-16T22:32:54.850 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-05-16T22:32:54.893 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-05-16T22:32:54.934 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-05-16T22:32:54.975 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-05-16T22:32:55.017 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-05-16T22:32:55.058 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.7", 2024-05-16T22:32:55.092 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAwiEZm9IVUJxAAXMx+HxIIDuBtRZ8pRXMdEQ==", 2024-05-16T22:32:55.133 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-05-16T22:32:55.175 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-05-16T22:32:55.217 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-05-16T22:32:55.259 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-05-16T22:32:55.300 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-05-16T22:32:55.342 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-05-16T22:32:55.384 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-05-16T22:32:55.425 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.0", 2024-05-16T22:32:55.484 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAXiEZms3dqGBAAS4ISUkubc7YrigOk4RRlXA==", 2024-05-16T22:32:55.526 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-05-16T22:32:55.567 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-05-16T22:32:55.609 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow r", 2024-05-16T22:32:55.651 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-05-16T22:32:55.692 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-05-16T22:32:55.734 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-05-16T22:32:55.776 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-05-16T22:32:55.817 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.admin", 2024-05-16T22:32:55.859 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAWiEZmdP/sDhAAu46uG2l+oX+eDfx+Uc5+Bg==", 2024-05-16T22:32:55.901 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-05-16T22:32:55.943 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2024-05-16T22:32:55.984 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-05-16T22:32:56.026 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-05-16T22:32:56.068 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-05-16T22:32:56.109 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-05-16T22:32:56.176 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-05-16T22:32:56.218 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-05-16T22:32:56.259 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mgr.x", 2024-05-16T22:32:56.301 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAWiEZm7uNONRAAmiKGMr87L5iAlRVZjapvxQ==", 2024-05-16T22:32:56.343 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-05-16T22:32:56.384 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2024-05-16T22:32:56.426 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile mgr", 2024-05-16T22:32:56.468 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-05-16T22:32:56.510 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-05-16T22:32:56.551 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-05-16T22:32:56.593 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-05-16T22:32:56.635 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mgr.y", 2024-05-16T22:32:56.676 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAWiEZmUj4wMRAAsBAzNHvbKW0neWbAITTL1A==", 2024-05-16T22:32:56.718 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-05-16T22:32:56.760 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2024-05-16T22:32:56.802 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile mgr", 2024-05-16T22:32:56.860 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-05-16T22:32:56.902 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-05-16T22:32:56.943 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-05-16T22:32:56.985 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-05-16T22:32:57.034 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-05-16T22:32:57.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.789+0000 7fe4ed5b7640 1 -- 172.21.15.44:0/2117061912 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fe4d40762d0 msgr2=0x7fe4d40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:57.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.789+0000 7fe4ed5b7640 1 --2- 172.21.15.44:0/2117061912 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fe4d40762d0 0x7fe4d40787e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0007fd0 tx=0x7fe4e0007d40 comp rx=0 tx=0).stop 2024-05-16T22:32:57.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.789+0000 7fe4ed5b7640 1 -- 172.21.15.44:0/2117061912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4e814c8e0 msgr2=0x7fe4e81e7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:57.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.789+0000 7fe4ed5b7640 1 --2- 172.21.15.44:0/2117061912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4e814c8e0 0x7fe4e81e7af0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8007e90 tx=0x7fe4d800e4b0 comp rx=0 tx=0).stop 2024-05-16T22:32:57.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.790+0000 7fe4ed5b7640 1 -- 172.21.15.44:0/2117061912 shutdown_connections 2024-05-16T22:32:57.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.790+0000 7fe4ed5b7640 1 --2- 172.21.15.44:0/2117061912 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fe4d40762d0 0x7fe4d40787e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:57.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.790+0000 7fe4ed5b7640 1 --2- 172.21.15.44:0/2117061912 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe4e80bc1c0 0x7fe4e814fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:57.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.790+0000 7fe4ed5b7640 1 --2- 172.21.15.44:0/2117061912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4e814c8e0 0x7fe4e81e7af0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:57.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.790+0000 7fe4ed5b7640 1 --2- 172.21.15.44:0/2117061912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4e80a0ba0 0x7fe4e81e4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:57.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.790+0000 7fe4ed5b7640 1 -- 172.21.15.44:0/2117061912 >> 172.21.15.44:0/2117061912 conn(0x7fe4e80c17c0 msgr2=0x7fe4e809fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:32:57.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.790+0000 7fe4ed5b7640 1 -- 172.21.15.44:0/2117061912 shutdown_connections 2024-05-16T22:32:57.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:48.790+0000 7fe4ed5b7640 1 -- 172.21.15.44:0/2117061912 wait complete. 2024-05-16T22:32:57.719 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-16T22:32:57.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.939+0000 7f3d7b30d640 1 Processor -- start 2024-05-16T22:32:58.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.939+0000 7f3d7b30d640 1 -- start start 2024-05-16T22:32:58.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.940+0000 7f3d7b30d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3d7414e360 0x7f3d741522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:58.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.940+0000 7f3d7b30d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3d74148770 0x7f3d740c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:58.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.940+0000 7f3d7b30d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3d740bf9b0 0x7f3d740bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:58.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.940+0000 7f3d7b30d640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f3d74151e40 con 0x7f3d7414e360 2024-05-16T22:32:58.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.940+0000 7f3d7b30d640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f3d740c0620 con 0x7f3d74148770 2024-05-16T22:32:58.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.940+0000 7f3d7b30d640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f3d74151ad0 con 0x7f3d740bf9b0 2024-05-16T22:32:58.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.940+0000 7f3d790a9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3d7414e360 0x7f3d741522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:58.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.940+0000 7f3d790a9640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3d7414e360 0x7f3d741522d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48278/0 (socket says 172.21.15.44:48278) 2024-05-16T22:32:58.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.940+0000 7f3d790a9640 1 -- 172.21.15.44:0/2164686304 learned_addr learned my addr 172.21.15.44:0/2164686304 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:32:58.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.940+0000 7f3d798aa640 1 --2- 172.21.15.44:0/2164686304 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3d740bf9b0 0x7f3d740bfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:58.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.940+0000 7f3d788a8640 1 --2- 172.21.15.44:0/2164686304 >> v2:172.21.15.70:3300/0 conn(0x7f3d74148770 0x7f3d740c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:58.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.941+0000 7f3d790a9640 1 -- 172.21.15.44:0/2164686304 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3d740bf9b0 msgr2=0x7f3d740bfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:32:58.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.941+0000 7f3d790a9640 1 --2- 172.21.15.44:0/2164686304 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3d740bf9b0 0x7f3d740bfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:58.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.941+0000 7f3d790a9640 1 -- 172.21.15.44:0/2164686304 >> v2:172.21.15.70:3300/0 conn(0x7f3d74148770 msgr2=0x7f3d740c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:32:58.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.941+0000 7f3d790a9640 1 --2- 172.21.15.44:0/2164686304 >> v2:172.21.15.70:3300/0 conn(0x7f3d74148770 0x7f3d740c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:58.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.941+0000 7f3d790a9640 1 -- 172.21.15.44:0/2164686304 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d74152810 con 0x7f3d7414e360 2024-05-16T22:32:58.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.941+0000 7f3d790a9640 1 --2- 172.21.15.44:0/2164686304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d7414e360 0x7f3d741522d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3d7414bf30 tx=0x7f3d7002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0550d265e52f0a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:32:58.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.941+0000 7f3d6bfff640 1 -- 172.21.15.44:0/2164686304 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d70036070 con 0x7f3d7414e360 2024-05-16T22:32:58.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.942+0000 7f3d6bfff640 1 -- 172.21.15.44:0/2164686304 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d70031600 con 0x7f3d7414e360 2024-05-16T22:32:58.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.942+0000 7f3d6bfff640 1 -- 172.21.15.44:0/2164686304 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d700319d0 con 0x7f3d7414e360 2024-05-16T22:32:59.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.942+0000 7f3d7b30d640 1 -- 172.21.15.44:0/2164686304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d7414e360 msgr2=0x7f3d741522d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:59.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.942+0000 7f3d7b30d640 1 --2- 172.21.15.44:0/2164686304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d7414e360 0x7f3d741522d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3d7414bf30 tx=0x7f3d7002a730 comp rx=0 tx=0).stop 2024-05-16T22:32:59.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.942+0000 7f3d7b30d640 1 -- 172.21.15.44:0/2164686304 shutdown_connections 2024-05-16T22:32:59.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.942+0000 7f3d7b30d640 1 --2- 172.21.15.44:0/2164686304 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3d740bf9b0 0x7f3d740bfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:59.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.942+0000 7f3d7b30d640 1 --2- 172.21.15.44:0/2164686304 >> v2:172.21.15.70:3300/0 conn(0x7f3d74148770 0x7f3d740c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:59.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.942+0000 7f3d7b30d640 1 --2- 172.21.15.44:0/2164686304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d7414e360 0x7f3d741522d0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:32:59.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.942+0000 7f3d7b30d640 1 -- 172.21.15.44:0/2164686304 >> 172.21.15.44:0/2164686304 conn(0x7f3d740c17c0 msgr2=0x7f3d740c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:32:59.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.942+0000 7f3d7b30d640 1 -- 172.21.15.44:0/2164686304 shutdown_connections 2024-05-16T22:32:59.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.942+0000 7f3d7b30d640 1 -- 172.21.15.44:0/2164686304 wait complete. 2024-05-16T22:32:59.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.944+0000 7f3d7b30d640 1 Processor -- start 2024-05-16T22:32:59.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.944+0000 7f3d7b30d640 1 -- start start 2024-05-16T22:32:59.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.945+0000 7f3d7b30d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3d740bf9b0 0x7f3d741e7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:59.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.945+0000 7f3d7b30d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d74148770 0x7f3d740718d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:59.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.945+0000 7f3d7b30d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d7414e360 0x7f3d74071e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:32:59.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.945+0000 7f3d7b30d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3d740c1340 con 0x7f3d7414e360 2024-05-16T22:32:59.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.945+0000 7f3d7b30d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3d740c11c0 con 0x7f3d74148770 2024-05-16T22:32:59.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.945+0000 7f3d7b30d640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f3d7409fd50 con 0x7f3d740bf9b0 2024-05-16T22:32:59.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.945+0000 7f3d798aa640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d7414e360 0x7f3d74071e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:59.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.945+0000 7f3d798aa640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d7414e360 0x7f3d74071e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48280/0 (socket says 172.21.15.44:48280) 2024-05-16T22:32:59.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.945+0000 7f3d798aa640 1 -- 172.21.15.44:0/548253853 learned_addr learned my addr 172.21.15.44:0/548253853 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:32:59.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.945+0000 7f3d790a9640 1 --2- 172.21.15.44:0/548253853 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3d740bf9b0 0x7f3d741e7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:59.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.945+0000 7f3d788a8640 1 --2- 172.21.15.44:0/548253853 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d74148770 0x7f3d740718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:32:59.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.946+0000 7f3d798aa640 1 -- 172.21.15.44:0/548253853 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3d740bf9b0 msgr2=0x7f3d741e7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:32:59.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.946+0000 7f3d798aa640 1 --2- 172.21.15.44:0/548253853 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3d740bf9b0 0x7f3d741e7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:00.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.946+0000 7f3d798aa640 1 -- 172.21.15.44:0/548253853 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d74148770 msgr2=0x7f3d740718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:00.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.946+0000 7f3d798aa640 1 --2- 172.21.15.44:0/548253853 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d74148770 0x7f3d740718d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:00.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.946+0000 7f3d798aa640 1 -- 172.21.15.44:0/548253853 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d740a1720 con 0x7f3d7414e360 2024-05-16T22:33:00.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.946+0000 7f3d798aa640 1 --2- 172.21.15.44:0/548253853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d7414e360 0x7f3d74071e10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c00e7f0 tx=0x7f3d6c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:00.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.946+0000 7f3d69ffb640 1 -- 172.21.15.44:0/548253853 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c017070 con 0x7f3d7414e360 2024-05-16T22:33:00.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.946+0000 7f3d69ffb640 1 -- 172.21.15.44:0/548253853 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d6c00c730 con 0x7f3d7414e360 2024-05-16T22:33:00.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.946+0000 7f3d7b30d640 1 -- 172.21.15.44:0/548253853 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d740a1a00 con 0x7f3d7414e360 2024-05-16T22:33:00.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.946+0000 7f3d69ffb640 1 -- 172.21.15.44:0/548253853 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c00cb40 con 0x7f3d7414e360 2024-05-16T22:33:00.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.946+0000 7f3d7b30d640 1 -- 172.21.15.44:0/548253853 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d74072970 con 0x7f3d7414e360 2024-05-16T22:33:00.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.947+0000 7f3d7b30d640 1 -- 172.21.15.44:0/548253853 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d74050940 con 0x7f3d7414e360 2024-05-16T22:33:00.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.948+0000 7f3d69ffb640 1 -- 172.21.15.44:0/548253853 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3d6c01a070 con 0x7f3d7414e360 2024-05-16T22:33:00.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.948+0000 7f3d69ffb640 1 --2- 172.21.15.44:0/548253853 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f3d58076300 0x7f3d58078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:00.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.949+0000 7f3d69ffb640 1 -- 172.21.15.44:0/548253853 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4857+0+0 (secure 0 0 0) 0x7f3d6c096fe0 con 0x7f3d7414e360 2024-05-16T22:33:00.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.949+0000 7f3d790a9640 1 --2- 172.21.15.44:0/548253853 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f3d58076300 0x7f3d58078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:00.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.949+0000 7f3d790a9640 1 --2- 172.21.15.44:0/548253853 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f3d58076300 0x7f3d58078810 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3d70033000 tx=0x7f3d70009000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:00.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:57.954+0000 7f3d69ffb640 1 -- 172.21.15.44:0/548253853 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3d6c0605a0 con 0x7f3d7414e360 2024-05-16T22:33:00.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:58.150+0000 7f3d7b30d640 1 -- 172.21.15.44:0/548253853 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f3d740bf790 con 0x7f3d7414e360 2024-05-16T22:33:00.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:58.151+0000 7f3d69ffb640 1 -- 172.21.15.44:0/548253853 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v41) ==== 84+0+65 (secure 0 0 0) 0x7f3d6c0648a0 con 0x7f3d7414e360 2024-05-16T22:33:00.846 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:33:00.888 INFO:teuthology.orchestra.run.smithi044.stdout:[ 2024-05-16T22:33:00.929 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-05-16T22:33:00.971 INFO:teuthology.orchestra.run.smithi044.stdout: "poolnum": 1, 2024-05-16T22:33:01.013 INFO:teuthology.orchestra.run.smithi044.stdout: "poolname": ".mgr" 2024-05-16T22:33:01.054 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-05-16T22:33:01.096 INFO:teuthology.orchestra.run.smithi044.stdout:] 2024-05-16T22:33:01.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:58.153+0000 7f3d7b30d640 1 -- 172.21.15.44:0/548253853 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f3d58076300 msgr2=0x7f3d58078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:01.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:58.153+0000 7f3d7b30d640 1 --2- 172.21.15.44:0/548253853 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f3d58076300 0x7f3d58078810 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3d70033000 tx=0x7f3d70009000 comp rx=0 tx=0).stop 2024-05-16T22:33:01.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:58.153+0000 7f3d7b30d640 1 -- 172.21.15.44:0/548253853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d7414e360 msgr2=0x7f3d74071e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:01.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:58.153+0000 7f3d7b30d640 1 --2- 172.21.15.44:0/548253853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d7414e360 0x7f3d74071e10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c00e7f0 tx=0x7f3d6c00ecb0 comp rx=0 tx=0).stop 2024-05-16T22:33:01.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:58.153+0000 7f3d7b30d640 1 -- 172.21.15.44:0/548253853 shutdown_connections 2024-05-16T22:33:01.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:58.153+0000 7f3d7b30d640 1 --2- 172.21.15.44:0/548253853 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f3d58076300 0x7f3d58078810 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:01.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:58.153+0000 7f3d7b30d640 1 --2- 172.21.15.44:0/548253853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d7414e360 0x7f3d74071e10 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:01.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:58.153+0000 7f3d7b30d640 1 --2- 172.21.15.44:0/548253853 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d74148770 0x7f3d740718d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:01.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:58.153+0000 7f3d7b30d640 1 --2- 172.21.15.44:0/548253853 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3d740bf9b0 0x7f3d741e7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:01.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:58.153+0000 7f3d7b30d640 1 -- 172.21.15.44:0/548253853 >> 172.21.15.44:0/548253853 conn(0x7f3d740c17c0 msgr2=0x7f3d741dac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:33:01.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:58.153+0000 7f3d7b30d640 1 -- 172.21.15.44:0/548253853 shutdown_connections 2024-05-16T22:33:01.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:32:58.153+0000 7f3d7b30d640 1 -- 172.21.15.44:0/548253853 wait complete. 2024-05-16T22:33:01.655 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-16T22:33:01.697 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-16T22:33:01.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.869+0000 7f4fd5c6e640 1 Processor -- start 2024-05-16T22:33:01.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.869+0000 7f4fd5c6e640 1 -- start start 2024-05-16T22:33:01.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.871+0000 7f4fd5c6e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4fd014e360 0x7f4fd01522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:02.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.871+0000 7f4fd5c6e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4fd0148770 0x7f4fd00c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:02.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.871+0000 7f4fd5c6e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4fd00bf9b0 0x7f4fd00bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:02.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.871+0000 7f4fd5c6e640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f4fd0151e40 con 0x7f4fd00bf9b0 2024-05-16T22:33:02.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.871+0000 7f4fd5c6e640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f4fd00c0620 con 0x7f4fd0148770 2024-05-16T22:33:02.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.871+0000 7f4fd5c6e640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f4fd0151ad0 con 0x7f4fd014e360 2024-05-16T22:33:02.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.871+0000 7f4fcffff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4fd00bf9b0 0x7f4fd00bfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:02.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.871+0000 7f4fcffff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4fd00bf9b0 0x7f4fd00bfdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60512/0 (socket says 172.21.15.44:60512) 2024-05-16T22:33:02.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.871+0000 7f4fcffff640 1 -- 172.21.15.44:0/251667656 learned_addr learned my addr 172.21.15.44:0/251667656 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:33:02.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.871+0000 7f4fceffd640 1 --2- 172.21.15.44:0/251667656 >> v2:172.21.15.70:3300/0 conn(0x7f4fd0148770 0x7f4fd00c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:02.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.871+0000 7f4fcf7fe640 1 --2- 172.21.15.44:0/251667656 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4fd014e360 0x7f4fd01522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:02.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.871+0000 7f4fcffff640 1 -- 172.21.15.44:0/251667656 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4fd014e360 msgr2=0x7f4fd01522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:33:02.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.871+0000 7f4fcffff640 1 --2- 172.21.15.44:0/251667656 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4fd014e360 0x7f4fd01522d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:02.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.871+0000 7f4fcffff640 1 -- 172.21.15.44:0/251667656 >> v2:172.21.15.70:3300/0 conn(0x7f4fd0148770 msgr2=0x7f4fd00c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:33:02.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.871+0000 7f4fcffff640 1 --2- 172.21.15.44:0/251667656 >> v2:172.21.15.70:3300/0 conn(0x7f4fd0148770 0x7f4fd00c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:02.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.871+0000 7f4fcffff640 1 -- 172.21.15.44:0/251667656 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fd0152810 con 0x7f4fd00bf9b0 2024-05-16T22:33:02.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.872+0000 7f4fcffff640 1 --2- 172.21.15.44:0/251667656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4fd00bf9b0 0x7f4fd00bfdc0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8009e50 tx=0x7f4fc802a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f261d0ec1e32f2fa server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:02.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.872+0000 7f4fce7fc640 1 -- 172.21.15.44:0/251667656 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc8036070 con 0x7f4fd00bf9b0 2024-05-16T22:33:02.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.872+0000 7f4fce7fc640 1 -- 172.21.15.44:0/251667656 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fc8031600 con 0x7f4fd00bf9b0 2024-05-16T22:33:02.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.872+0000 7f4fce7fc640 1 -- 172.21.15.44:0/251667656 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc80319d0 con 0x7f4fd00bf9b0 2024-05-16T22:33:03.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.873+0000 7f4fd5c6e640 1 -- 172.21.15.44:0/251667656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4fd00bf9b0 msgr2=0x7f4fd00bfdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:03.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.873+0000 7f4fd5c6e640 1 --2- 172.21.15.44:0/251667656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4fd00bf9b0 0x7f4fd00bfdc0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8009e50 tx=0x7f4fc802a750 comp rx=0 tx=0).stop 2024-05-16T22:33:03.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.873+0000 7f4fd5c6e640 1 -- 172.21.15.44:0/251667656 shutdown_connections 2024-05-16T22:33:03.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.873+0000 7f4fd5c6e640 1 --2- 172.21.15.44:0/251667656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4fd00bf9b0 0x7f4fd00bfdc0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:03.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.873+0000 7f4fd5c6e640 1 --2- 172.21.15.44:0/251667656 >> v2:172.21.15.70:3300/0 conn(0x7f4fd0148770 0x7f4fd00c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:03.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.873+0000 7f4fd5c6e640 1 --2- 172.21.15.44:0/251667656 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4fd014e360 0x7f4fd01522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:03.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.873+0000 7f4fd5c6e640 1 -- 172.21.15.44:0/251667656 >> 172.21.15.44:0/251667656 conn(0x7f4fd00c17c0 msgr2=0x7f4fd00c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:33:03.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.873+0000 7f4fd5c6e640 1 -- 172.21.15.44:0/251667656 shutdown_connections 2024-05-16T22:33:03.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.873+0000 7f4fd5c6e640 1 -- 172.21.15.44:0/251667656 wait complete. 2024-05-16T22:33:03.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.874+0000 7f4fd5c6e640 1 Processor -- start 2024-05-16T22:33:03.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.875+0000 7f4fd5c6e640 1 -- start start 2024-05-16T22:33:03.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.876+0000 7f4fd5c6e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4fd00bf9b0 0x7f4fd00a5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:03.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.876+0000 7f4fd5c6e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4fd0148770 0x7f4fd01d9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:03.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.876+0000 7f4fd5c6e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fd014e360 0x7f4fd0147580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:03.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.876+0000 7f4fd5c6e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd00c1340 con 0x7f4fd0148770 2024-05-16T22:33:03.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.876+0000 7f4fd5c6e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd00c11c0 con 0x7f4fd014e360 2024-05-16T22:33:03.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.876+0000 7f4fd5c6e640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f4fd009fd50 con 0x7f4fd00bf9b0 2024-05-16T22:33:03.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.876+0000 7f4fceffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4fd0148770 0x7f4fd01d9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:04.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.876+0000 7f4fceffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4fd0148770 0x7f4fd01d9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60524/0 (socket says 172.21.15.44:60524) 2024-05-16T22:33:04.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.876+0000 7f4fceffd640 1 -- 172.21.15.44:0/3692542893 learned_addr learned my addr 172.21.15.44:0/3692542893 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:33:04.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.876+0000 7f4fcf7fe640 1 --2- 172.21.15.44:0/3692542893 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4fd00bf9b0 0x7f4fd00a5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:04.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.876+0000 7f4fcffff640 1 --2- 172.21.15.44:0/3692542893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fd014e360 0x7f4fd0147580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:04.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.876+0000 7f4fceffd640 1 -- 172.21.15.44:0/3692542893 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4fd00bf9b0 msgr2=0x7f4fd00a5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:04.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.876+0000 7f4fceffd640 1 --2- 172.21.15.44:0/3692542893 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4fd00bf9b0 0x7f4fd00a5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:04.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.876+0000 7f4fceffd640 1 -- 172.21.15.44:0/3692542893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fd014e360 msgr2=0x7f4fd0147580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:04.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.876+0000 7f4fceffd640 1 --2- 172.21.15.44:0/3692542893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fd014e360 0x7f4fd0147580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:04.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.876+0000 7f4fceffd640 1 -- 172.21.15.44:0/3692542893 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fd014f500 con 0x7f4fd0148770 2024-05-16T22:33:04.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.876+0000 7f4fcf7fe640 1 --2- 172.21.15.44:0/3692542893 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4fd00bf9b0 0x7f4fd00a5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T22:33:04.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.876+0000 7f4fcffff640 1 --2- 172.21.15.44:0/3692542893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fd014e360 0x7f4fd0147580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T22:33:04.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.876+0000 7f4fceffd640 1 --2- 172.21.15.44:0/3692542893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4fd0148770 0x7f4fd01d9180 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4fc400e630 tx=0x7f4fc400eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:04.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.876+0000 7f4fb7fff640 1 -- 172.21.15.44:0/3692542893 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc4017070 con 0x7f4fd0148770 2024-05-16T22:33:04.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.877+0000 7f4fb7fff640 1 -- 172.21.15.44:0/3692542893 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fc4013680 con 0x7f4fd0148770 2024-05-16T22:33:04.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.877+0000 7f4fd5c6e640 1 -- 172.21.15.44:0/3692542893 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fd00a6820 con 0x7f4fd0148770 2024-05-16T22:33:04.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.877+0000 7f4fb7fff640 1 -- 172.21.15.44:0/3692542893 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc4013a70 con 0x7f4fd0148770 2024-05-16T22:33:04.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.877+0000 7f4fd5c6e640 1 -- 172.21.15.44:0/3692542893 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fd01da360 con 0x7f4fd0148770 2024-05-16T22:33:04.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.878+0000 7f4fd5c6e640 1 -- 172.21.15.44:0/3692542893 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fd00a6d70 con 0x7f4fd0148770 2024-05-16T22:33:04.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.878+0000 7f4fb7fff640 1 -- 172.21.15.44:0/3692542893 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4fc401a070 con 0x7f4fd0148770 2024-05-16T22:33:05.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.879+0000 7f4fb7fff640 1 --2- 172.21.15.44:0/3692542893 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4fbc0762d0 0x7f4fbc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:05.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.879+0000 7f4fb7fff640 1 -- 172.21.15.44:0/3692542893 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4857+0+0 (secure 0 0 0) 0x7f4fc4096f50 con 0x7f4fd0148770 2024-05-16T22:33:05.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.879+0000 7f4fcf7fe640 1 --2- 172.21.15.44:0/3692542893 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4fbc0762d0 0x7f4fbc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:05.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.880+0000 7f4fcf7fe640 1 --2- 172.21.15.44:0/3692542893 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4fbc0762d0 0x7f4fbc0787e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0009a20 tx=0x7f4fc0008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:05.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:01.883+0000 7f4fb7fff640 1 -- 172.21.15.44:0/3692542893 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4fc4060c00 con 0x7f4fd0148770 2024-05-16T22:33:05.261 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:33:05.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:02.080+0000 7f4fd5c6e640 1 -- 172.21.15.44:0/3692542893 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f4fd0050940 con 0x7f4fd0148770 2024-05-16T22:33:05.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:02.753+0000 7f4fb7fff640 1 -- 172.21.15.44:0/3692542893 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v42) ==== 138+0+0 (secure 0 0 0) 0x7f4fc4060500 con 0x7f4fd0148770 2024-05-16T22:33:05.435 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' created 2024-05-16T22:33:05.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:02.756+0000 7f4fd5c6e640 1 -- 172.21.15.44:0/3692542893 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4fbc0762d0 msgr2=0x7f4fbc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:05.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:02.756+0000 7f4fd5c6e640 1 --2- 172.21.15.44:0/3692542893 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4fbc0762d0 0x7f4fbc0787e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0009a20 tx=0x7f4fc0008040 comp rx=0 tx=0).stop 2024-05-16T22:33:05.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:02.756+0000 7f4fd5c6e640 1 -- 172.21.15.44:0/3692542893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4fd0148770 msgr2=0x7f4fd01d9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:05.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:02.756+0000 7f4fd5c6e640 1 --2- 172.21.15.44:0/3692542893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4fd0148770 0x7f4fd01d9180 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4fc400e630 tx=0x7f4fc400eaf0 comp rx=0 tx=0).stop 2024-05-16T22:33:05.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:02.756+0000 7f4fd5c6e640 1 -- 172.21.15.44:0/3692542893 shutdown_connections 2024-05-16T22:33:05.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:02.756+0000 7f4fd5c6e640 1 --2- 172.21.15.44:0/3692542893 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4fbc0762d0 0x7f4fbc0787e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:05.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:02.756+0000 7f4fd5c6e640 1 --2- 172.21.15.44:0/3692542893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fd014e360 0x7f4fd0147580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:05.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:02.756+0000 7f4fd5c6e640 1 --2- 172.21.15.44:0/3692542893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4fd0148770 0x7f4fd01d9180 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:05.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:02.756+0000 7f4fd5c6e640 1 --2- 172.21.15.44:0/3692542893 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4fd00bf9b0 0x7f4fd00a5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:05.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:02.756+0000 7f4fd5c6e640 1 -- 172.21.15.44:0/3692542893 >> 172.21.15.44:0/3692542893 conn(0x7f4fd00c17c0 msgr2=0x7f4fd01daa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:33:06.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:02.757+0000 7f4fd5c6e640 1 -- 172.21.15.44:0/3692542893 shutdown_connections 2024-05-16T22:33:06.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:02.757+0000 7f4fd5c6e640 1 -- 172.21.15.44:0/3692542893 wait complete. 2024-05-16T22:33:06.103 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-16T22:33:06.153 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:33:06.205 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:33:06.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.332+0000 7f78568af640 1 Processor -- start 2024-05-16T22:33:06.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.332+0000 7f78568af640 1 -- start start 2024-05-16T22:33:06.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.333+0000 7f78568af640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f785014e360 0x7f78501522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:06.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.333+0000 7f78568af640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f78500bf9b0 0x7f78500bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:06.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.334+0000 7f78568af640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78500c1390 con 0x7f7850148770 2024-05-16T22:33:06.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.334+0000 7f78568af640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f7850151e40 con 0x7f78500bf9b0 2024-05-16T22:33:06.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.334+0000 7f78568af640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f78500c0620 con 0x7f785014e360 2024-05-16T22:33:06.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.334+0000 7f784f7fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f7850148770 0x7f78500c0c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:51612/0 (socket says 172.21.15.44:51612) 2024-05-16T22:33:06.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.334+0000 7f784f7fe640 1 -- 172.21.15.44:0/3037236634 learned_addr learned my addr 172.21.15.44:0/3037236634 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:33:06.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.334+0000 7f784ffff640 1 --2- 172.21.15.44:0/3037236634 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f785014e360 0x7f78501522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:06.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.334+0000 7f7854e4c640 1 --2- 172.21.15.44:0/3037236634 >> v2:172.21.15.70:3300/0 conn(0x7f78500bf9b0 0x7f78500bfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:06.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.334+0000 7f784effd640 1 -- 172.21.15.44:0/3037236634 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 735911590 0 0) 0x7f7840001110 con 0x7f7850148770 2024-05-16T22:33:06.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.334+0000 7f784effd640 1 -- 172.21.15.44:0/3037236634 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f783c003520 con 0x7f7850148770 2024-05-16T22:33:06.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.334+0000 7f784ffff640 1 -- 172.21.15.44:0/3037236634 >> v2:172.21.15.70:3300/0 conn(0x7f78500bf9b0 msgr2=0x7f78500bfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:33:07.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.334+0000 7f784ffff640 1 --2- 172.21.15.44:0/3037236634 >> v2:172.21.15.70:3300/0 conn(0x7f78500bf9b0 0x7f78500bfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:07.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.334+0000 7f784ffff640 1 -- 172.21.15.44:0/3037236634 >> v1:172.21.15.44:6789/0 conn(0x7f7850148770 legacy=0x7f78500c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:07.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.334+0000 7f784ffff640 1 -- 172.21.15.44:0/3037236634 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7850151ad0 con 0x7f785014e360 2024-05-16T22:33:07.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.334+0000 7f7854e4c640 1 --2- 172.21.15.44:0/3037236634 >> v2:172.21.15.70:3300/0 conn(0x7f78500bf9b0 0x7f78500bfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:33:07.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.335+0000 7f784ffff640 1 --2- 172.21.15.44:0/3037236634 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f785014e360 0x7f78501522d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f78380097d0 tx=0x7f783802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77dfed8a3d4a4cbe server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:07.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.335+0000 7f784effd640 1 -- 172.21.15.44:0/3037236634 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7838037070 con 0x7f785014e360 2024-05-16T22:33:07.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.335+0000 7f784effd640 1 -- 172.21.15.44:0/3037236634 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7838032440 con 0x7f785014e360 2024-05-16T22:33:07.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.335+0000 7f784effd640 1 -- 172.21.15.44:0/3037236634 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78380327f0 con 0x7f785014e360 2024-05-16T22:33:07.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.336+0000 7f78568af640 1 -- 172.21.15.44:0/3037236634 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f785014e360 msgr2=0x7f78501522d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:07.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.336+0000 7f78568af640 1 --2- 172.21.15.44:0/3037236634 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f785014e360 0x7f78501522d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f78380097d0 tx=0x7f783802a270 comp rx=0 tx=0).stop 2024-05-16T22:33:07.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.336+0000 7f78568af640 1 -- 172.21.15.44:0/3037236634 shutdown_connections 2024-05-16T22:33:07.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.336+0000 7f78568af640 1 --2- 172.21.15.44:0/3037236634 >> v2:172.21.15.70:3300/0 conn(0x7f78500bf9b0 0x7f78500bfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:07.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.336+0000 7f78568af640 1 --2- 172.21.15.44:0/3037236634 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f785014e360 0x7f78501522d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:07.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.336+0000 7f78568af640 1 -- 172.21.15.44:0/3037236634 >> 172.21.15.44:0/3037236634 conn(0x7f78500c17c0 msgr2=0x7f78500c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:33:07.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.336+0000 7f78568af640 1 -- 172.21.15.44:0/3037236634 shutdown_connections 2024-05-16T22:33:07.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.336+0000 7f78568af640 1 -- 172.21.15.44:0/3037236634 wait complete. 2024-05-16T22:33:07.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.338+0000 7f78568af640 1 Processor -- start 2024-05-16T22:33:07.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.338+0000 7f78568af640 1 -- start start 2024-05-16T22:33:07.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.339+0000 7f78568af640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78500bf9b0 0x7f78500a4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:08.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.339+0000 7f78568af640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7850148770 0x7f78501e84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:08.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.339+0000 7f78568af640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f785014e360 0x7f7850142bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:08.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.339+0000 7f78568af640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7850158cc0 con 0x7f78500bf9b0 2024-05-16T22:33:08.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.339+0000 7f78568af640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f78500c0300 con 0x7f7850148770 2024-05-16T22:33:08.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.339+0000 7f78568af640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f7850158e40 con 0x7f785014e360 2024-05-16T22:33:08.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.339+0000 7f784ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78500bf9b0 0x7f78500a4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:08.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.339+0000 7f784ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78500bf9b0 0x7f78500a4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60538/0 (socket says 172.21.15.44:60538) 2024-05-16T22:33:08.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.339+0000 7f784ffff640 1 -- 172.21.15.44:0/2434913714 learned_addr learned my addr 172.21.15.44:0/2434913714 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:33:08.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.339+0000 7f784f7fe640 1 --2- 172.21.15.44:0/2434913714 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7850148770 0x7f78501e84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:08.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.339+0000 7f7854e4c640 1 --2- 172.21.15.44:0/2434913714 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f785014e360 0x7f7850142bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:08.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.339+0000 7f784ffff640 1 -- 172.21.15.44:0/2434913714 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f785014e360 msgr2=0x7f7850142bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:08.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.339+0000 7f784ffff640 1 --2- 172.21.15.44:0/2434913714 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f785014e360 0x7f7850142bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:08.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.339+0000 7f784ffff640 1 -- 172.21.15.44:0/2434913714 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7850148770 msgr2=0x7f78501e84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:08.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.339+0000 7f784ffff640 1 --2- 172.21.15.44:0/2434913714 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7850148770 0x7f78501e84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:08.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.339+0000 7f784ffff640 1 -- 172.21.15.44:0/2434913714 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78500a5090 con 0x7f78500bf9b0 2024-05-16T22:33:08.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.339+0000 7f784ffff640 1 --2- 172.21.15.44:0/2434913714 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78500bf9b0 0x7f78500a4b50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7838035040 tx=0x7f78380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:08.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.340+0000 7f784cff9640 1 -- 172.21.15.44:0/2434913714 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7838042020 con 0x7f78500bf9b0 2024-05-16T22:33:08.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.340+0000 7f784cff9640 1 -- 172.21.15.44:0/2434913714 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7838003c20 con 0x7f78500bf9b0 2024-05-16T22:33:08.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.340+0000 7f784cff9640 1 -- 172.21.15.44:0/2434913714 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7838037040 con 0x7f78500bf9b0 2024-05-16T22:33:09.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.340+0000 7f78568af640 1 -- 172.21.15.44:0/2434913714 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78501e89e0 con 0x7f78500bf9b0 2024-05-16T22:33:09.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.340+0000 7f78568af640 1 -- 172.21.15.44:0/2434913714 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78500b8010 con 0x7f78500bf9b0 2024-05-16T22:33:09.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.341+0000 7f78568af640 1 -- 172.21.15.44:0/2434913714 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78500b7e20 con 0x7f78500bf9b0 2024-05-16T22:33:09.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.341+0000 7f784cff9640 1 -- 172.21.15.44:0/2434913714 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7838045020 con 0x7f78500bf9b0 2024-05-16T22:33:09.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.342+0000 7f784cff9640 1 --2- 172.21.15.44:0/2434913714 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f7830076300 0x7f7830078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:09.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.342+0000 7f784cff9640 1 -- 172.21.15.44:0/2434913714 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5227+0+0 (secure 0 0 0) 0x7f78380b7ad0 con 0x7f78500bf9b0 2024-05-16T22:33:09.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.342+0000 7f784f7fe640 1 --2- 172.21.15.44:0/2434913714 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f7830076300 0x7f7830078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:09.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.343+0000 7f784f7fe640 1 --2- 172.21.15.44:0/2434913714 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f7830076300 0x7f7830078810 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7840005880 tx=0x7f7840009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:09.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.347+0000 7f784cff9640 1 -- 172.21.15.44:0/2434913714 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f783804c030 con 0x7f78500bf9b0 2024-05-16T22:33:09.488 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-05-16T22:33:09.537 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-05-16T22:33:09.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.538+0000 7f78568af640 1 -- 172.21.15.44:0/2434913714 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f78500c1570 con 0x7f78500bf9b0 2024-05-16T22:33:09.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.770+0000 7f784cff9640 1 -- 172.21.15.44:0/2434913714 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v45) ==== 170+0+0 (secure 0 0 0) 0x7f7838081610 con 0x7f78500bf9b0 2024-05-16T22:33:09.688 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' created 2024-05-16T22:33:09.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.772+0000 7f78568af640 1 -- 172.21.15.44:0/2434913714 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f7830076300 msgr2=0x7f7830078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:09.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.772+0000 7f78568af640 1 --2- 172.21.15.44:0/2434913714 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f7830076300 0x7f7830078810 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7840005880 tx=0x7f7840009040 comp rx=0 tx=0).stop 2024-05-16T22:33:09.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.772+0000 7f78568af640 1 -- 172.21.15.44:0/2434913714 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78500bf9b0 msgr2=0x7f78500a4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:09.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.772+0000 7f78568af640 1 --2- 172.21.15.44:0/2434913714 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78500bf9b0 0x7f78500a4b50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7838035040 tx=0x7f78380046c0 comp rx=0 tx=0).stop 2024-05-16T22:33:09.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.772+0000 7f78568af640 1 -- 172.21.15.44:0/2434913714 shutdown_connections 2024-05-16T22:33:10.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.772+0000 7f78568af640 1 --2- 172.21.15.44:0/2434913714 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f7830076300 0x7f7830078810 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:10.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.772+0000 7f78568af640 1 --2- 172.21.15.44:0/2434913714 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f785014e360 0x7f7850142bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:10.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.772+0000 7f78568af640 1 --2- 172.21.15.44:0/2434913714 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7850148770 0x7f78501e84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:10.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.772+0000 7f78568af640 1 --2- 172.21.15.44:0/2434913714 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78500bf9b0 0x7f78500a4b50 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:10.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.772+0000 7f78568af640 1 -- 172.21.15.44:0/2434913714 >> 172.21.15.44:0/2434913714 conn(0x7f78500c17c0 msgr2=0x7f78500be760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:33:10.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.772+0000 7f78568af640 1 -- 172.21.15.44:0/2434913714 shutdown_connections 2024-05-16T22:33:10.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:06.772+0000 7f78568af640 1 -- 172.21.15.44:0/2434913714 wait complete. 2024-05-16T22:33:10.430 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-16T22:33:10.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.608+0000 7f2872489640 1 Processor -- start 2024-05-16T22:33:10.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.608+0000 7f2872489640 1 -- start start 2024-05-16T22:33:10.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.609+0000 7f2872489640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f286c0bd6d0 0x7f286c0be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:10.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.609+0000 7f2872489640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f286c0bee80 0x7f286c158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:10.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.609+0000 7f2872489640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f286c06e140 con 0x7f286c151fc0 2024-05-16T22:33:10.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.609+0000 7f2872489640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f286c0c36f0 con 0x7f286c0bd6d0 2024-05-16T22:33:10.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.609+0000 7f2872489640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f286c152530 con 0x7f286c0bee80 2024-05-16T22:33:10.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.609+0000 7f286b7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f286c0bd6d0 0x7f286c0be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:11.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.609+0000 7f286b7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f286c0bd6d0 0x7f286c0be940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47530/0 (socket says 172.21.15.44:47530) 2024-05-16T22:33:11.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.609+0000 7f286b7fe640 1 -- 172.21.15.44:0/281672069 learned_addr learned my addr 172.21.15.44:0/281672069 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:33:11.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.609+0000 7f2870a26640 1 --2- 172.21.15.44:0/281672069 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f286c0bee80 0x7f286c158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:11.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.609+0000 7f286b7fe640 1 -- 172.21.15.44:0/281672069 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f286c0bee80 msgr2=0x7f286c158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:33:11.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.609+0000 7f286b7fe640 1 --2- 172.21.15.44:0/281672069 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f286c0bee80 0x7f286c158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:11.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.609+0000 7f286b7fe640 1 -- 172.21.15.44:0/281672069 >> v1:172.21.15.70:6789/0 conn(0x7f286c151fc0 legacy=0x7f286c06da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:33:11.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.610+0000 7f286b7fe640 1 -- 172.21.15.44:0/281672069 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f286c152810 con 0x7f286c0bd6d0 2024-05-16T22:33:11.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.610+0000 7f2870a26640 1 --2- 172.21.15.44:0/281672069 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f286c0bee80 0x7f286c158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T22:33:11.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.610+0000 7f286b7fe640 1 --2- 172.21.15.44:0/281672069 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f286c0bd6d0 0x7f286c0be940 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f2860009870 tx=0x7f286002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86692f2fad8f47a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:11.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.610+0000 7f286affd640 1 -- 172.21.15.44:0/281672069 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2860037070 con 0x7f286c0bd6d0 2024-05-16T22:33:11.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.610+0000 7f286affd640 1 -- 172.21.15.44:0/281672069 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2860032440 con 0x7f286c0bd6d0 2024-05-16T22:33:11.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.611+0000 7f286affd640 1 -- 172.21.15.44:0/281672069 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2860032810 con 0x7f286c0bd6d0 2024-05-16T22:33:11.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.611+0000 7f2872489640 1 -- 172.21.15.44:0/281672069 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f286c0bd6d0 msgr2=0x7f286c0be940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:11.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.611+0000 7f2872489640 1 --2- 172.21.15.44:0/281672069 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f286c0bd6d0 0x7f286c0be940 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f2860009870 tx=0x7f286002a270 comp rx=0 tx=0).stop 2024-05-16T22:33:11.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.611+0000 7f2872489640 1 -- 172.21.15.44:0/281672069 shutdown_connections 2024-05-16T22:33:11.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.611+0000 7f2872489640 1 --2- 172.21.15.44:0/281672069 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f286c0bee80 0x7f286c158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:11.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.611+0000 7f2872489640 1 --2- 172.21.15.44:0/281672069 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f286c0bd6d0 0x7f286c0be940 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:11.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.611+0000 7f2872489640 1 -- 172.21.15.44:0/281672069 >> 172.21.15.44:0/281672069 conn(0x7f286c0c3d20 msgr2=0x7f286c0c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:33:11.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.611+0000 7f2872489640 1 -- 172.21.15.44:0/281672069 shutdown_connections 2024-05-16T22:33:11.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.611+0000 7f2872489640 1 -- 172.21.15.44:0/281672069 wait complete. 2024-05-16T22:33:12.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.613+0000 7f2872489640 1 Processor -- start 2024-05-16T22:33:12.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.613+0000 7f2872489640 1 -- start start 2024-05-16T22:33:12.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.614+0000 7f2872489640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f286c0bd6d0 0x7f286c14c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:12.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.614+0000 7f2872489640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f286c0bee80 0x7f286c14d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:12.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.614+0000 7f2872489640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f286c151fc0 0x7f286c148b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:12.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.614+0000 7f2872489640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f286c0bdae0 con 0x7f286c0bee80 2024-05-16T22:33:12.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.614+0000 7f2872489640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f286c0c0070 con 0x7f286c151fc0 2024-05-16T22:33:12.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.614+0000 7f2872489640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f286c0a2ed0 con 0x7f286c0bd6d0 2024-05-16T22:33:12.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.614+0000 7f286b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f286c0bee80 0x7f286c14d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:12.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.614+0000 7f286b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f286c0bee80 0x7f286c14d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47532/0 (socket says 172.21.15.44:47532) 2024-05-16T22:33:12.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.614+0000 7f286b7fe640 1 -- 172.21.15.44:0/4067405776 learned_addr learned my addr 172.21.15.44:0/4067405776 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:33:12.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.614+0000 7f2870a26640 1 --2- 172.21.15.44:0/4067405776 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f286c151fc0 0x7f286c148b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:12.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.614+0000 7f286bfff640 1 --2- 172.21.15.44:0/4067405776 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f286c0bd6d0 0x7f286c14c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:12.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.615+0000 7f286b7fe640 1 -- 172.21.15.44:0/4067405776 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f286c0bd6d0 msgr2=0x7f286c14c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:12.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.615+0000 7f286b7fe640 1 --2- 172.21.15.44:0/4067405776 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f286c0bd6d0 0x7f286c14c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:12.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.615+0000 7f286b7fe640 1 -- 172.21.15.44:0/4067405776 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f286c151fc0 msgr2=0x7f286c148b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:12.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.615+0000 7f286b7fe640 1 --2- 172.21.15.44:0/4067405776 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f286c151fc0 0x7f286c148b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:12.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.615+0000 7f286b7fe640 1 -- 172.21.15.44:0/4067405776 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f286c14c8d0 con 0x7f286c0bee80 2024-05-16T22:33:12.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.615+0000 7f2870a26640 1 --2- 172.21.15.44:0/4067405776 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f286c151fc0 0x7f286c148b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:33:13.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.615+0000 7f286b7fe640 1 --2- 172.21.15.44:0/4067405776 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f286c0bee80 0x7f286c14d370 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2860000c00 tx=0x7f28600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:13.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.615+0000 7f2868ff9640 1 -- 172.21.15.44:0/4067405776 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2860037040 con 0x7f286c0bee80 2024-05-16T22:33:13.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.615+0000 7f2868ff9640 1 -- 172.21.15.44:0/4067405776 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2860042070 con 0x7f286c0bee80 2024-05-16T22:33:13.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.615+0000 7f2868ff9640 1 -- 172.21.15.44:0/4067405776 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2860030bd0 con 0x7f286c0bee80 2024-05-16T22:33:13.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.615+0000 7f2872489640 1 -- 172.21.15.44:0/4067405776 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f286c14d8b0 con 0x7f286c0bee80 2024-05-16T22:33:13.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.615+0000 7f2872489640 1 -- 172.21.15.44:0/4067405776 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f286c1e44e0 con 0x7f286c0bee80 2024-05-16T22:33:13.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.616+0000 7f2872489640 1 -- 172.21.15.44:0/4067405776 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f286c050940 con 0x7f286c0bee80 2024-05-16T22:33:13.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.617+0000 7f2868ff9640 1 -- 172.21.15.44:0/4067405776 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2860047460 con 0x7f286c0bee80 2024-05-16T22:33:13.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.617+0000 7f2868ff9640 1 --2- 172.21.15.44:0/4067405776 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f28580762d0 0x7f28580787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:13.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.618+0000 7f2868ff9640 1 -- 172.21.15.44:0/4067405776 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5609+0+0 (secure 0 0 0) 0x7f28600b8120 con 0x7f286c0bee80 2024-05-16T22:33:13.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.618+0000 7f286bfff640 1 --2- 172.21.15.44:0/4067405776 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f28580762d0 0x7f28580787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:13.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.618+0000 7f286bfff640 1 --2- 172.21.15.44:0/4067405776 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f28580762d0 0x7f28580787e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f285c000f60 tx=0x7f285c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:13.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.623+0000 7f2868ff9640 1 -- 172.21.15.44:0/4067405776 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2860081ae0 con 0x7f286c0bee80 2024-05-16T22:33:13.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:10.853+0000 7f2872489640 1 -- 172.21.15.44:0/4067405776 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f286c06eb40 con 0x7f286c0bee80 2024-05-16T22:33:13.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:11.800+0000 7f2868ff9640 1 -- 172.21.15.44:0/4067405776 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v23) ==== 172+0+0 (secure 0 0 0) 0x7f28600813e0 con 0x7f286c0bee80 2024-05-16T22:33:13.815 INFO:teuthology.orchestra.run.smithi044.stderr:new fs with metadata pool 6 and data pool 7 2024-05-16T22:33:13.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:11.803+0000 7f2872489640 1 -- 172.21.15.44:0/4067405776 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f28580762d0 msgr2=0x7f28580787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:13.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:11.803+0000 7f2872489640 1 --2- 172.21.15.44:0/4067405776 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f28580762d0 0x7f28580787e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f285c000f60 tx=0x7f285c009040 comp rx=0 tx=0).stop 2024-05-16T22:33:13.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:11.803+0000 7f2872489640 1 -- 172.21.15.44:0/4067405776 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f286c0bee80 msgr2=0x7f286c14d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:14.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:11.803+0000 7f2872489640 1 --2- 172.21.15.44:0/4067405776 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f286c0bee80 0x7f286c14d370 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2860000c00 tx=0x7f28600046c0 comp rx=0 tx=0).stop 2024-05-16T22:33:14.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:11.803+0000 7f2872489640 1 -- 172.21.15.44:0/4067405776 shutdown_connections 2024-05-16T22:33:14.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:11.803+0000 7f2872489640 1 --2- 172.21.15.44:0/4067405776 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f28580762d0 0x7f28580787e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:14.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:11.803+0000 7f2872489640 1 --2- 172.21.15.44:0/4067405776 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f286c151fc0 0x7f286c148b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:14.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:11.803+0000 7f2872489640 1 --2- 172.21.15.44:0/4067405776 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f286c0bee80 0x7f286c14d370 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:14.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:11.803+0000 7f2872489640 1 --2- 172.21.15.44:0/4067405776 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f286c0bd6d0 0x7f286c14c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:14.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:11.803+0000 7f2872489640 1 -- 172.21.15.44:0/4067405776 >> 172.21.15.44:0/4067405776 conn(0x7f286c0c3d20 msgr2=0x7f286c0bbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:33:14.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:11.803+0000 7f2872489640 1 -- 172.21.15.44:0/4067405776 shutdown_connections 2024-05-16T22:33:14.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:11.803+0000 7f2872489640 1 -- 172.21.15.44:0/4067405776 wait complete. 2024-05-16T22:33:14.482 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-16T22:33:14.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.657+0000 7f39a9015640 1 Processor -- start 2024-05-16T22:33:14.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.657+0000 7f39a9015640 1 -- start start 2024-05-16T22:33:14.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.658+0000 7f39a9015640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f39a4151fc0 0x7f39a40bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:14.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.658+0000 7f39a9015640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39a40c36f0 con 0x7f39a406da30 2024-05-16T22:33:14.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.658+0000 7f39a9015640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39a4152530 con 0x7f39a40bf050 2024-05-16T22:33:14.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.658+0000 7f39a9015640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f39a40bdc10 con 0x7f39a4151fc0 2024-05-16T22:33:14.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.659+0000 7f39a2d9d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f39a4151fc0 0x7f39a40bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:15.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.659+0000 7f39a259c640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f39a406da30 0x7f39a40be940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:33184/0 (socket says 172.21.15.44:33184) 2024-05-16T22:33:15.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.659+0000 7f39a2d9d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f39a4151fc0 0x7f39a40bd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47536/0 (socket says 172.21.15.44:47536) 2024-05-16T22:33:15.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.659+0000 7f39a259c640 1 -- 172.21.15.44:0/1942349228 learned_addr learned my addr 172.21.15.44:0/1942349228 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:33:15.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.659+0000 7f39a2d9d640 1 -- 172.21.15.44:0/1942349228 >> v1:172.21.15.70:6789/0 conn(0x7f39a40bf050 legacy=0x7f39a4158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:15.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.659+0000 7f39a2d9d640 1 -- 172.21.15.44:0/1942349228 >> v1:172.21.15.44:6789/0 conn(0x7f39a406da30 legacy=0x7f39a40be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:15.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.659+0000 7f39a1d9b640 1 -- 172.21.15.44:0/1942349228 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4067581004 0 0) 0x7f39a40c36f0 con 0x7f39a406da30 2024-05-16T22:33:15.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.659+0000 7f39a2d9d640 1 -- 172.21.15.44:0/1942349228 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39a4152810 con 0x7f39a4151fc0 2024-05-16T22:33:15.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.660+0000 7f39a2d9d640 1 --2- 172.21.15.44:0/1942349228 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39a4151fc0 0x7f39a40bd6d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f399c0097a0 tx=0x7f399c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5987f916f5c62815 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:15.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.660+0000 7f39a1d9b640 1 -- 172.21.15.44:0/1942349228 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f399c037070 con 0x7f39a4151fc0 2024-05-16T22:33:15.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.660+0000 7f39a1d9b640 1 -- 172.21.15.44:0/1942349228 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f399c032440 con 0x7f39a4151fc0 2024-05-16T22:33:15.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.660+0000 7f39a1d9b640 1 -- 172.21.15.44:0/1942349228 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f399c032810 con 0x7f39a4151fc0 2024-05-16T22:33:15.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.660+0000 7f39a9015640 1 -- 172.21.15.44:0/1942349228 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39a4151fc0 msgr2=0x7f39a40bd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:15.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.660+0000 7f39a9015640 1 --2- 172.21.15.44:0/1942349228 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39a4151fc0 0x7f39a40bd6d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f399c0097a0 tx=0x7f399c02a230 comp rx=0 tx=0).stop 2024-05-16T22:33:15.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.661+0000 7f39a9015640 1 -- 172.21.15.44:0/1942349228 shutdown_connections 2024-05-16T22:33:15.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.661+0000 7f39a9015640 1 --2- 172.21.15.44:0/1942349228 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39a4151fc0 0x7f39a40bd6d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:15.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.661+0000 7f39a9015640 1 -- 172.21.15.44:0/1942349228 >> 172.21.15.44:0/1942349228 conn(0x7f39a40c3d20 msgr2=0x7f39a40c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:33:15.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.661+0000 7f39a9015640 1 -- 172.21.15.44:0/1942349228 shutdown_connections 2024-05-16T22:33:15.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.661+0000 7f39a9015640 1 -- 172.21.15.44:0/1942349228 wait complete. 2024-05-16T22:33:15.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.662+0000 7f39a9015640 1 Processor -- start 2024-05-16T22:33:15.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.663+0000 7f39a9015640 1 -- start start 2024-05-16T22:33:16.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.664+0000 7f39a9015640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f39a406da30 0x7f39a41d8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:16.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.664+0000 7f39a9015640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39a40bf050 0x7f39a41d79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:16.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.664+0000 7f39a9015640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f39a4151fc0 0x7f39a414e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:16.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.664+0000 7f39a9015640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f39a40a3050 con 0x7f39a40bf050 2024-05-16T22:33:16.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.664+0000 7f39a9015640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f39a40a2ed0 con 0x7f39a4151fc0 2024-05-16T22:33:16.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.664+0000 7f39a9015640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f39a406de40 con 0x7f39a406da30 2024-05-16T22:33:16.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.664+0000 7f39a259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39a40bf050 0x7f39a41d79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:16.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.664+0000 7f39a259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39a40bf050 0x7f39a41d79e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47546/0 (socket says 172.21.15.44:47546) 2024-05-16T22:33:16.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.664+0000 7f39a259c640 1 -- 172.21.15.44:0/1464929235 learned_addr learned my addr 172.21.15.44:0/1464929235 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:33:16.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.664+0000 7f39a2d9d640 1 --2- 172.21.15.44:0/1464929235 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f39a406da30 0x7f39a41d8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:16.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.664+0000 7f39a359e640 1 --2- 172.21.15.44:0/1464929235 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f39a4151fc0 0x7f39a414e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:16.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.664+0000 7f39a259c640 1 -- 172.21.15.44:0/1464929235 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f39a406da30 msgr2=0x7f39a41d8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:16.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.664+0000 7f39a259c640 1 --2- 172.21.15.44:0/1464929235 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f39a406da30 0x7f39a41d8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:16.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.664+0000 7f39a259c640 1 -- 172.21.15.44:0/1464929235 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f39a4151fc0 msgr2=0x7f39a414e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:16.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.664+0000 7f39a259c640 1 --2- 172.21.15.44:0/1464929235 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f39a4151fc0 0x7f39a414e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:16.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.664+0000 7f39a259c640 1 -- 172.21.15.44:0/1464929235 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39a41d8aa0 con 0x7f39a40bf050 2024-05-16T22:33:16.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.664+0000 7f39a259c640 1 --2- 172.21.15.44:0/1464929235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39a40bf050 0x7f39a41d79e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f398c00c310 tx=0x7f398c00c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:16.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.664+0000 7f399b7fe640 1 -- 172.21.15.44:0/1464929235 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f398c017070 con 0x7f39a40bf050 2024-05-16T22:33:17.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.664+0000 7f399b7fe640 1 -- 172.21.15.44:0/1464929235 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f398c005ce0 con 0x7f39a40bf050 2024-05-16T22:33:17.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.664+0000 7f39a9015640 1 -- 172.21.15.44:0/1464929235 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39a40ba220 con 0x7f39a40bf050 2024-05-16T22:33:17.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.664+0000 7f399b7fe640 1 -- 172.21.15.44:0/1464929235 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f398c007310 con 0x7f39a40bf050 2024-05-16T22:33:17.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.665+0000 7f39a9015640 1 -- 172.21.15.44:0/1464929235 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39a41e4c70 con 0x7f39a40bf050 2024-05-16T22:33:17.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.666+0000 7f39a9015640 1 -- 172.21.15.44:0/1464929235 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39a40c10e0 con 0x7f39a40bf050 2024-05-16T22:33:17.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.666+0000 7f399b7fe640 1 -- 172.21.15.44:0/1464929235 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f398c01a070 con 0x7f39a40bf050 2024-05-16T22:33:17.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.667+0000 7f399b7fe640 1 --2- 172.21.15.44:0/1464929235 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f39840762d0 0x7f39840787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:17.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.667+0000 7f399b7fe640 1 -- 172.21.15.44:0/1464929235 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f398c096940 con 0x7f39a40bf050 2024-05-16T22:33:17.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.667+0000 7f39a2d9d640 1 --2- 172.21.15.44:0/1464929235 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f39840762d0 0x7f39840787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:17.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.668+0000 7f39a2d9d640 1 --2- 172.21.15.44:0/1464929235 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f39840762d0 0x7f39840787e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f399c034000 tx=0x7f399c02e000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:17.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.672+0000 7f399b7fe640 1 -- 172.21.15.44:0/1464929235 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f39a40c10e0 con 0x7f39a40bf050 2024-05-16T22:33:17.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.865+0000 7f39a9015640 1 -- 172.21.15.44:0/1464929235 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f39a4050940 con 0x7f39a40bf050 2024-05-16T22:33:17.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.866+0000 7f399b7fe640 1 -- 172.21.15.44:0/1464929235 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) ==== 74+0+16577 (secure 0 0 0) 0x7f398c0602a0 con 0x7f39a40bf050 2024-05-16T22:33:17.660 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:33:17.726 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":48,"fsid":"572ab7cc-b103-4548-ae8f-c6614d57f0c8","created":"2024-05-16T22:27:02.216874+0000","modified":"2024-05-16T22:33:10.855231+0000","last_up_change":"2024-05-16T22:27:13.693953+0000","last_in_change":"2024-05-16T22:27:04.455119+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-16T22:27:14.562409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-05-16T22:33:02.085011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-05-16T22:33:06.543396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a7003e89-c706-4562-9f25-670bb35ae108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6825","nonce":1074109859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6827","nonce":1074109859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6831","nonce":1074109859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6829","nonce":1074109859}]},"public_addr":"172.21.15.44:6825/1074109859","cluster_addr":"172.21.15.44:6827/1074109859","heartbeat_back_addr":"172.21.15.44:6831/1074109859","heartbeat_front_addr":"172.21.15.44:6829/1074109859","state":["exists","up"]},{"osd":1,"uuid":"a4d5169d-8327-4494-9c7c-58db21b00636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6817","nonce":2909429972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6819","nonce":2909429972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6823","nonce":2909429972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6821","nonce":2909429972}]},"public_addr":"172.21.15.44:6817/2909429972","cluster_addr":"172.21.15.44:6819/2909429972","heartbeat_back_addr":"172.21.15.44:6823/2909429972","heartbeat_front_addr":"172.21.15.44:6821/2909429972","state":["exists","up"]},{"osd":2,"uuid":"d4a834f8-83a5-400f-9814-eb0a25124df4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6801","nonce":2908194156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6803","nonce":2908194156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6807","nonce":2908194156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6805","nonce":2908194156}]},"public_addr":"172.21.15.44:6801/2908194156","cluster_addr":"172.21.15.44:6803/2908194156","heartbeat_back_addr":"172.21.15.44:6807/2908194156","heartbeat_front_addr":"172.21.15.44:6805/2908194156","state":["exists","up"]},{"osd":3,"uuid":"b9d24a56-ad43-4674-a395-5ec24d135ae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6809","nonce":2168695793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6811","nonce":2168695793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6815","nonce":2168695793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6813","nonce":2168695793}]},"public_addr":"172.21.15.44:6809/2168695793","cluster_addr":"172.21.15.44:6811/2168695793","heartbeat_back_addr":"172.21.15.44:6815/2168695793","heartbeat_front_addr":"172.21.15.44:6813/2168695793","state":["exists","up"]},{"osd":4,"uuid":"9bd94af5-3e17-4cbe-995a-8f837a66c653","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6823","nonce":1540297751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6825","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6827","nonce":1540297751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6831","nonce":1540297751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6829","nonce":1540297751}]},"public_addr":"172.21.15.70:6823/1540297751","cluster_addr":"172.21.15.70:6827/1540297751","heartbeat_back_addr":"172.21.15.70:6831/1540297751","heartbeat_front_addr":"172.21.15.70:6829/1540297751","state":["exists","up"]},{"osd":5,"uuid":"a5b0cfa5-b259-48bd-98b6-96b44f5ebabd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6804","nonce":4218901987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6808","nonce":4218901987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6815","nonce":4218901987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6812","nonce":4218901987}]},"public_addr":"172.21.15.70:6804/4218901987","cluster_addr":"172.21.15.70:6808/4218901987","heartbeat_back_addr":"172.21.15.70:6815/4218901987","heartbeat_front_addr":"172.21.15.70:6812/4218901987","state":["exists","up"]},{"osd":6,"uuid":"0b6af6df-1358-4fc6-a62c-ba57e02914ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6801","nonce":2389556489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6805","nonce":2389556489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6813","nonce":2389556489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6807","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6809","nonce":2389556489}]},"public_addr":"172.21.15.70:6801/2389556489","cluster_addr":"172.21.15.70:6805/2389556489","heartbeat_back_addr":"172.21.15.70:6813/2389556489","heartbeat_front_addr":"172.21.15.70:6809/2389556489","state":["exists","up"]},{"osd":7,"uuid":"eb1a2c5d-42cf-47d0-9e03-b9d26944a589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6817","nonce":3619691281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6819","nonce":3619691281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6826","nonce":3619691281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6822","nonce":3619691281}]},"public_addr":"172.21.15.70:6817/3619691281","cluster_addr":"172.21.15.70:6819/3619691281","heartbeat_back_addr":"172.21.15.70:6826/3619691281","heartbeat_front_addr":"172.21.15.70:6822/3619691281","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.652256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.613348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.528454+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.625204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.678845+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.680829+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.556200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.647030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T22:33:17.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.868+0000 7f39a9015640 1 -- 172.21.15.44:0/1464929235 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f39840762d0 msgr2=0x7f39840787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:17.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.868+0000 7f39a9015640 1 --2- 172.21.15.44:0/1464929235 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f39840762d0 0x7f39840787e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f399c034000 tx=0x7f399c02e000 comp rx=0 tx=0).stop 2024-05-16T22:33:17.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.868+0000 7f39a9015640 1 -- 172.21.15.44:0/1464929235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39a40bf050 msgr2=0x7f39a41d79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:17.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.868+0000 7f39a9015640 1 --2- 172.21.15.44:0/1464929235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39a40bf050 0x7f39a41d79e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f398c00c310 tx=0x7f398c00c7d0 comp rx=0 tx=0).stop 2024-05-16T22:33:17.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.868+0000 7f39a9015640 1 -- 172.21.15.44:0/1464929235 shutdown_connections 2024-05-16T22:33:18.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.868+0000 7f39a9015640 1 --2- 172.21.15.44:0/1464929235 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f39840762d0 0x7f39840787e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:18.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.868+0000 7f39a9015640 1 --2- 172.21.15.44:0/1464929235 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f39a4151fc0 0x7f39a414e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:18.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.868+0000 7f39a9015640 1 --2- 172.21.15.44:0/1464929235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39a40bf050 0x7f39a41d79e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:18.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.868+0000 7f39a9015640 1 --2- 172.21.15.44:0/1464929235 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f39a406da30 0x7f39a41d8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:18.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.868+0000 7f39a9015640 1 -- 172.21.15.44:0/1464929235 >> 172.21.15.44:0/1464929235 conn(0x7f39a40c3d20 msgr2=0x7f39a40c09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:33:18.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.868+0000 7f39a9015640 1 -- 172.21.15.44:0/1464929235 shutdown_connections 2024-05-16T22:33:18.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:14.868+0000 7f39a9015640 1 -- 172.21.15.44:0/1464929235 wait complete. 2024-05-16T22:33:18.385 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-16T22:33:18.435 INFO:tasks.ceph.mds.a.smithi044.stderr:2024-05-16T22:33:15.722+0000 7ff3d61fc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-16T22:33:18.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.610+0000 7f1caee1e640 1 Processor -- start 2024-05-16T22:33:18.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.610+0000 7f1caee1e640 1 -- start start 2024-05-16T22:33:18.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.611+0000 7f1caee1e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1ca80b4eb0 0x7f1ca806f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:18.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.611+0000 7f1caee1e640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ca80b52c0 con 0x7f1ca814ee30 2024-05-16T22:33:18.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.611+0000 7f1caee1e640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ca80bb0e0 con 0x7f1ca80b4aa0 2024-05-16T22:33:18.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.611+0000 7f1caee1e640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f1ca8071f40 con 0x7f1ca80b4eb0 2024-05-16T22:33:18.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.611+0000 7f1cad3bb640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f1ca814ee30 0x7f1ca81559e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:33192/0 (socket says 172.21.15.44:33192) 2024-05-16T22:33:18.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.611+0000 7f1cad3bb640 1 -- 172.21.15.44:0/3735475645 learned_addr learned my addr 172.21.15.44:0/3735475645 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:33:19.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.611+0000 7f1ca7fff640 1 --2- 172.21.15.44:0/3735475645 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1ca80b4eb0 0x7f1ca806f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:19.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.612+0000 7f1ca77fe640 1 -- 172.21.15.44:0/3735475645 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 974710459 0 0) 0x7f1ca80b52c0 con 0x7f1ca814ee30 2024-05-16T22:33:19.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.612+0000 7f1ca77fe640 1 -- 172.21.15.44:0/3735475645 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c98003520 con 0x7f1ca814ee30 2024-05-16T22:33:19.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.612+0000 7f1ca77fe640 1 -- 172.21.15.44:0/3735475645 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2378189861 0 0) 0x7f1ca80bb0e0 con 0x7f1ca80b4aa0 2024-05-16T22:33:19.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.612+0000 7f1ca77fe640 1 -- 172.21.15.44:0/3735475645 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ca80b52c0 con 0x7f1ca80b4aa0 2024-05-16T22:33:19.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.612+0000 7f1ca7fff640 1 -- 172.21.15.44:0/3735475645 >> v1:172.21.15.70:6789/0 conn(0x7f1ca80b4aa0 legacy=0x7f1ca814e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:19.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.612+0000 7f1ca77fe640 1 -- 172.21.15.44:0/3735475645 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1956632124 0 0) 0x7f1c98003520 con 0x7f1ca814ee30 2024-05-16T22:33:19.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.612+0000 7f1ca7fff640 1 -- 172.21.15.44:0/3735475645 >> v1:172.21.15.44:6789/0 conn(0x7f1ca814ee30 legacy=0x7f1ca81559e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:19.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.612+0000 7f1ca7fff640 1 -- 172.21.15.44:0/3735475645 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ca80bab60 con 0x7f1ca80b4eb0 2024-05-16T22:33:19.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.613+0000 7f1ca7fff640 1 --2- 172.21.15.44:0/3735475645 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1ca80b4eb0 0x7f1ca806f7c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1c9400a970 tx=0x7f1c9402b4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1694531fed69c010 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:19.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.613+0000 7f1ca77fe640 1 -- 172.21.15.44:0/3735475645 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca0001a70 con 0x7f1ca80b4eb0 2024-05-16T22:33:19.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.613+0000 7f1ca77fe640 1 -- 172.21.15.44:0/3735475645 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c94030510 con 0x7f1ca80b4eb0 2024-05-16T22:33:19.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.613+0000 7f1ca77fe640 1 -- 172.21.15.44:0/3735475645 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9400b040 con 0x7f1ca80b4eb0 2024-05-16T22:33:19.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.614+0000 7f1caee1e640 1 -- 172.21.15.44:0/3735475645 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1ca80b4eb0 msgr2=0x7f1ca806f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:19.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.614+0000 7f1caee1e640 1 --2- 172.21.15.44:0/3735475645 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1ca80b4eb0 0x7f1ca806f7c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1c9400a970 tx=0x7f1c9402b4c0 comp rx=0 tx=0).stop 2024-05-16T22:33:19.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.614+0000 7f1caee1e640 1 -- 172.21.15.44:0/3735475645 shutdown_connections 2024-05-16T22:33:19.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.614+0000 7f1caee1e640 1 --2- 172.21.15.44:0/3735475645 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1ca80b4eb0 0x7f1ca806f7c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:19.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.614+0000 7f1caee1e640 1 -- 172.21.15.44:0/3735475645 >> 172.21.15.44:0/3735475645 conn(0x7f1ca80a1ac0 msgr2=0x7f1ca80bbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:33:19.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.614+0000 7f1caee1e640 1 -- 172.21.15.44:0/3735475645 shutdown_connections 2024-05-16T22:33:20.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.614+0000 7f1caee1e640 1 -- 172.21.15.44:0/3735475645 wait complete. 2024-05-16T22:33:20.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.615+0000 7f1caee1e640 1 Processor -- start 2024-05-16T22:33:20.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.615+0000 7f1caee1e640 1 -- start start 2024-05-16T22:33:20.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.616+0000 7f1caee1e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1ca80b4aa0 0x7f1ca81e2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:20.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.616+0000 7f1caee1e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ca80b4eb0 0x7f1ca8148750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:20.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.616+0000 7f1caee1e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ca814ee30 0x7f1ca813d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:20.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.616+0000 7f1caee1e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca80b9ee0 con 0x7f1ca814ee30 2024-05-16T22:33:20.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.616+0000 7f1caee1e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca80ba060 con 0x7f1ca80b4eb0 2024-05-16T22:33:20.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.616+0000 7f1caee1e640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f1ca806fd00 con 0x7f1ca80b4aa0 2024-05-16T22:33:20.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.617+0000 7f1cad3bb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ca814ee30 0x7f1ca813d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:20.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.617+0000 7f1cad3bb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ca814ee30 0x7f1ca813d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47548/0 (socket says 172.21.15.44:47548) 2024-05-16T22:33:20.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.617+0000 7f1cad3bb640 1 -- 172.21.15.44:0/2201403944 learned_addr learned my addr 172.21.15.44:0/2201403944 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:33:20.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.617+0000 7f1ca7fff640 1 --2- 172.21.15.44:0/2201403944 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ca80b4eb0 0x7f1ca8148750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:20.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.617+0000 7f1cacbba640 1 --2- 172.21.15.44:0/2201403944 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1ca80b4aa0 0x7f1ca81e2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:20.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.617+0000 7f1cad3bb640 1 -- 172.21.15.44:0/2201403944 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1ca80b4aa0 msgr2=0x7f1ca81e2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:20.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.617+0000 7f1cad3bb640 1 --2- 172.21.15.44:0/2201403944 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1ca80b4aa0 0x7f1ca81e2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:20.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.617+0000 7f1cad3bb640 1 -- 172.21.15.44:0/2201403944 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ca80b4eb0 msgr2=0x7f1ca8148750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:20.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.617+0000 7f1cad3bb640 1 --2- 172.21.15.44:0/2201403944 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ca80b4eb0 0x7f1ca8148750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:20.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.617+0000 7f1cad3bb640 1 -- 172.21.15.44:0/2201403944 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ca8148c90 con 0x7f1ca814ee30 2024-05-16T22:33:20.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.617+0000 7f1ca7fff640 1 --2- 172.21.15.44:0/2201403944 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ca80b4eb0 0x7f1ca8148750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:33:21.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.617+0000 7f1cad3bb640 1 --2- 172.21.15.44:0/2201403944 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ca814ee30 0x7f1ca813d770 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1ca000cb30 tx=0x7f1ca000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:21.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.617+0000 7f1ca57fa640 1 -- 172.21.15.44:0/2201403944 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca0017070 con 0x7f1ca814ee30 2024-05-16T22:33:21.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.617+0000 7f1ca57fa640 1 -- 172.21.15.44:0/2201403944 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ca000aca0 con 0x7f1ca814ee30 2024-05-16T22:33:21.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.617+0000 7f1caee1e640 1 -- 172.21.15.44:0/2201403944 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ca8145cd0 con 0x7f1ca814ee30 2024-05-16T22:33:21.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.617+0000 7f1ca57fa640 1 -- 172.21.15.44:0/2201403944 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca0012640 con 0x7f1ca814ee30 2024-05-16T22:33:21.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.617+0000 7f1caee1e640 1 -- 172.21.15.44:0/2201403944 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ca8141f80 con 0x7f1ca814ee30 2024-05-16T22:33:21.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.618+0000 7f1caee1e640 1 -- 172.21.15.44:0/2201403944 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ca81415e0 con 0x7f1ca814ee30 2024-05-16T22:33:21.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.619+0000 7f1ca57fa640 1 -- 172.21.15.44:0/2201403944 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1ca001a070 con 0x7f1ca814ee30 2024-05-16T22:33:21.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.619+0000 7f1ca57fa640 1 --2- 172.21.15.44:0/2201403944 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f1c8c0762d0 0x7f1c8c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:21.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.620+0000 7f1ca57fa640 1 -- 172.21.15.44:0/2201403944 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f1ca00973a0 con 0x7f1ca814ee30 2024-05-16T22:33:21.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.620+0000 7f1cacbba640 1 --2- 172.21.15.44:0/2201403944 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f1c8c0762d0 0x7f1c8c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:21.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.620+0000 7f1cacbba640 1 --2- 172.21.15.44:0/2201403944 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f1c8c0762d0 0x7f1c8c0787e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c001120 tx=0x7f1c9c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:21.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.624+0000 7f1ca57fa640 1 -- 172.21.15.44:0/2201403944 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1ca0060d90 con 0x7f1ca814ee30 2024-05-16T22:33:21.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.818+0000 7f1caee1e640 1 -- 172.21.15.44:0/2201403944 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1ca806d3c0 con 0x7f1ca814ee30 2024-05-16T22:33:21.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.819+0000 7f1ca57fa640 1 -- 172.21.15.44:0/2201403944 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) ==== 74+0+16577 (secure 0 0 0) 0x7f1ca0060690 con 0x7f1ca814ee30 2024-05-16T22:33:21.812 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:33:21.861 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":48,"fsid":"572ab7cc-b103-4548-ae8f-c6614d57f0c8","created":"2024-05-16T22:27:02.216874+0000","modified":"2024-05-16T22:33:10.855231+0000","last_up_change":"2024-05-16T22:27:13.693953+0000","last_in_change":"2024-05-16T22:27:04.455119+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-16T22:27:14.562409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-05-16T22:33:02.085011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-05-16T22:33:06.543396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a7003e89-c706-4562-9f25-670bb35ae108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6825","nonce":1074109859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6827","nonce":1074109859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6831","nonce":1074109859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6829","nonce":1074109859}]},"public_addr":"172.21.15.44:6825/1074109859","cluster_addr":"172.21.15.44:6827/1074109859","heartbeat_back_addr":"172.21.15.44:6831/1074109859","heartbeat_front_addr":"172.21.15.44:6829/1074109859","state":["exists","up"]},{"osd":1,"uuid":"a4d5169d-8327-4494-9c7c-58db21b00636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6817","nonce":2909429972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6819","nonce":2909429972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6823","nonce":2909429972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6821","nonce":2909429972}]},"public_addr":"172.21.15.44:6817/2909429972","cluster_addr":"172.21.15.44:6819/2909429972","heartbeat_back_addr":"172.21.15.44:6823/2909429972","heartbeat_front_addr":"172.21.15.44:6821/2909429972","state":["exists","up"]},{"osd":2,"uuid":"d4a834f8-83a5-400f-9814-eb0a25124df4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6801","nonce":2908194156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6803","nonce":2908194156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6807","nonce":2908194156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6805","nonce":2908194156}]},"public_addr":"172.21.15.44:6801/2908194156","cluster_addr":"172.21.15.44:6803/2908194156","heartbeat_back_addr":"172.21.15.44:6807/2908194156","heartbeat_front_addr":"172.21.15.44:6805/2908194156","state":["exists","up"]},{"osd":3,"uuid":"b9d24a56-ad43-4674-a395-5ec24d135ae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6809","nonce":2168695793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6811","nonce":2168695793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6815","nonce":2168695793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6813","nonce":2168695793}]},"public_addr":"172.21.15.44:6809/2168695793","cluster_addr":"172.21.15.44:6811/2168695793","heartbeat_back_addr":"172.21.15.44:6815/2168695793","heartbeat_front_addr":"172.21.15.44:6813/2168695793","state":["exists","up"]},{"osd":4,"uuid":"9bd94af5-3e17-4cbe-995a-8f837a66c653","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6823","nonce":1540297751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6825","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6827","nonce":1540297751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6831","nonce":1540297751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6829","nonce":1540297751}]},"public_addr":"172.21.15.70:6823/1540297751","cluster_addr":"172.21.15.70:6827/1540297751","heartbeat_back_addr":"172.21.15.70:6831/1540297751","heartbeat_front_addr":"172.21.15.70:6829/1540297751","state":["exists","up"]},{"osd":5,"uuid":"a5b0cfa5-b259-48bd-98b6-96b44f5ebabd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6804","nonce":4218901987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6808","nonce":4218901987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6815","nonce":4218901987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6812","nonce":4218901987}]},"public_addr":"172.21.15.70:6804/4218901987","cluster_addr":"172.21.15.70:6808/4218901987","heartbeat_back_addr":"172.21.15.70:6815/4218901987","heartbeat_front_addr":"172.21.15.70:6812/4218901987","state":["exists","up"]},{"osd":6,"uuid":"0b6af6df-1358-4fc6-a62c-ba57e02914ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6801","nonce":2389556489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6805","nonce":2389556489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6813","nonce":2389556489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6807","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6809","nonce":2389556489}]},"public_addr":"172.21.15.70:6801/2389556489","cluster_addr":"172.21.15.70:6805/2389556489","heartbeat_back_addr":"172.21.15.70:6813/2389556489","heartbeat_front_addr":"172.21.15.70:6809/2389556489","state":["exists","up"]},{"osd":7,"uuid":"eb1a2c5d-42cf-47d0-9e03-b9d26944a589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6817","nonce":3619691281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6819","nonce":3619691281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6826","nonce":3619691281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6822","nonce":3619691281}]},"public_addr":"172.21.15.70:6817/3619691281","cluster_addr":"172.21.15.70:6819/3619691281","heartbeat_back_addr":"172.21.15.70:6826/3619691281","heartbeat_front_addr":"172.21.15.70:6822/3619691281","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.652256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.613348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.528454+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.625204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.678845+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.680829+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.556200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.647030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T22:33:21.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.822+0000 7f1caee1e640 1 -- 172.21.15.44:0/2201403944 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f1c8c0762d0 msgr2=0x7f1c8c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:21.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.822+0000 7f1caee1e640 1 --2- 172.21.15.44:0/2201403944 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f1c8c0762d0 0x7f1c8c0787e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c001120 tx=0x7f1c9c009040 comp rx=0 tx=0).stop 2024-05-16T22:33:22.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.822+0000 7f1caee1e640 1 -- 172.21.15.44:0/2201403944 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ca814ee30 msgr2=0x7f1ca813d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:22.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.822+0000 7f1caee1e640 1 --2- 172.21.15.44:0/2201403944 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ca814ee30 0x7f1ca813d770 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1ca000cb30 tx=0x7f1ca000a060 comp rx=0 tx=0).stop 2024-05-16T22:33:22.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.822+0000 7f1caee1e640 1 -- 172.21.15.44:0/2201403944 shutdown_connections 2024-05-16T22:33:22.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.822+0000 7f1caee1e640 1 --2- 172.21.15.44:0/2201403944 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f1c8c0762d0 0x7f1c8c0787e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:22.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.822+0000 7f1caee1e640 1 --2- 172.21.15.44:0/2201403944 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ca814ee30 0x7f1ca813d770 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:22.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.822+0000 7f1caee1e640 1 --2- 172.21.15.44:0/2201403944 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ca80b4eb0 0x7f1ca8148750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:22.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.822+0000 7f1caee1e640 1 --2- 172.21.15.44:0/2201403944 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1ca80b4aa0 0x7f1ca81e2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:22.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.822+0000 7f1caee1e640 1 -- 172.21.15.44:0/2201403944 >> 172.21.15.44:0/2201403944 conn(0x7f1ca80a1ac0 msgr2=0x7f1ca8149ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:33:22.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.822+0000 7f1caee1e640 1 -- 172.21.15.44:0/2201403944 shutdown_connections 2024-05-16T22:33:22.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:18.822+0000 7f1caee1e640 1 -- 172.21.15.44:0/2201403944 wait complete. 2024-05-16T22:33:22.537 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-16T22:33:22.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.716+0000 7fc0fe3b7640 1 Processor -- start 2024-05-16T22:33:22.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.716+0000 7fc0fe3b7640 1 -- start start 2024-05-16T22:33:22.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.718+0000 7fc0fe3b7640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc0f814e360 0x7fc0f81522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:22.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.718+0000 7fc0fe3b7640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc0f80bf9b0 0x7fc0f80bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:22.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.718+0000 7fc0fe3b7640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0f80c1390 con 0x7fc0f8148770 2024-05-16T22:33:22.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.718+0000 7fc0fe3b7640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fc0f8151e40 con 0x7fc0f814e360 2024-05-16T22:33:23.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.718+0000 7fc0fe3b7640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fc0f80c0620 con 0x7fc0f80bf9b0 2024-05-16T22:33:23.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.718+0000 7fc0f7fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc0f814e360 0x7fc0f81522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:23.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.718+0000 7fc0f7fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc0f814e360 0x7fc0f81522d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49068/0 (socket says 172.21.15.44:49068) 2024-05-16T22:33:23.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.718+0000 7fc0f7fff640 1 -- 172.21.15.44:0/2163275740 learned_addr learned my addr 172.21.15.44:0/2163275740 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:33:23.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.718+0000 7fc0fc954640 1 --2- 172.21.15.44:0/2163275740 >> v2:172.21.15.70:3300/0 conn(0x7fc0f80bf9b0 0x7fc0f80bfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:23.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.718+0000 7fc0f7fff640 1 -- 172.21.15.44:0/2163275740 >> v2:172.21.15.70:3300/0 conn(0x7fc0f80bf9b0 msgr2=0x7fc0f80bfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:33:23.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.718+0000 7fc0f7fff640 1 --2- 172.21.15.44:0/2163275740 >> v2:172.21.15.70:3300/0 conn(0x7fc0f80bf9b0 0x7fc0f80bfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:23.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.718+0000 7fc0f7fff640 1 -- 172.21.15.44:0/2163275740 >> v1:172.21.15.44:6789/0 conn(0x7fc0f8148770 legacy=0x7fc0f80c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:23.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.718+0000 7fc0f7fff640 1 -- 172.21.15.44:0/2163275740 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0f8151ad0 con 0x7fc0f814e360 2024-05-16T22:33:23.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.718+0000 7fc0f6ffd640 1 -- 172.21.15.44:0/2163275740 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 722969447 0 0) 0x7fc0ec001110 con 0x7fc0f8148770 2024-05-16T22:33:23.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.719+0000 7fc0f7fff640 1 --2- 172.21.15.44:0/2163275740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0f814e360 0x7fc0f81522d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8009870 tx=0x7fc0e802a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=686d91874125d962 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:23.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.719+0000 7fc0f6ffd640 1 -- 172.21.15.44:0/2163275740 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0e8037070 con 0x7fc0f814e360 2024-05-16T22:33:23.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.719+0000 7fc0f6ffd640 1 -- 172.21.15.44:0/2163275740 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0e8032640 con 0x7fc0f814e360 2024-05-16T22:33:23.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.719+0000 7fc0f6ffd640 1 -- 172.21.15.44:0/2163275740 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0e8032a10 con 0x7fc0f814e360 2024-05-16T22:33:23.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.720+0000 7fc0fe3b7640 1 -- 172.21.15.44:0/2163275740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0f814e360 msgr2=0x7fc0f81522d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:23.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.720+0000 7fc0fe3b7640 1 --2- 172.21.15.44:0/2163275740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0f814e360 0x7fc0f81522d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8009870 tx=0x7fc0e802a330 comp rx=0 tx=0).stop 2024-05-16T22:33:23.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.720+0000 7fc0fe3b7640 1 -- 172.21.15.44:0/2163275740 shutdown_connections 2024-05-16T22:33:23.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.720+0000 7fc0fe3b7640 1 --2- 172.21.15.44:0/2163275740 >> v2:172.21.15.70:3300/0 conn(0x7fc0f80bf9b0 0x7fc0f80bfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:23.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.720+0000 7fc0fe3b7640 1 --2- 172.21.15.44:0/2163275740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0f814e360 0x7fc0f81522d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:24.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.720+0000 7fc0fe3b7640 1 -- 172.21.15.44:0/2163275740 >> 172.21.15.44:0/2163275740 conn(0x7fc0f80c17c0 msgr2=0x7fc0f80c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:33:24.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.720+0000 7fc0fe3b7640 1 -- 172.21.15.44:0/2163275740 shutdown_connections 2024-05-16T22:33:24.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.720+0000 7fc0fe3b7640 1 -- 172.21.15.44:0/2163275740 wait complete. 2024-05-16T22:33:24.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.721+0000 7fc0fe3b7640 1 Processor -- start 2024-05-16T22:33:24.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.722+0000 7fc0fe3b7640 1 -- start start 2024-05-16T22:33:24.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.723+0000 7fc0fe3b7640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc0f80bf9b0 0x7fc0f81e4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:24.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.723+0000 7fc0fe3b7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc0f8148770 0x7fc0f806e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:24.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.723+0000 7fc0fe3b7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0f814e360 0x7fc0f814d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:24.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.723+0000 7fc0fe3b7640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f8158cc0 con 0x7fc0f814e360 2024-05-16T22:33:24.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.723+0000 7fc0fe3b7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f80c0300 con 0x7fc0f8148770 2024-05-16T22:33:24.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.723+0000 7fc0fe3b7640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fc0f8158e40 con 0x7fc0f80bf9b0 2024-05-16T22:33:24.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.723+0000 7fc0fc954640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0f814e360 0x7fc0f814d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:24.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.723+0000 7fc0fc954640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0f814e360 0x7fc0f814d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49076/0 (socket says 172.21.15.44:49076) 2024-05-16T22:33:24.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.723+0000 7fc0fc954640 1 -- 172.21.15.44:0/2689901439 learned_addr learned my addr 172.21.15.44:0/2689901439 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:33:24.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.723+0000 7fc0f7fff640 1 --2- 172.21.15.44:0/2689901439 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc0f80bf9b0 0x7fc0f81e4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:24.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.723+0000 7fc0f77fe640 1 --2- 172.21.15.44:0/2689901439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc0f8148770 0x7fc0f806e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:24.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.723+0000 7fc0fc954640 1 -- 172.21.15.44:0/2689901439 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc0f80bf9b0 msgr2=0x7fc0f81e4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:24.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.723+0000 7fc0fc954640 1 --2- 172.21.15.44:0/2689901439 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc0f80bf9b0 0x7fc0f81e4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:25.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.723+0000 7fc0fc954640 1 -- 172.21.15.44:0/2689901439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc0f8148770 msgr2=0x7fc0f806e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:25.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.723+0000 7fc0fc954640 1 --2- 172.21.15.44:0/2689901439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc0f8148770 0x7fc0f806e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:25.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.723+0000 7fc0fc954640 1 -- 172.21.15.44:0/2689901439 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0f81e7c20 con 0x7fc0f814e360 2024-05-16T22:33:25.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.723+0000 7fc0f77fe640 1 --2- 172.21.15.44:0/2689901439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc0f8148770 0x7fc0f806e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:33:25.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.723+0000 7fc0fc954640 1 --2- 172.21.15.44:0/2689901439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0f814e360 0x7fc0f814d770 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0009cb0 tx=0x7fc0f000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:25.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.724+0000 7fc0f4ff9640 1 -- 172.21.15.44:0/2689901439 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0018020 con 0x7fc0f814e360 2024-05-16T22:33:25.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.724+0000 7fc0f4ff9640 1 -- 172.21.15.44:0/2689901439 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0f0014480 con 0x7fc0f814e360 2024-05-16T22:33:25.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.724+0000 7fc0f4ff9640 1 -- 172.21.15.44:0/2689901439 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0014870 con 0x7fc0f814e360 2024-05-16T22:33:25.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.724+0000 7fc0fe3b7640 1 -- 172.21.15.44:0/2689901439 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0f81e7f00 con 0x7fc0f814e360 2024-05-16T22:33:25.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.724+0000 7fc0fe3b7640 1 -- 172.21.15.44:0/2689901439 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0f81e84c0 con 0x7fc0f814e360 2024-05-16T22:33:25.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.725+0000 7fc0fe3b7640 1 -- 172.21.15.44:0/2689901439 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0f8050940 con 0x7fc0f814e360 2024-05-16T22:33:25.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.726+0000 7fc0f4ff9640 1 -- 172.21.15.44:0/2689901439 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc0f0005d10 con 0x7fc0f814e360 2024-05-16T22:33:25.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.726+0000 7fc0f4ff9640 1 --2- 172.21.15.44:0/2689901439 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fc0e4076300 0x7fc0e4078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:25.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.726+0000 7fc0f4ff9640 1 -- 172.21.15.44:0/2689901439 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7fc0f0098850 con 0x7fc0f814e360 2024-05-16T22:33:25.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.726+0000 7fc0f7fff640 1 --2- 172.21.15.44:0/2689901439 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fc0e4076300 0x7fc0e4078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:25.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.727+0000 7fc0f7fff640 1 --2- 172.21.15.44:0/2689901439 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fc0e4076300 0x7fc0e4078810 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8034000 tx=0x7fc0e802e000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:25.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.730+0000 7fc0f4ff9640 1 -- 172.21.15.44:0/2689901439 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc0f0022030 con 0x7fc0f814e360 2024-05-16T22:33:25.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:22.964+0000 7fc0fe3b7640 1 -- 172.21.15.44:0/2689901439 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc0f80bf790 con 0x7fc0f814e360 2024-05-16T22:33:25.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:23.818+0000 7fc0f4ff9640 1 -- 172.21.15.44:0/2689901439 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v25) ==== 118+0+0 (secure 0 0 0) 0x7fc0f0010040 con 0x7fc0f814e360 2024-05-16T22:33:25.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:23.820+0000 7fc0fe3b7640 1 -- 172.21.15.44:0/2689901439 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fc0e4076300 msgr2=0x7fc0e4078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:26.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:23.820+0000 7fc0fe3b7640 1 --2- 172.21.15.44:0/2689901439 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fc0e4076300 0x7fc0e4078810 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8034000 tx=0x7fc0e802e000 comp rx=0 tx=0).stop 2024-05-16T22:33:26.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:23.820+0000 7fc0fe3b7640 1 -- 172.21.15.44:0/2689901439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0f814e360 msgr2=0x7fc0f814d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:26.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:23.820+0000 7fc0fe3b7640 1 --2- 172.21.15.44:0/2689901439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0f814e360 0x7fc0f814d770 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0009cb0 tx=0x7fc0f000c490 comp rx=0 tx=0).stop 2024-05-16T22:33:26.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:23.821+0000 7fc0fe3b7640 1 -- 172.21.15.44:0/2689901439 shutdown_connections 2024-05-16T22:33:26.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:23.821+0000 7fc0fe3b7640 1 --2- 172.21.15.44:0/2689901439 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fc0e4076300 0x7fc0e4078810 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:26.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:23.821+0000 7fc0fe3b7640 1 --2- 172.21.15.44:0/2689901439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0f814e360 0x7fc0f814d770 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:26.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:23.821+0000 7fc0fe3b7640 1 --2- 172.21.15.44:0/2689901439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc0f8148770 0x7fc0f806e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:26.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:23.821+0000 7fc0fe3b7640 1 --2- 172.21.15.44:0/2689901439 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc0f80bf9b0 0x7fc0f81e4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:26.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:23.821+0000 7fc0fe3b7640 1 -- 172.21.15.44:0/2689901439 >> 172.21.15.44:0/2689901439 conn(0x7fc0f80c17c0 msgr2=0x7fc0f8140940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:33:26.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:23.821+0000 7fc0fe3b7640 1 -- 172.21.15.44:0/2689901439 shutdown_connections 2024-05-16T22:33:26.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:23.821+0000 7fc0fe3b7640 1 -- 172.21.15.44:0/2689901439 wait complete. 2024-05-16T22:33:26.648 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-16T22:33:26.698 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-16T22:33:26.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.878+0000 7f195a267640 1 Processor -- start 2024-05-16T22:33:26.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.878+0000 7f195a267640 1 -- start start 2024-05-16T22:33:26.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.879+0000 7f195a267640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f19540bb490 0x7f19540b5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:27.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.879+0000 7f195a267640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19540bba80 con 0x7f19540b4500 2024-05-16T22:33:27.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.879+0000 7f195a267640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19540bbd20 con 0x7f19540b9ee0 2024-05-16T22:33:27.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.879+0000 7f195a267640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f19540b4f60 con 0x7f19540bb490 2024-05-16T22:33:27.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.879+0000 7f1953fff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f19540b4500 0x7f195406faa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:35398/0 (socket says 172.21.15.44:35398) 2024-05-16T22:33:27.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.879+0000 7f1953fff640 1 -- 172.21.15.44:0/1461174309 learned_addr learned my addr 172.21.15.44:0/1461174309 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:33:27.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.879+0000 7f19537fe640 1 --2- 172.21.15.44:0/1461174309 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f19540bb490 0x7f19540b5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:27.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.880+0000 7f1952ffd640 1 -- 172.21.15.44:0/1461174309 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3967492076 0 0) 0x7f19540bba80 con 0x7f19540b4500 2024-05-16T22:33:27.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.880+0000 7f1952ffd640 1 -- 172.21.15.44:0/1461174309 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f193c003520 con 0x7f19540b4500 2024-05-16T22:33:27.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.880+0000 7f1952ffd640 1 -- 172.21.15.44:0/1461174309 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1078164459 0 0) 0x7f19540bbd20 con 0x7f19540b9ee0 2024-05-16T22:33:27.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.880+0000 7f1952ffd640 1 -- 172.21.15.44:0/1461174309 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f19540bba80 con 0x7f19540b9ee0 2024-05-16T22:33:27.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.880+0000 7f19537fe640 1 -- 172.21.15.44:0/1461174309 >> v1:172.21.15.70:6789/0 conn(0x7f19540b9ee0 legacy=0x7f19540a3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:27.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.880+0000 7f19537fe640 1 -- 172.21.15.44:0/1461174309 >> v1:172.21.15.44:6789/0 conn(0x7f19540b4500 legacy=0x7f195406faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:27.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.880+0000 7f19537fe640 1 -- 172.21.15.44:0/1461174309 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19540b5240 con 0x7f19540bb490 2024-05-16T22:33:27.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.881+0000 7f19537fe640 1 --2- 172.21.15.44:0/1461174309 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f19540bb490 0x7f19540b5760 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f19480097d0 tx=0x7f194802a290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=785d48b3872ca218 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:27.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.881+0000 7f1952ffd640 1 -- 172.21.15.44:0/1461174309 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1948037070 con 0x7f19540bb490 2024-05-16T22:33:27.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.881+0000 7f1952ffd640 1 -- 172.21.15.44:0/1461174309 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1948032440 con 0x7f19540bb490 2024-05-16T22:33:27.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.881+0000 7f1952ffd640 1 -- 172.21.15.44:0/1461174309 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19480327f0 con 0x7f19540bb490 2024-05-16T22:33:27.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.882+0000 7f195a267640 1 -- 172.21.15.44:0/1461174309 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f19540bb490 msgr2=0x7f19540b5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:28.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.882+0000 7f195a267640 1 --2- 172.21.15.44:0/1461174309 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f19540bb490 0x7f19540b5760 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f19480097d0 tx=0x7f194802a290 comp rx=0 tx=0).stop 2024-05-16T22:33:28.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.882+0000 7f195a267640 1 -- 172.21.15.44:0/1461174309 shutdown_connections 2024-05-16T22:33:28.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.882+0000 7f195a267640 1 --2- 172.21.15.44:0/1461174309 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f19540bb490 0x7f19540b5760 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:28.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.882+0000 7f195a267640 1 -- 172.21.15.44:0/1461174309 >> 172.21.15.44:0/1461174309 conn(0x7f19540a1ac0 msgr2=0x7f19540bbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:33:28.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.882+0000 7f195a267640 1 -- 172.21.15.44:0/1461174309 shutdown_connections 2024-05-16T22:33:28.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.882+0000 7f195a267640 1 -- 172.21.15.44:0/1461174309 wait complete. 2024-05-16T22:33:28.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.883+0000 7f195a267640 1 Processor -- start 2024-05-16T22:33:28.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.884+0000 7f195a267640 1 -- start start 2024-05-16T22:33:28.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.885+0000 7f195a267640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19540b4500 0x7f1954142210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:28.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.885+0000 7f195a267640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f19540b9ee0 0x7f1954145640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:28.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.885+0000 7f195a267640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f19540bb490 0x7f19541e8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:28.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.885+0000 7f195a267640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f19540a46e0 con 0x7f19540b4500 2024-05-16T22:33:28.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.885+0000 7f195a267640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f19540ba2f0 con 0x7f19540b9ee0 2024-05-16T22:33:28.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.885+0000 7f195a267640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f19540a4860 con 0x7f19540bb490 2024-05-16T22:33:28.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.885+0000 7f1953fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19540b4500 0x7f1954142210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:28.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.885+0000 7f1953fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19540b4500 0x7f1954142210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49082/0 (socket says 172.21.15.44:49082) 2024-05-16T22:33:28.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.885+0000 7f1953fff640 1 -- 172.21.15.44:0/1971456215 learned_addr learned my addr 172.21.15.44:0/1971456215 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:33:29.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.885+0000 7f1958804640 1 --2- 172.21.15.44:0/1971456215 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f19540bb490 0x7f19541e8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:29.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.885+0000 7f19537fe640 1 --2- 172.21.15.44:0/1971456215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f19540b9ee0 0x7f1954145640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:29.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.885+0000 7f1953fff640 1 -- 172.21.15.44:0/1971456215 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f19540bb490 msgr2=0x7f19541e8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:29.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.885+0000 7f1953fff640 1 --2- 172.21.15.44:0/1971456215 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f19540bb490 0x7f19541e8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:29.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.885+0000 7f1953fff640 1 -- 172.21.15.44:0/1971456215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f19540b9ee0 msgr2=0x7f1954145640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:29.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.885+0000 7f1953fff640 1 --2- 172.21.15.44:0/1971456215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f19540b9ee0 0x7f1954145640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:29.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.885+0000 7f1953fff640 1 -- 172.21.15.44:0/1971456215 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1954145b80 con 0x7f19540b4500 2024-05-16T22:33:29.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.885+0000 7f1958804640 1 --2- 172.21.15.44:0/1971456215 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f19540bb490 0x7f19541e8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:33:29.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.885+0000 7f19537fe640 1 --2- 172.21.15.44:0/1971456215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f19540b9ee0 0x7f1954145640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:33:29.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.885+0000 7f1953fff640 1 --2- 172.21.15.44:0/1971456215 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19540b4500 0x7f1954142210 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f194400c430 tx=0x7f194400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:29.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.885+0000 7f1950ff9640 1 -- 172.21.15.44:0/1971456215 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1944017070 con 0x7f19540b4500 2024-05-16T22:33:29.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.885+0000 7f1950ff9640 1 -- 172.21.15.44:0/1971456215 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1944005ce0 con 0x7f19540b4500 2024-05-16T22:33:29.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.885+0000 7f195a267640 1 -- 172.21.15.44:0/1971456215 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19541e8b90 con 0x7f19540b4500 2024-05-16T22:33:29.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.885+0000 7f1950ff9640 1 -- 172.21.15.44:0/1971456215 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19440072d0 con 0x7f19540b4500 2024-05-16T22:33:29.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.886+0000 7f195a267640 1 -- 172.21.15.44:0/1971456215 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19541e7e50 con 0x7f19540b4500 2024-05-16T22:33:29.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.886+0000 7f195a267640 1 -- 172.21.15.44:0/1971456215 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19540747e0 con 0x7f19540b4500 2024-05-16T22:33:29.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.887+0000 7f1950ff9640 1 -- 172.21.15.44:0/1971456215 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f194401a070 con 0x7f19540b4500 2024-05-16T22:33:29.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.888+0000 7f1950ff9640 1 --2- 172.21.15.44:0/1971456215 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f1940076300 0x7f1940078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:29.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.888+0000 7f1950ff9640 1 -- 172.21.15.44:0/1971456215 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f19440967c0 con 0x7f19540b4500 2024-05-16T22:33:30.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.888+0000 7f19537fe640 1 --2- 172.21.15.44:0/1971456215 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f1940076300 0x7f1940078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:30.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.889+0000 7f19537fe640 1 --2- 172.21.15.44:0/1971456215 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f1940076300 0x7f1940078810 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1948034000 tx=0x7f194802e000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:30.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:26.892+0000 7f1950ff9640 1 -- 172.21.15.44:0/1971456215 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f194405fb60 con 0x7f19540b4500 2024-05-16T22:33:30.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:27.121+0000 7f195a267640 1 -- 172.21.15.44:0/1971456215 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f19540bce70 con 0x7f19540b4500 2024-05-16T22:33:30.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:27.832+0000 7f1950ff9640 1 -- 172.21.15.44:0/1971456215 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v26) ==== 122+0+0 (secure 0 0 0) 0x7f1944063e60 con 0x7f19540b4500 2024-05-16T22:33:30.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:27.835+0000 7f195a267640 1 -- 172.21.15.44:0/1971456215 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f1940076300 msgr2=0x7f1940078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:30.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:27.835+0000 7f195a267640 1 --2- 172.21.15.44:0/1971456215 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f1940076300 0x7f1940078810 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1948034000 tx=0x7f194802e000 comp rx=0 tx=0).stop 2024-05-16T22:33:30.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:27.835+0000 7f195a267640 1 -- 172.21.15.44:0/1971456215 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19540b4500 msgr2=0x7f1954142210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:30.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:27.835+0000 7f195a267640 1 --2- 172.21.15.44:0/1971456215 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19540b4500 0x7f1954142210 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f194400c430 tx=0x7f194400c8f0 comp rx=0 tx=0).stop 2024-05-16T22:33:30.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:27.835+0000 7f195a267640 1 -- 172.21.15.44:0/1971456215 shutdown_connections 2024-05-16T22:33:30.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:27.835+0000 7f195a267640 1 --2- 172.21.15.44:0/1971456215 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f1940076300 0x7f1940078810 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:30.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:27.835+0000 7f195a267640 1 --2- 172.21.15.44:0/1971456215 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f19540bb490 0x7f19541e8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:30.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:27.835+0000 7f195a267640 1 --2- 172.21.15.44:0/1971456215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f19540b9ee0 0x7f1954145640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:30.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:27.835+0000 7f195a267640 1 --2- 172.21.15.44:0/1971456215 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19540b4500 0x7f1954142210 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:30.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:27.835+0000 7f195a267640 1 -- 172.21.15.44:0/1971456215 >> 172.21.15.44:0/1971456215 conn(0x7f19540a1ac0 msgr2=0x7f195406faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:33:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:27.835+0000 7f195a267640 1 -- 172.21.15.44:0/1971456215 shutdown_connections 2024-05-16T22:33:30.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:27.835+0000 7f195a267640 1 -- 172.21.15.44:0/1971456215 wait complete. 2024-05-16T22:33:30.656 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-16T22:33:30.689 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T22:33:30.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.849+0000 7fa8468b6640 1 Processor -- start 2024-05-16T22:33:30.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.849+0000 7fa8468b6640 1 -- start start 2024-05-16T22:33:30.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.850+0000 7fa8468b6640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa8400bb940 0x7fa8401462b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:30.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.850+0000 7fa8468b6640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa84014fa20 0x7fa84014fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:31.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.850+0000 7fa8468b6640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8400a40b0 con 0x7fa8400a3bd0 2024-05-16T22:33:31.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.850+0000 7fa8468b6640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fa8400a49e0 con 0x7fa8400bb940 2024-05-16T22:33:31.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.850+0000 7fa8468b6640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fa8400a4390 con 0x7fa84014fa20 2024-05-16T22:33:31.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.850+0000 7fa83ffff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fa8400a3bd0 0x7fa8400bc8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:40242/0 (socket says 172.21.15.44:40242) 2024-05-16T22:33:31.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.850+0000 7fa83ffff640 1 -- 172.21.15.44:0/3917510144 learned_addr learned my addr 172.21.15.44:0/3917510144 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:33:31.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.851+0000 7fa844e53640 1 --2- 172.21.15.44:0/3917510144 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa84014fa20 0x7fa84014fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:31.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.851+0000 7fa83f7fe640 1 --2- 172.21.15.44:0/3917510144 >> v2:172.21.15.70:3300/0 conn(0x7fa8400bb940 0x7fa8401462b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:31.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.851+0000 7fa83effd640 1 -- 172.21.15.44:0/3917510144 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2545827840 0 0) 0x7fa8400a40b0 con 0x7fa8400a3bd0 2024-05-16T22:33:31.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.851+0000 7fa83effd640 1 -- 172.21.15.44:0/3917510144 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa828003520 con 0x7fa8400a3bd0 2024-05-16T22:33:31.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.851+0000 7fa844e53640 1 -- 172.21.15.44:0/3917510144 >> v2:172.21.15.70:3300/0 conn(0x7fa8400bb940 msgr2=0x7fa8401462b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:33:31.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.851+0000 7fa83effd640 1 -- 172.21.15.44:0/3917510144 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2368627979 0 0) 0x7fa828003520 con 0x7fa8400a3bd0 2024-05-16T22:33:31.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.851+0000 7fa844e53640 1 --2- 172.21.15.44:0/3917510144 >> v2:172.21.15.70:3300/0 conn(0x7fa8400bb940 0x7fa8401462b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:31.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.851+0000 7fa844e53640 1 -- 172.21.15.44:0/3917510144 >> v1:172.21.15.44:6789/0 conn(0x7fa8400a3bd0 legacy=0x7fa8400bc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:31.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.851+0000 7fa844e53640 1 -- 172.21.15.44:0/3917510144 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8400a4670 con 0x7fa84014fa20 2024-05-16T22:33:31.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.851+0000 7fa83f7fe640 1 --2- 172.21.15.44:0/3917510144 >> v2:172.21.15.70:3300/0 conn(0x7fa8400bb940 0x7fa8401462b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:33:31.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.852+0000 7fa844e53640 1 --2- 172.21.15.44:0/3917510144 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa84014fa20 0x7fa84014fe30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa838009d90 tx=0x7fa83802a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f375a37112a7dd87 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:31.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.852+0000 7fa83effd640 1 -- 172.21.15.44:0/3917510144 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8300016f0 con 0x7fa84014fa20 2024-05-16T22:33:31.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.852+0000 7fa83effd640 1 -- 172.21.15.44:0/3917510144 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa838007540 con 0x7fa84014fa20 2024-05-16T22:33:31.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.852+0000 7fa83effd640 1 -- 172.21.15.44:0/3917510144 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa838007910 con 0x7fa84014fa20 2024-05-16T22:33:31.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.853+0000 7fa8468b6640 1 -- 172.21.15.44:0/3917510144 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa84014fa20 msgr2=0x7fa84014fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:31.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.853+0000 7fa8468b6640 1 --2- 172.21.15.44:0/3917510144 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa84014fa20 0x7fa84014fe30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa838009d90 tx=0x7fa83802a5f0 comp rx=0 tx=0).stop 2024-05-16T22:33:31.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.853+0000 7fa8468b6640 1 -- 172.21.15.44:0/3917510144 shutdown_connections 2024-05-16T22:33:31.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.853+0000 7fa8468b6640 1 --2- 172.21.15.44:0/3917510144 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa84014fa20 0x7fa84014fe30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:31.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.853+0000 7fa8468b6640 1 --2- 172.21.15.44:0/3917510144 >> v2:172.21.15.70:3300/0 conn(0x7fa8400bb940 0x7fa8401462b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:31.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.853+0000 7fa8468b6640 1 -- 172.21.15.44:0/3917510144 >> 172.21.15.44:0/3917510144 conn(0x7fa8400a1ac0 msgr2=0x7fa8400bbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:33:31.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.853+0000 7fa8468b6640 1 -- 172.21.15.44:0/3917510144 shutdown_connections 2024-05-16T22:33:31.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.853+0000 7fa8468b6640 1 -- 172.21.15.44:0/3917510144 wait complete. 2024-05-16T22:33:31.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.854+0000 7fa8468b6640 1 Processor -- start 2024-05-16T22:33:32.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.855+0000 7fa8468b6640 1 -- start start 2024-05-16T22:33:32.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.856+0000 7fa8468b6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8400a3bd0 0x7fa8401d93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:32.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.856+0000 7fa8468b6640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa8400bb940 0x7fa8401e7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:32.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.856+0000 7fa8468b6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa84014fa20 0x7fa8401437b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:32.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.856+0000 7fa8468b6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa8400a28b0 con 0x7fa84014fa20 2024-05-16T22:33:32.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.856+0000 7fa8468b6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa8400bbe10 con 0x7fa8400a3bd0 2024-05-16T22:33:32.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.856+0000 7fa8468b6640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fa8400a2a30 con 0x7fa8400bb940 2024-05-16T22:33:32.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.856+0000 7fa844e53640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa84014fa20 0x7fa8401437b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:32.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.856+0000 7fa844e53640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa84014fa20 0x7fa8401437b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44750/0 (socket says 172.21.15.44:44750) 2024-05-16T22:33:32.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.856+0000 7fa844e53640 1 -- 172.21.15.44:0/4212333577 learned_addr learned my addr 172.21.15.44:0/4212333577 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:33:32.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.856+0000 7fa83ffff640 1 --2- 172.21.15.44:0/4212333577 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8400a3bd0 0x7fa8401d93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:32.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.856+0000 7fa83f7fe640 1 --2- 172.21.15.44:0/4212333577 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa8400bb940 0x7fa8401e7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:32.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.856+0000 7fa844e53640 1 -- 172.21.15.44:0/4212333577 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa8400bb940 msgr2=0x7fa8401e7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:32.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.856+0000 7fa844e53640 1 --2- 172.21.15.44:0/4212333577 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa8400bb940 0x7fa8401e7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:32.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.856+0000 7fa844e53640 1 -- 172.21.15.44:0/4212333577 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8400a3bd0 msgr2=0x7fa8401d93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:32.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.856+0000 7fa844e53640 1 --2- 172.21.15.44:0/4212333577 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8400a3bd0 0x7fa8401d93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:32.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.856+0000 7fa844e53640 1 -- 172.21.15.44:0/4212333577 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8401d9920 con 0x7fa84014fa20 2024-05-16T22:33:32.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.856+0000 7fa844e53640 1 --2- 172.21.15.44:0/4212333577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa84014fa20 0x7fa8401437b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa83802abe0 tx=0x7fa838004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:32.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.857+0000 7fa83cff9640 1 -- 172.21.15.44:0/4212333577 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa83803f070 con 0x7fa84014fa20 2024-05-16T22:33:32.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.857+0000 7fa83cff9640 1 -- 172.21.15.44:0/4212333577 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa838031c40 con 0x7fa84014fa20 2024-05-16T22:33:32.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.857+0000 7fa8468b6640 1 -- 172.21.15.44:0/4212333577 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8401e80e0 con 0x7fa84014fa20 2024-05-16T22:33:32.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.857+0000 7fa83cff9640 1 -- 172.21.15.44:0/4212333577 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa838009450 con 0x7fa84014fa20 2024-05-16T22:33:32.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.857+0000 7fa8468b6640 1 -- 172.21.15.44:0/4212333577 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8400b5970 con 0x7fa84014fa20 2024-05-16T22:33:32.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.858+0000 7fa8468b6640 1 -- 172.21.15.44:0/4212333577 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa840050940 con 0x7fa84014fa20 2024-05-16T22:33:32.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.858+0000 7fa83cff9640 1 -- 172.21.15.44:0/4212333577 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa83803b410 con 0x7fa84014fa20 2024-05-16T22:33:32.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.859+0000 7fa83cff9640 1 --2- 172.21.15.44:0/4212333577 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fa82c0762d0 0x7fa82c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:32.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.859+0000 7fa83cff9640 1 -- 172.21.15.44:0/4212333577 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7fa8380b88a0 con 0x7fa84014fa20 2024-05-16T22:33:33.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.859+0000 7fa83ffff640 1 --2- 172.21.15.44:0/4212333577 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fa82c0762d0 0x7fa82c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:33.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.860+0000 7fa83ffff640 1 --2- 172.21.15.44:0/4212333577 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fa82c0762d0 0x7fa82c0787e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa830005880 tx=0x7fa830001c10 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:33.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:30.864+0000 7fa83cff9640 1 -- 172.21.15.44:0/4212333577 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa838081b20 con 0x7fa84014fa20 2024-05-16T22:33:33.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:31.095+0000 7fa8468b6640 1 -- 172.21.15.44:0/4212333577 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa8400ba030 con 0x7fa84014fa20 2024-05-16T22:33:33.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:31.095+0000 7fa83cff9640 1 -- 172.21.15.44:0/4212333577 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+4347 (secure 0 0 0) 0x7fa838085e20 con 0x7fa84014fa20 2024-05-16T22:33:33.208 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:33:33.241 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4954,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2432336323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2432336323},{"type":"v1","addr":"172.21.15.70:6835","nonce":2432336323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4972,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/454770375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":454770375},{"type":"v1","addr":"172.21.15.44:6835","nonce":454770375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T22:33:10.855194+0000","modified":"2024-05-16T22:33:27.123137+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5043},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5043":{"gid":5043,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":8,"addr":"172.21.15.44:6834/97015923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":97015923},{"type":"v1","addr":"172.21.15.44:6834","nonce":97015923}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5043,"qdb_cluster":[5043]},"id":3}]} 2024-05-16T22:33:33.276 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 26 2024-05-16T22:33:33.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:31.098+0000 7fa8468b6640 1 -- 172.21.15.44:0/4212333577 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fa82c0762d0 msgr2=0x7fa82c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:33.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:31.098+0000 7fa8468b6640 1 --2- 172.21.15.44:0/4212333577 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fa82c0762d0 0x7fa82c0787e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa830005880 tx=0x7fa830001c10 comp rx=0 tx=0).stop 2024-05-16T22:33:33.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:31.098+0000 7fa8468b6640 1 -- 172.21.15.44:0/4212333577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa84014fa20 msgr2=0x7fa8401437b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:33.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:31.098+0000 7fa8468b6640 1 --2- 172.21.15.44:0/4212333577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa84014fa20 0x7fa8401437b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa83802abe0 tx=0x7fa838004a40 comp rx=0 tx=0).stop 2024-05-16T22:33:33.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:31.098+0000 7fa8468b6640 1 -- 172.21.15.44:0/4212333577 shutdown_connections 2024-05-16T22:33:33.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:31.098+0000 7fa8468b6640 1 --2- 172.21.15.44:0/4212333577 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fa82c0762d0 0x7fa82c0787e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:33.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:31.098+0000 7fa8468b6640 1 --2- 172.21.15.44:0/4212333577 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa8400bb940 0x7fa8401e7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:33.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:31.098+0000 7fa8468b6640 1 --2- 172.21.15.44:0/4212333577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa84014fa20 0x7fa8401437b0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:33.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:31.098+0000 7fa8468b6640 1 --2- 172.21.15.44:0/4212333577 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8400a3bd0 0x7fa8401d93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:33.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:31.098+0000 7fa8468b6640 1 -- 172.21.15.44:0/4212333577 >> 172.21.15.44:0/4212333577 conn(0x7fa8400a1ac0 msgr2=0x7fa84009fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:33:33.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:31.098+0000 7fa8468b6640 1 -- 172.21.15.44:0/4212333577 shutdown_connections 2024-05-16T22:33:33.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:31.098+0000 7fa8468b6640 1 -- 172.21.15.44:0/4212333577 wait complete. 2024-05-16T22:33:33.751 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-16T22:33:33.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.910+0000 7fa2f762b640 1 Processor -- start 2024-05-16T22:33:33.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.910+0000 7fa2f762b640 1 -- start start 2024-05-16T22:33:33.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.911+0000 7fa2f762b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa2f0148770 0x7fa2f00c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:34.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.911+0000 7fa2f762b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa2f00bf9b0 0x7fa2f00bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:34.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.911+0000 7fa2f762b640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2f00c0620 con 0x7fa2f014e360 2024-05-16T22:33:34.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.911+0000 7fa2f762b640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fa2f0151e40 con 0x7fa2f0148770 2024-05-16T22:33:34.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.911+0000 7fa2f762b640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fa2f0151ad0 con 0x7fa2f00bf9b0 2024-05-16T22:33:34.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.911+0000 7fa2f4bc6640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa2f0148770 0x7fa2f00c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:34.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.911+0000 7fa2f4bc6640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa2f0148770 0x7fa2f00c0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44754/0 (socket says 172.21.15.44:44754) 2024-05-16T22:33:34.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.912+0000 7fa2f4bc6640 1 -- 172.21.15.44:0/2084498617 learned_addr learned my addr 172.21.15.44:0/2084498617 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:33:34.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.912+0000 7fa2f5bc8640 1 --2- 172.21.15.44:0/2084498617 >> v2:172.21.15.70:3300/0 conn(0x7fa2f00bf9b0 0x7fa2f00bfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:34.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.912+0000 7fa2f4bc6640 1 -- 172.21.15.44:0/2084498617 >> v2:172.21.15.70:3300/0 conn(0x7fa2f00bf9b0 msgr2=0x7fa2f00bfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:33:34.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.912+0000 7fa2f4bc6640 1 --2- 172.21.15.44:0/2084498617 >> v2:172.21.15.70:3300/0 conn(0x7fa2f00bf9b0 0x7fa2f00bfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:34.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.912+0000 7fa2f4bc6640 1 -- 172.21.15.44:0/2084498617 >> v1:172.21.15.70:6789/0 conn(0x7fa2f014e360 legacy=0x7fa2f01522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:33:34.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.912+0000 7fa2f4bc6640 1 -- 172.21.15.44:0/2084498617 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2f00c0300 con 0x7fa2f0148770 2024-05-16T22:33:34.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.913+0000 7fa2f4bc6640 1 --2- 172.21.15.44:0/2084498617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2f0148770 0x7fa2f00c0c80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa2e0009870 tx=0x7fa2e002a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b91b9cc82338b686 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:34.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.913+0000 7fa2e7fff640 1 -- 172.21.15.44:0/2084498617 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0037070 con 0x7fa2f0148770 2024-05-16T22:33:34.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.913+0000 7fa2e7fff640 1 -- 172.21.15.44:0/2084498617 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2e0032640 con 0x7fa2f0148770 2024-05-16T22:33:34.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.913+0000 7fa2e7fff640 1 -- 172.21.15.44:0/2084498617 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0032a10 con 0x7fa2f0148770 2024-05-16T22:33:34.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.913+0000 7fa2f762b640 1 -- 172.21.15.44:0/2084498617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2f0148770 msgr2=0x7fa2f00c0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:34.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.913+0000 7fa2f762b640 1 --2- 172.21.15.44:0/2084498617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2f0148770 0x7fa2f00c0c80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa2e0009870 tx=0x7fa2e002a330 comp rx=0 tx=0).stop 2024-05-16T22:33:34.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.913+0000 7fa2f762b640 1 -- 172.21.15.44:0/2084498617 shutdown_connections 2024-05-16T22:33:34.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.913+0000 7fa2f762b640 1 --2- 172.21.15.44:0/2084498617 >> v2:172.21.15.70:3300/0 conn(0x7fa2f00bf9b0 0x7fa2f00bfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:34.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.913+0000 7fa2f762b640 1 --2- 172.21.15.44:0/2084498617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2f0148770 0x7fa2f00c0c80 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:34.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.913+0000 7fa2f762b640 1 -- 172.21.15.44:0/2084498617 >> 172.21.15.44:0/2084498617 conn(0x7fa2f00c17c0 msgr2=0x7fa2f00c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:33:34.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.914+0000 7fa2f762b640 1 -- 172.21.15.44:0/2084498617 shutdown_connections 2024-05-16T22:33:34.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.914+0000 7fa2f762b640 1 -- 172.21.15.44:0/2084498617 wait complete. 2024-05-16T22:33:34.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.915+0000 7fa2f762b640 1 Processor -- start 2024-05-16T22:33:34.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.915+0000 7fa2f762b640 1 -- start start 2024-05-16T22:33:35.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.916+0000 7fa2f762b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2f00bf9b0 0x7fa2f00b6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:35.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.916+0000 7fa2f762b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2f0148770 0x7fa2f00b8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:35.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.916+0000 7fa2f762b640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa2f014e360 0x7fa2f013d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:35.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.916+0000 7fa2f762b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f0158cc0 con 0x7fa2f0148770 2024-05-16T22:33:35.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.916+0000 7fa2f762b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f00c13d0 con 0x7fa2f00bf9b0 2024-05-16T22:33:35.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.916+0000 7fa2f762b640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fa2f0158e40 con 0x7fa2f014e360 2024-05-16T22:33:35.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.916+0000 7fa2f4bc6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2f0148770 0x7fa2f00b8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:35.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.916+0000 7fa2f4bc6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2f0148770 0x7fa2f00b8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44764/0 (socket says 172.21.15.44:44764) 2024-05-16T22:33:35.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.916+0000 7fa2f4bc6640 1 -- 172.21.15.44:0/1245012741 learned_addr learned my addr 172.21.15.44:0/1245012741 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:33:35.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.917+0000 7fa2f53c7640 1 --2- 172.21.15.44:0/1245012741 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2f00bf9b0 0x7fa2f00b6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:35.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.917+0000 7fa2f5bc8640 1 --2- 172.21.15.44:0/1245012741 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa2f014e360 0x7fa2f013d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:35.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.917+0000 7fa2f4bc6640 1 -- 172.21.15.44:0/1245012741 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa2f014e360 msgr2=0x7fa2f013d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:35.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.917+0000 7fa2f4bc6640 1 --2- 172.21.15.44:0/1245012741 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa2f014e360 0x7fa2f013d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:35.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.917+0000 7fa2f4bc6640 1 -- 172.21.15.44:0/1245012741 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2f00bf9b0 msgr2=0x7fa2f00b6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:35.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.917+0000 7fa2f4bc6640 1 --2- 172.21.15.44:0/1245012741 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2f00bf9b0 0x7fa2f00b6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:35.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.917+0000 7fa2f4bc6640 1 -- 172.21.15.44:0/1245012741 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2f00b8850 con 0x7fa2f0148770 2024-05-16T22:33:35.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.917+0000 7fa2f5bc8640 1 --2- 172.21.15.44:0/1245012741 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa2f014e360 0x7fa2f013d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T22:33:35.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.917+0000 7fa2f4bc6640 1 --2- 172.21.15.44:0/1245012741 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2f0148770 0x7fa2f00b8310 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa2e0000c00 tx=0x7fa2e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:35.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.917+0000 7fa2e5ffb640 1 -- 172.21.15.44:0/1245012741 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0037040 con 0x7fa2f0148770 2024-05-16T22:33:35.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.917+0000 7fa2e5ffb640 1 -- 172.21.15.44:0/1245012741 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2e0042070 con 0x7fa2f0148770 2024-05-16T22:33:35.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.917+0000 7fa2f762b640 1 -- 172.21.15.44:0/1245012741 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2f013fc90 con 0x7fa2f0148770 2024-05-16T22:33:35.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.917+0000 7fa2e5ffb640 1 -- 172.21.15.44:0/1245012741 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e00309b0 con 0x7fa2f0148770 2024-05-16T22:33:35.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.917+0000 7fa2f762b640 1 -- 172.21.15.44:0/1245012741 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2f0140250 con 0x7fa2f0148770 2024-05-16T22:33:35.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.918+0000 7fa2f762b640 1 -- 172.21.15.44:0/1245012741 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2f00be660 con 0x7fa2f0148770 2024-05-16T22:33:35.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.919+0000 7fa2e5ffb640 1 -- 172.21.15.44:0/1245012741 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa2e0030b50 con 0x7fa2f0148770 2024-05-16T22:33:35.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.920+0000 7fa2e5ffb640 1 --2- 172.21.15.44:0/1245012741 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fa2d40762d0 0x7fa2d40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:35.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.920+0000 7fa2e5ffb640 1 -- 172.21.15.44:0/1245012741 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7fa2e00b7ff0 con 0x7fa2f0148770 2024-05-16T22:33:36.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.920+0000 7fa2f53c7640 1 --2- 172.21.15.44:0/1245012741 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fa2d40762d0 0x7fa2d40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:36.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.921+0000 7fa2f53c7640 1 --2- 172.21.15.44:0/1245012741 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fa2d40762d0 0x7fa2d40787e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec0015e0 tx=0x7fa2ec009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:36.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:33.925+0000 7fa2e5ffb640 1 -- 172.21.15.44:0/1245012741 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa2f00b8850 con 0x7fa2f0148770 2024-05-16T22:33:36.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:34.118+0000 7fa2f762b640 1 -- 172.21.15.44:0/1245012741 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa2f0050940 con 0x7fa2f0148770 2024-05-16T22:33:36.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:34.119+0000 7fa2e5ffb640 1 -- 172.21.15.44:0/1245012741 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) ==== 74+0+16577 (secure 0 0 0) 0x7fa2e00818f0 con 0x7fa2f0148770 2024-05-16T22:33:36.212 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:33:36.250 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":48,"fsid":"572ab7cc-b103-4548-ae8f-c6614d57f0c8","created":"2024-05-16T22:27:02.216874+0000","modified":"2024-05-16T22:33:10.855231+0000","last_up_change":"2024-05-16T22:27:13.693953+0000","last_in_change":"2024-05-16T22:27:04.455119+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-16T22:27:14.562409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-05-16T22:33:02.085011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-05-16T22:33:06.543396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a7003e89-c706-4562-9f25-670bb35ae108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6825","nonce":1074109859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6827","nonce":1074109859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6831","nonce":1074109859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6829","nonce":1074109859}]},"public_addr":"172.21.15.44:6825/1074109859","cluster_addr":"172.21.15.44:6827/1074109859","heartbeat_back_addr":"172.21.15.44:6831/1074109859","heartbeat_front_addr":"172.21.15.44:6829/1074109859","state":["exists","up"]},{"osd":1,"uuid":"a4d5169d-8327-4494-9c7c-58db21b00636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6817","nonce":2909429972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6819","nonce":2909429972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6823","nonce":2909429972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6821","nonce":2909429972}]},"public_addr":"172.21.15.44:6817/2909429972","cluster_addr":"172.21.15.44:6819/2909429972","heartbeat_back_addr":"172.21.15.44:6823/2909429972","heartbeat_front_addr":"172.21.15.44:6821/2909429972","state":["exists","up"]},{"osd":2,"uuid":"d4a834f8-83a5-400f-9814-eb0a25124df4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6801","nonce":2908194156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6803","nonce":2908194156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6807","nonce":2908194156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6805","nonce":2908194156}]},"public_addr":"172.21.15.44:6801/2908194156","cluster_addr":"172.21.15.44:6803/2908194156","heartbeat_back_addr":"172.21.15.44:6807/2908194156","heartbeat_front_addr":"172.21.15.44:6805/2908194156","state":["exists","up"]},{"osd":3,"uuid":"b9d24a56-ad43-4674-a395-5ec24d135ae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6809","nonce":2168695793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6811","nonce":2168695793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6815","nonce":2168695793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6813","nonce":2168695793}]},"public_addr":"172.21.15.44:6809/2168695793","cluster_addr":"172.21.15.44:6811/2168695793","heartbeat_back_addr":"172.21.15.44:6815/2168695793","heartbeat_front_addr":"172.21.15.44:6813/2168695793","state":["exists","up"]},{"osd":4,"uuid":"9bd94af5-3e17-4cbe-995a-8f837a66c653","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6823","nonce":1540297751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6825","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6827","nonce":1540297751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6831","nonce":1540297751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6829","nonce":1540297751}]},"public_addr":"172.21.15.70:6823/1540297751","cluster_addr":"172.21.15.70:6827/1540297751","heartbeat_back_addr":"172.21.15.70:6831/1540297751","heartbeat_front_addr":"172.21.15.70:6829/1540297751","state":["exists","up"]},{"osd":5,"uuid":"a5b0cfa5-b259-48bd-98b6-96b44f5ebabd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6804","nonce":4218901987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6808","nonce":4218901987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6815","nonce":4218901987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6812","nonce":4218901987}]},"public_addr":"172.21.15.70:6804/4218901987","cluster_addr":"172.21.15.70:6808/4218901987","heartbeat_back_addr":"172.21.15.70:6815/4218901987","heartbeat_front_addr":"172.21.15.70:6812/4218901987","state":["exists","up"]},{"osd":6,"uuid":"0b6af6df-1358-4fc6-a62c-ba57e02914ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6801","nonce":2389556489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6805","nonce":2389556489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6813","nonce":2389556489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6807","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6809","nonce":2389556489}]},"public_addr":"172.21.15.70:6801/2389556489","cluster_addr":"172.21.15.70:6805/2389556489","heartbeat_back_addr":"172.21.15.70:6813/2389556489","heartbeat_front_addr":"172.21.15.70:6809/2389556489","state":["exists","up"]},{"osd":7,"uuid":"eb1a2c5d-42cf-47d0-9e03-b9d26944a589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6817","nonce":3619691281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6819","nonce":3619691281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6826","nonce":3619691281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6822","nonce":3619691281}]},"public_addr":"172.21.15.70:6817/3619691281","cluster_addr":"172.21.15.70:6819/3619691281","heartbeat_back_addr":"172.21.15.70:6826/3619691281","heartbeat_front_addr":"172.21.15.70:6822/3619691281","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.652256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.613348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.528454+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.625204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.678845+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.680829+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.556200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.647030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T22:33:36.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:34.121+0000 7fa2f762b640 1 -- 172.21.15.44:0/1245012741 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fa2d40762d0 msgr2=0x7fa2d40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:36.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:34.121+0000 7fa2f762b640 1 --2- 172.21.15.44:0/1245012741 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fa2d40762d0 0x7fa2d40787e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec0015e0 tx=0x7fa2ec009040 comp rx=0 tx=0).stop 2024-05-16T22:33:36.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:34.121+0000 7fa2f762b640 1 -- 172.21.15.44:0/1245012741 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2f0148770 msgr2=0x7fa2f00b8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:36.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:34.121+0000 7fa2f762b640 1 --2- 172.21.15.44:0/1245012741 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2f0148770 0x7fa2f00b8310 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa2e0000c00 tx=0x7fa2e00046c0 comp rx=0 tx=0).stop 2024-05-16T22:33:36.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:34.121+0000 7fa2f762b640 1 -- 172.21.15.44:0/1245012741 shutdown_connections 2024-05-16T22:33:36.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:34.121+0000 7fa2f762b640 1 --2- 172.21.15.44:0/1245012741 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fa2d40762d0 0x7fa2d40787e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:36.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:34.121+0000 7fa2f762b640 1 --2- 172.21.15.44:0/1245012741 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa2f014e360 0x7fa2f013d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:36.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:34.121+0000 7fa2f762b640 1 --2- 172.21.15.44:0/1245012741 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2f0148770 0x7fa2f00b8310 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:36.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:34.121+0000 7fa2f762b640 1 --2- 172.21.15.44:0/1245012741 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2f00bf9b0 0x7fa2f00b6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:36.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:34.121+0000 7fa2f762b640 1 -- 172.21.15.44:0/1245012741 >> 172.21.15.44:0/1245012741 conn(0x7fa2f00c17c0 msgr2=0x7fa2f00bd8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:33:36.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:34.121+0000 7fa2f762b640 1 -- 172.21.15.44:0/1245012741 shutdown_connections 2024-05-16T22:33:36.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:34.122+0000 7fa2f762b640 1 -- 172.21.15.44:0/1245012741 wait complete. 2024-05-16T22:33:36.779 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-16T22:33:36.812 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-16T22:33:36.871 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:33:36.906 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:33:36.943 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:33:37.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.030+0000 7fa56bbb2640 1 Processor -- start 2024-05-16T22:33:37.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.031+0000 7fa56bbb2640 1 -- start start 2024-05-16T22:33:37.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.032+0000 7fa56bbb2640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa564148770 0x7fa5640c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:37.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.032+0000 7fa56bbb2640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa5640bf9b0 0x7fa5640bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:37.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.032+0000 7fa56bbb2640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5640c0620 con 0x7fa56414e360 2024-05-16T22:33:37.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.032+0000 7fa56bbb2640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fa564151e40 con 0x7fa5640bf9b0 2024-05-16T22:33:37.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.032+0000 7fa56bbb2640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fa564151ad0 con 0x7fa564148770 2024-05-16T22:33:37.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.032+0000 7fa56a14f640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa5640bf9b0 0x7fa5640bfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:37.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.032+0000 7fa56a14f640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa5640bf9b0 0x7fa5640bfdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44774/0 (socket says 172.21.15.44:44774) 2024-05-16T22:33:37.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.032+0000 7fa56a14f640 1 -- 172.21.15.44:0/1345376319 learned_addr learned my addr 172.21.15.44:0/1345376319 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:33:37.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.032+0000 7fa56914d640 1 --2- 172.21.15.44:0/1345376319 >> v2:172.21.15.70:3300/0 conn(0x7fa564148770 0x7fa5640c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:37.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.032+0000 7fa56a14f640 1 -- 172.21.15.44:0/1345376319 >> v2:172.21.15.70:3300/0 conn(0x7fa564148770 msgr2=0x7fa5640c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:33:37.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.032+0000 7fa56a14f640 1 --2- 172.21.15.44:0/1345376319 >> v2:172.21.15.70:3300/0 conn(0x7fa564148770 0x7fa5640c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:37.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.032+0000 7fa56a14f640 1 -- 172.21.15.44:0/1345376319 >> v1:172.21.15.70:6789/0 conn(0x7fa56414e360 legacy=0x7fa5641522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:33:37.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.032+0000 7fa56a14f640 1 -- 172.21.15.44:0/1345376319 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5640c0300 con 0x7fa5640bf9b0 2024-05-16T22:33:37.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.032+0000 7fa56914d640 1 --2- 172.21.15.44:0/1345376319 >> v2:172.21.15.70:3300/0 conn(0x7fa564148770 0x7fa5640c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T22:33:37.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.033+0000 7fa56a14f640 1 --2- 172.21.15.44:0/1345376319 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5640bf9b0 0x7fa5640bfdc0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa55c009e50 tx=0x7fa55c02a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb52d5ea096c6792 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:37.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.033+0000 7fa56894c640 1 -- 172.21.15.44:0/1345376319 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa55c036070 con 0x7fa5640bf9b0 2024-05-16T22:33:37.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.033+0000 7fa56894c640 1 -- 172.21.15.44:0/1345376319 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa55c031600 con 0x7fa5640bf9b0 2024-05-16T22:33:37.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.033+0000 7fa56894c640 1 -- 172.21.15.44:0/1345376319 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa55c0319d0 con 0x7fa5640bf9b0 2024-05-16T22:33:37.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.034+0000 7fa56bbb2640 1 -- 172.21.15.44:0/1345376319 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5640bf9b0 msgr2=0x7fa5640bfdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:37.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.034+0000 7fa56bbb2640 1 --2- 172.21.15.44:0/1345376319 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5640bf9b0 0x7fa5640bfdc0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa55c009e50 tx=0x7fa55c02a750 comp rx=0 tx=0).stop 2024-05-16T22:33:37.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.034+0000 7fa56bbb2640 1 -- 172.21.15.44:0/1345376319 shutdown_connections 2024-05-16T22:33:37.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.034+0000 7fa56bbb2640 1 --2- 172.21.15.44:0/1345376319 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5640bf9b0 0x7fa5640bfdc0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:37.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.034+0000 7fa56bbb2640 1 --2- 172.21.15.44:0/1345376319 >> v2:172.21.15.70:3300/0 conn(0x7fa564148770 0x7fa5640c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:37.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.034+0000 7fa56bbb2640 1 -- 172.21.15.44:0/1345376319 >> 172.21.15.44:0/1345376319 conn(0x7fa5640c17c0 msgr2=0x7fa5640c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:33:37.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.034+0000 7fa56bbb2640 1 -- 172.21.15.44:0/1345376319 shutdown_connections 2024-05-16T22:33:37.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.034+0000 7fa56bbb2640 1 -- 172.21.15.44:0/1345376319 wait complete. 2024-05-16T22:33:37.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.036+0000 7fa56bbb2640 1 Processor -- start 2024-05-16T22:33:38.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.036+0000 7fa56bbb2640 1 -- start start 2024-05-16T22:33:38.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.037+0000 7fa56bbb2640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa5640bf9b0 0x7fa5641e77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:38.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.037+0000 7fa56bbb2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa564148770 0x7fa5640b69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:38.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.037+0000 7fa56bbb2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa56414e360 0x7fa56413db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:38.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.037+0000 7fa56bbb2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa564158cc0 con 0x7fa564148770 2024-05-16T22:33:38.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.037+0000 7fa56bbb2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa5640c13d0 con 0x7fa56414e360 2024-05-16T22:33:38.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.037+0000 7fa56bbb2640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fa564158e40 con 0x7fa5640bf9b0 2024-05-16T22:33:38.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.037+0000 7fa56914d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa564148770 0x7fa5640b69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:38.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.037+0000 7fa56914d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa564148770 0x7fa5640b69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44778/0 (socket says 172.21.15.44:44778) 2024-05-16T22:33:38.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.037+0000 7fa56914d640 1 -- 172.21.15.44:0/458565496 learned_addr learned my addr 172.21.15.44:0/458565496 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:33:38.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.037+0000 7fa56994e640 1 --2- 172.21.15.44:0/458565496 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa5640bf9b0 0x7fa5641e77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:38.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.037+0000 7fa56a14f640 1 --2- 172.21.15.44:0/458565496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa56414e360 0x7fa56413db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:38.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.037+0000 7fa56914d640 1 -- 172.21.15.44:0/458565496 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa5640bf9b0 msgr2=0x7fa5641e77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:38.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.037+0000 7fa56914d640 1 --2- 172.21.15.44:0/458565496 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa5640bf9b0 0x7fa5641e77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:38.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.037+0000 7fa56914d640 1 -- 172.21.15.44:0/458565496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa56414e360 msgr2=0x7fa56413db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:38.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.037+0000 7fa56914d640 1 --2- 172.21.15.44:0/458565496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa56414e360 0x7fa56413db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:38.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.037+0000 7fa56914d640 1 -- 172.21.15.44:0/458565496 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5640b6f00 con 0x7fa564148770 2024-05-16T22:33:38.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.037+0000 7fa56914d640 1 --2- 172.21.15.44:0/458565496 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa564148770 0x7fa5640b69c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa55400c820 tx=0x7fa55400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:38.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.037+0000 7fa55a7fc640 1 -- 172.21.15.44:0/458565496 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa554015070 con 0x7fa564148770 2024-05-16T22:33:38.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.037+0000 7fa55a7fc640 1 -- 172.21.15.44:0/458565496 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa554007a30 con 0x7fa564148770 2024-05-16T22:33:38.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.038+0000 7fa56bbb2640 1 -- 172.21.15.44:0/458565496 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa564072770 con 0x7fa564148770 2024-05-16T22:33:38.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.038+0000 7fa55a7fc640 1 -- 172.21.15.44:0/458565496 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa554007de0 con 0x7fa564148770 2024-05-16T22:33:38.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.038+0000 7fa56bbb2640 1 -- 172.21.15.44:0/458565496 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa56406f430 con 0x7fa564148770 2024-05-16T22:33:38.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.038+0000 7fa56bbb2640 1 -- 172.21.15.44:0/458565496 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5640bc3a0 con 0x7fa564148770 2024-05-16T22:33:38.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.039+0000 7fa55a7fc640 1 -- 172.21.15.44:0/458565496 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa554018070 con 0x7fa564148770 2024-05-16T22:33:38.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.040+0000 7fa55a7fc640 1 --2- 172.21.15.44:0/458565496 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fa5480762d0 0x7fa5480787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:38.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.040+0000 7fa55a7fc640 1 -- 172.21.15.44:0/458565496 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7fa554097400 con 0x7fa564148770 2024-05-16T22:33:39.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.040+0000 7fa56994e640 1 --2- 172.21.15.44:0/458565496 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fa5480762d0 0x7fa5480787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:39.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.041+0000 7fa56994e640 1 --2- 172.21.15.44:0/458565496 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fa5480762d0 0x7fa5480787e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa560006fd0 tx=0x7fa560009060 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:39.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.045+0000 7fa55a7fc640 1 -- 172.21.15.44:0/458565496 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa5640bc3a0 con 0x7fa564148770 2024-05-16T22:33:39.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.232+0000 7fa56bbb2640 1 -- 172.21.15.44:0/458565496 --> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa564072bc0 con 0x7fa5480762d0 2024-05-16T22:33:39.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.240+0000 7fa55a7fc640 1 -- 172.21.15.44:0/458565496 <== mgr.4114 v2:172.21.15.70:6832/4049588098 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251829 (secure 0 0 0) 0x7fa564072bc0 con 0x7fa5480762d0 2024-05-16T22:33:39.234 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:33:39.266 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-05-16T22:33:39.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.243+0000 7fa56bbb2640 1 -- 172.21.15.44:0/458565496 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fa5480762d0 msgr2=0x7fa5480787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:39.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.243+0000 7fa56bbb2640 1 --2- 172.21.15.44:0/458565496 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fa5480762d0 0x7fa5480787e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa560006fd0 tx=0x7fa560009060 comp rx=0 tx=0).stop 2024-05-16T22:33:39.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.243+0000 7fa56bbb2640 1 -- 172.21.15.44:0/458565496 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa564148770 msgr2=0x7fa5640b69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:39.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.243+0000 7fa56bbb2640 1 --2- 172.21.15.44:0/458565496 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa564148770 0x7fa5640b69c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa55400c820 tx=0x7fa55400cce0 comp rx=0 tx=0).stop 2024-05-16T22:33:39.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.243+0000 7fa56bbb2640 1 -- 172.21.15.44:0/458565496 shutdown_connections 2024-05-16T22:33:39.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.243+0000 7fa56bbb2640 1 --2- 172.21.15.44:0/458565496 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fa5480762d0 0x7fa5480787e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:39.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.243+0000 7fa56bbb2640 1 --2- 172.21.15.44:0/458565496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa56414e360 0x7fa56413db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:39.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.243+0000 7fa56bbb2640 1 --2- 172.21.15.44:0/458565496 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa564148770 0x7fa5640b69c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:39.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.243+0000 7fa56bbb2640 1 --2- 172.21.15.44:0/458565496 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa5640bf9b0 0x7fa5641e77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:39.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.243+0000 7fa56bbb2640 1 -- 172.21.15.44:0/458565496 >> 172.21.15.44:0/458565496 conn(0x7fa5640c17c0 msgr2=0x7fa564143ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:33:39.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.243+0000 7fa56bbb2640 1 -- 172.21.15.44:0/458565496 shutdown_connections 2024-05-16T22:33:39.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:37.243+0000 7fa56bbb2640 1 -- 172.21.15.44:0/458565496 wait complete. 2024-05-16T22:33:39.706 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":233,"stamp":"2024-05-16T22:33:36.644995+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":263404,"kb_used_data":5640,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754711316,"statfs":{"total":773094113280,"available":772824387584,"internally_reserved":0,"allocated":5775360,"data_stored":3030132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":263835185},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003138"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.813136+0000","last_change":"2024-05-16T22:33:07.786972+0000","last_active":"2024-05-16T22:33:11.813136+0000","last_peered":"2024-05-16T22:33:11.813136+0000","last_clean":"2024-05-16T22:33:11.813136+0000","last_became_active":"2024-05-16T22:33:07.786670+0000","last_became_peered":"2024-05-16T22:33:07.786670+0000","last_unstale":"2024-05-16T22:33:11.813136+0000","last_undegraded":"2024-05-16T22:33:11.813136+0000","last_fullsized":"2024-05-16T22:33:11.813136+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:12:52.620622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.813043+0000","last_change":"2024-05-16T22:33:07.798881+0000","last_active":"2024-05-16T22:33:11.813043+0000","last_peered":"2024-05-16T22:33:11.813043+0000","last_clean":"2024-05-16T22:33:11.813043+0000","last_became_active":"2024-05-16T22:33:07.798573+0000","last_became_peered":"2024-05-16T22:33:07.798573+0000","last_unstale":"2024-05-16T22:33:11.813043+0000","last_undegraded":"2024-05-16T22:33:11.813043+0000","last_fullsized":"2024-05-16T22:33:11.813043+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:08:32.674697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.799848+0000","last_change":"2024-05-16T22:33:07.799427+0000","last_active":"2024-05-16T22:33:11.799848+0000","last_peered":"2024-05-16T22:33:11.799848+0000","last_clean":"2024-05-16T22:33:11.799848+0000","last_became_active":"2024-05-16T22:33:07.799090+0000","last_became_peered":"2024-05-16T22:33:07.799090+0000","last_unstale":"2024-05-16T22:33:11.799848+0000","last_undegraded":"2024-05-16T22:33:11.799848+0000","last_fullsized":"2024-05-16T22:33:11.799848+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:18:11.659186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.811276+0000","last_change":"2024-05-16T22:33:07.795839+0000","last_active":"2024-05-16T22:33:11.811276+0000","last_peered":"2024-05-16T22:33:11.811276+0000","last_clean":"2024-05-16T22:33:11.811276+0000","last_became_active":"2024-05-16T22:33:07.795446+0000","last_became_peered":"2024-05-16T22:33:07.795446+0000","last_unstale":"2024-05-16T22:33:11.811276+0000","last_undegraded":"2024-05-16T22:33:11.811276+0000","last_fullsized":"2024-05-16T22:33:11.811276+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:34:03.827203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.812747+0000","last_change":"2024-05-16T22:33:07.799266+0000","last_active":"2024-05-16T22:33:11.812747+0000","last_peered":"2024-05-16T22:33:11.812747+0000","last_clean":"2024-05-16T22:33:11.812747+0000","last_became_active":"2024-05-16T22:33:07.798971+0000","last_became_peered":"2024-05-16T22:33:07.798971+0000","last_unstale":"2024-05-16T22:33:11.812747+0000","last_undegraded":"2024-05-16T22:33:11.812747+0000","last_fullsized":"2024-05-16T22:33:11.812747+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:30:57.253067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.812262+0000","last_change":"2024-05-16T22:33:07.796092+0000","last_active":"2024-05-16T22:33:11.812262+0000","last_peered":"2024-05-16T22:33:11.812262+0000","last_clean":"2024-05-16T22:33:11.812262+0000","last_became_active":"2024-05-16T22:33:07.795775+0000","last_became_peered":"2024-05-16T22:33:07.795775+0000","last_unstale":"2024-05-16T22:33:11.812262+0000","last_undegraded":"2024-05-16T22:33:11.812262+0000","last_fullsized":"2024-05-16T22:33:11.812262+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:05:56.208286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.811739+0000","last_change":"2024-05-16T22:33:07.792795+0000","last_active":"2024-05-16T22:33:11.811739+0000","last_peered":"2024-05-16T22:33:11.811739+0000","last_clean":"2024-05-16T22:33:11.811739+0000","last_became_active":"2024-05-16T22:33:07.792482+0000","last_became_peered":"2024-05-16T22:33:07.792482+0000","last_unstale":"2024-05-16T22:33:11.811739+0000","last_undegraded":"2024-05-16T22:33:11.811739+0000","last_fullsized":"2024-05-16T22:33:11.811739+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:15:30.250906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.811191+0000","last_change":"2024-05-16T22:33:07.793239+0000","last_active":"2024-05-16T22:33:11.811191+0000","last_peered":"2024-05-16T22:33:11.811191+0000","last_clean":"2024-05-16T22:33:11.811191+0000","last_became_active":"2024-05-16T22:33:07.791563+0000","last_became_peered":"2024-05-16T22:33:07.791563+0000","last_unstale":"2024-05-16T22:33:11.811191+0000","last_undegraded":"2024-05-16T22:33:11.811191+0000","last_fullsized":"2024-05-16T22:33:11.811191+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:37:30.236178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.812328+0000","last_change":"2024-05-16T22:33:07.793010+0000","last_active":"2024-05-16T22:33:11.812328+0000","last_peered":"2024-05-16T22:33:11.812328+0000","last_clean":"2024-05-16T22:33:11.812328+0000","last_became_active":"2024-05-16T22:33:07.791936+0000","last_became_peered":"2024-05-16T22:33:07.791936+0000","last_unstale":"2024-05-16T22:33:11.812328+0000","last_undegraded":"2024-05-16T22:33:11.812328+0000","last_fullsized":"2024-05-16T22:33:11.812328+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:27:43.960263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.811978+0000","last_change":"2024-05-16T22:33:07.797754+0000","last_active":"2024-05-16T22:33:11.811978+0000","last_peered":"2024-05-16T22:33:11.811978+0000","last_clean":"2024-05-16T22:33:11.811978+0000","last_became_active":"2024-05-16T22:33:07.797335+0000","last_became_peered":"2024-05-16T22:33:07.797335+0000","last_unstale":"2024-05-16T22:33:11.811978+0000","last_undegraded":"2024-05-16T22:33:11.811978+0000","last_fullsized":"2024-05-16T22:33:11.811978+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:12:52.620622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.811566+0000","last_change":"2024-05-16T22:33:07.791875+0000","last_active":"2024-05-16T22:33:11.811566+0000","last_peered":"2024-05-16T22:33:11.811566+0000","last_clean":"2024-05-16T22:33:11.811566+0000","last_became_active":"2024-05-16T22:33:07.791013+0000","last_became_peered":"2024-05-16T22:33:07.791013+0000","last_unstale":"2024-05-16T22:33:11.811566+0000","last_undegraded":"2024-05-16T22:33:11.811566+0000","last_fullsized":"2024-05-16T22:33:11.811566+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:15:30.250906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.813004+0000","last_change":"2024-05-16T22:33:07.800694+0000","last_active":"2024-05-16T22:33:11.813004+0000","last_peered":"2024-05-16T22:33:11.813004+0000","last_clean":"2024-05-16T22:33:11.813004+0000","last_became_active":"2024-05-16T22:33:07.800407+0000","last_became_peered":"2024-05-16T22:33:07.800407+0000","last_unstale":"2024-05-16T22:33:11.813004+0000","last_undegraded":"2024-05-16T22:33:11.813004+0000","last_fullsized":"2024-05-16T22:33:11.813004+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:15:30.250906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.811427+0000","last_change":"2024-05-16T22:33:07.796488+0000","last_active":"2024-05-16T22:33:11.811427+0000","last_peered":"2024-05-16T22:33:11.811427+0000","last_clean":"2024-05-16T22:33:11.811427+0000","last_became_active":"2024-05-16T22:33:07.796155+0000","last_became_peered":"2024-05-16T22:33:07.796155+0000","last_unstale":"2024-05-16T22:33:11.811427+0000","last_undegraded":"2024-05-16T22:33:11.811427+0000","last_fullsized":"2024-05-16T22:33:11.811427+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:03:15.846231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.811228+0000","last_change":"2024-05-16T22:33:07.796952+0000","last_active":"2024-05-16T22:33:11.811228+0000","last_peered":"2024-05-16T22:33:11.811228+0000","last_clean":"2024-05-16T22:33:11.811228+0000","last_became_active":"2024-05-16T22:33:07.795681+0000","last_became_peered":"2024-05-16T22:33:07.795681+0000","last_unstale":"2024-05-16T22:33:11.811228+0000","last_undegraded":"2024-05-16T22:33:11.811228+0000","last_fullsized":"2024-05-16T22:33:11.811228+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:28:48.221339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.811694+0000","last_change":"2024-05-16T22:33:07.793078+0000","last_active":"2024-05-16T22:33:11.811694+0000","last_peered":"2024-05-16T22:33:11.811694+0000","last_clean":"2024-05-16T22:33:11.811694+0000","last_became_active":"2024-05-16T22:33:07.792494+0000","last_became_peered":"2024-05-16T22:33:07.792494+0000","last_unstale":"2024-05-16T22:33:11.811694+0000","last_undegraded":"2024-05-16T22:33:11.811694+0000","last_fullsized":"2024-05-16T22:33:11.811694+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:20:51.929955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.814278+0000","last_change":"2024-05-16T22:33:07.798716+0000","last_active":"2024-05-16T22:33:11.814278+0000","last_peered":"2024-05-16T22:33:11.814278+0000","last_clean":"2024-05-16T22:33:11.814278+0000","last_became_active":"2024-05-16T22:33:07.798418+0000","last_became_peered":"2024-05-16T22:33:07.798418+0000","last_unstale":"2024-05-16T22:33:11.814278+0000","last_undegraded":"2024-05-16T22:33:11.814278+0000","last_fullsized":"2024-05-16T22:33:11.814278+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:50:44.555325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.800142+0000","last_change":"2024-05-16T22:33:07.788398+0000","last_active":"2024-05-16T22:33:11.800142+0000","last_peered":"2024-05-16T22:33:11.800142+0000","last_clean":"2024-05-16T22:33:11.800142+0000","last_became_active":"2024-05-16T22:33:07.788041+0000","last_became_peered":"2024-05-16T22:33:07.788041+0000","last_unstale":"2024-05-16T22:33:11.800142+0000","last_undegraded":"2024-05-16T22:33:11.800142+0000","last_fullsized":"2024-05-16T22:33:11.800142+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:32:17.527873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.800035+0000","last_change":"2024-05-16T22:33:07.798417+0000","last_active":"2024-05-16T22:33:11.800035+0000","last_peered":"2024-05-16T22:33:11.800035+0000","last_clean":"2024-05-16T22:33:11.800035+0000","last_became_active":"2024-05-16T22:33:07.798077+0000","last_became_peered":"2024-05-16T22:33:07.798077+0000","last_unstale":"2024-05-16T22:33:11.800035+0000","last_undegraded":"2024-05-16T22:33:11.800035+0000","last_fullsized":"2024-05-16T22:33:11.800035+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:04:00.833667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.813621+0000","last_change":"2024-05-16T22:33:07.799131+0000","last_active":"2024-05-16T22:33:11.813621+0000","last_peered":"2024-05-16T22:33:11.813621+0000","last_clean":"2024-05-16T22:33:11.813621+0000","last_became_active":"2024-05-16T22:33:07.798812+0000","last_became_peered":"2024-05-16T22:33:07.798812+0000","last_unstale":"2024-05-16T22:33:11.813621+0000","last_undegraded":"2024-05-16T22:33:11.813621+0000","last_fullsized":"2024-05-16T22:33:11.813621+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:53:19.649731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.813098+0000","last_change":"2024-05-16T22:33:07.800314+0000","last_active":"2024-05-16T22:33:11.813098+0000","last_peered":"2024-05-16T22:33:11.813098+0000","last_clean":"2024-05-16T22:33:11.813098+0000","last_became_active":"2024-05-16T22:33:07.799969+0000","last_became_peered":"2024-05-16T22:33:07.799969+0000","last_unstale":"2024-05-16T22:33:11.813098+0000","last_undegraded":"2024-05-16T22:33:11.813098+0000","last_fullsized":"2024-05-16T22:33:11.813098+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:37:20.913308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.813040+0000","last_change":"2024-05-16T22:33:07.794579+0000","last_active":"2024-05-16T22:33:11.813040+0000","last_peered":"2024-05-16T22:33:11.813040+0000","last_clean":"2024-05-16T22:33:11.813040+0000","last_became_active":"2024-05-16T22:33:07.794200+0000","last_became_peered":"2024-05-16T22:33:07.794200+0000","last_unstale":"2024-05-16T22:33:11.813040+0000","last_undegraded":"2024-05-16T22:33:11.813040+0000","last_fullsized":"2024-05-16T22:33:11.813040+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:51:01.100457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.811458+0000","last_change":"2024-05-16T22:33:07.793011+0000","last_active":"2024-05-16T22:33:11.811458+0000","last_peered":"2024-05-16T22:33:11.811458+0000","last_clean":"2024-05-16T22:33:11.811458+0000","last_became_active":"2024-05-16T22:33:07.792510+0000","last_became_peered":"2024-05-16T22:33:07.792510+0000","last_unstale":"2024-05-16T22:33:11.811458+0000","last_undegraded":"2024-05-16T22:33:11.811458+0000","last_fullsized":"2024-05-16T22:33:11.811458+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:30:57.253067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.812771+0000","last_change":"2024-05-16T22:33:07.793128+0000","last_active":"2024-05-16T22:33:11.812771+0000","last_peered":"2024-05-16T22:33:11.812771+0000","last_clean":"2024-05-16T22:33:11.812771+0000","last_became_active":"2024-05-16T22:33:07.792139+0000","last_became_peered":"2024-05-16T22:33:07.792139+0000","last_unstale":"2024-05-16T22:33:11.812771+0000","last_undegraded":"2024-05-16T22:33:11.812771+0000","last_fullsized":"2024-05-16T22:33:11.812771+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:05:24.115985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.814477+0000","last_change":"2024-05-16T22:33:07.792449+0000","last_active":"2024-05-16T22:33:11.814477+0000","last_peered":"2024-05-16T22:33:11.814477+0000","last_clean":"2024-05-16T22:33:11.814477+0000","last_became_active":"2024-05-16T22:33:07.792119+0000","last_became_peered":"2024-05-16T22:33:07.792119+0000","last_unstale":"2024-05-16T22:33:11.814477+0000","last_undegraded":"2024-05-16T22:33:11.814477+0000","last_fullsized":"2024-05-16T22:33:11.814477+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:04:00.833667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.812670+0000","last_change":"2024-05-16T22:33:07.792296+0000","last_active":"2024-05-16T22:33:11.812670+0000","last_peered":"2024-05-16T22:33:11.812670+0000","last_clean":"2024-05-16T22:33:11.812670+0000","last_became_active":"2024-05-16T22:33:07.791991+0000","last_became_peered":"2024-05-16T22:33:07.791991+0000","last_unstale":"2024-05-16T22:33:11.812670+0000","last_undegraded":"2024-05-16T22:33:11.812670+0000","last_fullsized":"2024-05-16T22:33:11.812670+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:48:21.104886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.811821+0000","last_change":"2024-05-16T22:33:07.797568+0000","last_active":"2024-05-16T22:33:11.811821+0000","last_peered":"2024-05-16T22:33:11.811821+0000","last_clean":"2024-05-16T22:33:11.811821+0000","last_became_active":"2024-05-16T22:33:07.797228+0000","last_became_peered":"2024-05-16T22:33:07.797228+0000","last_unstale":"2024-05-16T22:33:11.811821+0000","last_undegraded":"2024-05-16T22:33:11.811821+0000","last_fullsized":"2024-05-16T22:33:11.811821+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:38:09.482227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.800316+0000","last_change":"2024-05-16T22:33:07.792298+0000","last_active":"2024-05-16T22:33:11.800316+0000","last_peered":"2024-05-16T22:33:11.800316+0000","last_clean":"2024-05-16T22:33:11.800316+0000","last_became_active":"2024-05-16T22:33:07.791972+0000","last_became_peered":"2024-05-16T22:33:07.791972+0000","last_unstale":"2024-05-16T22:33:11.800316+0000","last_undegraded":"2024-05-16T22:33:11.800316+0000","last_fullsized":"2024-05-16T22:33:11.800316+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:33:08.723015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.813158+0000","last_change":"2024-05-16T22:33:07.799963+0000","last_active":"2024-05-16T22:33:11.813158+0000","last_peered":"2024-05-16T22:33:11.813158+0000","last_clean":"2024-05-16T22:33:11.813158+0000","last_became_active":"2024-05-16T22:33:07.799641+0000","last_became_peered":"2024-05-16T22:33:07.799641+0000","last_unstale":"2024-05-16T22:33:11.813158+0000","last_undegraded":"2024-05-16T22:33:11.813158+0000","last_fullsized":"2024-05-16T22:33:11.813158+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:44:00.628985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.814230+0000","last_change":"2024-05-16T22:33:07.793631+0000","last_active":"2024-05-16T22:33:11.814230+0000","last_peered":"2024-05-16T22:33:11.814230+0000","last_clean":"2024-05-16T22:33:11.814230+0000","last_became_active":"2024-05-16T22:33:07.792913+0000","last_became_peered":"2024-05-16T22:33:07.792913+0000","last_unstale":"2024-05-16T22:33:11.814230+0000","last_undegraded":"2024-05-16T22:33:11.814230+0000","last_fullsized":"2024-05-16T22:33:11.814230+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:18:11.659186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.799757+0000","last_change":"2024-05-16T22:33:07.786995+0000","last_active":"2024-05-16T22:33:11.799757+0000","last_peered":"2024-05-16T22:33:11.799757+0000","last_clean":"2024-05-16T22:33:11.799757+0000","last_became_active":"2024-05-16T22:33:07.786666+0000","last_became_peered":"2024-05-16T22:33:07.786666+0000","last_unstale":"2024-05-16T22:33:11.799757+0000","last_undegraded":"2024-05-16T22:33:11.799757+0000","last_fullsized":"2024-05-16T22:33:11.799757+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:18:11.045305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.811880+0000","last_change":"2024-05-16T22:33:07.792778+0000","last_active":"2024-05-16T22:33:11.811880+0000","last_peered":"2024-05-16T22:33:11.811880+0000","last_clean":"2024-05-16T22:33:11.811880+0000","last_became_active":"2024-05-16T22:33:07.792175+0000","last_became_peered":"2024-05-16T22:33:07.792175+0000","last_unstale":"2024-05-16T22:33:11.811880+0000","last_undegraded":"2024-05-16T22:33:11.811880+0000","last_fullsized":"2024-05-16T22:33:11.811880+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:36:27.885318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.814173+0000","last_change":"2024-05-16T22:33:07.799178+0000","last_active":"2024-05-16T22:33:11.814173+0000","last_peered":"2024-05-16T22:33:11.814173+0000","last_clean":"2024-05-16T22:33:11.814173+0000","last_became_active":"2024-05-16T22:33:07.798806+0000","last_became_peered":"2024-05-16T22:33:07.798806+0000","last_unstale":"2024-05-16T22:33:11.814173+0000","last_undegraded":"2024-05-16T22:33:11.814173+0000","last_fullsized":"2024-05-16T22:33:11.814173+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:34:28.933408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.799481+0000","last_change":"2024-05-16T22:33:07.795832+0000","last_active":"2024-05-16T22:33:11.799481+0000","last_peered":"2024-05-16T22:33:11.799481+0000","last_clean":"2024-05-16T22:33:11.799481+0000","last_became_active":"2024-05-16T22:33:07.795499+0000","last_became_peered":"2024-05-16T22:33:07.795499+0000","last_unstale":"2024-05-16T22:33:11.799481+0000","last_undegraded":"2024-05-16T22:33:11.799481+0000","last_fullsized":"2024-05-16T22:33:11.799481+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:14:36.433345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"48'4","reported_seq":25,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.820232+0000","last_change":"2024-05-16T22:33:03.999309+0000","last_active":"2024-05-16T22:33:11.820232+0000","last_peered":"2024-05-16T22:33:11.820232+0000","last_clean":"2024-05-16T22:33:11.820232+0000","last_became_active":"2024-05-16T22:33:03.998916+0000","last_became_peered":"2024-05-16T22:33:03.998916+0000","last_unstale":"2024-05-16T22:33:11.820232+0000","last_undegraded":"2024-05-16T22:33:11.820232+0000","last_fullsized":"2024-05-16T22:33:11.820232+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:02:31.124265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.812883+0000","last_change":"2024-05-16T22:33:07.794430+0000","last_active":"2024-05-16T22:33:11.812883+0000","last_peered":"2024-05-16T22:33:11.812883+0000","last_clean":"2024-05-16T22:33:11.812883+0000","last_became_active":"2024-05-16T22:33:07.794098+0000","last_became_peered":"2024-05-16T22:33:07.794098+0000","last_unstale":"2024-05-16T22:33:11.812883+0000","last_undegraded":"2024-05-16T22:33:11.812883+0000","last_fullsized":"2024-05-16T22:33:11.812883+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:48:01.966089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"48'1","reported_seq":22,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.800276+0000","last_change":"2024-05-16T22:33:03.999256+0000","last_active":"2024-05-16T22:33:11.800276+0000","last_peered":"2024-05-16T22:33:11.800276+0000","last_clean":"2024-05-16T22:33:11.800276+0000","last_became_active":"2024-05-16T22:33:03.998806+0000","last_became_peered":"2024-05-16T22:33:03.998806+0000","last_unstale":"2024-05-16T22:33:11.800276+0000","last_undegraded":"2024-05-16T22:33:11.800276+0000","last_fullsized":"2024-05-16T22:33:11.800276+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:30:53.846073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.813313+0000","last_change":"2024-05-16T22:33:07.796193+0000","last_active":"2024-05-16T22:33:11.813313+0000","last_peered":"2024-05-16T22:33:11.813313+0000","last_clean":"2024-05-16T22:33:11.813313+0000","last_became_active":"2024-05-16T22:33:07.795779+0000","last_became_peered":"2024-05-16T22:33:07.795779+0000","last_unstale":"2024-05-16T22:33:11.813313+0000","last_undegraded":"2024-05-16T22:33:11.813313+0000","last_fullsized":"2024-05-16T22:33:11.813313+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:26:01.310749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"48'2","reported_seq":23,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.817492+0000","last_change":"2024-05-16T22:33:03.769600+0000","last_active":"2024-05-16T22:33:11.817492+0000","last_peered":"2024-05-16T22:33:11.817492+0000","last_clean":"2024-05-16T22:33:11.817492+0000","last_became_active":"2024-05-16T22:33:03.769256+0000","last_became_peered":"2024-05-16T22:33:03.769256+0000","last_unstale":"2024-05-16T22:33:11.817492+0000","last_undegraded":"2024-05-16T22:33:11.817492+0000","last_fullsized":"2024-05-16T22:33:11.817492+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:46:26.391064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.799525+0000","last_change":"2024-05-16T22:33:07.791199+0000","last_active":"2024-05-16T22:33:11.799525+0000","last_peered":"2024-05-16T22:33:11.799525+0000","last_clean":"2024-05-16T22:33:11.799525+0000","last_became_active":"2024-05-16T22:33:07.789644+0000","last_became_peered":"2024-05-16T22:33:07.789644+0000","last_unstale":"2024-05-16T22:33:11.799525+0000","last_undegraded":"2024-05-16T22:33:11.799525+0000","last_fullsized":"2024-05-16T22:33:11.799525+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:18:11.045305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"48'2","reported_seq":23,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.815343+0000","last_change":"2024-05-16T22:33:03.769173+0000","last_active":"2024-05-16T22:33:11.815343+0000","last_peered":"2024-05-16T22:33:11.815343+0000","last_clean":"2024-05-16T22:33:11.815343+0000","last_became_active":"2024-05-16T22:33:03.768811+0000","last_became_peered":"2024-05-16T22:33:03.768811+0000","last_unstale":"2024-05-16T22:33:11.815343+0000","last_undegraded":"2024-05-16T22:33:11.815343+0000","last_fullsized":"2024-05-16T22:33:11.815343+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:30:53.235100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.799807+0000","last_change":"2024-05-16T22:33:07.797710+0000","last_active":"2024-05-16T22:33:11.799807+0000","last_peered":"2024-05-16T22:33:11.799807+0000","last_clean":"2024-05-16T22:33:11.799807+0000","last_became_active":"2024-05-16T22:33:07.797349+0000","last_became_peered":"2024-05-16T22:33:07.797349+0000","last_unstale":"2024-05-16T22:33:11.799807+0000","last_undegraded":"2024-05-16T22:33:11.799807+0000","last_fullsized":"2024-05-16T22:33:11.799807+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:53:19.649731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"48'1","reported_seq":22,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.813375+0000","last_change":"2024-05-16T22:33:03.769253+0000","last_active":"2024-05-16T22:33:11.813375+0000","last_peered":"2024-05-16T22:33:11.813375+0000","last_clean":"2024-05-16T22:33:11.813375+0000","last_became_active":"2024-05-16T22:33:03.768638+0000","last_became_peered":"2024-05-16T22:33:03.768638+0000","last_unstale":"2024-05-16T22:33:11.813375+0000","last_undegraded":"2024-05-16T22:33:11.813375+0000","last_fullsized":"2024-05-16T22:33:11.813375+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:06:36.058576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.811592+0000","last_change":"2024-05-16T22:33:07.799288+0000","last_active":"2024-05-16T22:33:11.811592+0000","last_peered":"2024-05-16T22:33:11.811592+0000","last_clean":"2024-05-16T22:33:11.811592+0000","last_became_active":"2024-05-16T22:33:07.798549+0000","last_became_peered":"2024-05-16T22:33:07.798549+0000","last_unstale":"2024-05-16T22:33:11.811592+0000","last_undegraded":"2024-05-16T22:33:11.811592+0000","last_fullsized":"2024-05-16T22:33:11.811592+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:08:32.674697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"48'1","reported_seq":22,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.800082+0000","last_change":"2024-05-16T22:33:03.766942+0000","last_active":"2024-05-16T22:33:11.800082+0000","last_peered":"2024-05-16T22:33:11.800082+0000","last_clean":"2024-05-16T22:33:11.800082+0000","last_became_active":"2024-05-16T22:33:03.766587+0000","last_became_peered":"2024-05-16T22:33:03.766587+0000","last_unstale":"2024-05-16T22:33:11.800082+0000","last_undegraded":"2024-05-16T22:33:11.800082+0000","last_fullsized":"2024-05-16T22:33:11.800082+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:50:40.537357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.811406+0000","last_change":"2024-05-16T22:33:07.791984+0000","last_active":"2024-05-16T22:33:11.811406+0000","last_peered":"2024-05-16T22:33:11.811406+0000","last_clean":"2024-05-16T22:33:11.811406+0000","last_became_active":"2024-05-16T22:33:07.790427+0000","last_became_peered":"2024-05-16T22:33:07.790427+0000","last_unstale":"2024-05-16T22:33:11.811406+0000","last_undegraded":"2024-05-16T22:33:11.811406+0000","last_fullsized":"2024-05-16T22:33:11.811406+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:19:34.747729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":21,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.811976+0000","last_change":"2024-05-16T22:33:03.767136+0000","last_active":"2024-05-16T22:33:11.811976+0000","last_peered":"2024-05-16T22:33:11.811976+0000","last_clean":"2024-05-16T22:33:11.811976+0000","last_became_active":"2024-05-16T22:33:03.766728+0000","last_became_peered":"2024-05-16T22:33:03.766728+0000","last_unstale":"2024-05-16T22:33:11.811976+0000","last_undegraded":"2024-05-16T22:33:11.811976+0000","last_fullsized":"2024-05-16T22:33:11.811976+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:39:00.890315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.812579+0000","last_change":"2024-05-16T22:33:07.793374+0000","last_active":"2024-05-16T22:33:11.812579+0000","last_peered":"2024-05-16T22:33:11.812579+0000","last_clean":"2024-05-16T22:33:11.812579+0000","last_became_active":"2024-05-16T22:33:07.792569+0000","last_became_peered":"2024-05-16T22:33:07.792569+0000","last_unstale":"2024-05-16T22:33:11.812579+0000","last_undegraded":"2024-05-16T22:33:11.812579+0000","last_fullsized":"2024-05-16T22:33:11.812579+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:18:18.571371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":21,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.811625+0000","last_change":"2024-05-16T22:33:03.772820+0000","last_active":"2024-05-16T22:33:11.811625+0000","last_peered":"2024-05-16T22:33:11.811625+0000","last_clean":"2024-05-16T22:33:11.811625+0000","last_became_active":"2024-05-16T22:33:03.772196+0000","last_became_peered":"2024-05-16T22:33:03.772196+0000","last_unstale":"2024-05-16T22:33:11.811625+0000","last_undegraded":"2024-05-16T22:33:11.811625+0000","last_fullsized":"2024-05-16T22:33:11.811625+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:43:56.611018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.800059+0000","last_change":"2024-05-16T22:33:07.799258+0000","last_active":"2024-05-16T22:33:11.800059+0000","last_peered":"2024-05-16T22:33:11.800059+0000","last_clean":"2024-05-16T22:33:11.800059+0000","last_became_active":"2024-05-16T22:33:07.798923+0000","last_became_peered":"2024-05-16T22:33:07.798923+0000","last_unstale":"2024-05-16T22:33:11.800059+0000","last_undegraded":"2024-05-16T22:33:11.800059+0000","last_fullsized":"2024-05-16T22:33:11.800059+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:19:33.825579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":21,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.800315+0000","last_change":"2024-05-16T22:33:03.764278+0000","last_active":"2024-05-16T22:33:11.800315+0000","last_peered":"2024-05-16T22:33:11.800315+0000","last_clean":"2024-05-16T22:33:11.800315+0000","last_became_active":"2024-05-16T22:33:03.763935+0000","last_became_peered":"2024-05-16T22:33:03.763935+0000","last_unstale":"2024-05-16T22:33:11.800315+0000","last_undegraded":"2024-05-16T22:33:11.800315+0000","last_fullsized":"2024-05-16T22:33:11.800315+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:36:18.369082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.813192+0000","last_change":"2024-05-16T22:33:07.790526+0000","last_active":"2024-05-16T22:33:11.813192+0000","last_peered":"2024-05-16T22:33:11.813192+0000","last_clean":"2024-05-16T22:33:11.813192+0000","last_became_active":"2024-05-16T22:33:07.790238+0000","last_became_peered":"2024-05-16T22:33:07.790238+0000","last_unstale":"2024-05-16T22:33:11.813192+0000","last_undegraded":"2024-05-16T22:33:11.813192+0000","last_fullsized":"2024-05-16T22:33:11.813192+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:55:26.611271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":21,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.812340+0000","last_change":"2024-05-16T22:33:03.771482+0000","last_active":"2024-05-16T22:33:11.812340+0000","last_peered":"2024-05-16T22:33:11.812340+0000","last_clean":"2024-05-16T22:33:11.812340+0000","last_became_active":"2024-05-16T22:33:03.771107+0000","last_became_peered":"2024-05-16T22:33:03.771107+0000","last_unstale":"2024-05-16T22:33:11.812340+0000","last_undegraded":"2024-05-16T22:33:11.812340+0000","last_fullsized":"2024-05-16T22:33:11.812340+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:20:47.911988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.813110+0000","last_change":"2024-05-16T22:33:07.801619+0000","last_active":"2024-05-16T22:33:11.813110+0000","last_peered":"2024-05-16T22:33:11.813110+0000","last_clean":"2024-05-16T22:33:11.813110+0000","last_became_active":"2024-05-16T22:33:07.801221+0000","last_became_peered":"2024-05-16T22:33:07.801221+0000","last_unstale":"2024-05-16T22:33:11.813110+0000","last_undegraded":"2024-05-16T22:33:11.813110+0000","last_fullsized":"2024-05-16T22:33:11.813110+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:07:29.315685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"48'3","reported_seq":24,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.816648+0000","last_change":"2024-05-16T22:33:03.999378+0000","last_active":"2024-05-16T22:33:11.816648+0000","last_peered":"2024-05-16T22:33:11.816648+0000","last_clean":"2024-05-16T22:33:11.816648+0000","last_became_active":"2024-05-16T22:33:03.998793+0000","last_became_peered":"2024-05-16T22:33:03.998793+0000","last_unstale":"2024-05-16T22:33:11.816648+0000","last_undegraded":"2024-05-16T22:33:11.816648+0000","last_fullsized":"2024-05-16T22:33:11.816648+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:20:40.908537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.812552+0000","last_change":"2024-05-16T22:33:07.797040+0000","last_active":"2024-05-16T22:33:11.812552+0000","last_peered":"2024-05-16T22:33:11.812552+0000","last_clean":"2024-05-16T22:33:11.812552+0000","last_became_active":"2024-05-16T22:33:07.796716+0000","last_became_peered":"2024-05-16T22:33:07.796716+0000","last_unstale":"2024-05-16T22:33:11.812552+0000","last_undegraded":"2024-05-16T22:33:11.812552+0000","last_fullsized":"2024-05-16T22:33:11.812552+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:26:01.310749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"48'6","reported_seq":27,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.818840+0000","last_change":"2024-05-16T22:33:03.760612+0000","last_active":"2024-05-16T22:33:11.818840+0000","last_peered":"2024-05-16T22:33:11.818840+0000","last_clean":"2024-05-16T22:33:11.818840+0000","last_became_active":"2024-05-16T22:33:03.760117+0000","last_became_peered":"2024-05-16T22:33:03.760117+0000","last_unstale":"2024-05-16T22:33:11.818840+0000","last_undegraded":"2024-05-16T22:33:11.818840+0000","last_fullsized":"2024-05-16T22:33:11.818840+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:43:43.932963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.813178+0000","last_change":"2024-05-16T22:33:07.802171+0000","last_active":"2024-05-16T22:33:11.813178+0000","last_peered":"2024-05-16T22:33:11.813178+0000","last_clean":"2024-05-16T22:33:11.813178+0000","last_became_active":"2024-05-16T22:33:07.801829+0000","last_became_peered":"2024-05-16T22:33:07.801829+0000","last_unstale":"2024-05-16T22:33:11.813178+0000","last_undegraded":"2024-05-16T22:33:11.813178+0000","last_fullsized":"2024-05-16T22:33:11.813178+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:14:36.433345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"48'2","reported_seq":23,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.819258+0000","last_change":"2024-05-16T22:33:03.772748+0000","last_active":"2024-05-16T22:33:11.819258+0000","last_peered":"2024-05-16T22:33:11.819258+0000","last_clean":"2024-05-16T22:33:11.819258+0000","last_became_active":"2024-05-16T22:33:03.772387+0000","last_became_peered":"2024-05-16T22:33:03.772387+0000","last_unstale":"2024-05-16T22:33:11.819258+0000","last_undegraded":"2024-05-16T22:33:11.819258+0000","last_fullsized":"2024-05-16T22:33:11.819258+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:58:07.655101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.811778+0000","last_change":"2024-05-16T22:33:07.791460+0000","last_active":"2024-05-16T22:33:11.811778+0000","last_peered":"2024-05-16T22:33:11.811778+0000","last_clean":"2024-05-16T22:33:11.811778+0000","last_became_active":"2024-05-16T22:33:07.791068+0000","last_became_peered":"2024-05-16T22:33:07.791068+0000","last_unstale":"2024-05-16T22:33:11.811778+0000","last_undegraded":"2024-05-16T22:33:11.811778+0000","last_fullsized":"2024-05-16T22:33:11.811778+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:26:01.310749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":21,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.811642+0000","last_change":"2024-05-16T22:33:03.771335+0000","last_active":"2024-05-16T22:33:11.811642+0000","last_peered":"2024-05-16T22:33:11.811642+0000","last_clean":"2024-05-16T22:33:11.811642+0000","last_became_active":"2024-05-16T22:33:03.770949+0000","last_became_peered":"2024-05-16T22:33:03.770949+0000","last_unstale":"2024-05-16T22:33:11.811642+0000","last_undegraded":"2024-05-16T22:33:11.811642+0000","last_fullsized":"2024-05-16T22:33:11.811642+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:19:30.729762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.811338+0000","last_change":"2024-05-16T22:33:07.801805+0000","last_active":"2024-05-16T22:33:11.811338+0000","last_peered":"2024-05-16T22:33:11.811338+0000","last_clean":"2024-05-16T22:33:11.811338+0000","last_became_active":"2024-05-16T22:33:07.801469+0000","last_became_peered":"2024-05-16T22:33:07.801469+0000","last_unstale":"2024-05-16T22:33:11.811338+0000","last_undegraded":"2024-05-16T22:33:11.811338+0000","last_fullsized":"2024-05-16T22:33:11.811338+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:27:43.960263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":21,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.812053+0000","last_change":"2024-05-16T22:33:03.774002+0000","last_active":"2024-05-16T22:33:11.812053+0000","last_peered":"2024-05-16T22:33:11.812053+0000","last_clean":"2024-05-16T22:33:11.812053+0000","last_became_active":"2024-05-16T22:33:03.773598+0000","last_became_peered":"2024-05-16T22:33:03.773598+0000","last_unstale":"2024-05-16T22:33:11.812053+0000","last_undegraded":"2024-05-16T22:33:11.812053+0000","last_fullsized":"2024-05-16T22:33:11.812053+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:09:09.608625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.811920+0000","last_change":"2024-05-16T22:33:07.790600+0000","last_active":"2024-05-16T22:33:11.811920+0000","last_peered":"2024-05-16T22:33:11.811920+0000","last_clean":"2024-05-16T22:33:11.811920+0000","last_became_active":"2024-05-16T22:33:07.790334+0000","last_became_peered":"2024-05-16T22:33:07.790334+0000","last_unstale":"2024-05-16T22:33:11.811920+0000","last_undegraded":"2024-05-16T22:33:11.811920+0000","last_fullsized":"2024-05-16T22:33:11.811920+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:08:32.674697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"48'8","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.819449+0000","last_change":"2024-05-16T22:33:03.772528+0000","last_active":"2024-05-16T22:33:11.819449+0000","last_peered":"2024-05-16T22:33:11.819449+0000","last_clean":"2024-05-16T22:33:11.819449+0000","last_became_active":"2024-05-16T22:33:03.772148+0000","last_became_peered":"2024-05-16T22:33:03.772148+0000","last_unstale":"2024-05-16T22:33:11.819449+0000","last_undegraded":"2024-05-16T22:33:11.819449+0000","last_fullsized":"2024-05-16T22:33:11.819449+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:20:40.908537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.812010+0000","last_change":"2024-05-16T22:33:07.792943+0000","last_active":"2024-05-16T22:33:11.812010+0000","last_peered":"2024-05-16T22:33:11.812010+0000","last_clean":"2024-05-16T22:33:11.812010+0000","last_became_active":"2024-05-16T22:33:07.792585+0000","last_became_peered":"2024-05-16T22:33:07.792585+0000","last_unstale":"2024-05-16T22:33:11.812010+0000","last_undegraded":"2024-05-16T22:33:11.812010+0000","last_fullsized":"2024-05-16T22:33:11.812010+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:11:49.983401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"48'1","reported_seq":22,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.813126+0000","last_change":"2024-05-16T22:33:03.768594+0000","last_active":"2024-05-16T22:33:11.813126+0000","last_peered":"2024-05-16T22:33:11.813126+0000","last_clean":"2024-05-16T22:33:11.813126+0000","last_became_active":"2024-05-16T22:33:03.768272+0000","last_became_peered":"2024-05-16T22:33:03.768272+0000","last_unstale":"2024-05-16T22:33:11.813126+0000","last_undegraded":"2024-05-16T22:33:11.813126+0000","last_fullsized":"2024-05-16T22:33:11.813126+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:33:03.362928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.812514+0000","last_change":"2024-05-16T22:33:07.798367+0000","last_active":"2024-05-16T22:33:11.812514+0000","last_peered":"2024-05-16T22:33:11.812514+0000","last_clean":"2024-05-16T22:33:11.812514+0000","last_became_active":"2024-05-16T22:33:07.797531+0000","last_became_peered":"2024-05-16T22:33:07.797531+0000","last_unstale":"2024-05-16T22:33:11.812514+0000","last_undegraded":"2024-05-16T22:33:11.812514+0000","last_fullsized":"2024-05-16T22:33:11.812514+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:36:27.885318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"48'2","reported_seq":23,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.813677+0000","last_change":"2024-05-16T22:33:03.765338+0000","last_active":"2024-05-16T22:33:11.813677+0000","last_peered":"2024-05-16T22:33:11.813677+0000","last_clean":"2024-05-16T22:33:11.813677+0000","last_became_active":"2024-05-16T22:33:03.764944+0000","last_became_peered":"2024-05-16T22:33:03.764944+0000","last_unstale":"2024-05-16T22:33:11.813677+0000","last_undegraded":"2024-05-16T22:33:11.813677+0000","last_fullsized":"2024-05-16T22:33:11.813677+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:28:44.203371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.813430+0000","last_change":"2024-05-16T22:33:07.796460+0000","last_active":"2024-05-16T22:33:11.813430+0000","last_peered":"2024-05-16T22:33:11.813430+0000","last_clean":"2024-05-16T22:33:11.813430+0000","last_became_active":"2024-05-16T22:33:07.794906+0000","last_became_peered":"2024-05-16T22:33:07.794906+0000","last_unstale":"2024-05-16T22:33:11.813430+0000","last_undegraded":"2024-05-16T22:33:11.813430+0000","last_fullsized":"2024-05-16T22:33:11.813430+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:46:30.409031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"48'1","reported_seq":22,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.812642+0000","last_change":"2024-05-16T22:33:03.771139+0000","last_active":"2024-05-16T22:33:11.812642+0000","last_peered":"2024-05-16T22:33:11.812642+0000","last_clean":"2024-05-16T22:33:11.812642+0000","last_became_active":"2024-05-16T22:33:03.770733+0000","last_became_peered":"2024-05-16T22:33:03.770733+0000","last_unstale":"2024-05-16T22:33:11.812642+0000","last_undegraded":"2024-05-16T22:33:11.812642+0000","last_fullsized":"2024-05-16T22:33:11.812642+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:19:30.729762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.813377+0000","last_change":"2024-05-16T22:33:07.801614+0000","last_active":"2024-05-16T22:33:11.813377+0000","last_peered":"2024-05-16T22:33:11.813377+0000","last_clean":"2024-05-16T22:33:11.813377+0000","last_became_active":"2024-05-16T22:33:07.801229+0000","last_became_peered":"2024-05-16T22:33:07.801229+0000","last_unstale":"2024-05-16T22:33:11.813377+0000","last_undegraded":"2024-05-16T22:33:11.813377+0000","last_fullsized":"2024-05-16T22:33:11.813377+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:18:11.045305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":21,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.813296+0000","last_change":"2024-05-16T22:33:03.999459+0000","last_active":"2024-05-16T22:33:11.813296+0000","last_peered":"2024-05-16T22:33:11.813296+0000","last_clean":"2024-05-16T22:33:11.813296+0000","last_became_active":"2024-05-16T22:33:03.998812+0000","last_became_peered":"2024-05-16T22:33:03.998812+0000","last_unstale":"2024-05-16T22:33:11.813296+0000","last_undegraded":"2024-05-16T22:33:11.813296+0000","last_fullsized":"2024-05-16T22:33:11.813296+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:37:24.141095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.812433+0000","last_change":"2024-05-16T22:33:07.803092+0000","last_active":"2024-05-16T22:33:11.812433+0000","last_peered":"2024-05-16T22:33:11.812433+0000","last_clean":"2024-05-16T22:33:11.812433+0000","last_became_active":"2024-05-16T22:33:07.802762+0000","last_became_peered":"2024-05-16T22:33:07.802762+0000","last_unstale":"2024-05-16T22:33:11.812433+0000","last_undegraded":"2024-05-16T22:33:11.812433+0000","last_fullsized":"2024-05-16T22:33:11.812433+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:49:51.527355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"48'2","reported_seq":23,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.817031+0000","last_change":"2024-05-16T22:33:03.768670+0000","last_active":"2024-05-16T22:33:11.817031+0000","last_peered":"2024-05-16T22:33:11.817031+0000","last_clean":"2024-05-16T22:33:11.817031+0000","last_became_active":"2024-05-16T22:33:03.768314+0000","last_became_peered":"2024-05-16T22:33:03.768314+0000","last_unstale":"2024-05-16T22:33:11.817031+0000","last_undegraded":"2024-05-16T22:33:11.817031+0000","last_fullsized":"2024-05-16T22:33:11.817031+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:40:39.761130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.799256+0000","last_change":"2024-05-16T22:33:07.780692+0000","last_active":"2024-05-16T22:33:11.799256+0000","last_peered":"2024-05-16T22:33:11.799256+0000","last_clean":"2024-05-16T22:33:11.799256+0000","last_became_active":"2024-05-16T22:33:07.780293+0000","last_became_peered":"2024-05-16T22:33:07.780293+0000","last_unstale":"2024-05-16T22:33:11.799256+0000","last_undegraded":"2024-05-16T22:33:11.799256+0000","last_fullsized":"2024-05-16T22:33:11.799256+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:48:01.966089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":21,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.812468+0000","last_change":"2024-05-16T22:33:03.998909+0000","last_active":"2024-05-16T22:33:11.812468+0000","last_peered":"2024-05-16T22:33:11.812468+0000","last_clean":"2024-05-16T22:33:11.812468+0000","last_became_active":"2024-05-16T22:33:03.998546+0000","last_became_peered":"2024-05-16T22:33:03.998546+0000","last_unstale":"2024-05-16T22:33:11.812468+0000","last_undegraded":"2024-05-16T22:33:11.812468+0000","last_fullsized":"2024-05-16T22:33:11.812468+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:33:59.809235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.814362+0000","last_change":"2024-05-16T22:33:07.797223+0000","last_active":"2024-05-16T22:33:11.814362+0000","last_peered":"2024-05-16T22:33:11.814362+0000","last_clean":"2024-05-16T22:33:11.814362+0000","last_became_active":"2024-05-16T22:33:07.796864+0000","last_became_peered":"2024-05-16T22:33:07.796864+0000","last_unstale":"2024-05-16T22:33:11.814362+0000","last_undegraded":"2024-05-16T22:33:11.814362+0000","last_fullsized":"2024-05-16T22:33:11.814362+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:14:39.739523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":21,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.812076+0000","last_change":"2024-05-16T22:33:03.772064+0000","last_active":"2024-05-16T22:33:11.812076+0000","last_peered":"2024-05-16T22:33:11.812076+0000","last_clean":"2024-05-16T22:33:11.812076+0000","last_became_active":"2024-05-16T22:33:03.771663+0000","last_became_peered":"2024-05-16T22:33:03.771663+0000","last_unstale":"2024-05-16T22:33:11.812076+0000","last_undegraded":"2024-05-16T22:33:11.812076+0000","last_fullsized":"2024-05-16T22:33:11.812076+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:05:52.712914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.811266+0000","last_change":"2024-05-16T22:33:07.792771+0000","last_active":"2024-05-16T22:33:11.811266+0000","last_peered":"2024-05-16T22:33:11.811266+0000","last_clean":"2024-05-16T22:33:11.811266+0000","last_became_active":"2024-05-16T22:33:07.792423+0000","last_became_peered":"2024-05-16T22:33:07.792423+0000","last_unstale":"2024-05-16T22:33:11.811266+0000","last_undegraded":"2024-05-16T22:33:11.811266+0000","last_fullsized":"2024-05-16T22:33:11.811266+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:39:04.908283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":21,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.811446+0000","last_change":"2024-05-16T22:33:03.770175+0000","last_active":"2024-05-16T22:33:11.811446+0000","last_peered":"2024-05-16T22:33:11.811446+0000","last_clean":"2024-05-16T22:33:11.811446+0000","last_became_active":"2024-05-16T22:33:03.769816+0000","last_became_peered":"2024-05-16T22:33:03.769816+0000","last_unstale":"2024-05-16T22:33:11.811446+0000","last_undegraded":"2024-05-16T22:33:11.811446+0000","last_fullsized":"2024-05-16T22:33:11.811446+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:33:59.809235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.813081+0000","last_change":"2024-05-16T22:33:07.798709+0000","last_active":"2024-05-16T22:33:11.813081+0000","last_peered":"2024-05-16T22:33:11.813081+0000","last_clean":"2024-05-16T22:33:11.813081+0000","last_became_active":"2024-05-16T22:33:07.798400+0000","last_became_peered":"2024-05-16T22:33:07.798400+0000","last_unstale":"2024-05-16T22:33:11.813081+0000","last_undegraded":"2024-05-16T22:33:11.813081+0000","last_fullsized":"2024-05-16T22:33:11.813081+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:41:27.693799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"48'1","reported_seq":22,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.813748+0000","last_change":"2024-05-16T22:33:03.767203+0000","last_active":"2024-05-16T22:33:11.813748+0000","last_peered":"2024-05-16T22:33:11.813748+0000","last_clean":"2024-05-16T22:33:11.813748+0000","last_became_active":"2024-05-16T22:33:03.766560+0000","last_became_peered":"2024-05-16T22:33:03.766560+0000","last_unstale":"2024-05-16T22:33:11.813748+0000","last_undegraded":"2024-05-16T22:33:11.813748+0000","last_fullsized":"2024-05-16T22:33:11.813748+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:06:38.014577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.811784+0000","last_change":"2024-05-16T22:33:07.791362+0000","last_active":"2024-05-16T22:33:11.811784+0000","last_peered":"2024-05-16T22:33:11.811784+0000","last_clean":"2024-05-16T22:33:11.811784+0000","last_became_active":"2024-05-16T22:33:07.790818+0000","last_became_peered":"2024-05-16T22:33:07.790818+0000","last_unstale":"2024-05-16T22:33:11.811784+0000","last_undegraded":"2024-05-16T22:33:11.811784+0000","last_fullsized":"2024-05-16T22:33:11.811784+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:19:28.290115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":21,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.813313+0000","last_change":"2024-05-16T22:33:03.999761+0000","last_active":"2024-05-16T22:33:11.813313+0000","last_peered":"2024-05-16T22:33:11.813313+0000","last_clean":"2024-05-16T22:33:11.813313+0000","last_became_active":"2024-05-16T22:33:03.999238+0000","last_became_peered":"2024-05-16T22:33:03.999238+0000","last_unstale":"2024-05-16T22:33:11.813313+0000","last_undegraded":"2024-05-16T22:33:11.813313+0000","last_fullsized":"2024-05-16T22:33:11.813313+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:05:52.712914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.812737+0000","last_change":"2024-05-16T22:33:07.800007+0000","last_active":"2024-05-16T22:33:11.812737+0000","last_peered":"2024-05-16T22:33:11.812737+0000","last_clean":"2024-05-16T22:33:11.812737+0000","last_became_active":"2024-05-16T22:33:07.799676+0000","last_became_peered":"2024-05-16T22:33:07.799676+0000","last_unstale":"2024-05-16T22:33:11.812737+0000","last_undegraded":"2024-05-16T22:33:11.812737+0000","last_fullsized":"2024-05-16T22:33:11.812737+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:19:28.290115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":21,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.799296+0000","last_change":"2024-05-16T22:33:03.768474+0000","last_active":"2024-05-16T22:33:11.799296+0000","last_peered":"2024-05-16T22:33:11.799296+0000","last_clean":"2024-05-16T22:33:11.799296+0000","last_became_active":"2024-05-16T22:33:03.768158+0000","last_became_peered":"2024-05-16T22:33:03.768158+0000","last_unstale":"2024-05-16T22:33:11.799296+0000","last_undegraded":"2024-05-16T22:33:11.799296+0000","last_fullsized":"2024-05-16T22:33:11.799296+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:41:23.675831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.812589+0000","last_change":"2024-05-16T22:33:07.795462+0000","last_active":"2024-05-16T22:33:11.812589+0000","last_peered":"2024-05-16T22:33:11.812589+0000","last_clean":"2024-05-16T22:33:11.812589+0000","last_became_active":"2024-05-16T22:33:07.795130+0000","last_became_peered":"2024-05-16T22:33:07.795130+0000","last_unstale":"2024-05-16T22:33:11.812589+0000","last_undegraded":"2024-05-16T22:33:11.812589+0000","last_fullsized":"2024-05-16T22:33:11.812589+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:29:26.509349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":21,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.812331+0000","last_change":"2024-05-16T22:33:03.999205+0000","last_active":"2024-05-16T22:33:11.812331+0000","last_peered":"2024-05-16T22:33:11.812331+0000","last_clean":"2024-05-16T22:33:11.812331+0000","last_became_active":"2024-05-16T22:33:03.998563+0000","last_became_peered":"2024-05-16T22:33:03.998563+0000","last_unstale":"2024-05-16T22:33:11.812331+0000","last_undegraded":"2024-05-16T22:33:11.812331+0000","last_fullsized":"2024-05-16T22:33:11.812331+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:43:56.611018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.813236+0000","last_change":"2024-05-16T22:33:07.802994+0000","last_active":"2024-05-16T22:33:11.813236+0000","last_peered":"2024-05-16T22:33:11.813236+0000","last_clean":"2024-05-16T22:33:11.813236+0000","last_became_active":"2024-05-16T22:33:07.800578+0000","last_became_peered":"2024-05-16T22:33:07.800578+0000","last_unstale":"2024-05-16T22:33:11.813236+0000","last_undegraded":"2024-05-16T22:33:11.813236+0000","last_fullsized":"2024-05-16T22:33:11.813236+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:00:20.576002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":21,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.800326+0000","last_change":"2024-05-16T22:33:03.765155+0000","last_active":"2024-05-16T22:33:11.800326+0000","last_peered":"2024-05-16T22:33:11.800326+0000","last_clean":"2024-05-16T22:33:11.800326+0000","last_became_active":"2024-05-16T22:33:03.764839+0000","last_became_peered":"2024-05-16T22:33:03.764839+0000","last_unstale":"2024-05-16T22:33:11.800326+0000","last_undegraded":"2024-05-16T22:33:11.800326+0000","last_fullsized":"2024-05-16T22:33:11.800326+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:37:26.218211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.811883+0000","last_change":"2024-05-16T22:33:07.781981+0000","last_active":"2024-05-16T22:33:11.811883+0000","last_peered":"2024-05-16T22:33:11.811883+0000","last_clean":"2024-05-16T22:33:11.811883+0000","last_became_active":"2024-05-16T22:33:07.781621+0000","last_became_peered":"2024-05-16T22:33:07.781621+0000","last_unstale":"2024-05-16T22:33:11.811883+0000","last_undegraded":"2024-05-16T22:33:11.811883+0000","last_fullsized":"2024-05-16T22:33:11.811883+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:28:48.221339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":21,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.799167+0000","last_change":"2024-05-16T22:33:03.999317+0000","last_active":"2024-05-16T22:33:11.799167+0000","last_peered":"2024-05-16T22:33:11.799167+0000","last_clean":"2024-05-16T22:33:11.799167+0000","last_became_active":"2024-05-16T22:33:03.998882+0000","last_became_peered":"2024-05-16T22:33:03.998882+0000","last_unstale":"2024-05-16T22:33:11.799167+0000","last_undegraded":"2024-05-16T22:33:11.799167+0000","last_fullsized":"2024-05-16T22:33:11.799167+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:05:20.098018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.799774+0000","last_change":"2024-05-16T22:33:07.795404+0000","last_active":"2024-05-16T22:33:11.799774+0000","last_peered":"2024-05-16T22:33:11.799774+0000","last_clean":"2024-05-16T22:33:11.799774+0000","last_became_active":"2024-05-16T22:33:07.795054+0000","last_became_peered":"2024-05-16T22:33:07.795054+0000","last_unstale":"2024-05-16T22:33:11.799774+0000","last_undegraded":"2024-05-16T22:33:11.799774+0000","last_fullsized":"2024-05-16T22:33:11.799774+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:46:30.409031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":21,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.812066+0000","last_change":"2024-05-16T22:33:03.772974+0000","last_active":"2024-05-16T22:33:11.812066+0000","last_peered":"2024-05-16T22:33:11.812066+0000","last_clean":"2024-05-16T22:33:11.812066+0000","last_became_active":"2024-05-16T22:33:03.772554+0000","last_became_peered":"2024-05-16T22:33:03.772554+0000","last_unstale":"2024-05-16T22:33:11.812066+0000","last_undegraded":"2024-05-16T22:33:11.812066+0000","last_fullsized":"2024-05-16T22:33:11.812066+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:55:22.593304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.812167+0000","last_change":"2024-05-16T22:33:07.797751+0000","last_active":"2024-05-16T22:33:11.812167+0000","last_peered":"2024-05-16T22:33:11.812167+0000","last_clean":"2024-05-16T22:33:11.812167+0000","last_became_active":"2024-05-16T22:33:07.796217+0000","last_became_peered":"2024-05-16T22:33:07.796217+0000","last_unstale":"2024-05-16T22:33:11.812167+0000","last_undegraded":"2024-05-16T22:33:11.812167+0000","last_fullsized":"2024-05-16T22:33:11.812167+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:28:06.958534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"48'2","reported_seq":23,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.817001+0000","last_change":"2024-05-16T22:33:03.769898+0000","last_active":"2024-05-16T22:33:11.817001+0000","last_peered":"2024-05-16T22:33:11.817001+0000","last_clean":"2024-05-16T22:33:11.817001+0000","last_became_active":"2024-05-16T22:33:03.769455+0000","last_became_peered":"2024-05-16T22:33:03.769455+0000","last_unstale":"2024-05-16T22:33:11.817001+0000","last_undegraded":"2024-05-16T22:33:11.817001+0000","last_fullsized":"2024-05-16T22:33:11.817001+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:19:24.272148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":164,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.811443+0000","last_change":"2024-05-16T22:27:15.950850+0000","last_active":"2024-05-16T22:33:11.811443+0000","last_peered":"2024-05-16T22:33:11.811443+0000","last_clean":"2024-05-16T22:33:11.811443+0000","last_became_active":"2024-05-16T22:27:15.949553+0000","last_became_peered":"2024-05-16T22:27:15.949553+0000","last_unstale":"2024-05-16T22:33:11.811443+0000","last_undegraded":"2024-05-16T22:33:11.811443+0000","last_fullsized":"2024-05-16T22:33:11.811443+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:14.702385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:14.702385+0000","last_clean_scrub_stamp":"2024-05-16T22:27:14.702385+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:46:07.495562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542224,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36476,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335364,"statfs":{"total":96636764160,"available":96599412736,"internally_reserved":0,"allocated":1163264,"data_stored":821030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574927,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31740,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340100,"statfs":{"total":96636764160,"available":96604262400,"internally_reserved":0,"allocated":573440,"data_stored":231244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574927,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35896,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335944,"statfs":{"total":96636764160,"available":96600006656,"internally_reserved":0,"allocated":569344,"data_stored":230642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31744,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340096,"statfs":{"total":96636764160,"available":96604258304,"internally_reserved":0,"allocated":577536,"data_stored":232184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574927,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31744,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340096,"statfs":{"total":96636764160,"available":96604258304,"internally_reserved":0,"allocated":577536,"data_stored":231210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574927,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31752,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340088,"statfs":{"total":96636764160,"available":96604250112,"internally_reserved":0,"allocated":581632,"data_stored":232206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31736,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340104,"statfs":{"total":96636764160,"available":96604266496,"internally_reserved":0,"allocated":569344,"data_stored":230642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574927,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32316,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339524,"statfs":{"total":96636764160,"available":96603672576,"internally_reserved":0,"allocated":1163264,"data_stored":820974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-16T22:33:39.743 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-16T22:33:39.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.918+0000 7f91d8e0c640 1 Processor -- start 2024-05-16T22:33:39.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.918+0000 7f91d8e0c640 1 -- start start 2024-05-16T22:33:40.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.919+0000 7f91d8e0c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f91d40b4500 0x7f91d40b57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:40.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.919+0000 7f91d8e0c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f91d40b9ee0 0x7f91d40a4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:40.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.919+0000 7f91d8e0c640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91d40bba80 con 0x7f91d40bb490 2024-05-16T22:33:40.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.919+0000 7f91d8e0c640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f91d40bbd60 con 0x7f91d40b4500 2024-05-16T22:33:40.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.919+0000 7f91d8e0c640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f91d40b4ff0 con 0x7f91d40b9ee0 2024-05-16T22:33:40.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.919+0000 7f91d259c640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f91d40bb490 0x7f91d406faa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46562/0 (socket says 172.21.15.44:46562) 2024-05-16T22:33:40.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.919+0000 7f91d259c640 1 -- 172.21.15.44:0/1835593467 learned_addr learned my addr 172.21.15.44:0/1835593467 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:33:40.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.919+0000 7f91cbfff640 1 --2- 172.21.15.44:0/1835593467 >> v2:172.21.15.70:3300/0 conn(0x7f91d40b4500 0x7f91d40b57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:40.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.919+0000 7f91d2d9d640 1 --2- 172.21.15.44:0/1835593467 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f91d40b9ee0 0x7f91d40a4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:40.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.919+0000 7f91d1d9b640 1 -- 172.21.15.44:0/1835593467 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3356583070 0 0) 0x7f91d40bba80 con 0x7f91d40bb490 2024-05-16T22:33:40.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.920+0000 7f91d1d9b640 1 -- 172.21.15.44:0/1835593467 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91c0003520 con 0x7f91d40bb490 2024-05-16T22:33:40.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.920+0000 7f91d1d9b640 1 -- 172.21.15.44:0/1835593467 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2851201150 0 0) 0x7f91c0003520 con 0x7f91d40bb490 2024-05-16T22:33:40.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.920+0000 7f91d1d9b640 1 -- 172.21.15.44:0/1835593467 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f91d40b9ee0 msgr2=0x7f91d40a4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:33:40.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.920+0000 7f91d1d9b640 1 --2- 172.21.15.44:0/1835593467 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f91d40b9ee0 0x7f91d40a4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:40.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.920+0000 7f91d1d9b640 1 -- 172.21.15.44:0/1835593467 >> v2:172.21.15.70:3300/0 conn(0x7f91d40b4500 msgr2=0x7f91d40b57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:33:40.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.920+0000 7f91d1d9b640 1 --2- 172.21.15.44:0/1835593467 >> v2:172.21.15.70:3300/0 conn(0x7f91d40b4500 0x7f91d40b57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:40.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.920+0000 7f91d1d9b640 1 -- 172.21.15.44:0/1835593467 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91d40b52d0 con 0x7f91d40bb490 2024-05-16T22:33:40.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.920+0000 7f91d1d9b640 1 -- 172.21.15.44:0/1835593467 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 568431863 0 0) 0x7f91c40016f0 con 0x7f91d40bb490 2024-05-16T22:33:40.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.920+0000 7f91d1d9b640 1 -- 172.21.15.44:0/1835593467 >> v1:172.21.15.44:6789/0 conn(0x7f91d40bb490 legacy=0x7f91d406faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:40.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.920+0000 7f91d1d9b640 1 --2- 172.21.15.44:0/1835593467 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91c0003a00 0x7f91c0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:40.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.920+0000 7f91d1d9b640 1 --2- 172.21.15.44:0/1835593467 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91c0004800 0x7f91c0004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:40.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.920+0000 7f91d1d9b640 1 --2- 172.21.15.44:0/1835593467 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f91d40b9ee0 0x7f91c0005170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:41.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.920+0000 7f91d1d9b640 1 -- 172.21.15.44:0/1835593467 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f91d40bbd60 con 0x7f91c0004800 2024-05-16T22:33:41.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.920+0000 7f91d1d9b640 1 -- 172.21.15.44:0/1835593467 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f91d40b4ff0 con 0x7f91c0003a00 2024-05-16T22:33:41.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.920+0000 7f91d1d9b640 1 -- 172.21.15.44:0/1835593467 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f91c000baf0 con 0x7f91d40b9ee0 2024-05-16T22:33:41.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.920+0000 7f91cbfff640 1 --2- 172.21.15.44:0/1835593467 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91c0004800 0x7f91c0004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:41.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.920+0000 7f91d259c640 1 --2- 172.21.15.44:0/1835593467 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91c0003a00 0x7f91c0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:41.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.920+0000 7f91d2d9d640 1 --2- 172.21.15.44:0/1835593467 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f91d40b9ee0 0x7f91c0005170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:41.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.920+0000 7f91cbfff640 1 -- 172.21.15.44:0/1835593467 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f91d40b9ee0 msgr2=0x7f91c0005170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:33:41.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.920+0000 7f91cbfff640 1 --2- 172.21.15.44:0/1835593467 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f91d40b9ee0 0x7f91c0005170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:41.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.920+0000 7f91cbfff640 1 -- 172.21.15.44:0/1835593467 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91c0003a00 msgr2=0x7f91c0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:33:41.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.920+0000 7f91cbfff640 1 --2- 172.21.15.44:0/1835593467 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91c0003a00 0x7f91c0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:41.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.920+0000 7f91cbfff640 1 -- 172.21.15.44:0/1835593467 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91c0003520 con 0x7f91c0004800 2024-05-16T22:33:41.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.921+0000 7f91cbfff640 1 --2- 172.21.15.44:0/1835593467 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91c0004800 0x7f91c0004c10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f91bc009ac0 tx=0x7f91c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95577ad66f27aa3c server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:41.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.921+0000 7f91d1d9b640 1 -- 172.21.15.44:0/1835593467 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91bc036070 con 0x7f91c0004800 2024-05-16T22:33:41.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.921+0000 7f91d1d9b640 1 -- 172.21.15.44:0/1835593467 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91bc031400 con 0x7f91c0004800 2024-05-16T22:33:41.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.921+0000 7f91d1d9b640 1 -- 172.21.15.44:0/1835593467 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91bc009690 con 0x7f91c0004800 2024-05-16T22:33:41.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.922+0000 7f91d8e0c640 1 -- 172.21.15.44:0/1835593467 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91c0004800 msgr2=0x7f91c0004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:41.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.922+0000 7f91d8e0c640 1 --2- 172.21.15.44:0/1835593467 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91c0004800 0x7f91c0004c10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f91bc009ac0 tx=0x7f91c0005830 comp rx=0 tx=0).stop 2024-05-16T22:33:41.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.922+0000 7f91d2d9d640 1 -- 172.21.15.44:0/1835593467 reap_dead start 2024-05-16T22:33:41.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.922+0000 7f91d8e0c640 1 -- 172.21.15.44:0/1835593467 shutdown_connections 2024-05-16T22:33:41.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.922+0000 7f91d8e0c640 1 -- 172.21.15.44:0/1835593467 >> 172.21.15.44:0/1835593467 conn(0x7f91d40a1ac0 msgr2=0x7f91d40bbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:33:41.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.922+0000 7f91d8e0c640 1 -- 172.21.15.44:0/1835593467 shutdown_connections 2024-05-16T22:33:41.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.922+0000 7f91d8e0c640 1 -- 172.21.15.44:0/1835593467 wait complete. 2024-05-16T22:33:41.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.924+0000 7f91d8e0c640 1 Processor -- start 2024-05-16T22:33:41.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.924+0000 7f91d8e0c640 1 -- start start 2024-05-16T22:33:41.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.925+0000 7f91d8e0c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91c0004800 0x7f91d41d1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:41.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.925+0000 7f91d8e0c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91d409f480 0x7f91d41d71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:41.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.925+0000 7f91d8e0c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f91d41d7720 0x7f91d41e5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:41.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.925+0000 7f91d8e0c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f91d40a4080 con 0x7f91c0004800 2024-05-16T22:33:41.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.925+0000 7f91d8e0c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f91d40ba2f0 con 0x7f91d409f480 2024-05-16T22:33:41.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.925+0000 7f91d8e0c640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f91d40a4200 con 0x7f91d41d7720 2024-05-16T22:33:41.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.925+0000 7f91d259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91c0004800 0x7f91d41d1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:41.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.925+0000 7f91d259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91c0004800 0x7f91d41d1410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57782/0 (socket says 172.21.15.44:57782) 2024-05-16T22:33:41.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.925+0000 7f91d259c640 1 -- 172.21.15.44:0/3308032018 learned_addr learned my addr 172.21.15.44:0/3308032018 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:33:42.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.925+0000 7f91d2d9d640 1 --2- 172.21.15.44:0/3308032018 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f91d41d7720 0x7f91d41e5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:42.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.925+0000 7f91cbfff640 1 --2- 172.21.15.44:0/3308032018 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91d409f480 0x7f91d41d71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:42.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.925+0000 7f91d259c640 1 -- 172.21.15.44:0/3308032018 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f91d41d7720 msgr2=0x7f91d41e5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:42.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.925+0000 7f91d259c640 1 --2- 172.21.15.44:0/3308032018 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f91d41d7720 0x7f91d41e5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:42.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.925+0000 7f91d259c640 1 -- 172.21.15.44:0/3308032018 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91d409f480 msgr2=0x7f91d41d71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:42.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.925+0000 7f91d259c640 1 --2- 172.21.15.44:0/3308032018 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91d409f480 0x7f91d41d71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:42.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.925+0000 7f91d259c640 1 -- 172.21.15.44:0/3308032018 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91d41e33c0 con 0x7f91c0004800 2024-05-16T22:33:42.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.925+0000 7f91cbfff640 1 --2- 172.21.15.44:0/3308032018 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91d409f480 0x7f91d41d71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:33:42.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.925+0000 7f91d2d9d640 1 --2- 172.21.15.44:0/3308032018 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f91d41d7720 0x7f91d41e5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:33:42.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.926+0000 7f91d259c640 1 --2- 172.21.15.44:0/3308032018 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91c0004800 0x7f91d41d1410 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f91c40072c0 tx=0x7f91c4007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:42.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.926+0000 7f91caffd640 1 -- 172.21.15.44:0/3308032018 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c401a070 con 0x7f91c0004800 2024-05-16T22:33:42.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.926+0000 7f91caffd640 1 -- 172.21.15.44:0/3308032018 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91c400f940 con 0x7f91c0004800 2024-05-16T22:33:42.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.926+0000 7f91caffd640 1 -- 172.21.15.44:0/3308032018 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c400fcf0 con 0x7f91c0004800 2024-05-16T22:33:42.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.926+0000 7f91d8e0c640 1 -- 172.21.15.44:0/3308032018 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91d41e2600 con 0x7f91c0004800 2024-05-16T22:33:42.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.926+0000 7f91d8e0c640 1 -- 172.21.15.44:0/3308032018 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91d41e2bc0 con 0x7f91c0004800 2024-05-16T22:33:42.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.927+0000 7f91d8e0c640 1 -- 172.21.15.44:0/3308032018 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91d40a2690 con 0x7f91c0004800 2024-05-16T22:33:42.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.928+0000 7f91caffd640 1 -- 172.21.15.44:0/3308032018 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f91c401d360 con 0x7f91c0004800 2024-05-16T22:33:42.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.928+0000 7f91caffd640 1 --2- 172.21.15.44:0/3308032018 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f91b40762d0 0x7f91b40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:42.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.928+0000 7f91caffd640 1 -- 172.21.15.44:0/3308032018 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f91c4096f60 con 0x7f91c0004800 2024-05-16T22:33:42.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.928+0000 7f91cbfff640 1 --2- 172.21.15.44:0/3308032018 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f91b40762d0 0x7f91b40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:42.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.929+0000 7f91cbfff640 1 --2- 172.21.15.44:0/3308032018 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f91b40762d0 0x7f91b40787e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f91bc009ac0 tx=0x7f91bc008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:42.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:39.933+0000 7f91caffd640 1 -- 172.21.15.44:0/3308032018 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f91c4060950 con 0x7f91c0004800 2024-05-16T22:33:42.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:40.119+0000 7f91d8e0c640 1 -- 172.21.15.44:0/3308032018 --> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f91d4050940 con 0x7f91b40762d0 2024-05-16T22:33:42.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:40.126+0000 7f91caffd640 1 -- 172.21.15.44:0/3308032018 <== mgr.4114 v2:172.21.15.70:6832/4049588098 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251829 (secure 0 0 0) 0x7f91d4050940 con 0x7f91b40762d0 2024-05-16T22:33:42.862 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:33:42.894 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-05-16T22:33:42.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:40.129+0000 7f91d8e0c640 1 -- 172.21.15.44:0/3308032018 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f91b40762d0 msgr2=0x7f91b40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:42.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:40.129+0000 7f91d8e0c640 1 --2- 172.21.15.44:0/3308032018 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f91b40762d0 0x7f91b40787e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f91bc009ac0 tx=0x7f91bc008030 comp rx=0 tx=0).stop 2024-05-16T22:33:42.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:40.129+0000 7f91d8e0c640 1 -- 172.21.15.44:0/3308032018 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91c0004800 msgr2=0x7f91d41d1410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:43.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:40.129+0000 7f91d8e0c640 1 --2- 172.21.15.44:0/3308032018 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91c0004800 0x7f91d41d1410 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f91c40072c0 tx=0x7f91c4007780 comp rx=0 tx=0).stop 2024-05-16T22:33:43.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:40.129+0000 7f91d8e0c640 1 -- 172.21.15.44:0/3308032018 shutdown_connections 2024-05-16T22:33:43.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:40.129+0000 7f91d8e0c640 1 --2- 172.21.15.44:0/3308032018 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f91b40762d0 0x7f91b40787e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:43.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:40.129+0000 7f91d8e0c640 1 --2- 172.21.15.44:0/3308032018 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f91d41d7720 0x7f91d41e5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:43.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:40.129+0000 7f91d8e0c640 1 --2- 172.21.15.44:0/3308032018 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91d409f480 0x7f91d41d71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:43.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:40.129+0000 7f91d8e0c640 1 --2- 172.21.15.44:0/3308032018 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91c0004800 0x7f91d41d1410 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:43.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:40.129+0000 7f91d8e0c640 1 -- 172.21.15.44:0/3308032018 >> 172.21.15.44:0/3308032018 conn(0x7f91d40a1ac0 msgr2=0x7f91d40bd2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:33:43.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:40.129+0000 7f91d8e0c640 1 -- 172.21.15.44:0/3308032018 shutdown_connections 2024-05-16T22:33:43.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:40.129+0000 7f91d8e0c640 1 -- 172.21.15.44:0/3308032018 wait complete. 2024-05-16T22:33:43.326 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":234,"stamp":"2024-05-16T22:33:38.645540+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":263404,"kb_used_data":5640,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754711316,"statfs":{"total":773094113280,"available":772824387584,"internally_reserved":0,"allocated":5775360,"data_stored":3030132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":263835185},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002999"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.813136+0000","last_change":"2024-05-16T22:33:07.786972+0000","last_active":"2024-05-16T22:33:11.813136+0000","last_peered":"2024-05-16T22:33:11.813136+0000","last_clean":"2024-05-16T22:33:11.813136+0000","last_became_active":"2024-05-16T22:33:07.786670+0000","last_became_peered":"2024-05-16T22:33:07.786670+0000","last_unstale":"2024-05-16T22:33:11.813136+0000","last_undegraded":"2024-05-16T22:33:11.813136+0000","last_fullsized":"2024-05-16T22:33:11.813136+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:12:52.620622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.813043+0000","last_change":"2024-05-16T22:33:07.798881+0000","last_active":"2024-05-16T22:33:11.813043+0000","last_peered":"2024-05-16T22:33:11.813043+0000","last_clean":"2024-05-16T22:33:11.813043+0000","last_became_active":"2024-05-16T22:33:07.798573+0000","last_became_peered":"2024-05-16T22:33:07.798573+0000","last_unstale":"2024-05-16T22:33:11.813043+0000","last_undegraded":"2024-05-16T22:33:11.813043+0000","last_fullsized":"2024-05-16T22:33:11.813043+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:08:32.674697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.799848+0000","last_change":"2024-05-16T22:33:07.799427+0000","last_active":"2024-05-16T22:33:11.799848+0000","last_peered":"2024-05-16T22:33:11.799848+0000","last_clean":"2024-05-16T22:33:11.799848+0000","last_became_active":"2024-05-16T22:33:07.799090+0000","last_became_peered":"2024-05-16T22:33:07.799090+0000","last_unstale":"2024-05-16T22:33:11.799848+0000","last_undegraded":"2024-05-16T22:33:11.799848+0000","last_fullsized":"2024-05-16T22:33:11.799848+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:18:11.659186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.811276+0000","last_change":"2024-05-16T22:33:07.795839+0000","last_active":"2024-05-16T22:33:11.811276+0000","last_peered":"2024-05-16T22:33:11.811276+0000","last_clean":"2024-05-16T22:33:11.811276+0000","last_became_active":"2024-05-16T22:33:07.795446+0000","last_became_peered":"2024-05-16T22:33:07.795446+0000","last_unstale":"2024-05-16T22:33:11.811276+0000","last_undegraded":"2024-05-16T22:33:11.811276+0000","last_fullsized":"2024-05-16T22:33:11.811276+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:34:03.827203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.812747+0000","last_change":"2024-05-16T22:33:07.799266+0000","last_active":"2024-05-16T22:33:11.812747+0000","last_peered":"2024-05-16T22:33:11.812747+0000","last_clean":"2024-05-16T22:33:11.812747+0000","last_became_active":"2024-05-16T22:33:07.798971+0000","last_became_peered":"2024-05-16T22:33:07.798971+0000","last_unstale":"2024-05-16T22:33:11.812747+0000","last_undegraded":"2024-05-16T22:33:11.812747+0000","last_fullsized":"2024-05-16T22:33:11.812747+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:30:57.253067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.812262+0000","last_change":"2024-05-16T22:33:07.796092+0000","last_active":"2024-05-16T22:33:11.812262+0000","last_peered":"2024-05-16T22:33:11.812262+0000","last_clean":"2024-05-16T22:33:11.812262+0000","last_became_active":"2024-05-16T22:33:07.795775+0000","last_became_peered":"2024-05-16T22:33:07.795775+0000","last_unstale":"2024-05-16T22:33:11.812262+0000","last_undegraded":"2024-05-16T22:33:11.812262+0000","last_fullsized":"2024-05-16T22:33:11.812262+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:05:56.208286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.811739+0000","last_change":"2024-05-16T22:33:07.792795+0000","last_active":"2024-05-16T22:33:11.811739+0000","last_peered":"2024-05-16T22:33:11.811739+0000","last_clean":"2024-05-16T22:33:11.811739+0000","last_became_active":"2024-05-16T22:33:07.792482+0000","last_became_peered":"2024-05-16T22:33:07.792482+0000","last_unstale":"2024-05-16T22:33:11.811739+0000","last_undegraded":"2024-05-16T22:33:11.811739+0000","last_fullsized":"2024-05-16T22:33:11.811739+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:15:30.250906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.811191+0000","last_change":"2024-05-16T22:33:07.793239+0000","last_active":"2024-05-16T22:33:11.811191+0000","last_peered":"2024-05-16T22:33:11.811191+0000","last_clean":"2024-05-16T22:33:11.811191+0000","last_became_active":"2024-05-16T22:33:07.791563+0000","last_became_peered":"2024-05-16T22:33:07.791563+0000","last_unstale":"2024-05-16T22:33:11.811191+0000","last_undegraded":"2024-05-16T22:33:11.811191+0000","last_fullsized":"2024-05-16T22:33:11.811191+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:37:30.236178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.812328+0000","last_change":"2024-05-16T22:33:07.793010+0000","last_active":"2024-05-16T22:33:11.812328+0000","last_peered":"2024-05-16T22:33:11.812328+0000","last_clean":"2024-05-16T22:33:11.812328+0000","last_became_active":"2024-05-16T22:33:07.791936+0000","last_became_peered":"2024-05-16T22:33:07.791936+0000","last_unstale":"2024-05-16T22:33:11.812328+0000","last_undegraded":"2024-05-16T22:33:11.812328+0000","last_fullsized":"2024-05-16T22:33:11.812328+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:27:43.960263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.811978+0000","last_change":"2024-05-16T22:33:07.797754+0000","last_active":"2024-05-16T22:33:11.811978+0000","last_peered":"2024-05-16T22:33:11.811978+0000","last_clean":"2024-05-16T22:33:11.811978+0000","last_became_active":"2024-05-16T22:33:07.797335+0000","last_became_peered":"2024-05-16T22:33:07.797335+0000","last_unstale":"2024-05-16T22:33:11.811978+0000","last_undegraded":"2024-05-16T22:33:11.811978+0000","last_fullsized":"2024-05-16T22:33:11.811978+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:12:52.620622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.811566+0000","last_change":"2024-05-16T22:33:07.791875+0000","last_active":"2024-05-16T22:33:11.811566+0000","last_peered":"2024-05-16T22:33:11.811566+0000","last_clean":"2024-05-16T22:33:11.811566+0000","last_became_active":"2024-05-16T22:33:07.791013+0000","last_became_peered":"2024-05-16T22:33:07.791013+0000","last_unstale":"2024-05-16T22:33:11.811566+0000","last_undegraded":"2024-05-16T22:33:11.811566+0000","last_fullsized":"2024-05-16T22:33:11.811566+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:15:30.250906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.813004+0000","last_change":"2024-05-16T22:33:07.800694+0000","last_active":"2024-05-16T22:33:11.813004+0000","last_peered":"2024-05-16T22:33:11.813004+0000","last_clean":"2024-05-16T22:33:11.813004+0000","last_became_active":"2024-05-16T22:33:07.800407+0000","last_became_peered":"2024-05-16T22:33:07.800407+0000","last_unstale":"2024-05-16T22:33:11.813004+0000","last_undegraded":"2024-05-16T22:33:11.813004+0000","last_fullsized":"2024-05-16T22:33:11.813004+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:15:30.250906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.811427+0000","last_change":"2024-05-16T22:33:07.796488+0000","last_active":"2024-05-16T22:33:11.811427+0000","last_peered":"2024-05-16T22:33:11.811427+0000","last_clean":"2024-05-16T22:33:11.811427+0000","last_became_active":"2024-05-16T22:33:07.796155+0000","last_became_peered":"2024-05-16T22:33:07.796155+0000","last_unstale":"2024-05-16T22:33:11.811427+0000","last_undegraded":"2024-05-16T22:33:11.811427+0000","last_fullsized":"2024-05-16T22:33:11.811427+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:03:15.846231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.811228+0000","last_change":"2024-05-16T22:33:07.796952+0000","last_active":"2024-05-16T22:33:11.811228+0000","last_peered":"2024-05-16T22:33:11.811228+0000","last_clean":"2024-05-16T22:33:11.811228+0000","last_became_active":"2024-05-16T22:33:07.795681+0000","last_became_peered":"2024-05-16T22:33:07.795681+0000","last_unstale":"2024-05-16T22:33:11.811228+0000","last_undegraded":"2024-05-16T22:33:11.811228+0000","last_fullsized":"2024-05-16T22:33:11.811228+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:28:48.221339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.811694+0000","last_change":"2024-05-16T22:33:07.793078+0000","last_active":"2024-05-16T22:33:11.811694+0000","last_peered":"2024-05-16T22:33:11.811694+0000","last_clean":"2024-05-16T22:33:11.811694+0000","last_became_active":"2024-05-16T22:33:07.792494+0000","last_became_peered":"2024-05-16T22:33:07.792494+0000","last_unstale":"2024-05-16T22:33:11.811694+0000","last_undegraded":"2024-05-16T22:33:11.811694+0000","last_fullsized":"2024-05-16T22:33:11.811694+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:20:51.929955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.814278+0000","last_change":"2024-05-16T22:33:07.798716+0000","last_active":"2024-05-16T22:33:11.814278+0000","last_peered":"2024-05-16T22:33:11.814278+0000","last_clean":"2024-05-16T22:33:11.814278+0000","last_became_active":"2024-05-16T22:33:07.798418+0000","last_became_peered":"2024-05-16T22:33:07.798418+0000","last_unstale":"2024-05-16T22:33:11.814278+0000","last_undegraded":"2024-05-16T22:33:11.814278+0000","last_fullsized":"2024-05-16T22:33:11.814278+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:50:44.555325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.800142+0000","last_change":"2024-05-16T22:33:07.788398+0000","last_active":"2024-05-16T22:33:11.800142+0000","last_peered":"2024-05-16T22:33:11.800142+0000","last_clean":"2024-05-16T22:33:11.800142+0000","last_became_active":"2024-05-16T22:33:07.788041+0000","last_became_peered":"2024-05-16T22:33:07.788041+0000","last_unstale":"2024-05-16T22:33:11.800142+0000","last_undegraded":"2024-05-16T22:33:11.800142+0000","last_fullsized":"2024-05-16T22:33:11.800142+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T10:32:17.527873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.800035+0000","last_change":"2024-05-16T22:33:07.798417+0000","last_active":"2024-05-16T22:33:11.800035+0000","last_peered":"2024-05-16T22:33:11.800035+0000","last_clean":"2024-05-16T22:33:11.800035+0000","last_became_active":"2024-05-16T22:33:07.798077+0000","last_became_peered":"2024-05-16T22:33:07.798077+0000","last_unstale":"2024-05-16T22:33:11.800035+0000","last_undegraded":"2024-05-16T22:33:11.800035+0000","last_fullsized":"2024-05-16T22:33:11.800035+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:04:00.833667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.813621+0000","last_change":"2024-05-16T22:33:07.799131+0000","last_active":"2024-05-16T22:33:11.813621+0000","last_peered":"2024-05-16T22:33:11.813621+0000","last_clean":"2024-05-16T22:33:11.813621+0000","last_became_active":"2024-05-16T22:33:07.798812+0000","last_became_peered":"2024-05-16T22:33:07.798812+0000","last_unstale":"2024-05-16T22:33:11.813621+0000","last_undegraded":"2024-05-16T22:33:11.813621+0000","last_fullsized":"2024-05-16T22:33:11.813621+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:53:19.649731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.813098+0000","last_change":"2024-05-16T22:33:07.800314+0000","last_active":"2024-05-16T22:33:11.813098+0000","last_peered":"2024-05-16T22:33:11.813098+0000","last_clean":"2024-05-16T22:33:11.813098+0000","last_became_active":"2024-05-16T22:33:07.799969+0000","last_became_peered":"2024-05-16T22:33:07.799969+0000","last_unstale":"2024-05-16T22:33:11.813098+0000","last_undegraded":"2024-05-16T22:33:11.813098+0000","last_fullsized":"2024-05-16T22:33:11.813098+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:37:20.913308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.813040+0000","last_change":"2024-05-16T22:33:07.794579+0000","last_active":"2024-05-16T22:33:11.813040+0000","last_peered":"2024-05-16T22:33:11.813040+0000","last_clean":"2024-05-16T22:33:11.813040+0000","last_became_active":"2024-05-16T22:33:07.794200+0000","last_became_peered":"2024-05-16T22:33:07.794200+0000","last_unstale":"2024-05-16T22:33:11.813040+0000","last_undegraded":"2024-05-16T22:33:11.813040+0000","last_fullsized":"2024-05-16T22:33:11.813040+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:51:01.100457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.811458+0000","last_change":"2024-05-16T22:33:07.793011+0000","last_active":"2024-05-16T22:33:11.811458+0000","last_peered":"2024-05-16T22:33:11.811458+0000","last_clean":"2024-05-16T22:33:11.811458+0000","last_became_active":"2024-05-16T22:33:07.792510+0000","last_became_peered":"2024-05-16T22:33:07.792510+0000","last_unstale":"2024-05-16T22:33:11.811458+0000","last_undegraded":"2024-05-16T22:33:11.811458+0000","last_fullsized":"2024-05-16T22:33:11.811458+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:30:57.253067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.812771+0000","last_change":"2024-05-16T22:33:07.793128+0000","last_active":"2024-05-16T22:33:11.812771+0000","last_peered":"2024-05-16T22:33:11.812771+0000","last_clean":"2024-05-16T22:33:11.812771+0000","last_became_active":"2024-05-16T22:33:07.792139+0000","last_became_peered":"2024-05-16T22:33:07.792139+0000","last_unstale":"2024-05-16T22:33:11.812771+0000","last_undegraded":"2024-05-16T22:33:11.812771+0000","last_fullsized":"2024-05-16T22:33:11.812771+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:05:24.115985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.814477+0000","last_change":"2024-05-16T22:33:07.792449+0000","last_active":"2024-05-16T22:33:11.814477+0000","last_peered":"2024-05-16T22:33:11.814477+0000","last_clean":"2024-05-16T22:33:11.814477+0000","last_became_active":"2024-05-16T22:33:07.792119+0000","last_became_peered":"2024-05-16T22:33:07.792119+0000","last_unstale":"2024-05-16T22:33:11.814477+0000","last_undegraded":"2024-05-16T22:33:11.814477+0000","last_fullsized":"2024-05-16T22:33:11.814477+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:04:00.833667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.812670+0000","last_change":"2024-05-16T22:33:07.792296+0000","last_active":"2024-05-16T22:33:11.812670+0000","last_peered":"2024-05-16T22:33:11.812670+0000","last_clean":"2024-05-16T22:33:11.812670+0000","last_became_active":"2024-05-16T22:33:07.791991+0000","last_became_peered":"2024-05-16T22:33:07.791991+0000","last_unstale":"2024-05-16T22:33:11.812670+0000","last_undegraded":"2024-05-16T22:33:11.812670+0000","last_fullsized":"2024-05-16T22:33:11.812670+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:48:21.104886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.811821+0000","last_change":"2024-05-16T22:33:07.797568+0000","last_active":"2024-05-16T22:33:11.811821+0000","last_peered":"2024-05-16T22:33:11.811821+0000","last_clean":"2024-05-16T22:33:11.811821+0000","last_became_active":"2024-05-16T22:33:07.797228+0000","last_became_peered":"2024-05-16T22:33:07.797228+0000","last_unstale":"2024-05-16T22:33:11.811821+0000","last_undegraded":"2024-05-16T22:33:11.811821+0000","last_fullsized":"2024-05-16T22:33:11.811821+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:38:09.482227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.800316+0000","last_change":"2024-05-16T22:33:07.792298+0000","last_active":"2024-05-16T22:33:11.800316+0000","last_peered":"2024-05-16T22:33:11.800316+0000","last_clean":"2024-05-16T22:33:11.800316+0000","last_became_active":"2024-05-16T22:33:07.791972+0000","last_became_peered":"2024-05-16T22:33:07.791972+0000","last_unstale":"2024-05-16T22:33:11.800316+0000","last_undegraded":"2024-05-16T22:33:11.800316+0000","last_fullsized":"2024-05-16T22:33:11.800316+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:33:08.723015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.813158+0000","last_change":"2024-05-16T22:33:07.799963+0000","last_active":"2024-05-16T22:33:11.813158+0000","last_peered":"2024-05-16T22:33:11.813158+0000","last_clean":"2024-05-16T22:33:11.813158+0000","last_became_active":"2024-05-16T22:33:07.799641+0000","last_became_peered":"2024-05-16T22:33:07.799641+0000","last_unstale":"2024-05-16T22:33:11.813158+0000","last_undegraded":"2024-05-16T22:33:11.813158+0000","last_fullsized":"2024-05-16T22:33:11.813158+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:44:00.628985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.814230+0000","last_change":"2024-05-16T22:33:07.793631+0000","last_active":"2024-05-16T22:33:11.814230+0000","last_peered":"2024-05-16T22:33:11.814230+0000","last_clean":"2024-05-16T22:33:11.814230+0000","last_became_active":"2024-05-16T22:33:07.792913+0000","last_became_peered":"2024-05-16T22:33:07.792913+0000","last_unstale":"2024-05-16T22:33:11.814230+0000","last_undegraded":"2024-05-16T22:33:11.814230+0000","last_fullsized":"2024-05-16T22:33:11.814230+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:18:11.659186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.799757+0000","last_change":"2024-05-16T22:33:07.786995+0000","last_active":"2024-05-16T22:33:11.799757+0000","last_peered":"2024-05-16T22:33:11.799757+0000","last_clean":"2024-05-16T22:33:11.799757+0000","last_became_active":"2024-05-16T22:33:07.786666+0000","last_became_peered":"2024-05-16T22:33:07.786666+0000","last_unstale":"2024-05-16T22:33:11.799757+0000","last_undegraded":"2024-05-16T22:33:11.799757+0000","last_fullsized":"2024-05-16T22:33:11.799757+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:18:11.045305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.811880+0000","last_change":"2024-05-16T22:33:07.792778+0000","last_active":"2024-05-16T22:33:11.811880+0000","last_peered":"2024-05-16T22:33:11.811880+0000","last_clean":"2024-05-16T22:33:11.811880+0000","last_became_active":"2024-05-16T22:33:07.792175+0000","last_became_peered":"2024-05-16T22:33:07.792175+0000","last_unstale":"2024-05-16T22:33:11.811880+0000","last_undegraded":"2024-05-16T22:33:11.811880+0000","last_fullsized":"2024-05-16T22:33:11.811880+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:36:27.885318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.814173+0000","last_change":"2024-05-16T22:33:07.799178+0000","last_active":"2024-05-16T22:33:11.814173+0000","last_peered":"2024-05-16T22:33:11.814173+0000","last_clean":"2024-05-16T22:33:11.814173+0000","last_became_active":"2024-05-16T22:33:07.798806+0000","last_became_peered":"2024-05-16T22:33:07.798806+0000","last_unstale":"2024-05-16T22:33:11.814173+0000","last_undegraded":"2024-05-16T22:33:11.814173+0000","last_fullsized":"2024-05-16T22:33:11.814173+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:34:28.933408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.799481+0000","last_change":"2024-05-16T22:33:07.795832+0000","last_active":"2024-05-16T22:33:11.799481+0000","last_peered":"2024-05-16T22:33:11.799481+0000","last_clean":"2024-05-16T22:33:11.799481+0000","last_became_active":"2024-05-16T22:33:07.795499+0000","last_became_peered":"2024-05-16T22:33:07.795499+0000","last_unstale":"2024-05-16T22:33:11.799481+0000","last_undegraded":"2024-05-16T22:33:11.799481+0000","last_fullsized":"2024-05-16T22:33:11.799481+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:14:36.433345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"48'4","reported_seq":25,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.820232+0000","last_change":"2024-05-16T22:33:03.999309+0000","last_active":"2024-05-16T22:33:11.820232+0000","last_peered":"2024-05-16T22:33:11.820232+0000","last_clean":"2024-05-16T22:33:11.820232+0000","last_became_active":"2024-05-16T22:33:03.998916+0000","last_became_peered":"2024-05-16T22:33:03.998916+0000","last_unstale":"2024-05-16T22:33:11.820232+0000","last_undegraded":"2024-05-16T22:33:11.820232+0000","last_fullsized":"2024-05-16T22:33:11.820232+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:02:31.124265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.812883+0000","last_change":"2024-05-16T22:33:07.794430+0000","last_active":"2024-05-16T22:33:11.812883+0000","last_peered":"2024-05-16T22:33:11.812883+0000","last_clean":"2024-05-16T22:33:11.812883+0000","last_became_active":"2024-05-16T22:33:07.794098+0000","last_became_peered":"2024-05-16T22:33:07.794098+0000","last_unstale":"2024-05-16T22:33:11.812883+0000","last_undegraded":"2024-05-16T22:33:11.812883+0000","last_fullsized":"2024-05-16T22:33:11.812883+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:48:01.966089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"48'1","reported_seq":22,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.800276+0000","last_change":"2024-05-16T22:33:03.999256+0000","last_active":"2024-05-16T22:33:11.800276+0000","last_peered":"2024-05-16T22:33:11.800276+0000","last_clean":"2024-05-16T22:33:11.800276+0000","last_became_active":"2024-05-16T22:33:03.998806+0000","last_became_peered":"2024-05-16T22:33:03.998806+0000","last_unstale":"2024-05-16T22:33:11.800276+0000","last_undegraded":"2024-05-16T22:33:11.800276+0000","last_fullsized":"2024-05-16T22:33:11.800276+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:30:53.846073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.813313+0000","last_change":"2024-05-16T22:33:07.796193+0000","last_active":"2024-05-16T22:33:11.813313+0000","last_peered":"2024-05-16T22:33:11.813313+0000","last_clean":"2024-05-16T22:33:11.813313+0000","last_became_active":"2024-05-16T22:33:07.795779+0000","last_became_peered":"2024-05-16T22:33:07.795779+0000","last_unstale":"2024-05-16T22:33:11.813313+0000","last_undegraded":"2024-05-16T22:33:11.813313+0000","last_fullsized":"2024-05-16T22:33:11.813313+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:26:01.310749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"48'2","reported_seq":23,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.817492+0000","last_change":"2024-05-16T22:33:03.769600+0000","last_active":"2024-05-16T22:33:11.817492+0000","last_peered":"2024-05-16T22:33:11.817492+0000","last_clean":"2024-05-16T22:33:11.817492+0000","last_became_active":"2024-05-16T22:33:03.769256+0000","last_became_peered":"2024-05-16T22:33:03.769256+0000","last_unstale":"2024-05-16T22:33:11.817492+0000","last_undegraded":"2024-05-16T22:33:11.817492+0000","last_fullsized":"2024-05-16T22:33:11.817492+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:46:26.391064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.799525+0000","last_change":"2024-05-16T22:33:07.791199+0000","last_active":"2024-05-16T22:33:11.799525+0000","last_peered":"2024-05-16T22:33:11.799525+0000","last_clean":"2024-05-16T22:33:11.799525+0000","last_became_active":"2024-05-16T22:33:07.789644+0000","last_became_peered":"2024-05-16T22:33:07.789644+0000","last_unstale":"2024-05-16T22:33:11.799525+0000","last_undegraded":"2024-05-16T22:33:11.799525+0000","last_fullsized":"2024-05-16T22:33:11.799525+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:18:11.045305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"48'2","reported_seq":23,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.815343+0000","last_change":"2024-05-16T22:33:03.769173+0000","last_active":"2024-05-16T22:33:11.815343+0000","last_peered":"2024-05-16T22:33:11.815343+0000","last_clean":"2024-05-16T22:33:11.815343+0000","last_became_active":"2024-05-16T22:33:03.768811+0000","last_became_peered":"2024-05-16T22:33:03.768811+0000","last_unstale":"2024-05-16T22:33:11.815343+0000","last_undegraded":"2024-05-16T22:33:11.815343+0000","last_fullsized":"2024-05-16T22:33:11.815343+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:30:53.235100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.799807+0000","last_change":"2024-05-16T22:33:07.797710+0000","last_active":"2024-05-16T22:33:11.799807+0000","last_peered":"2024-05-16T22:33:11.799807+0000","last_clean":"2024-05-16T22:33:11.799807+0000","last_became_active":"2024-05-16T22:33:07.797349+0000","last_became_peered":"2024-05-16T22:33:07.797349+0000","last_unstale":"2024-05-16T22:33:11.799807+0000","last_undegraded":"2024-05-16T22:33:11.799807+0000","last_fullsized":"2024-05-16T22:33:11.799807+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:53:19.649731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"48'1","reported_seq":22,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.813375+0000","last_change":"2024-05-16T22:33:03.769253+0000","last_active":"2024-05-16T22:33:11.813375+0000","last_peered":"2024-05-16T22:33:11.813375+0000","last_clean":"2024-05-16T22:33:11.813375+0000","last_became_active":"2024-05-16T22:33:03.768638+0000","last_became_peered":"2024-05-16T22:33:03.768638+0000","last_unstale":"2024-05-16T22:33:11.813375+0000","last_undegraded":"2024-05-16T22:33:11.813375+0000","last_fullsized":"2024-05-16T22:33:11.813375+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:06:36.058576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.811592+0000","last_change":"2024-05-16T22:33:07.799288+0000","last_active":"2024-05-16T22:33:11.811592+0000","last_peered":"2024-05-16T22:33:11.811592+0000","last_clean":"2024-05-16T22:33:11.811592+0000","last_became_active":"2024-05-16T22:33:07.798549+0000","last_became_peered":"2024-05-16T22:33:07.798549+0000","last_unstale":"2024-05-16T22:33:11.811592+0000","last_undegraded":"2024-05-16T22:33:11.811592+0000","last_fullsized":"2024-05-16T22:33:11.811592+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:08:32.674697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"48'1","reported_seq":22,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.800082+0000","last_change":"2024-05-16T22:33:03.766942+0000","last_active":"2024-05-16T22:33:11.800082+0000","last_peered":"2024-05-16T22:33:11.800082+0000","last_clean":"2024-05-16T22:33:11.800082+0000","last_became_active":"2024-05-16T22:33:03.766587+0000","last_became_peered":"2024-05-16T22:33:03.766587+0000","last_unstale":"2024-05-16T22:33:11.800082+0000","last_undegraded":"2024-05-16T22:33:11.800082+0000","last_fullsized":"2024-05-16T22:33:11.800082+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:50:40.537357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.811406+0000","last_change":"2024-05-16T22:33:07.791984+0000","last_active":"2024-05-16T22:33:11.811406+0000","last_peered":"2024-05-16T22:33:11.811406+0000","last_clean":"2024-05-16T22:33:11.811406+0000","last_became_active":"2024-05-16T22:33:07.790427+0000","last_became_peered":"2024-05-16T22:33:07.790427+0000","last_unstale":"2024-05-16T22:33:11.811406+0000","last_undegraded":"2024-05-16T22:33:11.811406+0000","last_fullsized":"2024-05-16T22:33:11.811406+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:19:34.747729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":21,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.811976+0000","last_change":"2024-05-16T22:33:03.767136+0000","last_active":"2024-05-16T22:33:11.811976+0000","last_peered":"2024-05-16T22:33:11.811976+0000","last_clean":"2024-05-16T22:33:11.811976+0000","last_became_active":"2024-05-16T22:33:03.766728+0000","last_became_peered":"2024-05-16T22:33:03.766728+0000","last_unstale":"2024-05-16T22:33:11.811976+0000","last_undegraded":"2024-05-16T22:33:11.811976+0000","last_fullsized":"2024-05-16T22:33:11.811976+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:39:00.890315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.812579+0000","last_change":"2024-05-16T22:33:07.793374+0000","last_active":"2024-05-16T22:33:11.812579+0000","last_peered":"2024-05-16T22:33:11.812579+0000","last_clean":"2024-05-16T22:33:11.812579+0000","last_became_active":"2024-05-16T22:33:07.792569+0000","last_became_peered":"2024-05-16T22:33:07.792569+0000","last_unstale":"2024-05-16T22:33:11.812579+0000","last_undegraded":"2024-05-16T22:33:11.812579+0000","last_fullsized":"2024-05-16T22:33:11.812579+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:18:18.571371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":21,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.811625+0000","last_change":"2024-05-16T22:33:03.772820+0000","last_active":"2024-05-16T22:33:11.811625+0000","last_peered":"2024-05-16T22:33:11.811625+0000","last_clean":"2024-05-16T22:33:11.811625+0000","last_became_active":"2024-05-16T22:33:03.772196+0000","last_became_peered":"2024-05-16T22:33:03.772196+0000","last_unstale":"2024-05-16T22:33:11.811625+0000","last_undegraded":"2024-05-16T22:33:11.811625+0000","last_fullsized":"2024-05-16T22:33:11.811625+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:43:56.611018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.800059+0000","last_change":"2024-05-16T22:33:07.799258+0000","last_active":"2024-05-16T22:33:11.800059+0000","last_peered":"2024-05-16T22:33:11.800059+0000","last_clean":"2024-05-16T22:33:11.800059+0000","last_became_active":"2024-05-16T22:33:07.798923+0000","last_became_peered":"2024-05-16T22:33:07.798923+0000","last_unstale":"2024-05-16T22:33:11.800059+0000","last_undegraded":"2024-05-16T22:33:11.800059+0000","last_fullsized":"2024-05-16T22:33:11.800059+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:19:33.825579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":21,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.800315+0000","last_change":"2024-05-16T22:33:03.764278+0000","last_active":"2024-05-16T22:33:11.800315+0000","last_peered":"2024-05-16T22:33:11.800315+0000","last_clean":"2024-05-16T22:33:11.800315+0000","last_became_active":"2024-05-16T22:33:03.763935+0000","last_became_peered":"2024-05-16T22:33:03.763935+0000","last_unstale":"2024-05-16T22:33:11.800315+0000","last_undegraded":"2024-05-16T22:33:11.800315+0000","last_fullsized":"2024-05-16T22:33:11.800315+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:36:18.369082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.813192+0000","last_change":"2024-05-16T22:33:07.790526+0000","last_active":"2024-05-16T22:33:11.813192+0000","last_peered":"2024-05-16T22:33:11.813192+0000","last_clean":"2024-05-16T22:33:11.813192+0000","last_became_active":"2024-05-16T22:33:07.790238+0000","last_became_peered":"2024-05-16T22:33:07.790238+0000","last_unstale":"2024-05-16T22:33:11.813192+0000","last_undegraded":"2024-05-16T22:33:11.813192+0000","last_fullsized":"2024-05-16T22:33:11.813192+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:55:26.611271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":21,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.812340+0000","last_change":"2024-05-16T22:33:03.771482+0000","last_active":"2024-05-16T22:33:11.812340+0000","last_peered":"2024-05-16T22:33:11.812340+0000","last_clean":"2024-05-16T22:33:11.812340+0000","last_became_active":"2024-05-16T22:33:03.771107+0000","last_became_peered":"2024-05-16T22:33:03.771107+0000","last_unstale":"2024-05-16T22:33:11.812340+0000","last_undegraded":"2024-05-16T22:33:11.812340+0000","last_fullsized":"2024-05-16T22:33:11.812340+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:20:47.911988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.813110+0000","last_change":"2024-05-16T22:33:07.801619+0000","last_active":"2024-05-16T22:33:11.813110+0000","last_peered":"2024-05-16T22:33:11.813110+0000","last_clean":"2024-05-16T22:33:11.813110+0000","last_became_active":"2024-05-16T22:33:07.801221+0000","last_became_peered":"2024-05-16T22:33:07.801221+0000","last_unstale":"2024-05-16T22:33:11.813110+0000","last_undegraded":"2024-05-16T22:33:11.813110+0000","last_fullsized":"2024-05-16T22:33:11.813110+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:07:29.315685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"48'3","reported_seq":24,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.816648+0000","last_change":"2024-05-16T22:33:03.999378+0000","last_active":"2024-05-16T22:33:11.816648+0000","last_peered":"2024-05-16T22:33:11.816648+0000","last_clean":"2024-05-16T22:33:11.816648+0000","last_became_active":"2024-05-16T22:33:03.998793+0000","last_became_peered":"2024-05-16T22:33:03.998793+0000","last_unstale":"2024-05-16T22:33:11.816648+0000","last_undegraded":"2024-05-16T22:33:11.816648+0000","last_fullsized":"2024-05-16T22:33:11.816648+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:20:40.908537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.812552+0000","last_change":"2024-05-16T22:33:07.797040+0000","last_active":"2024-05-16T22:33:11.812552+0000","last_peered":"2024-05-16T22:33:11.812552+0000","last_clean":"2024-05-16T22:33:11.812552+0000","last_became_active":"2024-05-16T22:33:07.796716+0000","last_became_peered":"2024-05-16T22:33:07.796716+0000","last_unstale":"2024-05-16T22:33:11.812552+0000","last_undegraded":"2024-05-16T22:33:11.812552+0000","last_fullsized":"2024-05-16T22:33:11.812552+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:26:01.310749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"48'6","reported_seq":27,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.818840+0000","last_change":"2024-05-16T22:33:03.760612+0000","last_active":"2024-05-16T22:33:11.818840+0000","last_peered":"2024-05-16T22:33:11.818840+0000","last_clean":"2024-05-16T22:33:11.818840+0000","last_became_active":"2024-05-16T22:33:03.760117+0000","last_became_peered":"2024-05-16T22:33:03.760117+0000","last_unstale":"2024-05-16T22:33:11.818840+0000","last_undegraded":"2024-05-16T22:33:11.818840+0000","last_fullsized":"2024-05-16T22:33:11.818840+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:43:43.932963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.813178+0000","last_change":"2024-05-16T22:33:07.802171+0000","last_active":"2024-05-16T22:33:11.813178+0000","last_peered":"2024-05-16T22:33:11.813178+0000","last_clean":"2024-05-16T22:33:11.813178+0000","last_became_active":"2024-05-16T22:33:07.801829+0000","last_became_peered":"2024-05-16T22:33:07.801829+0000","last_unstale":"2024-05-16T22:33:11.813178+0000","last_undegraded":"2024-05-16T22:33:11.813178+0000","last_fullsized":"2024-05-16T22:33:11.813178+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:14:36.433345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"48'2","reported_seq":23,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.819258+0000","last_change":"2024-05-16T22:33:03.772748+0000","last_active":"2024-05-16T22:33:11.819258+0000","last_peered":"2024-05-16T22:33:11.819258+0000","last_clean":"2024-05-16T22:33:11.819258+0000","last_became_active":"2024-05-16T22:33:03.772387+0000","last_became_peered":"2024-05-16T22:33:03.772387+0000","last_unstale":"2024-05-16T22:33:11.819258+0000","last_undegraded":"2024-05-16T22:33:11.819258+0000","last_fullsized":"2024-05-16T22:33:11.819258+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:58:07.655101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.811778+0000","last_change":"2024-05-16T22:33:07.791460+0000","last_active":"2024-05-16T22:33:11.811778+0000","last_peered":"2024-05-16T22:33:11.811778+0000","last_clean":"2024-05-16T22:33:11.811778+0000","last_became_active":"2024-05-16T22:33:07.791068+0000","last_became_peered":"2024-05-16T22:33:07.791068+0000","last_unstale":"2024-05-16T22:33:11.811778+0000","last_undegraded":"2024-05-16T22:33:11.811778+0000","last_fullsized":"2024-05-16T22:33:11.811778+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:26:01.310749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":21,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.811642+0000","last_change":"2024-05-16T22:33:03.771335+0000","last_active":"2024-05-16T22:33:11.811642+0000","last_peered":"2024-05-16T22:33:11.811642+0000","last_clean":"2024-05-16T22:33:11.811642+0000","last_became_active":"2024-05-16T22:33:03.770949+0000","last_became_peered":"2024-05-16T22:33:03.770949+0000","last_unstale":"2024-05-16T22:33:11.811642+0000","last_undegraded":"2024-05-16T22:33:11.811642+0000","last_fullsized":"2024-05-16T22:33:11.811642+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:19:30.729762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.811338+0000","last_change":"2024-05-16T22:33:07.801805+0000","last_active":"2024-05-16T22:33:11.811338+0000","last_peered":"2024-05-16T22:33:11.811338+0000","last_clean":"2024-05-16T22:33:11.811338+0000","last_became_active":"2024-05-16T22:33:07.801469+0000","last_became_peered":"2024-05-16T22:33:07.801469+0000","last_unstale":"2024-05-16T22:33:11.811338+0000","last_undegraded":"2024-05-16T22:33:11.811338+0000","last_fullsized":"2024-05-16T22:33:11.811338+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:27:43.960263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":21,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.812053+0000","last_change":"2024-05-16T22:33:03.774002+0000","last_active":"2024-05-16T22:33:11.812053+0000","last_peered":"2024-05-16T22:33:11.812053+0000","last_clean":"2024-05-16T22:33:11.812053+0000","last_became_active":"2024-05-16T22:33:03.773598+0000","last_became_peered":"2024-05-16T22:33:03.773598+0000","last_unstale":"2024-05-16T22:33:11.812053+0000","last_undegraded":"2024-05-16T22:33:11.812053+0000","last_fullsized":"2024-05-16T22:33:11.812053+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:09:09.608625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.811920+0000","last_change":"2024-05-16T22:33:07.790600+0000","last_active":"2024-05-16T22:33:11.811920+0000","last_peered":"2024-05-16T22:33:11.811920+0000","last_clean":"2024-05-16T22:33:11.811920+0000","last_became_active":"2024-05-16T22:33:07.790334+0000","last_became_peered":"2024-05-16T22:33:07.790334+0000","last_unstale":"2024-05-16T22:33:11.811920+0000","last_undegraded":"2024-05-16T22:33:11.811920+0000","last_fullsized":"2024-05-16T22:33:11.811920+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:08:32.674697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"48'8","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.819449+0000","last_change":"2024-05-16T22:33:03.772528+0000","last_active":"2024-05-16T22:33:11.819449+0000","last_peered":"2024-05-16T22:33:11.819449+0000","last_clean":"2024-05-16T22:33:11.819449+0000","last_became_active":"2024-05-16T22:33:03.772148+0000","last_became_peered":"2024-05-16T22:33:03.772148+0000","last_unstale":"2024-05-16T22:33:11.819449+0000","last_undegraded":"2024-05-16T22:33:11.819449+0000","last_fullsized":"2024-05-16T22:33:11.819449+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:20:40.908537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.812010+0000","last_change":"2024-05-16T22:33:07.792943+0000","last_active":"2024-05-16T22:33:11.812010+0000","last_peered":"2024-05-16T22:33:11.812010+0000","last_clean":"2024-05-16T22:33:11.812010+0000","last_became_active":"2024-05-16T22:33:07.792585+0000","last_became_peered":"2024-05-16T22:33:07.792585+0000","last_unstale":"2024-05-16T22:33:11.812010+0000","last_undegraded":"2024-05-16T22:33:11.812010+0000","last_fullsized":"2024-05-16T22:33:11.812010+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:11:49.983401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"48'1","reported_seq":22,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.813126+0000","last_change":"2024-05-16T22:33:03.768594+0000","last_active":"2024-05-16T22:33:11.813126+0000","last_peered":"2024-05-16T22:33:11.813126+0000","last_clean":"2024-05-16T22:33:11.813126+0000","last_became_active":"2024-05-16T22:33:03.768272+0000","last_became_peered":"2024-05-16T22:33:03.768272+0000","last_unstale":"2024-05-16T22:33:11.813126+0000","last_undegraded":"2024-05-16T22:33:11.813126+0000","last_fullsized":"2024-05-16T22:33:11.813126+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:33:03.362928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.812514+0000","last_change":"2024-05-16T22:33:07.798367+0000","last_active":"2024-05-16T22:33:11.812514+0000","last_peered":"2024-05-16T22:33:11.812514+0000","last_clean":"2024-05-16T22:33:11.812514+0000","last_became_active":"2024-05-16T22:33:07.797531+0000","last_became_peered":"2024-05-16T22:33:07.797531+0000","last_unstale":"2024-05-16T22:33:11.812514+0000","last_undegraded":"2024-05-16T22:33:11.812514+0000","last_fullsized":"2024-05-16T22:33:11.812514+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:36:27.885318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"48'2","reported_seq":23,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.813677+0000","last_change":"2024-05-16T22:33:03.765338+0000","last_active":"2024-05-16T22:33:11.813677+0000","last_peered":"2024-05-16T22:33:11.813677+0000","last_clean":"2024-05-16T22:33:11.813677+0000","last_became_active":"2024-05-16T22:33:03.764944+0000","last_became_peered":"2024-05-16T22:33:03.764944+0000","last_unstale":"2024-05-16T22:33:11.813677+0000","last_undegraded":"2024-05-16T22:33:11.813677+0000","last_fullsized":"2024-05-16T22:33:11.813677+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:28:44.203371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.813430+0000","last_change":"2024-05-16T22:33:07.796460+0000","last_active":"2024-05-16T22:33:11.813430+0000","last_peered":"2024-05-16T22:33:11.813430+0000","last_clean":"2024-05-16T22:33:11.813430+0000","last_became_active":"2024-05-16T22:33:07.794906+0000","last_became_peered":"2024-05-16T22:33:07.794906+0000","last_unstale":"2024-05-16T22:33:11.813430+0000","last_undegraded":"2024-05-16T22:33:11.813430+0000","last_fullsized":"2024-05-16T22:33:11.813430+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:46:30.409031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"48'1","reported_seq":22,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.812642+0000","last_change":"2024-05-16T22:33:03.771139+0000","last_active":"2024-05-16T22:33:11.812642+0000","last_peered":"2024-05-16T22:33:11.812642+0000","last_clean":"2024-05-16T22:33:11.812642+0000","last_became_active":"2024-05-16T22:33:03.770733+0000","last_became_peered":"2024-05-16T22:33:03.770733+0000","last_unstale":"2024-05-16T22:33:11.812642+0000","last_undegraded":"2024-05-16T22:33:11.812642+0000","last_fullsized":"2024-05-16T22:33:11.812642+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:19:30.729762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.813377+0000","last_change":"2024-05-16T22:33:07.801614+0000","last_active":"2024-05-16T22:33:11.813377+0000","last_peered":"2024-05-16T22:33:11.813377+0000","last_clean":"2024-05-16T22:33:11.813377+0000","last_became_active":"2024-05-16T22:33:07.801229+0000","last_became_peered":"2024-05-16T22:33:07.801229+0000","last_unstale":"2024-05-16T22:33:11.813377+0000","last_undegraded":"2024-05-16T22:33:11.813377+0000","last_fullsized":"2024-05-16T22:33:11.813377+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:18:11.045305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":21,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.813296+0000","last_change":"2024-05-16T22:33:03.999459+0000","last_active":"2024-05-16T22:33:11.813296+0000","last_peered":"2024-05-16T22:33:11.813296+0000","last_clean":"2024-05-16T22:33:11.813296+0000","last_became_active":"2024-05-16T22:33:03.998812+0000","last_became_peered":"2024-05-16T22:33:03.998812+0000","last_unstale":"2024-05-16T22:33:11.813296+0000","last_undegraded":"2024-05-16T22:33:11.813296+0000","last_fullsized":"2024-05-16T22:33:11.813296+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:37:24.141095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.812433+0000","last_change":"2024-05-16T22:33:07.803092+0000","last_active":"2024-05-16T22:33:11.812433+0000","last_peered":"2024-05-16T22:33:11.812433+0000","last_clean":"2024-05-16T22:33:11.812433+0000","last_became_active":"2024-05-16T22:33:07.802762+0000","last_became_peered":"2024-05-16T22:33:07.802762+0000","last_unstale":"2024-05-16T22:33:11.812433+0000","last_undegraded":"2024-05-16T22:33:11.812433+0000","last_fullsized":"2024-05-16T22:33:11.812433+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T23:49:51.527355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"48'2","reported_seq":23,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.817031+0000","last_change":"2024-05-16T22:33:03.768670+0000","last_active":"2024-05-16T22:33:11.817031+0000","last_peered":"2024-05-16T22:33:11.817031+0000","last_clean":"2024-05-16T22:33:11.817031+0000","last_became_active":"2024-05-16T22:33:03.768314+0000","last_became_peered":"2024-05-16T22:33:03.768314+0000","last_unstale":"2024-05-16T22:33:11.817031+0000","last_undegraded":"2024-05-16T22:33:11.817031+0000","last_fullsized":"2024-05-16T22:33:11.817031+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:40:39.761130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.799256+0000","last_change":"2024-05-16T22:33:07.780692+0000","last_active":"2024-05-16T22:33:11.799256+0000","last_peered":"2024-05-16T22:33:11.799256+0000","last_clean":"2024-05-16T22:33:11.799256+0000","last_became_active":"2024-05-16T22:33:07.780293+0000","last_became_peered":"2024-05-16T22:33:07.780293+0000","last_unstale":"2024-05-16T22:33:11.799256+0000","last_undegraded":"2024-05-16T22:33:11.799256+0000","last_fullsized":"2024-05-16T22:33:11.799256+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:48:01.966089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":21,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.812468+0000","last_change":"2024-05-16T22:33:03.998909+0000","last_active":"2024-05-16T22:33:11.812468+0000","last_peered":"2024-05-16T22:33:11.812468+0000","last_clean":"2024-05-16T22:33:11.812468+0000","last_became_active":"2024-05-16T22:33:03.998546+0000","last_became_peered":"2024-05-16T22:33:03.998546+0000","last_unstale":"2024-05-16T22:33:11.812468+0000","last_undegraded":"2024-05-16T22:33:11.812468+0000","last_fullsized":"2024-05-16T22:33:11.812468+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:33:59.809235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.814362+0000","last_change":"2024-05-16T22:33:07.797223+0000","last_active":"2024-05-16T22:33:11.814362+0000","last_peered":"2024-05-16T22:33:11.814362+0000","last_clean":"2024-05-16T22:33:11.814362+0000","last_became_active":"2024-05-16T22:33:07.796864+0000","last_became_peered":"2024-05-16T22:33:07.796864+0000","last_unstale":"2024-05-16T22:33:11.814362+0000","last_undegraded":"2024-05-16T22:33:11.814362+0000","last_fullsized":"2024-05-16T22:33:11.814362+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:14:39.739523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":21,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.812076+0000","last_change":"2024-05-16T22:33:03.772064+0000","last_active":"2024-05-16T22:33:11.812076+0000","last_peered":"2024-05-16T22:33:11.812076+0000","last_clean":"2024-05-16T22:33:11.812076+0000","last_became_active":"2024-05-16T22:33:03.771663+0000","last_became_peered":"2024-05-16T22:33:03.771663+0000","last_unstale":"2024-05-16T22:33:11.812076+0000","last_undegraded":"2024-05-16T22:33:11.812076+0000","last_fullsized":"2024-05-16T22:33:11.812076+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:05:52.712914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.811266+0000","last_change":"2024-05-16T22:33:07.792771+0000","last_active":"2024-05-16T22:33:11.811266+0000","last_peered":"2024-05-16T22:33:11.811266+0000","last_clean":"2024-05-16T22:33:11.811266+0000","last_became_active":"2024-05-16T22:33:07.792423+0000","last_became_peered":"2024-05-16T22:33:07.792423+0000","last_unstale":"2024-05-16T22:33:11.811266+0000","last_undegraded":"2024-05-16T22:33:11.811266+0000","last_fullsized":"2024-05-16T22:33:11.811266+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T22:39:04.908283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":21,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.811446+0000","last_change":"2024-05-16T22:33:03.770175+0000","last_active":"2024-05-16T22:33:11.811446+0000","last_peered":"2024-05-16T22:33:11.811446+0000","last_clean":"2024-05-16T22:33:11.811446+0000","last_became_active":"2024-05-16T22:33:03.769816+0000","last_became_peered":"2024-05-16T22:33:03.769816+0000","last_unstale":"2024-05-16T22:33:11.811446+0000","last_undegraded":"2024-05-16T22:33:11.811446+0000","last_fullsized":"2024-05-16T22:33:11.811446+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:33:59.809235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.813081+0000","last_change":"2024-05-16T22:33:07.798709+0000","last_active":"2024-05-16T22:33:11.813081+0000","last_peered":"2024-05-16T22:33:11.813081+0000","last_clean":"2024-05-16T22:33:11.813081+0000","last_became_active":"2024-05-16T22:33:07.798400+0000","last_became_peered":"2024-05-16T22:33:07.798400+0000","last_unstale":"2024-05-16T22:33:11.813081+0000","last_undegraded":"2024-05-16T22:33:11.813081+0000","last_fullsized":"2024-05-16T22:33:11.813081+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:41:27.693799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"48'1","reported_seq":22,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.813748+0000","last_change":"2024-05-16T22:33:03.767203+0000","last_active":"2024-05-16T22:33:11.813748+0000","last_peered":"2024-05-16T22:33:11.813748+0000","last_clean":"2024-05-16T22:33:11.813748+0000","last_became_active":"2024-05-16T22:33:03.766560+0000","last_became_peered":"2024-05-16T22:33:03.766560+0000","last_unstale":"2024-05-16T22:33:11.813748+0000","last_undegraded":"2024-05-16T22:33:11.813748+0000","last_fullsized":"2024-05-16T22:33:11.813748+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:06:38.014577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.811784+0000","last_change":"2024-05-16T22:33:07.791362+0000","last_active":"2024-05-16T22:33:11.811784+0000","last_peered":"2024-05-16T22:33:11.811784+0000","last_clean":"2024-05-16T22:33:11.811784+0000","last_became_active":"2024-05-16T22:33:07.790818+0000","last_became_peered":"2024-05-16T22:33:07.790818+0000","last_unstale":"2024-05-16T22:33:11.811784+0000","last_undegraded":"2024-05-16T22:33:11.811784+0000","last_fullsized":"2024-05-16T22:33:11.811784+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:19:28.290115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":21,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.813313+0000","last_change":"2024-05-16T22:33:03.999761+0000","last_active":"2024-05-16T22:33:11.813313+0000","last_peered":"2024-05-16T22:33:11.813313+0000","last_clean":"2024-05-16T22:33:11.813313+0000","last_became_active":"2024-05-16T22:33:03.999238+0000","last_became_peered":"2024-05-16T22:33:03.999238+0000","last_unstale":"2024-05-16T22:33:11.813313+0000","last_undegraded":"2024-05-16T22:33:11.813313+0000","last_fullsized":"2024-05-16T22:33:11.813313+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:05:52.712914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.812737+0000","last_change":"2024-05-16T22:33:07.800007+0000","last_active":"2024-05-16T22:33:11.812737+0000","last_peered":"2024-05-16T22:33:11.812737+0000","last_clean":"2024-05-16T22:33:11.812737+0000","last_became_active":"2024-05-16T22:33:07.799676+0000","last_became_peered":"2024-05-16T22:33:07.799676+0000","last_unstale":"2024-05-16T22:33:11.812737+0000","last_undegraded":"2024-05-16T22:33:11.812737+0000","last_fullsized":"2024-05-16T22:33:11.812737+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:19:28.290115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":21,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.799296+0000","last_change":"2024-05-16T22:33:03.768474+0000","last_active":"2024-05-16T22:33:11.799296+0000","last_peered":"2024-05-16T22:33:11.799296+0000","last_clean":"2024-05-16T22:33:11.799296+0000","last_became_active":"2024-05-16T22:33:03.768158+0000","last_became_peered":"2024-05-16T22:33:03.768158+0000","last_unstale":"2024-05-16T22:33:11.799296+0000","last_undegraded":"2024-05-16T22:33:11.799296+0000","last_fullsized":"2024-05-16T22:33:11.799296+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T04:41:23.675831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.812589+0000","last_change":"2024-05-16T22:33:07.795462+0000","last_active":"2024-05-16T22:33:11.812589+0000","last_peered":"2024-05-16T22:33:11.812589+0000","last_clean":"2024-05-16T22:33:11.812589+0000","last_became_active":"2024-05-16T22:33:07.795130+0000","last_became_peered":"2024-05-16T22:33:07.795130+0000","last_unstale":"2024-05-16T22:33:11.812589+0000","last_undegraded":"2024-05-16T22:33:11.812589+0000","last_fullsized":"2024-05-16T22:33:11.812589+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:29:26.509349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":21,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.812331+0000","last_change":"2024-05-16T22:33:03.999205+0000","last_active":"2024-05-16T22:33:11.812331+0000","last_peered":"2024-05-16T22:33:11.812331+0000","last_clean":"2024-05-16T22:33:11.812331+0000","last_became_active":"2024-05-16T22:33:03.998563+0000","last_became_peered":"2024-05-16T22:33:03.998563+0000","last_unstale":"2024-05-16T22:33:11.812331+0000","last_undegraded":"2024-05-16T22:33:11.812331+0000","last_fullsized":"2024-05-16T22:33:11.812331+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T00:43:56.611018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.813236+0000","last_change":"2024-05-16T22:33:07.802994+0000","last_active":"2024-05-16T22:33:11.813236+0000","last_peered":"2024-05-16T22:33:11.813236+0000","last_clean":"2024-05-16T22:33:11.813236+0000","last_became_active":"2024-05-16T22:33:07.800578+0000","last_became_peered":"2024-05-16T22:33:07.800578+0000","last_unstale":"2024-05-16T22:33:11.813236+0000","last_undegraded":"2024-05-16T22:33:11.813236+0000","last_fullsized":"2024-05-16T22:33:11.813236+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:00:20.576002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":21,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.800326+0000","last_change":"2024-05-16T22:33:03.765155+0000","last_active":"2024-05-16T22:33:11.800326+0000","last_peered":"2024-05-16T22:33:11.800326+0000","last_clean":"2024-05-16T22:33:11.800326+0000","last_became_active":"2024-05-16T22:33:03.764839+0000","last_became_peered":"2024-05-16T22:33:03.764839+0000","last_unstale":"2024-05-16T22:33:11.800326+0000","last_undegraded":"2024-05-16T22:33:11.800326+0000","last_fullsized":"2024-05-16T22:33:11.800326+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T08:37:26.218211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.811883+0000","last_change":"2024-05-16T22:33:07.781981+0000","last_active":"2024-05-16T22:33:11.811883+0000","last_peered":"2024-05-16T22:33:11.811883+0000","last_clean":"2024-05-16T22:33:11.811883+0000","last_became_active":"2024-05-16T22:33:07.781621+0000","last_became_peered":"2024-05-16T22:33:07.781621+0000","last_unstale":"2024-05-16T22:33:11.811883+0000","last_undegraded":"2024-05-16T22:33:11.811883+0000","last_fullsized":"2024-05-16T22:33:11.811883+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T07:28:48.221339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":21,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.799167+0000","last_change":"2024-05-16T22:33:03.999317+0000","last_active":"2024-05-16T22:33:11.799167+0000","last_peered":"2024-05-16T22:33:11.799167+0000","last_clean":"2024-05-16T22:33:11.799167+0000","last_became_active":"2024-05-16T22:33:03.998882+0000","last_became_peered":"2024-05-16T22:33:03.998882+0000","last_unstale":"2024-05-16T22:33:11.799167+0000","last_undegraded":"2024-05-16T22:33:11.799167+0000","last_fullsized":"2024-05-16T22:33:11.799167+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T03:05:20.098018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.799774+0000","last_change":"2024-05-16T22:33:07.795404+0000","last_active":"2024-05-16T22:33:11.799774+0000","last_peered":"2024-05-16T22:33:11.799774+0000","last_clean":"2024-05-16T22:33:11.799774+0000","last_became_active":"2024-05-16T22:33:07.795054+0000","last_became_peered":"2024-05-16T22:33:07.795054+0000","last_unstale":"2024-05-16T22:33:11.799774+0000","last_undegraded":"2024-05-16T22:33:11.799774+0000","last_fullsized":"2024-05-16T22:33:11.799774+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T06:46:30.409031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":21,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.812066+0000","last_change":"2024-05-16T22:33:03.772974+0000","last_active":"2024-05-16T22:33:11.812066+0000","last_peered":"2024-05-16T22:33:11.812066+0000","last_clean":"2024-05-16T22:33:11.812066+0000","last_became_active":"2024-05-16T22:33:03.772554+0000","last_became_peered":"2024-05-16T22:33:03.772554+0000","last_unstale":"2024-05-16T22:33:11.812066+0000","last_undegraded":"2024-05-16T22:33:11.812066+0000","last_fullsized":"2024-05-16T22:33:11.812066+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:55:22.593304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.812167+0000","last_change":"2024-05-16T22:33:07.797751+0000","last_active":"2024-05-16T22:33:11.812167+0000","last_peered":"2024-05-16T22:33:11.812167+0000","last_clean":"2024-05-16T22:33:11.812167+0000","last_became_active":"2024-05-16T22:33:07.796217+0000","last_became_peered":"2024-05-16T22:33:07.796217+0000","last_unstale":"2024-05-16T22:33:11.812167+0000","last_undegraded":"2024-05-16T22:33:11.812167+0000","last_fullsized":"2024-05-16T22:33:11.812167+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:06.766994+0000","last_clean_scrub_stamp":"2024-05-16T22:33:06.766994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T09:28:06.958534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"48'2","reported_seq":23,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.817001+0000","last_change":"2024-05-16T22:33:03.769898+0000","last_active":"2024-05-16T22:33:11.817001+0000","last_peered":"2024-05-16T22:33:11.817001+0000","last_clean":"2024-05-16T22:33:11.817001+0000","last_became_active":"2024-05-16T22:33:03.769455+0000","last_became_peered":"2024-05-16T22:33:03.769455+0000","last_unstale":"2024-05-16T22:33:11.817001+0000","last_undegraded":"2024-05-16T22:33:11.817001+0000","last_fullsized":"2024-05-16T22:33:11.817001+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:33:02.749027+0000","last_clean_scrub_stamp":"2024-05-16T22:33:02.749027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T02:19:24.272148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":164,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-16T22:33:11.811443+0000","last_change":"2024-05-16T22:27:15.950850+0000","last_active":"2024-05-16T22:33:11.811443+0000","last_peered":"2024-05-16T22:33:11.811443+0000","last_clean":"2024-05-16T22:33:11.811443+0000","last_became_active":"2024-05-16T22:27:15.949553+0000","last_became_peered":"2024-05-16T22:27:15.949553+0000","last_unstale":"2024-05-16T22:33:11.811443+0000","last_undegraded":"2024-05-16T22:33:11.811443+0000","last_fullsized":"2024-05-16T22:33:11.811443+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:14.702385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:14.702385+0000","last_clean_scrub_stamp":"2024-05-16T22:27:14.702385+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:46:07.495562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542224,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36476,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335364,"statfs":{"total":96636764160,"available":96599412736,"internally_reserved":0,"allocated":1163264,"data_stored":821030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574928,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31740,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340100,"statfs":{"total":96636764160,"available":96604262400,"internally_reserved":0,"allocated":573440,"data_stored":231244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574928,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35896,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335944,"statfs":{"total":96636764160,"available":96600006656,"internally_reserved":0,"allocated":569344,"data_stored":230642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574928,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31744,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340096,"statfs":{"total":96636764160,"available":96604258304,"internally_reserved":0,"allocated":577536,"data_stored":232184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574928,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31744,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340096,"statfs":{"total":96636764160,"available":96604258304,"internally_reserved":0,"allocated":577536,"data_stored":231210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574928,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31752,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340088,"statfs":{"total":96636764160,"available":96604250112,"internally_reserved":0,"allocated":581632,"data_stored":232206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31736,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340104,"statfs":{"total":96636764160,"available":96604266496,"internally_reserved":0,"allocated":569344,"data_stored":230642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574928,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32316,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339524,"statfs":{"total":96636764160,"available":96603672576,"internally_reserved":0,"allocated":1163264,"data_stored":820974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-16T22:33:43.397 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-16T22:33:43.427 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-16T22:33:43.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.593+0000 7faad0c13640 1 Processor -- start 2024-05-16T22:33:43.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.593+0000 7faad0c13640 1 -- start start 2024-05-16T22:33:43.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.594+0000 7faad0c13640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7faacc0b4500 0x7faacc0b5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:43.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.595+0000 7faad0c13640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faacc0b9ee0 0x7faacc0a3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:43.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.595+0000 7faad0c13640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faacc0bba80 con 0x7faacc0bb490 2024-05-16T22:33:43.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.595+0000 7faad0c13640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7faacc0bbd20 con 0x7faacc0b4500 2024-05-16T22:33:43.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.595+0000 7faad0c13640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7faacc0b4f60 con 0x7faacc0b9ee0 2024-05-16T22:33:43.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.595+0000 7faaca59c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7faacc0b4500 0x7faacc0b5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:43.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.595+0000 7faac9d9b640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7faacc0bb490 0x7faacc06faa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46576/0 (socket says 172.21.15.44:46576) 2024-05-16T22:33:43.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.595+0000 7faac9d9b640 1 -- 172.21.15.44:0/3142882415 learned_addr learned my addr 172.21.15.44:0/3142882415 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:33:43.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.595+0000 7faaca59c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7faacc0b4500 0x7faacc0b5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57794/0 (socket says 172.21.15.44:57794) 2024-05-16T22:33:43.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.595+0000 7faacad9d640 1 --2- 172.21.15.44:0/3142882415 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faacc0b9ee0 0x7faacc0a3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:43.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.595+0000 7faaca59c640 1 -- 172.21.15.44:0/3142882415 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faacc0b9ee0 msgr2=0x7faacc0a3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:33:44.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.595+0000 7faaca59c640 1 --2- 172.21.15.44:0/3142882415 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faacc0b9ee0 0x7faacc0a3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:44.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.595+0000 7faaca59c640 1 -- 172.21.15.44:0/3142882415 >> v1:172.21.15.44:6789/0 conn(0x7faacc0bb490 legacy=0x7faacc06faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:44.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.595+0000 7faaca59c640 1 -- 172.21.15.44:0/3142882415 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faacc0b5240 con 0x7faacc0b4500 2024-05-16T22:33:44.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.595+0000 7faac959a640 1 -- 172.21.15.44:0/3142882415 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 310682756 0 0) 0x7faacc0bba80 con 0x7faacc0bb490 2024-05-16T22:33:44.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.595+0000 7faacad9d640 1 --2- 172.21.15.44:0/3142882415 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faacc0b9ee0 0x7faacc0a3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:33:44.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.596+0000 7faaca59c640 1 --2- 172.21.15.44:0/3142882415 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faacc0b4500 0x7faacc0b5760 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7faac400ba40 tx=0x7faac402c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc32c0e9df675678 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:44.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.596+0000 7faac959a640 1 -- 172.21.15.44:0/3142882415 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac40327d0 con 0x7faacc0b4500 2024-05-16T22:33:44.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.596+0000 7faac959a640 1 -- 172.21.15.44:0/3142882415 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faac4038070 con 0x7faacc0b4500 2024-05-16T22:33:44.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.596+0000 7faac959a640 1 -- 172.21.15.44:0/3142882415 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac4032b90 con 0x7faacc0b4500 2024-05-16T22:33:44.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.597+0000 7faad0c13640 1 -- 172.21.15.44:0/3142882415 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faacc0b4500 msgr2=0x7faacc0b5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:44.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.597+0000 7faad0c13640 1 --2- 172.21.15.44:0/3142882415 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faacc0b4500 0x7faacc0b5760 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7faac400ba40 tx=0x7faac402c8d0 comp rx=0 tx=0).stop 2024-05-16T22:33:44.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.597+0000 7faad0c13640 1 -- 172.21.15.44:0/3142882415 shutdown_connections 2024-05-16T22:33:44.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.597+0000 7faad0c13640 1 --2- 172.21.15.44:0/3142882415 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faacc0b9ee0 0x7faacc0a3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:44.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.597+0000 7faad0c13640 1 --2- 172.21.15.44:0/3142882415 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faacc0b4500 0x7faacc0b5760 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:44.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.597+0000 7faad0c13640 1 -- 172.21.15.44:0/3142882415 >> 172.21.15.44:0/3142882415 conn(0x7faacc0a1ac0 msgr2=0x7faacc0bbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:33:44.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.597+0000 7faad0c13640 1 -- 172.21.15.44:0/3142882415 shutdown_connections 2024-05-16T22:33:44.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.597+0000 7faad0c13640 1 -- 172.21.15.44:0/3142882415 wait complete. 2024-05-16T22:33:44.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.599+0000 7faad0c13640 1 Processor -- start 2024-05-16T22:33:44.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.599+0000 7faad0c13640 1 -- start start 2024-05-16T22:33:44.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.600+0000 7faad0c13640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faacc0b4500 0x7faacc1e0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:44.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.600+0000 7faad0c13640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faacc0b9ee0 0x7faacc0b6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:44.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.600+0000 7faad0c13640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faacc0bb490 0x7faacc146770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:44.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.600+0000 7faad0c13640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7faacc0a4510 con 0x7faacc0b4500 2024-05-16T22:33:44.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.600+0000 7faad0c13640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7faacc0ba2f0 con 0x7faacc0b9ee0 2024-05-16T22:33:44.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.600+0000 7faad0c13640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7faacc0a4690 con 0x7faacc0bb490 2024-05-16T22:33:44.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.600+0000 7faaca59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faacc0b4500 0x7faacc1e0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:44.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.600+0000 7faaca59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faacc0b4500 0x7faacc1e0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57802/0 (socket says 172.21.15.44:57802) 2024-05-16T22:33:44.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.600+0000 7faaca59c640 1 -- 172.21.15.44:0/2193581732 learned_addr learned my addr 172.21.15.44:0/2193581732 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:33:44.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.600+0000 7faacad9d640 1 --2- 172.21.15.44:0/2193581732 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faacc0bb490 0x7faacc146770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:44.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.600+0000 7faac9d9b640 1 --2- 172.21.15.44:0/2193581732 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faacc0b9ee0 0x7faacc0b6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:44.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.600+0000 7faaca59c640 1 -- 172.21.15.44:0/2193581732 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faacc0bb490 msgr2=0x7faacc146770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:44.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.600+0000 7faaca59c640 1 --2- 172.21.15.44:0/2193581732 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faacc0bb490 0x7faacc146770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:44.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.600+0000 7faaca59c640 1 -- 172.21.15.44:0/2193581732 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faacc0b9ee0 msgr2=0x7faacc0b6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:45.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.600+0000 7faaca59c640 1 --2- 172.21.15.44:0/2193581732 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faacc0b9ee0 0x7faacc0b6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:45.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.600+0000 7faaca59c640 1 -- 172.21.15.44:0/2193581732 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faacc1e0880 con 0x7faacc0b4500 2024-05-16T22:33:45.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.600+0000 7faaca59c640 1 --2- 172.21.15.44:0/2193581732 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faacc0b4500 0x7faacc1e0340 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7faac4035040 tx=0x7faac40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:45.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.601+0000 7faac2ffd640 1 -- 172.21.15.44:0/2193581732 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac404a070 con 0x7faacc0b4500 2024-05-16T22:33:45.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.601+0000 7faac2ffd640 1 -- 172.21.15.44:0/2193581732 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faac4033670 con 0x7faacc0b4500 2024-05-16T22:33:45.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.601+0000 7faac2ffd640 1 -- 172.21.15.44:0/2193581732 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac4033a40 con 0x7faacc0b4500 2024-05-16T22:33:45.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.601+0000 7faad0c13640 1 -- 172.21.15.44:0/2193581732 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faacc1e3c70 con 0x7faacc0b4500 2024-05-16T22:33:45.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.601+0000 7faad0c13640 1 -- 172.21.15.44:0/2193581732 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faacc1e4220 con 0x7faacc0b4500 2024-05-16T22:33:45.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.602+0000 7faad0c13640 1 -- 172.21.15.44:0/2193581732 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faacc0747e0 con 0x7faacc0b4500 2024-05-16T22:33:45.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.602+0000 7faac2ffd640 1 -- 172.21.15.44:0/2193581732 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7faac404d070 con 0x7faacc0b4500 2024-05-16T22:33:45.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.603+0000 7faac2ffd640 1 --2- 172.21.15.44:0/2193581732 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7faaac0762d0 0x7faaac0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:45.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.603+0000 7faac2ffd640 1 -- 172.21.15.44:0/2193581732 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7faac40b9e80 con 0x7faacc0b4500 2024-05-16T22:33:45.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.603+0000 7faac9d9b640 1 --2- 172.21.15.44:0/2193581732 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7faaac0762d0 0x7faaac0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:45.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.604+0000 7faac9d9b640 1 --2- 172.21.15.44:0/2193581732 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7faaac0762d0 0x7faaac0787e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7faacc147730 tx=0x7faab4007de0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:45.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.608+0000 7faac2ffd640 1 -- 172.21.15.44:0/2193581732 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7faac4083190 con 0x7faacc0b4500 2024-05-16T22:33:45.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.875+0000 7faad0c13640 1 -- 172.21.15.44:0/2193581732 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7faacc0bce70 con 0x7faacc0b4500 2024-05-16T22:33:45.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.877+0000 7faac2ffd640 1 -- 172.21.15.44:0/2193581732 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) ==== 190+0+147 (secure 0 0 0) 0x7faac4087490 con 0x7faacc0b4500 2024-05-16T22:33:45.604 INFO:teuthology.orchestra.run.smithi044.stdout:[client.0] 2024-05-16T22:33:45.620 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQAXiEZms3dqGBAAS4ISUkubc7YrigOk4RRlXA== 2024-05-16T22:33:45.637 INFO:teuthology.orchestra.run.smithi044.stdout: caps mds = "allow" 2024-05-16T22:33:45.654 INFO:teuthology.orchestra.run.smithi044.stdout: caps mon = "allow r" 2024-05-16T22:33:45.670 INFO:teuthology.orchestra.run.smithi044.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-16T22:33:45.689 INFO:teuthology.orchestra.run.smithi044.stderr:updated caps for client.0 2024-05-16T22:33:45.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.879+0000 7faad0c13640 1 -- 172.21.15.44:0/2193581732 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7faaac0762d0 msgr2=0x7faaac0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:45.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.879+0000 7faad0c13640 1 --2- 172.21.15.44:0/2193581732 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7faaac0762d0 0x7faaac0787e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7faacc147730 tx=0x7faab4007de0 comp rx=0 tx=0).stop 2024-05-16T22:33:45.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.879+0000 7faad0c13640 1 -- 172.21.15.44:0/2193581732 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faacc0b4500 msgr2=0x7faacc1e0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:45.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.879+0000 7faad0c13640 1 --2- 172.21.15.44:0/2193581732 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faacc0b4500 0x7faacc1e0340 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7faac4035040 tx=0x7faac40046c0 comp rx=0 tx=0).stop 2024-05-16T22:33:45.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.879+0000 7faad0c13640 1 -- 172.21.15.44:0/2193581732 shutdown_connections 2024-05-16T22:33:45.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.879+0000 7faad0c13640 1 --2- 172.21.15.44:0/2193581732 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7faaac0762d0 0x7faaac0787e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:45.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.879+0000 7faad0c13640 1 --2- 172.21.15.44:0/2193581732 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faacc0bb490 0x7faacc146770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:45.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.879+0000 7faad0c13640 1 --2- 172.21.15.44:0/2193581732 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faacc0b9ee0 0x7faacc0b6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:45.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.879+0000 7faad0c13640 1 --2- 172.21.15.44:0/2193581732 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faacc0b4500 0x7faacc1e0340 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:46.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.879+0000 7faad0c13640 1 -- 172.21.15.44:0/2193581732 >> 172.21.15.44:0/2193581732 conn(0x7faacc0a1ac0 msgr2=0x7faacc068600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:33:46.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.879+0000 7faad0c13640 1 -- 172.21.15.44:0/2193581732 shutdown_connections 2024-05-16T22:33:46.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:43.879+0000 7faad0c13640 1 -- 172.21.15.44:0/2193581732 wait complete. 2024-05-16T22:33:46.105 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T22:33:46.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.264+0000 7fcb8b468640 1 Processor -- start 2024-05-16T22:33:46.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.264+0000 7fcb8b468640 1 -- start start 2024-05-16T22:33:46.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.266+0000 7fcb8b468640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcb84074a30 0x7fcb84152590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:46.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.266+0000 7fcb8b468640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb840bbc80 con 0x7fcb8406c8c0 2024-05-16T22:33:46.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.266+0000 7fcb8b468640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb840bbf60 con 0x7fcb84152180 2024-05-16T22:33:46.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.266+0000 7fcb8b468640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fcb84151a10 con 0x7fcb84074a30 2024-05-16T22:33:46.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.266+0000 7fcb89a05640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcb84074a30 0x7fcb84152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:46.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.266+0000 7fcb89204640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fcb8406c8c0 0x7fcb840bb4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46584/0 (socket says 172.21.15.44:46584) 2024-05-16T22:33:46.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.266+0000 7fcb89204640 1 -- 172.21.15.44:0/2253532213 learned_addr learned my addr 172.21.15.44:0/2253532213 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:33:46.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.266+0000 7fcb7bfff640 1 -- 172.21.15.44:0/2253532213 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4215016885 0 0) 0x7fcb840bbc80 con 0x7fcb8406c8c0 2024-05-16T22:33:46.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.266+0000 7fcb7bfff640 1 -- 172.21.15.44:0/2253532213 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb70003520 con 0x7fcb8406c8c0 2024-05-16T22:33:46.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.266+0000 7fcb7bfff640 1 -- 172.21.15.44:0/2253532213 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4213234800 0 0) 0x7fcb840bbf60 con 0x7fcb84152180 2024-05-16T22:33:46.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.266+0000 7fcb89a05640 1 -- 172.21.15.44:0/2253532213 >> v1:172.21.15.70:6789/0 conn(0x7fcb84152180 legacy=0x7fcb84074320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:46.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.266+0000 7fcb89a05640 1 -- 172.21.15.44:0/2253532213 >> v1:172.21.15.44:6789/0 conn(0x7fcb8406c8c0 legacy=0x7fcb840bb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:46.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.266+0000 7fcb89a05640 1 -- 172.21.15.44:0/2253532213 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb84151c60 con 0x7fcb84074a30 2024-05-16T22:33:46.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.267+0000 7fcb89a05640 1 --2- 172.21.15.44:0/2253532213 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcb84074a30 0x7fcb84152590 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c009dc0 tx=0x7fcb7c02a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b3a05190f62a866 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:46.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.267+0000 7fcb7bfff640 1 -- 172.21.15.44:0/2253532213 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c007740 con 0x7fcb84074a30 2024-05-16T22:33:46.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.267+0000 7fcb7bfff640 1 -- 172.21.15.44:0/2253532213 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb7c0078e0 con 0x7fcb84074a30 2024-05-16T22:33:46.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.267+0000 7fcb7bfff640 1 -- 172.21.15.44:0/2253532213 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c007c90 con 0x7fcb84074a30 2024-05-16T22:33:46.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.268+0000 7fcb8b468640 1 -- 172.21.15.44:0/2253532213 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcb84074a30 msgr2=0x7fcb84152590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:46.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.268+0000 7fcb8b468640 1 --2- 172.21.15.44:0/2253532213 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcb84074a30 0x7fcb84152590 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c009dc0 tx=0x7fcb7c02a6d0 comp rx=0 tx=0).stop 2024-05-16T22:33:46.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.268+0000 7fcb8b468640 1 -- 172.21.15.44:0/2253532213 shutdown_connections 2024-05-16T22:33:47.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.268+0000 7fcb8b468640 1 --2- 172.21.15.44:0/2253532213 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcb84074a30 0x7fcb84152590 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:47.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.268+0000 7fcb8b468640 1 -- 172.21.15.44:0/2253532213 >> 172.21.15.44:0/2253532213 conn(0x7fcb840bd0f0 msgr2=0x7fcb840bd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:33:47.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.268+0000 7fcb8b468640 1 -- 172.21.15.44:0/2253532213 shutdown_connections 2024-05-16T22:33:47.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.268+0000 7fcb8b468640 1 -- 172.21.15.44:0/2253532213 wait complete. 2024-05-16T22:33:47.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.270+0000 7fcb8b468640 1 Processor -- start 2024-05-16T22:33:47.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.270+0000 7fcb8b468640 1 -- start start 2024-05-16T22:33:47.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.271+0000 7fcb8b468640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb8406c8c0 0x7fcb84148f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:47.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.271+0000 7fcb8b468640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcb84074a30 0x7fcb841e7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:47.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.271+0000 7fcb8b468640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb84152180 0x7fcb841e47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:47.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.271+0000 7fcb8b468640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8406ccd0 con 0x7fcb84152180 2024-05-16T22:33:47.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.271+0000 7fcb8b468640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcb840bb090 con 0x7fcb8406c8c0 2024-05-16T22:33:47.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.271+0000 7fcb8b468640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fcb8406ce50 con 0x7fcb84074a30 2024-05-16T22:33:47.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.271+0000 7fcb89a05640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb84152180 0x7fcb841e47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:47.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.271+0000 7fcb89a05640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb84152180 0x7fcb841e47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57814/0 (socket says 172.21.15.44:57814) 2024-05-16T22:33:47.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.271+0000 7fcb89a05640 1 -- 172.21.15.44:0/2844767352 learned_addr learned my addr 172.21.15.44:0/2844767352 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:33:47.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.272+0000 7fcb89204640 1 --2- 172.21.15.44:0/2844767352 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb8406c8c0 0x7fcb84148f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:47.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.272+0000 7fcb88a03640 1 --2- 172.21.15.44:0/2844767352 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcb84074a30 0x7fcb841e7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:47.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.272+0000 7fcb89a05640 1 -- 172.21.15.44:0/2844767352 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcb84074a30 msgr2=0x7fcb841e7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:47.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.272+0000 7fcb89a05640 1 --2- 172.21.15.44:0/2844767352 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcb84074a30 0x7fcb841e7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:47.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.272+0000 7fcb89a05640 1 -- 172.21.15.44:0/2844767352 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb8406c8c0 msgr2=0x7fcb84148f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:47.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.272+0000 7fcb89a05640 1 --2- 172.21.15.44:0/2844767352 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb8406c8c0 0x7fcb84148f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:47.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.272+0000 7fcb89a05640 1 -- 172.21.15.44:0/2844767352 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb841494c0 con 0x7fcb84152180 2024-05-16T22:33:47.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.272+0000 7fcb89a05640 1 --2- 172.21.15.44:0/2844767352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb84152180 0x7fcb841e47b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c02acc0 tx=0x7fcb7c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:47.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.272+0000 7fcb79ffb640 1 -- 172.21.15.44:0/2844767352 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c040070 con 0x7fcb84152180 2024-05-16T22:33:47.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.272+0000 7fcb79ffb640 1 -- 172.21.15.44:0/2844767352 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb7c031c40 con 0x7fcb84152180 2024-05-16T22:33:47.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.272+0000 7fcb8b468640 1 -- 172.21.15.44:0/2844767352 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb841e84b0 con 0x7fcb84152180 2024-05-16T22:33:47.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.272+0000 7fcb79ffb640 1 -- 172.21.15.44:0/2844767352 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c009450 con 0x7fcb84152180 2024-05-16T22:33:48.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.272+0000 7fcb8b468640 1 -- 172.21.15.44:0/2844767352 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb84151290 con 0x7fcb84152180 2024-05-16T22:33:48.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.274+0000 7fcb8b468640 1 -- 172.21.15.44:0/2844767352 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb84073760 con 0x7fcb84152180 2024-05-16T22:33:48.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.274+0000 7fcb79ffb640 1 -- 172.21.15.44:0/2844767352 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcb7c039040 con 0x7fcb84152180 2024-05-16T22:33:48.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.275+0000 7fcb79ffb640 1 --2- 172.21.15.44:0/2844767352 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fcb68076300 0x7fcb68078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:48.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.275+0000 7fcb79ffb640 1 -- 172.21.15.44:0/2844767352 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7fcb7c0b8d00 con 0x7fcb84152180 2024-05-16T22:33:48.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.275+0000 7fcb89204640 1 --2- 172.21.15.44:0/2844767352 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fcb68076300 0x7fcb68078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:48.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.276+0000 7fcb89204640 1 --2- 172.21.15.44:0/2844767352 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fcb68076300 0x7fcb68078810 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcb80005880 tx=0x7fcb80006aa0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:48.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.279+0000 7fcb79ffb640 1 -- 172.21.15.44:0/2844767352 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fcb84073760 con 0x7fcb84152180 2024-05-16T22:33:48.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.509+0000 7fcb8b468640 1 -- 172.21.15.44:0/2844767352 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcb840be3f0 con 0x7fcb84152180 2024-05-16T22:33:48.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.510+0000 7fcb79ffb640 1 -- 172.21.15.44:0/2844767352 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+4347 (secure 0 0 0) 0x7fcb7c081f70 con 0x7fcb84152180 2024-05-16T22:33:48.357 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:33:48.407 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4954,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2432336323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2432336323},{"type":"v1","addr":"172.21.15.70:6835","nonce":2432336323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4972,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/454770375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":454770375},{"type":"v1","addr":"172.21.15.44:6835","nonce":454770375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T22:33:10.855194+0000","modified":"2024-05-16T22:33:27.123137+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5043},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5043":{"gid":5043,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":8,"addr":"172.21.15.44:6834/97015923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":97015923},{"type":"v1","addr":"172.21.15.44:6834","nonce":97015923}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5043,"qdb_cluster":[5043]},"id":3}]} 2024-05-16T22:33:48.441 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 26 2024-05-16T22:33:48.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.512+0000 7fcb8b468640 1 -- 172.21.15.44:0/2844767352 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fcb68076300 msgr2=0x7fcb68078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:48.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.512+0000 7fcb8b468640 1 --2- 172.21.15.44:0/2844767352 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fcb68076300 0x7fcb68078810 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcb80005880 tx=0x7fcb80006aa0 comp rx=0 tx=0).stop 2024-05-16T22:33:48.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.512+0000 7fcb8b468640 1 -- 172.21.15.44:0/2844767352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb84152180 msgr2=0x7fcb841e47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:48.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.512+0000 7fcb8b468640 1 --2- 172.21.15.44:0/2844767352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb84152180 0x7fcb841e47b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c02acc0 tx=0x7fcb7c004a40 comp rx=0 tx=0).stop 2024-05-16T22:33:48.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.512+0000 7fcb8b468640 1 -- 172.21.15.44:0/2844767352 shutdown_connections 2024-05-16T22:33:48.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.512+0000 7fcb8b468640 1 --2- 172.21.15.44:0/2844767352 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fcb68076300 0x7fcb68078810 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:48.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.512+0000 7fcb8b468640 1 --2- 172.21.15.44:0/2844767352 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcb84074a30 0x7fcb841e7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:48.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.512+0000 7fcb8b468640 1 --2- 172.21.15.44:0/2844767352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb84152180 0x7fcb841e47b0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:48.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.512+0000 7fcb8b468640 1 --2- 172.21.15.44:0/2844767352 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb8406c8c0 0x7fcb84148f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:48.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.512+0000 7fcb8b468640 1 -- 172.21.15.44:0/2844767352 >> 172.21.15.44:0/2844767352 conn(0x7fcb840bd0f0 msgr2=0x7fcb84073050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:33:48.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.513+0000 7fcb8b468640 1 -- 172.21.15.44:0/2844767352 shutdown_connections 2024-05-16T22:33:48.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:46.513+0000 7fcb8b468640 1 -- 172.21.15.44:0/2844767352 wait complete. 2024-05-16T22:33:49.210 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-16T22:33:10.855194+0000', 'modified': '2024-05-16T22:33:27.123137+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5043}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5043': {'gid': 5043, 'name': 'a', 'rank': 0, 'incarnation': 23, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.44:6834/97015923', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6832', 'nonce': 97015923}, {'type': 'v1', 'addr': '172.21.15.44:6834', 'nonce': 97015923}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5043, 'qdb_cluster': [5043]} 2024-05-16T22:33:49.266 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-16T22:33:49.325 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-16T22:33:49.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.486+0000 7f3615f9d640 1 Processor -- start 2024-05-16T22:33:49.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.486+0000 7f3615f9d640 1 -- start start 2024-05-16T22:33:49.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.487+0000 7f3615f9d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f36100bdf90 0x7f361014e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:49.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.487+0000 7f3615f9d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f361014ec60 0x7f3610158be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:49.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.487+0000 7f3615f9d640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36100c0eb0 con 0x7f36100bd630 2024-05-16T22:33:49.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.487+0000 7f3615f9d640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f36100bf060 con 0x7f361014ec60 2024-05-16T22:33:49.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.487+0000 7f3615f9d640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f36100bda40 con 0x7f36100bdf90 2024-05-16T22:33:49.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.488+0000 7f3614f9b640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f36100bd630 0x7f36100c07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46588/0 (socket says 172.21.15.44:46588) 2024-05-16T22:33:49.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.488+0000 7f3614f9b640 1 -- 172.21.15.44:0/1075963893 learned_addr learned my addr 172.21.15.44:0/1075963893 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:33:49.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.488+0000 7f361579c640 1 --2- 172.21.15.44:0/1075963893 >> v2:172.21.15.44:3300/0 conn(0x7f361014ec60 0x7f3610158be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:49.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.488+0000 7f360ffff640 1 --2- 172.21.15.44:0/1075963893 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f36100bdf90 0x7f361014e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:49.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.488+0000 7f361579c640 1 -- 172.21.15.44:0/1075963893 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f36100bdf90 msgr2=0x7f361014e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:33:49.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.488+0000 7f361579c640 1 --2- 172.21.15.44:0/1075963893 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f36100bdf90 0x7f361014e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:49.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.488+0000 7f361579c640 1 -- 172.21.15.44:0/1075963893 >> v1:172.21.15.44:6789/0 conn(0x7f36100bd630 legacy=0x7f36100c07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:49.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.488+0000 7f361579c640 1 -- 172.21.15.44:0/1075963893 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36100bfdd0 con 0x7f361014ec60 2024-05-16T22:33:50.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.488+0000 7f360f7fe640 1 -- 172.21.15.44:0/1075963893 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4105677020 0 0) 0x7f3608001490 con 0x7f36100bd630 2024-05-16T22:33:50.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.489+0000 7f361579c640 1 --2- 172.21.15.44:0/1075963893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f361014ec60 0x7f3610158be0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f36000097a0 tx=0x7f360002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aac9fee73bd6a026 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:50.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.489+0000 7f360f7fe640 1 -- 172.21.15.44:0/1075963893 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3600037070 con 0x7f361014ec60 2024-05-16T22:33:50.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.489+0000 7f360f7fe640 1 -- 172.21.15.44:0/1075963893 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3600032440 con 0x7f361014ec60 2024-05-16T22:33:50.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.489+0000 7f360f7fe640 1 -- 172.21.15.44:0/1075963893 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3600032810 con 0x7f361014ec60 2024-05-16T22:33:50.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.490+0000 7f3615f9d640 1 -- 172.21.15.44:0/1075963893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f361014ec60 msgr2=0x7f3610158be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:50.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.490+0000 7f3615f9d640 1 --2- 172.21.15.44:0/1075963893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f361014ec60 0x7f3610158be0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f36000097a0 tx=0x7f360002a180 comp rx=0 tx=0).stop 2024-05-16T22:33:50.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.490+0000 7f3615f9d640 1 -- 172.21.15.44:0/1075963893 shutdown_connections 2024-05-16T22:33:50.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.490+0000 7f3615f9d640 1 --2- 172.21.15.44:0/1075963893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f361014ec60 0x7f3610158be0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:50.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.490+0000 7f3615f9d640 1 --2- 172.21.15.44:0/1075963893 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f36100bdf90 0x7f361014e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:50.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.490+0000 7f3615f9d640 1 -- 172.21.15.44:0/1075963893 >> 172.21.15.44:0/1075963893 conn(0x7f36100c3c40 msgr2=0x7f36100c0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:33:50.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.490+0000 7f3615f9d640 1 -- 172.21.15.44:0/1075963893 shutdown_connections 2024-05-16T22:33:50.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.490+0000 7f3615f9d640 1 -- 172.21.15.44:0/1075963893 wait complete. 2024-05-16T22:33:50.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.491+0000 7f3615f9d640 1 Processor -- start 2024-05-16T22:33:50.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.491+0000 7f3615f9d640 1 -- start start 2024-05-16T22:33:50.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.492+0000 7f3615f9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36100bd630 0x7f36100a6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:50.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.493+0000 7f3615f9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36100bdf90 0x7f36100a74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:50.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.493+0000 7f3615f9d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f361014ec60 0x7f36100b97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:50.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.493+0000 7f3615f9d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f36100becf0 con 0x7f36100bd630 2024-05-16T22:33:50.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.493+0000 7f3615f9d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f36100bea10 con 0x7f36100bdf90 2024-05-16T22:33:50.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.493+0000 7f3615f9d640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f361014f070 con 0x7f361014ec60 2024-05-16T22:33:50.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.493+0000 7f3614f9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36100bd630 0x7f36100a6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:50.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.493+0000 7f3614f9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36100bd630 0x7f36100a6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57830/0 (socket says 172.21.15.44:57830) 2024-05-16T22:33:50.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.493+0000 7f3614f9b640 1 -- 172.21.15.44:0/3712631391 learned_addr learned my addr 172.21.15.44:0/3712631391 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:33:50.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.493+0000 7f361579c640 1 --2- 172.21.15.44:0/3712631391 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f361014ec60 0x7f36100b97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:50.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.493+0000 7f360ffff640 1 --2- 172.21.15.44:0/3712631391 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36100bdf90 0x7f36100a74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:50.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.493+0000 7f3614f9b640 1 -- 172.21.15.44:0/3712631391 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f361014ec60 msgr2=0x7f36100b97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:50.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.493+0000 7f3614f9b640 1 --2- 172.21.15.44:0/3712631391 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f361014ec60 0x7f36100b97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:51.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.493+0000 7f3614f9b640 1 -- 172.21.15.44:0/3712631391 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36100bdf90 msgr2=0x7f36100a74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:51.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.493+0000 7f3614f9b640 1 --2- 172.21.15.44:0/3712631391 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36100bdf90 0x7f36100a74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:51.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.493+0000 7f3614f9b640 1 -- 172.21.15.44:0/3712631391 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36100a6c80 con 0x7f36100bd630 2024-05-16T22:33:51.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.493+0000 7f3614f9b640 1 --2- 172.21.15.44:0/3712631391 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36100bd630 0x7f36100a6740 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f360800c7a0 tx=0x7f360800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:51.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.493+0000 7f360d7fa640 1 -- 172.21.15.44:0/3712631391 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3608018070 con 0x7f36100bd630 2024-05-16T22:33:51.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.493+0000 7f360d7fa640 1 -- 172.21.15.44:0/3712631391 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f360800a640 con 0x7f36100bd630 2024-05-16T22:33:51.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.493+0000 7f3615f9d640 1 -- 172.21.15.44:0/3712631391 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36101e42a0 con 0x7f36100bd630 2024-05-16T22:33:51.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.493+0000 7f360d7fa640 1 -- 172.21.15.44:0/3712631391 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f360800aa30 con 0x7f36100bd630 2024-05-16T22:33:51.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.493+0000 7f3615f9d640 1 -- 172.21.15.44:0/3712631391 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36100b6910 con 0x7f36100bd630 2024-05-16T22:33:51.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.496+0000 7f360d7fa640 1 -- 172.21.15.44:0/3712631391 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f360801b070 con 0x7f36100bd630 2024-05-16T22:33:51.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.496+0000 7f360d7fa640 1 --2- 172.21.15.44:0/3712631391 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f35fc076300 0x7f35fc078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:51.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.496+0000 7f360d7fa640 1 -- 172.21.15.44:0/3712631391 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f3608096b50 con 0x7f36100bd630 2024-05-16T22:33:51.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.497+0000 7f360ffff640 1 --2- 172.21.15.44:0/3712631391 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f35fc076300 0x7f35fc078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:51.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.497+0000 7f361e18e740 1 Processor -- start 2024-05-16T22:33:51.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.497+0000 7f361e18e740 1 -- start start 2024-05-16T22:33:51.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.497+0000 7f360ffff640 1 --2- 172.21.15.44:0/3712631391 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f35fc076300 0x7f35fc078810 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3610076730 tx=0x7f3604009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:51.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.498+0000 7f361e18e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ef95485270 0x55ef9585e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:51.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.498+0000 7f361e18e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef9545c3b0 0x55ef95822850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:51.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.498+0000 7f361e18e740 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55ef95464590 0x55ef95853480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:51.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.498+0000 7f361e18e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ef95798f10 con 0x55ef9545c3b0 2024-05-16T22:33:51.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.498+0000 7f361e18e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ef95788ab0 con 0x55ef95485270 2024-05-16T22:33:51.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.498+0000 7f361e18e740 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x55ef9578caf0 con 0x55ef95464590 2024-05-16T22:33:51.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.498+0000 7f360ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef9545c3b0 0x55ef95822850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:51.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.498+0000 7f360ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef9545c3b0 0x55ef95822850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57840/0 (socket says 172.21.15.44:57840) 2024-05-16T22:33:51.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.498+0000 7f360ffff640 1 -- 172.21.15.44:0/665236733 learned_addr learned my addr 172.21.15.44:0/665236733 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:33:51.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.498+0000 7f361579c640 1 --2- 172.21.15.44:0/665236733 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55ef95464590 0x55ef95853480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:51.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.498+0000 7f3614f9b640 1 --2- 172.21.15.44:0/665236733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ef95485270 0x55ef9585e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:51.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.498+0000 7f360ffff640 1 -- 172.21.15.44:0/665236733 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55ef95464590 msgr2=0x55ef95853480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:33:51.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.498+0000 7f360ffff640 1 --2- 172.21.15.44:0/665236733 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55ef95464590 0x55ef95853480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:52.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.498+0000 7f360ffff640 1 -- 172.21.15.44:0/665236733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ef95485270 msgr2=0x55ef9585e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:33:52.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.498+0000 7f360ffff640 1 --2- 172.21.15.44:0/665236733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ef95485270 0x55ef9585e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:52.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.498+0000 7f360ffff640 1 -- 172.21.15.44:0/665236733 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef9574c5d0 con 0x55ef9545c3b0 2024-05-16T22:33:52.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.498+0000 7f3614f9b640 1 --2- 172.21.15.44:0/665236733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ef95485270 0x55ef9585e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T22:33:52.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.498+0000 7f361579c640 1 --2- 172.21.15.44:0/665236733 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55ef95464590 0x55ef95853480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T22:33:52.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.499+0000 7f360ffff640 1 --2- 172.21.15.44:0/665236733 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef9545c3b0 0x55ef95822850 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f36040095c0 tx=0x7f3604014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c40cbaf7af5e0ba1 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:52.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.499+0000 7f35f67fc640 1 -- 172.21.15.44:0/665236733 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3604025070 con 0x55ef9545c3b0 2024-05-16T22:33:52.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.499+0000 7f35f67fc640 1 -- 172.21.15.44:0/665236733 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f360401b070 con 0x55ef9545c3b0 2024-05-16T22:33:52.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.499+0000 7f35f67fc640 1 -- 172.21.15.44:0/665236733 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3604014df0 con 0x55ef9545c3b0 2024-05-16T22:33:52.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.499+0000 7f361e18e740 1 -- 172.21.15.44:0/665236733 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef9545c3b0 msgr2=0x55ef95822850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:52.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.499+0000 7f361e18e740 1 --2- 172.21.15.44:0/665236733 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef9545c3b0 0x55ef95822850 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f36040095c0 tx=0x7f3604014000 comp rx=0 tx=0).stop 2024-05-16T22:33:52.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.500+0000 7f361e18e740 1 -- 172.21.15.44:0/665236733 shutdown_connections 2024-05-16T22:33:52.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.500+0000 7f361e18e740 1 --2- 172.21.15.44:0/665236733 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55ef95464590 0x55ef95853480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:52.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.500+0000 7f361e18e740 1 --2- 172.21.15.44:0/665236733 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef9545c3b0 0x55ef95822850 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:52.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.500+0000 7f361e18e740 1 --2- 172.21.15.44:0/665236733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ef95485270 0x55ef9585e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:52.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.500+0000 7f361e18e740 1 -- 172.21.15.44:0/665236733 >> 172.21.15.44:0/665236733 conn(0x55ef954793c0 msgr2=0x55ef9585da90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:33:52.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.500+0000 7f361e18e740 1 -- 172.21.15.44:0/665236733 shutdown_connections 2024-05-16T22:33:52.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.500+0000 7f361e18e740 1 -- 172.21.15.44:0/665236733 wait complete. 2024-05-16T22:33:52.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.500+0000 7f361e18e740 1 -- start start 2024-05-16T22:33:52.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.501+0000 7f361e18e740 1 Processor -- start 2024-05-16T22:33:52.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.502+0000 7f361e18e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef9545c3b0 0x55ef9586a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:52.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.502+0000 7f361e18e740 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55ef95464590 0x55ef95853540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:52.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.502+0000 7f361e18e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ef95485270 0x55ef95853a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:52.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.502+0000 7f361e18e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ef9546e850 con 0x55ef9545c3b0 2024-05-16T22:33:52.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.502+0000 7f361e18e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ef95744c10 con 0x55ef95485270 2024-05-16T22:33:52.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.502+0000 7f361e18e740 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x55ef95823260 con 0x55ef95464590 2024-05-16T22:33:52.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.502+0000 7f361e18e740 10 client.0 _ll_register_callbacks cb 0x55ef95748150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-16T22:33:53.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.502+0000 7f3614f9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef9545c3b0 0x55ef9586a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:53.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.502+0000 7f3614f9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef9545c3b0 0x55ef9586a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57854/0 (socket says 172.21.15.44:57854) 2024-05-16T22:33:53.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.502+0000 7f3614f9b640 1 -- 172.21.15.44:0/469935936 learned_addr learned my addr 172.21.15.44:0/469935936 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:33:53.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.502+0000 7f360ffff640 1 --2- 172.21.15.44:0/469935936 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55ef95464590 0x55ef95853540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:53.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.502+0000 7f361579c640 1 --2- 172.21.15.44:0/469935936 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ef95485270 0x55ef95853a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:53.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.502+0000 7f3614f9b640 1 -- 172.21.15.44:0/469935936 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55ef95464590 msgr2=0x55ef95853540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:33:53.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.502+0000 7f3614f9b640 1 --2- 172.21.15.44:0/469935936 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55ef95464590 0x55ef95853540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:53.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.502+0000 7f3614f9b640 1 -- 172.21.15.44:0/469935936 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ef95485270 msgr2=0x55ef95853a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:33:53.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.502+0000 7f3614f9b640 1 --2- 172.21.15.44:0/469935936 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ef95485270 0x55ef95853a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:53.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.502+0000 7f3614f9b640 1 -- 172.21.15.44:0/469935936 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef9549d2d0 con 0x55ef9545c3b0 2024-05-16T22:33:53.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.502+0000 7f360ffff640 1 --2- 172.21.15.44:0/469935936 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55ef95464590 0x55ef95853540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:33:53.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.502+0000 7f3614f9b640 1 --2- 172.21.15.44:0/469935936 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef9545c3b0 0x55ef9586a200 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f360800a430 tx=0x7f360805f7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39883307537c54fb server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:53.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.502+0000 7f35ef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-05-16T22:33:53.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.502+0000 7f35ef7fe640 1 -- 172.21.15.44:0/469935936 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3608076070 con 0x55ef9545c3b0 2024-05-16T22:33:53.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.502+0000 7f35ef7fe640 1 -- 172.21.15.44:0/469935936 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f360805f030 con 0x55ef9545c3b0 2024-05-16T22:33:53.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.502+0000 7f361e18e740 1 -- 172.21.15.44:0/469935936 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f360401b070 con 0x55ef9545c3b0 2024-05-16T22:33:53.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.503+0000 7f35ef7fe640 1 -- 172.21.15.44:0/469935936 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f36080640d0 con 0x55ef9545c3b0 2024-05-16T22:33:53.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.503+0000 7f361e18e740 10 client.5169 fetch_fsmap learned FSMap version 26 2024-05-16T22:33:53.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.503+0000 7f361e18e740 1 -- 172.21.15.44:0/469935936 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55ef955676b0 con 0x55ef9545c3b0 2024-05-16T22:33:53.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.503+0000 7f35ef7fe640 1 -- 172.21.15.44:0/469935936 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f360401b070 con 0x55ef9545c3b0 2024-05-16T22:33:53.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.503+0000 7f35ef7fe640 1 -- 172.21.15.44:0/469935936 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 26) ==== 2889+0+0 (secure 0 0 0) 0x7f360805b740 con 0x55ef9545c3b0 2024-05-16T22:33:53.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.503+0000 7f361e18e740 10 client.5169 fetch_fsmap finished waiting for FSMap version 26 2024-05-16T22:33:53.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.503+0000 7f361e18e740 10 client.5169 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-16T22:33:53.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.503+0000 7f361e18e740 20 client.5169 populate_metadata read hostname 'smithi044' 2024-05-16T22:33:53.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.503+0000 7f361e18e740 1 --2- 172.21.15.44:0/469935936 >> [v2:172.21.15.44:6832/97015923,v1:172.21.15.44:6834/97015923] conn(0x55ef95443e40 0x55ef958476f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:53.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.503+0000 7f361e18e740 4 client.5169 mds_command: new command op to 5043 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-16T22:33:53.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.503+0000 7f361e18e740 1 -- 172.21.15.44:0/469935936 --> [v2:172.21.15.44:6832/97015923,v1:172.21.15.44:6834/97015923] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ef9579ae60 con 0x55ef95443e40 2024-05-16T22:33:53.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.503+0000 7f360ffff640 1 --2- 172.21.15.44:0/469935936 >> [v2:172.21.15.44:6832/97015923,v1:172.21.15.44:6834/97015923] conn(0x55ef95443e40 0x55ef958476f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:54.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.503+0000 7f35ef7fe640 10 client.5169 ms_handle_connect on v2:172.21.15.44:6832/97015923 2024-05-16T22:33:54.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.504+0000 7f360ffff640 1 --2- 172.21.15.44:0/469935936 >> [v2:172.21.15.44:6832/97015923,v1:172.21.15.44:6834/97015923] conn(0x55ef95443e40 0x55ef958476f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab0e8532605e14c0 server_cookie=7bed7030d30d4887 in_seq=0 out_seq=0 2024-05-16T22:33:54.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.504+0000 7f35ef7fe640 1 -- 172.21.15.44:0/469935936 <== mds.0 v2:172.21.15.44:6832/97015923 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ef9579ae60 con 0x55ef95443e40 2024-05-16T22:33:54.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.504+0000 7f35ef7fe640 10 client.5169 handle_command_reply: tid=0 2024-05-16T22:33:54.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.504+0000 7f361e18e740 1 client.5169 shutdown 2024-05-16T22:33:54.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.505+0000 7f361e18e740 1 -- 172.21.15.44:0/469935936 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef9545c3b0 msgr2=0x55ef9586a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:54.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.505+0000 7f361e18e740 1 --2- 172.21.15.44:0/469935936 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef9545c3b0 0x55ef9586a200 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f360800a430 tx=0x7f360805f7e0 comp rx=0 tx=0).stop 2024-05-16T22:33:54.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.505+0000 7f361e18e740 1 -- 172.21.15.44:0/469935936 shutdown_connections 2024-05-16T22:33:54.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.505+0000 7f361e18e740 1 --2- 172.21.15.44:0/469935936 >> [v2:172.21.15.44:6832/97015923,v1:172.21.15.44:6834/97015923] conn(0x55ef95443e40 0x55ef958476f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:54.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.505+0000 7f361e18e740 1 --2- 172.21.15.44:0/469935936 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55ef95464590 0x55ef95853540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:54.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.505+0000 7f361e18e740 1 --2- 172.21.15.44:0/469935936 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ef95485270 0x55ef95853a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:54.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.505+0000 7f35ef7fe640 0 client.5169 ms_handle_reset on v2:172.21.15.44:6832/97015923 2024-05-16T22:33:54.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.505+0000 7f361e18e740 1 --2- 172.21.15.44:0/469935936 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef9545c3b0 0x55ef9586a200 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:54.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.505+0000 7f361e18e740 1 -- 172.21.15.44:0/469935936 >> 172.21.15.44:0/469935936 conn(0x55ef954793c0 msgr2=0x55ef958227e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:33:54.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.505+0000 7f361e18e740 1 -- 172.21.15.44:0/469935936 shutdown_connections 2024-05-16T22:33:54.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.505+0000 7f361e18e740 1 -- 172.21.15.44:0/469935936 wait complete. 2024-05-16T22:33:54.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.505+0000 7f361e18e740 20 client.5169 trim_cache size 0 max 16384 2024-05-16T22:33:54.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.524+0000 7f361e18e740 1 Processor -- start 2024-05-16T22:33:54.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.524+0000 7f361e18e740 1 -- start start 2024-05-16T22:33:54.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.525+0000 7f361e18e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ef954793c0 0x55ef95822530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:54.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.525+0000 7f361e18e740 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55ef95443e40 0x55ef95822a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:54.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.525+0000 7f361e18e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef9545c3b0 0x55ef95867140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:54.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.525+0000 7f361e18e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f36101f0e60 con 0x55ef9545c3b0 2024-05-16T22:33:54.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.525+0000 7f361e18e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f36101e83f0 con 0x55ef954793c0 2024-05-16T22:33:54.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.525+0000 7f361e18e740 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f36101eff70 con 0x55ef95443e40 2024-05-16T22:33:54.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.525+0000 7f361579c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef9545c3b0 0x55ef95867140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:54.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.525+0000 7f361579c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef9545c3b0 0x55ef95867140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57856/0 (socket says 172.21.15.44:57856) 2024-05-16T22:33:54.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.525+0000 7f361579c640 1 -- 172.21.15.44:0/3337786392 learned_addr learned my addr 172.21.15.44:0/3337786392 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:33:55.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.525+0000 7f3614f9b640 1 --2- 172.21.15.44:0/3337786392 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ef954793c0 0x55ef95822530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:55.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.525+0000 7f360ffff640 1 --2- 172.21.15.44:0/3337786392 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55ef95443e40 0x55ef95822a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:55.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.525+0000 7f361579c640 1 -- 172.21.15.44:0/3337786392 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55ef95443e40 msgr2=0x55ef95822a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:33:55.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.525+0000 7f361579c640 1 --2- 172.21.15.44:0/3337786392 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55ef95443e40 0x55ef95822a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:55.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.525+0000 7f361579c640 1 -- 172.21.15.44:0/3337786392 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ef954793c0 msgr2=0x55ef95822530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:33:55.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.525+0000 7f361579c640 1 --2- 172.21.15.44:0/3337786392 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ef954793c0 0x55ef95822530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:55.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.525+0000 7f361579c640 1 -- 172.21.15.44:0/3337786392 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef958578f0 con 0x55ef9545c3b0 2024-05-16T22:33:55.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.525+0000 7f3614f9b640 1 --2- 172.21.15.44:0/3337786392 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ef954793c0 0x55ef95822530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T22:33:55.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.526+0000 7f361579c640 1 --2- 172.21.15.44:0/3337786392 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef9545c3b0 0x55ef95867140 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f36000098c0 tx=0x7f360002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbfc5d697ac3d19b server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:55.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.526+0000 7f35f5ffb640 1 -- 172.21.15.44:0/3337786392 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3600037040 con 0x55ef9545c3b0 2024-05-16T22:33:55.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.526+0000 7f35f5ffb640 1 -- 172.21.15.44:0/3337786392 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36000328f0 con 0x55ef9545c3b0 2024-05-16T22:33:55.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.526+0000 7f35f5ffb640 1 -- 172.21.15.44:0/3337786392 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3600032ce0 con 0x55ef9545c3b0 2024-05-16T22:33:55.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.526+0000 7f361e18e740 1 -- 172.21.15.44:0/3337786392 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef9545c3b0 msgr2=0x55ef95867140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:55.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.526+0000 7f361e18e740 1 --2- 172.21.15.44:0/3337786392 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef9545c3b0 0x55ef95867140 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f36000098c0 tx=0x7f360002c000 comp rx=0 tx=0).stop 2024-05-16T22:33:55.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.526+0000 7f361e18e740 1 -- 172.21.15.44:0/3337786392 shutdown_connections 2024-05-16T22:33:55.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.526+0000 7f361e18e740 1 --2- 172.21.15.44:0/3337786392 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55ef95443e40 0x55ef95822a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:55.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.526+0000 7f361e18e740 1 --2- 172.21.15.44:0/3337786392 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef9545c3b0 0x55ef95867140 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:55.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.526+0000 7f361e18e740 1 --2- 172.21.15.44:0/3337786392 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ef954793c0 0x55ef95822530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:55.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.526+0000 7f361e18e740 1 -- 172.21.15.44:0/3337786392 >> 172.21.15.44:0/3337786392 conn(0x55ef95821470 msgr2=0x55ef95827460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:33:55.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.527+0000 7f361e18e740 1 -- 172.21.15.44:0/3337786392 shutdown_connections 2024-05-16T22:33:55.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.527+0000 7f361e18e740 1 -- 172.21.15.44:0/3337786392 wait complete. 2024-05-16T22:33:55.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.527+0000 7f361e18e740 1 -- start start 2024-05-16T22:33:55.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.527+0000 7f361e18e740 1 Processor -- start 2024-05-16T22:33:55.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.528+0000 7f361e18e740 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55ef95443e40 0x55ef95855030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:55.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.528+0000 7f361e18e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ef9545c3b0 0x55ef958d2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:56.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.529+0000 7f361e18e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef954793c0 0x55ef958d26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:56.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.529+0000 7f361e18e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ef95848900 con 0x55ef954793c0 2024-05-16T22:33:56.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.529+0000 7f361e18e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ef95856df0 con 0x55ef9545c3b0 2024-05-16T22:33:56.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.529+0000 7f361e18e740 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x55ef95847180 con 0x55ef95443e40 2024-05-16T22:33:56.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.529+0000 7f361e18e740 10 client.0 _ll_register_callbacks cb 0x7f360805bd60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-16T22:33:56.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.529+0000 7f361579c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef954793c0 0x55ef958d26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:56.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.529+0000 7f361579c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef954793c0 0x55ef958d26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57866/0 (socket says 172.21.15.44:57866) 2024-05-16T22:33:56.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.529+0000 7f361579c640 1 -- 172.21.15.44:0/167704759 learned_addr learned my addr 172.21.15.44:0/167704759 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:33:56.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.529+0000 7f3614f9b640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55ef95443e40 0x55ef95855030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:56.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.529+0000 7f360ffff640 1 --2- 172.21.15.44:0/167704759 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ef9545c3b0 0x55ef958d2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:56.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.529+0000 7f361579c640 1 -- 172.21.15.44:0/167704759 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55ef95443e40 msgr2=0x55ef95855030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:33:56.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.529+0000 7f361579c640 1 --2- 172.21.15.44:0/167704759 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55ef95443e40 0x55ef95855030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:56.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.529+0000 7f361579c640 1 -- 172.21.15.44:0/167704759 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ef9545c3b0 msgr2=0x55ef958d2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:33:56.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.529+0000 7f361579c640 1 --2- 172.21.15.44:0/167704759 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ef9545c3b0 0x55ef958d2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:56.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.529+0000 7f361579c640 1 -- 172.21.15.44:0/167704759 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef958d2be0 con 0x55ef954793c0 2024-05-16T22:33:56.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.529+0000 7f361579c640 1 --2- 172.21.15.44:0/167704759 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef954793c0 0x55ef958d26a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3600042000 tx=0x7f3600004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=108037afe18f7b74 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:56.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.529+0000 7f35ef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-05-16T22:33:56.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.529+0000 7f35ef7fe640 1 -- 172.21.15.44:0/167704759 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3600037070 con 0x55ef954793c0 2024-05-16T22:33:56.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.529+0000 7f35ef7fe640 1 -- 172.21.15.44:0/167704759 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f3600004440 con 0x55ef954793c0 2024-05-16T22:33:56.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.529+0000 7f361e18e740 1 -- 172.21.15.44:0/167704759 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36000328f0 con 0x55ef954793c0 2024-05-16T22:33:56.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.529+0000 7f35ef7fe640 1 -- 172.21.15.44:0/167704759 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3600003610 con 0x55ef954793c0 2024-05-16T22:33:56.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.529+0000 7f361e18e740 10 client.5175 fetch_fsmap learned FSMap version 26 2024-05-16T22:33:56.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.529+0000 7f361e18e740 1 -- 172.21.15.44:0/167704759 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55ef9584f6b0 con 0x55ef954793c0 2024-05-16T22:33:56.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.530+0000 7f35ef7fe640 1 -- 172.21.15.44:0/167704759 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36000328f0 con 0x55ef954793c0 2024-05-16T22:33:56.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.530+0000 7f35ef7fe640 1 -- 172.21.15.44:0/167704759 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 26) ==== 2889+0+0 (secure 0 0 0) 0x7f36000037b0 con 0x55ef954793c0 2024-05-16T22:33:56.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.530+0000 7f361e18e740 10 client.5175 fetch_fsmap finished waiting for FSMap version 26 2024-05-16T22:33:56.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.530+0000 7f361e18e740 10 client.5175 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-16T22:33:56.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.530+0000 7f361e18e740 20 client.5175 populate_metadata read hostname 'smithi044' 2024-05-16T22:33:57.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.530+0000 7f361e18e740 1 --2- 172.21.15.44:0/167704759 >> [v2:172.21.15.44:6832/97015923,v1:172.21.15.44:6834/97015923] conn(0x55ef95485270 0x55ef95852670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:57.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.530+0000 7f361e18e740 4 client.5175 mds_command: new command op to 5043 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-16T22:33:57.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.530+0000 7f361e18e740 1 -- 172.21.15.44:0/167704759 --> [v2:172.21.15.44:6832/97015923,v1:172.21.15.44:6834/97015923] -- command(tid 0: {"prefix": "status"}) -- 0x55ef95857740 con 0x55ef95485270 2024-05-16T22:33:57.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.530+0000 7f3614f9b640 1 --2- 172.21.15.44:0/167704759 >> [v2:172.21.15.44:6832/97015923,v1:172.21.15.44:6834/97015923] conn(0x55ef95485270 0x55ef95852670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:57.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.530+0000 7f35ef7fe640 10 client.5175 ms_handle_connect on v2:172.21.15.44:6832/97015923 2024-05-16T22:33:57.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.530+0000 7f3614f9b640 1 --2- 172.21.15.44:0/167704759 >> [v2:172.21.15.44:6832/97015923,v1:172.21.15.44:6834/97015923] conn(0x55ef95485270 0x55ef95852670 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=796e36167f8e81f server_cookie=361b1e9d0481eb2e in_seq=0 out_seq=0 2024-05-16T22:33:57.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.531+0000 7f35ef7fe640 1 -- 172.21.15.44:0/167704759 <== mds.0 v2:172.21.15.44:6832/97015923 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55ef95857740 con 0x55ef95485270 2024-05-16T22:33:57.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.531+0000 7f35ef7fe640 10 client.5175 handle_command_reply: tid=0 2024-05-16T22:33:57.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.531+0000 7f361e18e740 1 client.5175 shutdown 2024-05-16T22:33:57.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.531+0000 7f361e18e740 1 -- 172.21.15.44:0/167704759 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef954793c0 msgr2=0x55ef958d26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:57.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.531+0000 7f361e18e740 1 --2- 172.21.15.44:0/167704759 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef954793c0 0x55ef958d26a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3600042000 tx=0x7f3600004730 comp rx=0 tx=0).stop 2024-05-16T22:33:57.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.531+0000 7f361e18e740 1 -- 172.21.15.44:0/167704759 shutdown_connections 2024-05-16T22:33:57.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.531+0000 7f361e18e740 1 --2- 172.21.15.44:0/167704759 >> [v2:172.21.15.44:6832/97015923,v1:172.21.15.44:6834/97015923] conn(0x55ef95485270 0x55ef95852670 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:57.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.531+0000 7f361e18e740 1 --2- 172.21.15.44:0/167704759 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef954793c0 0x55ef958d26a0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:57.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.531+0000 7f361e18e740 1 --2- 172.21.15.44:0/167704759 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ef9545c3b0 0x55ef958d2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:57.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.531+0000 7f361e18e740 1 --2- 172.21.15.44:0/167704759 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55ef95443e40 0x55ef95855030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:57.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.531+0000 7f35ef7fe640 0 client.5175 ms_handle_reset on v2:172.21.15.44:6832/97015923 2024-05-16T22:33:57.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.531+0000 7f361e18e740 1 -- 172.21.15.44:0/167704759 >> 172.21.15.44:0/167704759 conn(0x55ef95821470 msgr2=0x55ef95826b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:33:57.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.531+0000 7f361e18e740 1 -- 172.21.15.44:0/167704759 shutdown_connections 2024-05-16T22:33:57.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.531+0000 7f361e18e740 1 -- 172.21.15.44:0/167704759 wait complete. 2024-05-16T22:33:57.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.531+0000 7f361e18e740 20 client.5175 trim_cache size 0 max 16384 2024-05-16T22:33:57.750 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-05-16T22:33:57.783 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "572ab7cc-b103-4548-ae8f-c6614d57f0c8", 2024-05-16T22:33:57.816 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2024-05-16T22:33:57.849 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 5043, 2024-05-16T22:33:57.883 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-05-16T22:33:57.916 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-05-16T22:33:57.949 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-05-16T22:33:57.983 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 37.729087970999998, 2024-05-16T22:33:58.016 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 26, 2024-05-16T22:33:58.050 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 48, 2024-05-16T22:33:58.100 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 48, 2024-05-16T22:33:58.133 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 64.384211621999995 2024-05-16T22:33:58.166 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-05-16T22:33:58.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.531+0000 7f3615f9d640 1 -- 172.21.15.44:0/3712631391 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f35fc076300 msgr2=0x7f35fc078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:58.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.531+0000 7f3615f9d640 1 --2- 172.21.15.44:0/3712631391 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f35fc076300 0x7f35fc078810 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3610076730 tx=0x7f3604009190 comp rx=0 tx=0).stop 2024-05-16T22:33:58.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.531+0000 7f3615f9d640 1 -- 172.21.15.44:0/3712631391 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36100bd630 msgr2=0x7f36100a6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:58.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.531+0000 7f3615f9d640 1 --2- 172.21.15.44:0/3712631391 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36100bd630 0x7f36100a6740 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f360800c7a0 tx=0x7f360800cc60 comp rx=0 tx=0).stop 2024-05-16T22:33:58.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.532+0000 7f3615f9d640 1 -- 172.21.15.44:0/3712631391 shutdown_connections 2024-05-16T22:33:58.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.532+0000 7f3615f9d640 1 --2- 172.21.15.44:0/3712631391 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f35fc076300 0x7f35fc078810 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:58.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.532+0000 7f3615f9d640 1 --2- 172.21.15.44:0/3712631391 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f361014ec60 0x7f36100b97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:58.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.532+0000 7f3615f9d640 1 --2- 172.21.15.44:0/3712631391 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36100bdf90 0x7f36100a74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:58.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.532+0000 7f3615f9d640 1 --2- 172.21.15.44:0/3712631391 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36100bd630 0x7f36100a6740 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:58.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.532+0000 7f3615f9d640 1 -- 172.21.15.44:0/3712631391 >> 172.21.15.44:0/3712631391 conn(0x7f36100c3c40 msgr2=0x7f361006d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:33:58.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.532+0000 7f3615f9d640 1 -- 172.21.15.44:0/3712631391 shutdown_connections 2024-05-16T22:33:58.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:49.532+0000 7f3615f9d640 1 -- 172.21.15.44:0/3712631391 wait complete. 2024-05-16T22:33:58.609 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-16T22:33:58.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.786+0000 7f359e051640 1 Processor -- start 2024-05-16T22:33:58.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.786+0000 7f359e051640 1 -- start start 2024-05-16T22:33:58.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.787+0000 7f359e051640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f359814e360 0x7f35981522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:58.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.787+0000 7f359e051640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3598148770 0x7f35980c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:58.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.787+0000 7f359e051640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f35980bf9b0 0x7f35980bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:33:58.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.787+0000 7f359e051640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f3598151e40 con 0x7f35980bf9b0 2024-05-16T22:33:59.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.787+0000 7f359e051640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f35980c0620 con 0x7f3598148770 2024-05-16T22:33:59.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.787+0000 7f359e051640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f3598151ad0 con 0x7f359814e360 2024-05-16T22:33:59.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.787+0000 7f3597fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f35980bf9b0 0x7f35980bfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:59.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.787+0000 7f3597fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f35980bf9b0 0x7f35980bfdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57392/0 (socket says 172.21.15.44:57392) 2024-05-16T22:33:59.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.787+0000 7f3597fff640 1 -- 172.21.15.44:0/1086824947 learned_addr learned my addr 172.21.15.44:0/1086824947 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:33:59.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.787+0000 7f3596ffd640 1 --2- 172.21.15.44:0/1086824947 >> v2:172.21.15.70:3300/0 conn(0x7f3598148770 0x7f35980c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:59.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.787+0000 7f35977fe640 1 --2- 172.21.15.44:0/1086824947 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f359814e360 0x7f35981522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:33:59.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.787+0000 7f3597fff640 1 -- 172.21.15.44:0/1086824947 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f359814e360 msgr2=0x7f35981522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:33:59.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.787+0000 7f3597fff640 1 --2- 172.21.15.44:0/1086824947 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f359814e360 0x7f35981522d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:59.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.787+0000 7f3597fff640 1 -- 172.21.15.44:0/1086824947 >> v2:172.21.15.70:3300/0 conn(0x7f3598148770 msgr2=0x7f35980c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:33:59.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.787+0000 7f3597fff640 1 --2- 172.21.15.44:0/1086824947 >> v2:172.21.15.70:3300/0 conn(0x7f3598148770 0x7f35980c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:59.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.787+0000 7f3597fff640 1 -- 172.21.15.44:0/1086824947 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3598152810 con 0x7f35980bf9b0 2024-05-16T22:33:59.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.787+0000 7f35977fe640 1 --2- 172.21.15.44:0/1086824947 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f359814e360 0x7f35981522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:33:59.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.787+0000 7f3596ffd640 1 --2- 172.21.15.44:0/1086824947 >> v2:172.21.15.70:3300/0 conn(0x7f3598148770 0x7f35980c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:33:59.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.788+0000 7f3597fff640 1 --2- 172.21.15.44:0/1086824947 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35980bf9b0 0x7f35980bfdc0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3590009e50 tx=0x7f359002a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1ffbce43198ffdc server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:33:59.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.788+0000 7f35967fc640 1 -- 172.21.15.44:0/1086824947 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3590036070 con 0x7f35980bf9b0 2024-05-16T22:33:59.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.788+0000 7f35967fc640 1 -- 172.21.15.44:0/1086824947 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3590031600 con 0x7f35980bf9b0 2024-05-16T22:33:59.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.788+0000 7f35967fc640 1 -- 172.21.15.44:0/1086824947 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35900319d0 con 0x7f35980bf9b0 2024-05-16T22:33:59.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.789+0000 7f359e051640 1 -- 172.21.15.44:0/1086824947 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35980bf9b0 msgr2=0x7f35980bfdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:33:59.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.789+0000 7f359e051640 1 --2- 172.21.15.44:0/1086824947 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35980bf9b0 0x7f35980bfdc0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3590009e50 tx=0x7f359002a760 comp rx=0 tx=0).stop 2024-05-16T22:33:59.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.789+0000 7f359e051640 1 -- 172.21.15.44:0/1086824947 shutdown_connections 2024-05-16T22:33:59.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.789+0000 7f359e051640 1 --2- 172.21.15.44:0/1086824947 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35980bf9b0 0x7f35980bfdc0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:59.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.789+0000 7f359e051640 1 --2- 172.21.15.44:0/1086824947 >> v2:172.21.15.70:3300/0 conn(0x7f3598148770 0x7f35980c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:59.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.789+0000 7f359e051640 1 --2- 172.21.15.44:0/1086824947 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f359814e360 0x7f35981522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:33:59.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.789+0000 7f359e051640 1 -- 172.21.15.44:0/1086824947 >> 172.21.15.44:0/1086824947 conn(0x7f35980c17c0 msgr2=0x7f35980c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:33:59.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.789+0000 7f359e051640 1 -- 172.21.15.44:0/1086824947 shutdown_connections 2024-05-16T22:34:00.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.789+0000 7f359e051640 1 -- 172.21.15.44:0/1086824947 wait complete. 2024-05-16T22:34:00.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.791+0000 7f359e051640 1 Processor -- start 2024-05-16T22:34:00.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.791+0000 7f359e051640 1 -- start start 2024-05-16T22:34:00.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.792+0000 7f359e051640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35980bf9b0 0x7f35981d7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:00.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.792+0000 7f359e051640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3598148770 0x7f35981e4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:00.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.792+0000 7f359e051640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f359814e360 0x7f3598145ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:00.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.792+0000 7f359e051640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f35980c1340 con 0x7f35980bf9b0 2024-05-16T22:34:00.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.792+0000 7f359e051640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f35980c11c0 con 0x7f3598148770 2024-05-16T22:34:00.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.792+0000 7f359e051640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f359809fd50 con 0x7f359814e360 2024-05-16T22:34:00.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.792+0000 7f35977fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35980bf9b0 0x7f35981d7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:00.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.792+0000 7f35977fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35980bf9b0 0x7f35981d7930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57400/0 (socket says 172.21.15.44:57400) 2024-05-16T22:34:00.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.792+0000 7f35977fe640 1 -- 172.21.15.44:0/1484945629 learned_addr learned my addr 172.21.15.44:0/1484945629 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:34:00.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.792+0000 7f3596ffd640 1 --2- 172.21.15.44:0/1484945629 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3598148770 0x7f35981e4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:00.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.792+0000 7f3597fff640 1 --2- 172.21.15.44:0/1484945629 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f359814e360 0x7f3598145ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:00.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.792+0000 7f35977fe640 1 -- 172.21.15.44:0/1484945629 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f359814e360 msgr2=0x7f3598145ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:00.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.792+0000 7f35977fe640 1 --2- 172.21.15.44:0/1484945629 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f359814e360 0x7f3598145ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:00.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.792+0000 7f35977fe640 1 -- 172.21.15.44:0/1484945629 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3598148770 msgr2=0x7f35981e4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:00.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.792+0000 7f35977fe640 1 --2- 172.21.15.44:0/1484945629 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3598148770 0x7f35981e4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:00.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.792+0000 7f35977fe640 1 -- 172.21.15.44:0/1484945629 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35981d7e70 con 0x7f35980bf9b0 2024-05-16T22:34:00.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.793+0000 7f35977fe640 1 --2- 172.21.15.44:0/1484945629 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35980bf9b0 0x7f35981d7930 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f358800d800 tx=0x7f358800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:00.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.793+0000 7f357ffff640 1 -- 172.21.15.44:0/1484945629 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3588004030 con 0x7f35980bf9b0 2024-05-16T22:34:00.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.793+0000 7f357ffff640 1 -- 172.21.15.44:0/1484945629 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35880041d0 con 0x7f35980bf9b0 2024-05-16T22:34:00.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.793+0000 7f359e051640 1 -- 172.21.15.44:0/1484945629 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35981e4fc0 con 0x7f35980bf9b0 2024-05-16T22:34:00.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.793+0000 7f357ffff640 1 -- 172.21.15.44:0/1484945629 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35880096a0 con 0x7f35980bf9b0 2024-05-16T22:34:00.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.793+0000 7f359e051640 1 -- 172.21.15.44:0/1484945629 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3598150570 con 0x7f35980bf9b0 2024-05-16T22:34:00.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.794+0000 7f359e051640 1 -- 172.21.15.44:0/1484945629 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3598050940 con 0x7f35980bf9b0 2024-05-16T22:34:00.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.795+0000 7f357ffff640 1 -- 172.21.15.44:0/1484945629 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3588009840 con 0x7f35980bf9b0 2024-05-16T22:34:01.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.795+0000 7f357ffff640 1 --2- 172.21.15.44:0/1484945629 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f35840762d0 0x7f35840787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:01.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.795+0000 7f357ffff640 1 -- 172.21.15.44:0/1484945629 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f3588097670 con 0x7f35980bf9b0 2024-05-16T22:34:01.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.795+0000 7f3596ffd640 1 --2- 172.21.15.44:0/1484945629 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f35840762d0 0x7f35840787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:01.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.796+0000 7f3596ffd640 1 --2- 172.21.15.44:0/1484945629 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f35840762d0 0x7f35840787e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f359814d9f0 tx=0x7f358c004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:01.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:58.800+0000 7f357ffff640 1 -- 172.21.15.44:0/1484945629 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3588060a10 con 0x7f35980bf9b0 2024-05-16T22:34:01.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:59.030+0000 7f359e051640 1 -- 172.21.15.44:0/1484945629 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f35980bf790 con 0x7f35980bf9b0 2024-05-16T22:34:01.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:59.030+0000 7f357ffff640 1 -- 172.21.15.44:0/1484945629 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) ==== 53+0+73 (secure 0 0 0) 0x7f3588064d10 con 0x7f35980bf9b0 2024-05-16T22:34:01.269 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-16T22:34:01.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:59.032+0000 7f359e051640 1 -- 172.21.15.44:0/1484945629 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f35840762d0 msgr2=0x7f35840787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:01.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:59.032+0000 7f359e051640 1 --2- 172.21.15.44:0/1484945629 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f35840762d0 0x7f35840787e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f359814d9f0 tx=0x7f358c004730 comp rx=0 tx=0).stop 2024-05-16T22:34:01.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:59.032+0000 7f359e051640 1 -- 172.21.15.44:0/1484945629 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35980bf9b0 msgr2=0x7f35981d7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:01.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:59.032+0000 7f359e051640 1 --2- 172.21.15.44:0/1484945629 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35980bf9b0 0x7f35981d7930 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f358800d800 tx=0x7f358800dcc0 comp rx=0 tx=0).stop 2024-05-16T22:34:01.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:59.032+0000 7f359e051640 1 -- 172.21.15.44:0/1484945629 shutdown_connections 2024-05-16T22:34:01.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:59.032+0000 7f359e051640 1 --2- 172.21.15.44:0/1484945629 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f35840762d0 0x7f35840787e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:01.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:59.032+0000 7f359e051640 1 --2- 172.21.15.44:0/1484945629 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f359814e360 0x7f3598145ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:01.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:59.032+0000 7f359e051640 1 --2- 172.21.15.44:0/1484945629 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3598148770 0x7f35981e4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:01.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:59.032+0000 7f359e051640 1 --2- 172.21.15.44:0/1484945629 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35980bf9b0 0x7f35981d7930 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:01.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:59.032+0000 7f359e051640 1 -- 172.21.15.44:0/1484945629 >> 172.21.15.44:0/1484945629 conn(0x7f35980c17c0 msgr2=0x7f3598147a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:01.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:59.033+0000 7f359e051640 1 -- 172.21.15.44:0/1484945629 shutdown_connections 2024-05-16T22:34:01.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:33:59.033+0000 7f359e051640 1 -- 172.21.15.44:0/1484945629 wait complete. 2024-05-16T22:34:01.711 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-16T22:34:01.761 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-16T22:34:01.794 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi196.front.sepia.ceph.com 2024-05-16T22:34:01.828 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-16T22:34:01.861 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-16T22:34:01.894 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-16T22:34:01.928 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-16T22:34:01.961 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-16T22:34:01.995 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-16T22:34:02.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T22:34:02.061 DEBUG:teuthology.orchestra.run.smithi196:> ip addr 2024-05-16T22:34:02.153 INFO:teuthology.orchestra.run.smithi196.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-16T22:34:02.178 INFO:teuthology.orchestra.run.smithi196.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-16T22:34:02.211 INFO:teuthology.orchestra.run.smithi196.stdout: inet 127.0.0.1/8 scope host lo 2024-05-16T22:34:02.245 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2024-05-16T22:34:02.278 INFO:teuthology.orchestra.run.smithi196.stdout: inet6 ::1/128 scope host 2024-05-16T22:34:02.311 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2024-05-16T22:34:02.361 INFO:teuthology.orchestra.run.smithi196.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-16T22:34:02.395 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 0c:c4:7a:d9:38:be brd ff:ff:ff:ff:ff:ff 2024-05-16T22:34:02.428 INFO:teuthology.orchestra.run.smithi196.stdout: altname enp7s0f0 2024-05-16T22:34:02.461 INFO:teuthology.orchestra.run.smithi196.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-16T22:34:02.495 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 0c:c4:7a:d9:38:bf brd ff:ff:ff:ff:ff:ff 2024-05-16T22:34:02.528 INFO:teuthology.orchestra.run.smithi196.stdout: altname enp7s0f1 2024-05-16T22:34:02.561 INFO:teuthology.orchestra.run.smithi196.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-16T22:34:02.595 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 0c:c4:7a:88:7f:46 brd ff:ff:ff:ff:ff:ff 2024-05-16T22:34:02.645 INFO:teuthology.orchestra.run.smithi196.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-16T22:34:02.678 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 0c:c4:7a:88:7f:47 brd ff:ff:ff:ff:ff:ff 2024-05-16T22:34:02.712 INFO:teuthology.orchestra.run.smithi196.stdout: inet 172.21.15.196/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-16T22:34:02.745 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft 42249sec preferred_lft 42249sec 2024-05-16T22:34:02.779 INFO:teuthology.orchestra.run.smithi196.stdout: inet6 fe80::ec4:7aff:fe88:7f47/64 scope link 2024-05-16T22:34:02.812 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2024-05-16T22:34:02.845 INFO:teuthology.orchestra.run.smithi196.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-16T22:34:02.879 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 2a:27:dc:6e:82:51 brd ff:ff:ff:ff:ff:ff 2024-05-16T22:34:02.929 INFO:teuthology.orchestra.run.smithi196.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-16T22:34:02.962 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2024-05-16T22:34:02.995 INFO:teuthology.orchestra.run.smithi196.stdout: inet6 fe80::7403:a5ff:fe53:f2bf/64 scope link 2024-05-16T22:34:03.096 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2024-05-16T22:34:03.129 INFO:teuthology.orchestra.run.smithi196.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-16T22:34:03.162 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 2a:27:dc:6e:82:51 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-16T22:34:03.196 INFO:teuthology.orchestra.run.smithi196.stdout: inet6 fe80::2827:dcff:fe6e:8251/64 scope link 2024-05-16T22:34:03.229 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2024-05-16T22:34:03.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T22:34:03.296 DEBUG:teuthology.orchestra.run.smithi196:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-16T22:34:03.411 INFO:teuthology.orchestra.run.smithi196.stdout:1 2024-05-16T22:34:03.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T22:34:03.480 DEBUG:teuthology.orchestra.run.smithi196:> route 2024-05-16T22:34:03.573 INFO:teuthology.orchestra.run.smithi196.stdout:Kernel IP routing table 2024-05-16T22:34:03.596 INFO:teuthology.orchestra.run.smithi196.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-16T22:34:03.630 INFO:teuthology.orchestra.run.smithi196.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-16T22:34:03.680 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-16T22:34:03.713 INFO:teuthology.orchestra.run.smithi196.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-16T22:34:03.747 DEBUG:teuthology.orchestra.run.smithi196:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-16T22:34:03.781 DEBUG:teuthology.orchestra.run.smithi196:> set -e 2024-05-16T22:34:03.813 DEBUG:teuthology.orchestra.run.smithi196:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-16T22:34:03.846 DEBUG:teuthology.orchestra.run.smithi196:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-16T22:34:03.880 DEBUG:teuthology.orchestra.run.smithi196:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-16T22:34:03.913 DEBUG:teuthology.orchestra.run.smithi196:> ') 2024-05-16T22:34:04.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:34:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-16T22:34:04.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:34:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T22:34:04.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T22:34:04.205 DEBUG:teuthology.orchestra.run.smithi196:> ip netns list 2024-05-16T22:34:04.292 INFO:teuthology.orchestra.run.smithi196.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-16T22:34:04.314 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-16T22:34:04.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T22:34:04.380 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link set brx.0 up 2024-05-16T22:34:04.510 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-16T22:34:04.530 DEBUG:teuthology.orchestra.run.smithi196:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-16T22:34:04.620 INFO:teuthology.orchestra.run.smithi196.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-16T22:34:04.647 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-16T22:34:04.680 DEBUG:teuthology.orchestra.run.smithi196:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-16T22:34:04.768 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-16T22:34:04.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T22:34:04.822 DEBUG:teuthology.orchestra.run.smithi196:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-16T22:34:05.067 INFO:teuthology.orchestra.run.smithi196.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-16T22:34:05.131 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-16T22:34:05.164 INFO:teuthology.orchestra.run.smithi196.stdout:invalid new device string format 2024-05-16T22:34:05.243 INFO:teuthology.orchestra.run.smithi196.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-16T22:34:05.272 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-16T22:34:05.305 INFO:teuthology.orchestra.run.smithi196.stdout:invalid new device string format 2024-05-16T22:34:05.339 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.70:3300,172.21.15.70:3301" 2024-05-16T22:34:05.372 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-16T22:34:05.447 INFO:teuthology.orchestra.run.smithi196.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-16T22:34:05.493 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-16T22:34:05.522 INFO:teuthology.orchestra.run.smithi196.stdout:invalid new device string format 2024-05-16T22:34:05.556 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.70:3300,172.21.15.70:3301" 2024-05-16T22:34:05.589 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-16T22:34:05.624 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: resolved to: "172.21.15.44:6789,172.21.15.70:6789,172.21.15.70:6790" 2024-05-16T22:34:05.658 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.44:6789,172.21.15.70:6789,172.21.15.70:6790:/ 2024-05-16T22:34:05.689 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=572ab7cc-b103-4548-ae8f-c6614d57f0c8" will pass to kernel 2024-05-16T22:34:05.722 INFO:teuthology.orchestra.run.smithi196.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-16T22:34:05.756 INFO:teuthology.orchestra.run.smithi196.stdout: You just mounted a file system that supports labels which does not 2024-05-16T22:34:05.789 INFO:teuthology.orchestra.run.smithi196.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-16T22:34:05.822 INFO:teuthology.orchestra.run.smithi196.stdout: applications will generate AVC messages and not be allowed access to 2024-05-16T22:34:05.856 INFO:teuthology.orchestra.run.smithi196.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-16T22:34:05.889 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-16T22:34:05.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T22:34:05.978 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-16T22:34:06.127 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-16T22:34:06.260 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:34:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T22:34:06.299 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:34:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T22:34:06.356 INFO:teuthology.orchestra.run.smithi196.stdout:client5184 2024-05-16T22:34:06.390 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-16T22:34:06.423 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-16T22:34:06.514 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'sudo fscrypt --help') 2024-05-16T22:34:06.640 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:34:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T22:34:06.686 INFO:teuthology.orchestra.run.smithi196.stdout:fscrypt - A tool for managing Linux native filesystem encryption 2024-05-16T22:34:06.706 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:34:06.740 INFO:teuthology.orchestra.run.smithi196.stdout:Usage: 2024-05-16T22:34:06.773 INFO:teuthology.orchestra.run.smithi196.stdout: fscrypt COMMAND [arguments] [options] 2024-05-16T22:34:06.806 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:34:06.848 INFO:teuthology.orchestra.run.smithi196.stdout:Commands: 2024-05-16T22:34:06.881 INFO:teuthology.orchestra.run.smithi196.stdout: setup - perform global setup or filesystem setup 2024-05-16T22:34:06.915 INFO:teuthology.orchestra.run.smithi196.stdout: encrypt - enable filesystem encryption for a directory 2024-05-16T22:34:06.965 INFO:teuthology.orchestra.run.smithi196.stdout: unlock - unlock an encrypted directory 2024-05-16T22:34:06.998 INFO:teuthology.orchestra.run.smithi196.stdout: lock - lock an encrypted directory 2024-05-16T22:34:07.032 INFO:teuthology.orchestra.run.smithi196.stdout: purge - Remove a filesystem's keys 2024-05-16T22:34:07.065 INFO:teuthology.orchestra.run.smithi196.stdout: status - print the global, filesystem, or file status 2024-05-16T22:34:07.098 INFO:teuthology.orchestra.run.smithi196.stdout: metadata - [ADVANCED] manipulate the policy or protector metadata 2024-05-16T22:34:07.132 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:34:07.165 INFO:teuthology.orchestra.run.smithi196.stdout:Options: 2024-05-16T22:34:07.199 INFO:teuthology.orchestra.run.smithi196.stdout: --verbose Prints additional debug messages to standard 2024-05-16T22:34:07.232 INFO:teuthology.orchestra.run.smithi196.stdout: output. 2024-05-16T22:34:07.265 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:34:07.298 INFO:teuthology.orchestra.run.smithi196.stdout: --quiet Prints nothing to standard output except for 2024-05-16T22:34:07.332 INFO:teuthology.orchestra.run.smithi196.stdout: errors. Selects the default for any options that 2024-05-16T22:34:07.365 INFO:teuthology.orchestra.run.smithi196.stdout: would normally show a prompt. 2024-05-16T22:34:07.399 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:34:07.440 INFO:teuthology.orchestra.run.smithi196.stdout: --help Prints help screen for commands and subcommands. 2024-05-16T22:34:07.474 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:34:07.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:34:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T22:34:07.565 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'sudo fscrypt setup --help') 2024-05-16T22:34:07.715 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:34:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T22:34:07.784 INFO:teuthology.orchestra.run.smithi196.stdout:fscrypt setup - perform global setup or filesystem setup 2024-05-16T22:34:07.816 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:34:07.849 INFO:teuthology.orchestra.run.smithi196.stdout:Usage: 2024-05-16T22:34:07.882 INFO:teuthology.orchestra.run.smithi196.stdout: fscrypt setup [MOUNTPOINT] [options] 2024-05-16T22:34:07.915 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:34:07.949 INFO:teuthology.orchestra.run.smithi196.stdout:Description: 2024-05-16T22:34:07.982 INFO:teuthology.orchestra.run.smithi196.stdout: This command creates fscrypt's global config file and/or prepares a filesystem 2024-05-16T22:34:08.016 INFO:teuthology.orchestra.run.smithi196.stdout: for use with fscrypt. 2024-05-16T22:34:08.049 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:34:08.082 INFO:teuthology.orchestra.run.smithi196.stdout: (1) When used without MOUNTPOINT, this command creates the global config file 2024-05-16T22:34:08.116 INFO:teuthology.orchestra.run.smithi196.stdout: /etc/fscrypt.conf and the fscrypt metadata directory for the root filesystem 2024-05-16T22:34:08.149 INFO:teuthology.orchestra.run.smithi196.stdout: (i.e. /.fscrypt). This requires root privileges. The passphrase hashing 2024-05-16T22:34:08.182 INFO:teuthology.orchestra.run.smithi196.stdout: parameters in /etc/fscrypt.conf are automatically set to an appropriate 2024-05-16T22:34:08.241 INFO:teuthology.orchestra.run.smithi196.stdout: hardness, as determined by --time=TIME. The root filesystem's metadata 2024-05-16T22:34:08.274 INFO:teuthology.orchestra.run.smithi196.stdout: directory is created even if the root filesystem doesn't support encryption 2024-05-16T22:34:08.307 INFO:teuthology.orchestra.run.smithi196.stdout: itself, since it's where login passphrase protectors are stored. 2024-05-16T22:34:08.341 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:34:08.374 INFO:teuthology.orchestra.run.smithi196.stdout: (2) When used with MOUNTPOINT, this command creates the fscrypt metadata 2024-05-16T22:34:08.408 INFO:teuthology.orchestra.run.smithi196.stdout: directory for the filesystem mounted at MOUNTPOINT. This allows fscrypt to be 2024-05-16T22:34:08.441 INFO:teuthology.orchestra.run.smithi196.stdout: used on that filesystem, provided that any kernel and filesystem-specific 2024-05-16T22:34:08.474 INFO:teuthology.orchestra.run.smithi196.stdout: prerequisites are also met (see the README). This may require root privileges. 2024-05-16T22:34:08.508 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:34:08.541 INFO:teuthology.orchestra.run.smithi196.stdout:Options: 2024-05-16T22:34:08.574 INFO:teuthology.orchestra.run.smithi196.stdout: --time=TIME Set the global options so that passphrase hashing 2024-05-16T22:34:08.608 INFO:teuthology.orchestra.run.smithi196.stdout: takes TIME long. TIME should be formatted as a 2024-05-16T22:34:08.641 INFO:teuthology.orchestra.run.smithi196.stdout: sequence of decimal numbers, each with optional 2024-05-16T22:34:08.675 INFO:teuthology.orchestra.run.smithi196.stdout: fraction and a unit suffix, such as "300ms", 2024-05-16T22:34:08.708 INFO:teuthology.orchestra.run.smithi196.stdout: "1.5s" or "2h45m". Valid time units are "ms", 2024-05-16T22:34:08.741 INFO:teuthology.orchestra.run.smithi196.stdout: "s", "m", and "h". (default: 1s) 2024-05-16T22:34:08.808 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:34:08.841 INFO:teuthology.orchestra.run.smithi196.stdout: --force Suppresses all confirmation prompts and warnings, 2024-05-16T22:34:08.875 INFO:teuthology.orchestra.run.smithi196.stdout: causing any action to automatically proceed. 2024-05-16T22:34:08.908 INFO:teuthology.orchestra.run.smithi196.stdout: WARNING: This bypasses confirmations for 2024-05-16T22:34:08.941 INFO:teuthology.orchestra.run.smithi196.stdout: protective operations, use with care. 2024-05-16T22:34:08.975 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:34:09.008 INFO:teuthology.orchestra.run.smithi196.stdout: --all-users When setting up a filesystem for fscrypt, allow 2024-05-16T22:34:09.042 INFO:teuthology.orchestra.run.smithi196.stdout: users other than the calling user (typically 2024-05-16T22:34:09.075 INFO:teuthology.orchestra.run.smithi196.stdout: root) to create fscrypt policies and protectors 2024-05-16T22:34:09.108 INFO:teuthology.orchestra.run.smithi196.stdout: on the filesystem. Note that this will create a 2024-05-16T22:34:09.141 INFO:teuthology.orchestra.run.smithi196.stdout: world-writable directory, which users could use 2024-05-16T22:34:09.173 INFO:teuthology.orchestra.run.smithi196.stdout: to fill up the entire filesystem. Hence, this 2024-05-16T22:34:09.207 INFO:teuthology.orchestra.run.smithi196.stdout: option may not be appropriate for some systems. 2024-05-16T22:34:09.240 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:34:09.273 INFO:teuthology.orchestra.run.smithi196.stdout: --verbose Prints additional debug messages to standard 2024-05-16T22:34:09.307 INFO:teuthology.orchestra.run.smithi196.stdout: output. 2024-05-16T22:34:09.365 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:34:09.399 INFO:teuthology.orchestra.run.smithi196.stdout: --quiet Prints nothing to standard output except for 2024-05-16T22:34:09.432 INFO:teuthology.orchestra.run.smithi196.stdout: errors. Selects the default for any options that 2024-05-16T22:34:09.465 INFO:teuthology.orchestra.run.smithi196.stdout: would normally show a prompt. 2024-05-16T22:34:09.499 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:34:09.549 INFO:teuthology.orchestra.run.smithi196.stdout: --help Prints help screen for commands and subcommands. 2024-05-16T22:34:09.582 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:34:09.616 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:34:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T22:34:09.649 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'sudo fscrypt setup --force --quiet') 2024-05-16T22:34:09.683 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:34:09.718 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:34:09.752 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:34:09.829 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:34:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T22:34:12.867 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:34:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T22:34:12.933 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'sudo fscrypt status') 2024-05-16T22:34:13.069 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:34:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T22:34:13.109 INFO:teuthology.orchestra.run.smithi196.stdout:filesystems supporting encryption: 0 2024-05-16T22:34:13.132 INFO:teuthology.orchestra.run.smithi196.stdout:filesystems with fscrypt metadata: 1 2024-05-16T22:34:13.165 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:34:13.199 INFO:teuthology.orchestra.run.smithi196.stdout:MOUNTPOINT DEVICE FILESYSTEM ENCRYPTION FSCRYPT 2024-05-16T22:34:13.232 INFO:teuthology.orchestra.run.smithi196.stdout:/ /dev/sda1 ext4 not enabled Yes 2024-05-16T22:34:13.268 INFO:teuthology.orchestra.run.smithi196.stdout:/var/lib/ceph /dev/dm-4 xfs not supported No 2024-05-16T22:34:13.300 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:34:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T22:34:13.332 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'sudo fscrypt setup --quiet /home/ubuntu/cephtest/mnt.0') 2024-05-16T22:34:13.474 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:34:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T22:34:13.540 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:34:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T22:34:13.567 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'sudo fscrypt status') 2024-05-16T22:34:13.726 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:34:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T22:34:13.765 INFO:teuthology.orchestra.run.smithi196.stdout:filesystems supporting encryption: 1 2024-05-16T22:34:13.791 INFO:teuthology.orchestra.run.smithi196.stdout:filesystems with fscrypt metadata: 2 2024-05-16T22:34:13.849 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-16T22:34:13.883 INFO:teuthology.orchestra.run.smithi196.stdout:MOUNTPOINT DEVICE FILESYSTEM ENCRYPTION FSCRYPT 2024-05-16T22:34:13.916 INFO:teuthology.orchestra.run.smithi196.stdout:/ /dev/sda1 ext4 not enabled Yes 2024-05-16T22:34:13.949 INFO:teuthology.orchestra.run.smithi196.stdout:/home/ubuntu/cephtest/mnt.0 ceph supported Yes 2024-05-16T22:34:13.982 INFO:teuthology.orchestra.run.smithi196.stdout:/var/lib/ceph /dev/dm-4 xfs not supported No 2024-05-16T22:34:14.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:34:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T22:34:14.049 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'sudo dd if=/dev/urandom of=/tmp/key bs=32 count=1') 2024-05-16T22:34:14.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:34:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T22:34:14.224 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-05-16T22:34:14.249 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-05-16T22:34:14.283 INFO:teuthology.orchestra.run.smithi196.stderr:32 bytes copied, 0.000194282 s, 165 kB/s 2024-05-16T22:34:14.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:34:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T22:34:14.350 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'mkdir -p dir/') 2024-05-16T22:34:14.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:34:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T22:34:14.517 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:34:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T22:34:14.550 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'sudo fscrypt encrypt --quiet --source=raw_key --name=YBRncHuR --no-recovery --skip-unlock --key=/tmp/key dir/') 2024-05-16T22:34:14.720 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:34:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T22:34:14.792 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:34:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T22:34:14.859 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'sudo fscrypt unlock --quiet --key=/tmp/key dir/') 2024-05-16T22:34:15.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:34:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T22:34:15.067 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:34:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T22:34:15.100 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'cd dir/ && dd if=/dev/urandom of=AdFjELGyFvBSsEjPAfENhuLqFcxmPdqGZyMdWTWiDFOQOftpYDNZJKoIXqsjWovibDTXNzmEmFGhWUsleURvwLMBoauEFAsDnhAxLwTszJixNbkvyUrihrJXstFyUDFYgmCumLKBlXvLbpGKPghCKKWODGgSjfzBpwBZebtxvGwKXhLLjqpqtLQTLjyIbBWYvFRezOQUrVQAVvweaRAPlyQsEHFqolKREXGyRqvDEGLgbDpJvRVvewwBGIwHKHc bs=512 count=1 conv=sync && stat AdFjELGyFvBSsEjPAfENhuLqFcxmPdqGZyMdWTWiDFOQOftpYDNZJKoIXqsjWovibDTXNzmEmFGhWUsleURvwLMBoauEFAsDnhAxLwTszJixNbkvyUrihrJXstFyUDFYgmCumLKBlXvLbpGKPghCKKWODGgSjfzBpwBZebtxvGwKXhLLjqpqtLQTLjyIbBWYvFRezOQUrVQAVvweaRAPlyQsEHFqolKREXGyRqvDEGLgbDpJvRVvewwBGIwHKHc') 2024-05-16T22:34:15.244 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:34:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T22:34:15.275 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-05-16T22:34:15.308 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-05-16T22:34:15.341 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000209852 s, 2.4 MB/s 2024-05-16T22:34:15.375 INFO:teuthology.orchestra.run.smithi196.stdout: File: AdFjELGyFvBSsEjPAfENhuLqFcxmPdqGZyMdWTWiDFOQOftpYDNZJKoIXqsjWovibDTXNzmEmFGhWUsleURvwLMBoauEFAsDnhAxLwTszJixNbkvyUrihrJXstFyUDFYgmCumLKBlXvLbpGKPghCKKWODGgSjfzBpwBZebtxvGwKXhLLjqpqtLQTLjyIbBWYvFRezOQUrVQAVvweaRAPlyQsEHFqolKREXGyRqvDEGLgbDpJvRVvewwBGIwHKHc 2024-05-16T22:34:15.408 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 512 Blocks: 1 IO Block: 4096 regular file 2024-05-16T22:34:15.442 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 28h/40d Inode: 1099511628283 Links: 1 2024-05-16T22:34:15.475 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0644/-rw-r--r--) Uid: ( 1000/ ubuntu) Gid: ( 1316/ ubuntu) 2024-05-16T22:34:15.532 INFO:teuthology.orchestra.run.smithi196.stdout:Context: unconfined_u:object_r:unlabeled_t:s0 2024-05-16T22:34:15.567 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-05-16 22:34:15.249864235 +0000 2024-05-16T22:34:15.617 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-05-16 22:34:15.251864191 +0000 2024-05-16T22:34:15.650 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-05-16 22:34:15.251864191 +0000 2024-05-16T22:34:15.684 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: 2024-05-16 22:34:15.249864235 +0000 2024-05-16T22:34:15.726 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:34:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T22:34:15.759 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T22:34:15.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.919+0000 7f473fe2a640 1 Processor -- start 2024-05-16T22:34:15.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.920+0000 7f473fe2a640 1 -- start start 2024-05-16T22:34:15.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.921+0000 7f473fe2a640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4738151fc0 0x7f47380bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:16.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.921+0000 7f473fe2a640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47380c36f0 con 0x7f47380bf050 2024-05-16T22:34:16.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.921+0000 7f473fe2a640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4738152530 con 0x7f473806da30 2024-05-16T22:34:16.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.921+0000 7f473fe2a640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f47380bdc10 con 0x7f4738151fc0 2024-05-16T22:34:16.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.921+0000 7f473dbc6640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4738151fc0 0x7f47380bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:16.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.921+0000 7f473dbc6640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4738151fc0 0x7f47380bd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39968/0 (socket says 172.21.15.44:39968) 2024-05-16T22:34:16.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.921+0000 7f473e3c7640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f47380bf050 0x7f4738158e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:56862/0 (socket says 172.21.15.44:56862) 2024-05-16T22:34:16.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.921+0000 7f473dbc6640 1 -- 172.21.15.44:0/2830655876 learned_addr learned my addr 172.21.15.44:0/2830655876 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:34:16.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.921+0000 7f473dbc6640 1 -- 172.21.15.44:0/2830655876 >> v1:172.21.15.70:6789/0 conn(0x7f473806da30 legacy=0x7f47380be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:16.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.921+0000 7f473dbc6640 1 -- 172.21.15.44:0/2830655876 >> v1:172.21.15.44:6789/0 conn(0x7f47380bf050 legacy=0x7f4738158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:16.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.921+0000 7f473cbc4640 1 -- 172.21.15.44:0/2830655876 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1167907428 0 0) 0x7f47380c36f0 con 0x7f47380bf050 2024-05-16T22:34:16.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.921+0000 7f473dbc6640 1 -- 172.21.15.44:0/2830655876 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4738152810 con 0x7f4738151fc0 2024-05-16T22:34:16.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.922+0000 7f473dbc6640 1 --2- 172.21.15.44:0/2830655876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4738151fc0 0x7f47380bd6d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4728009e50 tx=0x7f472802a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84f42884df51d7b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:16.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.922+0000 7f473cbc4640 1 -- 172.21.15.44:0/2830655876 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4728036070 con 0x7f4738151fc0 2024-05-16T22:34:16.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.922+0000 7f473cbc4640 1 -- 172.21.15.44:0/2830655876 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4728031600 con 0x7f4738151fc0 2024-05-16T22:34:16.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.922+0000 7f473cbc4640 1 -- 172.21.15.44:0/2830655876 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47280319f0 con 0x7f4738151fc0 2024-05-16T22:34:16.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.923+0000 7f473fe2a640 1 -- 172.21.15.44:0/2830655876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4738151fc0 msgr2=0x7f47380bd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:16.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.923+0000 7f473fe2a640 1 --2- 172.21.15.44:0/2830655876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4738151fc0 0x7f47380bd6d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4728009e50 tx=0x7f472802a7c0 comp rx=0 tx=0).stop 2024-05-16T22:34:16.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.923+0000 7f473fe2a640 1 -- 172.21.15.44:0/2830655876 shutdown_connections 2024-05-16T22:34:16.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.923+0000 7f473fe2a640 1 --2- 172.21.15.44:0/2830655876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4738151fc0 0x7f47380bd6d0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:16.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.923+0000 7f473fe2a640 1 -- 172.21.15.44:0/2830655876 >> 172.21.15.44:0/2830655876 conn(0x7f47380c3d20 msgr2=0x7f47380c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:16.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.923+0000 7f473fe2a640 1 -- 172.21.15.44:0/2830655876 shutdown_connections 2024-05-16T22:34:16.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.923+0000 7f473fe2a640 1 -- 172.21.15.44:0/2830655876 wait complete. 2024-05-16T22:34:16.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.924+0000 7f473fe2a640 1 Processor -- start 2024-05-16T22:34:16.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.924+0000 7f473fe2a640 1 -- start start 2024-05-16T22:34:16.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.925+0000 7f473fe2a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f473806da30 0x7f47381e8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:16.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.925+0000 7f473fe2a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47380bf050 0x7f47380b7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:16.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.926+0000 7f473fe2a640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4738151fc0 0x7f47380b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:16.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.926+0000 7f473fe2a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f47380a3050 con 0x7f473806da30 2024-05-16T22:34:17.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.926+0000 7f473fe2a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f47380a2ed0 con 0x7f47380bf050 2024-05-16T22:34:17.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.926+0000 7f473fe2a640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f473806de40 con 0x7f4738151fc0 2024-05-16T22:34:17.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.926+0000 7f473dbc6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f473806da30 0x7f47381e8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:17.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.926+0000 7f473dbc6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f473806da30 0x7f47381e8150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39978/0 (socket says 172.21.15.44:39978) 2024-05-16T22:34:17.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.926+0000 7f473dbc6640 1 -- 172.21.15.44:0/3596202092 learned_addr learned my addr 172.21.15.44:0/3596202092 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:34:17.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.926+0000 7f473e3c7640 1 --2- 172.21.15.44:0/3596202092 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4738151fc0 0x7f47380b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:17.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.926+0000 7f473d3c5640 1 --2- 172.21.15.44:0/3596202092 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47380bf050 0x7f47380b7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:17.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.926+0000 7f473dbc6640 1 -- 172.21.15.44:0/3596202092 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4738151fc0 msgr2=0x7f47380b89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:17.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.926+0000 7f473dbc6640 1 --2- 172.21.15.44:0/3596202092 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4738151fc0 0x7f47380b89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:17.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.926+0000 7f473dbc6640 1 -- 172.21.15.44:0/3596202092 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47380bf050 msgr2=0x7f47380b7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:17.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.926+0000 7f473dbc6640 1 --2- 172.21.15.44:0/3596202092 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47380bf050 0x7f47380b7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:17.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.926+0000 7f473dbc6640 1 -- 172.21.15.44:0/3596202092 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47380b7b50 con 0x7f473806da30 2024-05-16T22:34:17.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.926+0000 7f473dbc6640 1 --2- 172.21.15.44:0/3596202092 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f473806da30 0x7f47381e8150 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f472802a800 tx=0x7f4728004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:17.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.926+0000 7f47367fc640 1 -- 172.21.15.44:0/3596202092 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4728040020 con 0x7f473806da30 2024-05-16T22:34:17.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.926+0000 7f47367fc640 1 -- 172.21.15.44:0/3596202092 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4728004040 con 0x7f473806da30 2024-05-16T22:34:17.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.926+0000 7f473fe2a640 1 -- 172.21.15.44:0/3596202092 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47380b8f20 con 0x7f473806da30 2024-05-16T22:34:17.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.926+0000 7f47367fc640 1 -- 172.21.15.44:0/3596202092 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4728036040 con 0x7f473806da30 2024-05-16T22:34:17.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.927+0000 7f473fe2a640 1 -- 172.21.15.44:0/3596202092 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47381e8930 con 0x7f473806da30 2024-05-16T22:34:17.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.928+0000 7f473fe2a640 1 -- 172.21.15.44:0/3596202092 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47380c10e0 con 0x7f473806da30 2024-05-16T22:34:17.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.928+0000 7f47367fc640 1 -- 172.21.15.44:0/3596202092 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4728043020 con 0x7f473806da30 2024-05-16T22:34:17.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.929+0000 7f47367fc640 1 --2- 172.21.15.44:0/3596202092 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4724076300 0x7f4724078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:17.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.929+0000 7f47367fc640 1 -- 172.21.15.44:0/3596202092 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5767+0+0 (secure 0 0 0) 0x7f47280b7f30 con 0x7f473806da30 2024-05-16T22:34:17.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.929+0000 7f473d3c5640 1 --2- 172.21.15.44:0/3596202092 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4724076300 0x7f4724078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:17.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.930+0000 7f473d3c5640 1 --2- 172.21.15.44:0/3596202092 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4724076300 0x7f4724078810 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f47381517c0 tx=0x7f472c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:17.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:15.934+0000 7f47367fc640 1 -- 172.21.15.44:0/3596202092 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f47380c10e0 con 0x7f473806da30 2024-05-16T22:34:17.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:16.163+0000 7f473fe2a640 1 -- 172.21.15.44:0/3596202092 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f473814bf20 con 0x7f473806da30 2024-05-16T22:34:17.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:16.163+0000 7f47367fc640 1 -- 172.21.15.44:0/3596202092 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+4347 (secure 0 0 0) 0x7f472804a030 con 0x7f473806da30 2024-05-16T22:34:17.970 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:34:18.053 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4954,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2432336323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2432336323},{"type":"v1","addr":"172.21.15.70:6835","nonce":2432336323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4972,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/454770375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":454770375},{"type":"v1","addr":"172.21.15.44:6835","nonce":454770375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T22:33:10.855194+0000","modified":"2024-05-16T22:33:27.123137+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5043},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5043":{"gid":5043,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":8,"addr":"172.21.15.44:6834/97015923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":97015923},{"type":"v1","addr":"172.21.15.44:6834","nonce":97015923}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5043,"qdb_cluster":[5043]},"id":3}]} 2024-05-16T22:34:18.095 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 26 2024-05-16T22:34:18.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:16.165+0000 7f473fe2a640 1 -- 172.21.15.44:0/3596202092 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4724076300 msgr2=0x7f4724078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:18.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:16.165+0000 7f473fe2a640 1 --2- 172.21.15.44:0/3596202092 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4724076300 0x7f4724078810 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f47381517c0 tx=0x7f472c009040 comp rx=0 tx=0).stop 2024-05-16T22:34:18.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:16.165+0000 7f473fe2a640 1 -- 172.21.15.44:0/3596202092 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f473806da30 msgr2=0x7f47381e8150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:18.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:16.165+0000 7f473fe2a640 1 --2- 172.21.15.44:0/3596202092 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f473806da30 0x7f47381e8150 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f472802a800 tx=0x7f4728004a40 comp rx=0 tx=0).stop 2024-05-16T22:34:18.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:16.165+0000 7f473fe2a640 1 -- 172.21.15.44:0/3596202092 shutdown_connections 2024-05-16T22:34:18.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:16.165+0000 7f473fe2a640 1 --2- 172.21.15.44:0/3596202092 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4724076300 0x7f4724078810 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:18.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:16.165+0000 7f473fe2a640 1 --2- 172.21.15.44:0/3596202092 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4738151fc0 0x7f47380b89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:18.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:16.165+0000 7f473fe2a640 1 --2- 172.21.15.44:0/3596202092 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47380bf050 0x7f47380b7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:18.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:16.165+0000 7f473fe2a640 1 --2- 172.21.15.44:0/3596202092 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f473806da30 0x7f47381e8150 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:18.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:16.165+0000 7f473fe2a640 1 -- 172.21.15.44:0/3596202092 >> 172.21.15.44:0/3596202092 conn(0x7f47380c3d20 msgr2=0x7f47380c09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:18.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:16.165+0000 7f473fe2a640 1 -- 172.21.15.44:0/3596202092 shutdown_connections 2024-05-16T22:34:18.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:16.165+0000 7f473fe2a640 1 -- 172.21.15.44:0/3596202092 wait complete. 2024-05-16T22:34:18.542 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T22:34:18.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.705+0000 7f5267957640 1 Processor -- start 2024-05-16T22:34:18.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.705+0000 7f5267957640 1 -- start start 2024-05-16T22:34:18.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.705+0000 7f5267957640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52600b9540 0x7f5260152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:18.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.705+0000 7f5267957640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52600bbbe0 con 0x7f52600be290 2024-05-16T22:34:18.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.705+0000 7f5267957640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52600be6a0 con 0x7f5260153420 2024-05-16T22:34:18.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.705+0000 7f5267957640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f5260153830 con 0x7f52600b9540 2024-05-16T22:34:19.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.706+0000 7f52656f3640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f52600be290 0x7f52600ba140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:56874/0 (socket says 172.21.15.44:56874) 2024-05-16T22:34:19.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.706+0000 7f52656f3640 1 -- 172.21.15.44:0/1593351716 learned_addr learned my addr 172.21.15.44:0/1593351716 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:34:19.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.706+0000 7f5264ef2640 1 --2- 172.21.15.44:0/1593351716 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52600b9540 0x7f5260152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:19.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.706+0000 7f5257fff640 1 -- 172.21.15.44:0/1593351716 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 304471317 0 0) 0x7f52600bbbe0 con 0x7f52600be290 2024-05-16T22:34:19.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.706+0000 7f5257fff640 1 -- 172.21.15.44:0/1593351716 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f524c003520 con 0x7f52600be290 2024-05-16T22:34:19.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.706+0000 7f5257fff640 1 -- 172.21.15.44:0/1593351716 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3114548117 0 0) 0x7f5258001490 con 0x7f5260153420 2024-05-16T22:34:19.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.706+0000 7f5257fff640 1 -- 172.21.15.44:0/1593351716 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52600bbbe0 con 0x7f5260153420 2024-05-16T22:34:19.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.706+0000 7f5264ef2640 1 -- 172.21.15.44:0/1593351716 >> v1:172.21.15.70:6789/0 conn(0x7f5260153420 legacy=0x7f526014c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:19.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.706+0000 7f5264ef2640 1 -- 172.21.15.44:0/1593351716 >> v1:172.21.15.44:6789/0 conn(0x7f52600be290 legacy=0x7f52600ba140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:19.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.706+0000 7f5264ef2640 1 -- 172.21.15.44:0/1593351716 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52600ba850 con 0x7f52600b9540 2024-05-16T22:34:19.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.707+0000 7f5264ef2640 1 --2- 172.21.15.44:0/1593351716 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52600b9540 0x7f5260152ee0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f52500097d0 tx=0x7f525002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ce0f08d541f46dc server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:19.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.707+0000 7f5257fff640 1 -- 172.21.15.44:0/1593351716 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5250037070 con 0x7f52600b9540 2024-05-16T22:34:19.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.707+0000 7f5257fff640 1 -- 172.21.15.44:0/1593351716 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5250032440 con 0x7f52600b9540 2024-05-16T22:34:19.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.707+0000 7f5257fff640 1 -- 172.21.15.44:0/1593351716 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52500327f0 con 0x7f52600b9540 2024-05-16T22:34:19.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.708+0000 7f5267957640 1 -- 172.21.15.44:0/1593351716 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52600b9540 msgr2=0x7f5260152ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:19.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.708+0000 7f5267957640 1 --2- 172.21.15.44:0/1593351716 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52600b9540 0x7f5260152ee0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f52500097d0 tx=0x7f525002a210 comp rx=0 tx=0).stop 2024-05-16T22:34:19.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.708+0000 7f5267957640 1 -- 172.21.15.44:0/1593351716 shutdown_connections 2024-05-16T22:34:19.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.708+0000 7f5267957640 1 --2- 172.21.15.44:0/1593351716 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52600b9540 0x7f5260152ee0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:19.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.708+0000 7f5267957640 1 -- 172.21.15.44:0/1593351716 >> 172.21.15.44:0/1593351716 conn(0x7f52600c0570 msgr2=0x7f52600c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:19.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.708+0000 7f5267957640 1 -- 172.21.15.44:0/1593351716 shutdown_connections 2024-05-16T22:34:19.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.708+0000 7f5267957640 1 -- 172.21.15.44:0/1593351716 wait complete. 2024-05-16T22:34:19.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.709+0000 7f5267957640 1 Processor -- start 2024-05-16T22:34:19.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.709+0000 7f5267957640 1 -- start start 2024-05-16T22:34:19.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.710+0000 7f5267957640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52600b9540 0x7f526014fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:19.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.710+0000 7f5267957640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52600be290 0x7f5260145c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:19.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.710+0000 7f5267957640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5260153420 0x7f5260146180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:19.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.710+0000 7f5267957640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f52600b8d40 con 0x7f52600b9540 2024-05-16T22:34:19.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.711+0000 7f5267957640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f52600b9950 con 0x7f52600be290 2024-05-16T22:34:20.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.711+0000 7f5267957640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f52600b9020 con 0x7f5260153420 2024-05-16T22:34:20.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.711+0000 7f52656f3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52600b9540 0x7f526014fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:20.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.711+0000 7f52656f3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52600b9540 0x7f526014fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39980/0 (socket says 172.21.15.44:39980) 2024-05-16T22:34:20.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.711+0000 7f52656f3640 1 -- 172.21.15.44:0/867818008 learned_addr learned my addr 172.21.15.44:0/867818008 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:34:20.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.711+0000 7f5264ef2640 1 --2- 172.21.15.44:0/867818008 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52600be290 0x7f5260145c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:20.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.711+0000 7f5265ef4640 1 --2- 172.21.15.44:0/867818008 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5260153420 0x7f5260146180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:20.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.711+0000 7f52656f3640 1 -- 172.21.15.44:0/867818008 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5260153420 msgr2=0x7f5260146180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:20.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.711+0000 7f52656f3640 1 --2- 172.21.15.44:0/867818008 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5260153420 0x7f5260146180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:20.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.711+0000 7f52656f3640 1 -- 172.21.15.44:0/867818008 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52600be290 msgr2=0x7f5260145c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:20.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.711+0000 7f52656f3640 1 --2- 172.21.15.44:0/867818008 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52600be290 0x7f5260145c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:20.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.711+0000 7f52656f3640 1 -- 172.21.15.44:0/867818008 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5260154400 con 0x7f52600b9540 2024-05-16T22:34:20.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.711+0000 7f5264ef2640 1 --2- 172.21.15.44:0/867818008 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52600be290 0x7f5260145c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:34:20.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.711+0000 7f52656f3640 1 --2- 172.21.15.44:0/867818008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52600b9540 0x7f526014fac0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f525c00c440 tx=0x7f525c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:20.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.711+0000 7f5255ffb640 1 -- 172.21.15.44:0/867818008 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525c017070 con 0x7f52600b9540 2024-05-16T22:34:20.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.711+0000 7f5255ffb640 1 -- 172.21.15.44:0/867818008 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f525c007480 con 0x7f52600b9540 2024-05-16T22:34:20.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.711+0000 7f5267957640 1 -- 172.21.15.44:0/867818008 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5260155fa0 con 0x7f52600b9540 2024-05-16T22:34:20.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.711+0000 7f5255ffb640 1 -- 172.21.15.44:0/867818008 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525c0059e0 con 0x7f52600b9540 2024-05-16T22:34:20.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.712+0000 7f5267957640 1 -- 172.21.15.44:0/867818008 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5260154b40 con 0x7f52600b9540 2024-05-16T22:34:20.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.713+0000 7f5267957640 1 -- 172.21.15.44:0/867818008 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52600ba5f0 con 0x7f52600b9540 2024-05-16T22:34:20.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.713+0000 7f5255ffb640 1 -- 172.21.15.44:0/867818008 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f525c01a070 con 0x7f52600b9540 2024-05-16T22:34:20.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.714+0000 7f5255ffb640 1 --2- 172.21.15.44:0/867818008 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f5244076300 0x7f5244078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:20.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.714+0000 7f5255ffb640 1 -- 172.21.15.44:0/867818008 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5767+0+0 (secure 0 0 0) 0x7f525c096880 con 0x7f52600b9540 2024-05-16T22:34:20.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.714+0000 7f5264ef2640 1 --2- 172.21.15.44:0/867818008 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f5244076300 0x7f5244078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:20.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.715+0000 7f5264ef2640 1 --2- 172.21.15.44:0/867818008 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f5244076300 0x7f5244078810 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5250034000 tx=0x7f525002e000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:21.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.719+0000 7f5255ffb640 1 -- 172.21.15.44:0/867818008 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f52600ba5f0 con 0x7f52600b9540 2024-05-16T22:34:21.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.948+0000 7f5267957640 1 -- 172.21.15.44:0/867818008 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f52600c2680 con 0x7f52600b9540 2024-05-16T22:34:21.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.948+0000 7f5255ffb640 1 -- 172.21.15.44:0/867818008 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+4347 (secure 0 0 0) 0x7f52600c2680 con 0x7f52600b9540 2024-05-16T22:34:21.147 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:34:21.180 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4954,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2432336323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2432336323},{"type":"v1","addr":"172.21.15.70:6835","nonce":2432336323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4972,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/454770375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":454770375},{"type":"v1","addr":"172.21.15.44:6835","nonce":454770375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T22:33:10.855194+0000","modified":"2024-05-16T22:33:27.123137+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5043},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5043":{"gid":5043,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":8,"addr":"172.21.15.44:6834/97015923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":97015923},{"type":"v1","addr":"172.21.15.44:6834","nonce":97015923}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5043,"qdb_cluster":[5043]},"id":3}]} 2024-05-16T22:34:21.215 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 26 2024-05-16T22:34:21.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.950+0000 7f5267957640 1 -- 172.21.15.44:0/867818008 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f5244076300 msgr2=0x7f5244078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:21.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.950+0000 7f5267957640 1 --2- 172.21.15.44:0/867818008 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f5244076300 0x7f5244078810 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5250034000 tx=0x7f525002e000 comp rx=0 tx=0).stop 2024-05-16T22:34:21.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.950+0000 7f5267957640 1 -- 172.21.15.44:0/867818008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52600b9540 msgr2=0x7f526014fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:21.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.950+0000 7f5267957640 1 --2- 172.21.15.44:0/867818008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52600b9540 0x7f526014fac0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f525c00c440 tx=0x7f525c00c900 comp rx=0 tx=0).stop 2024-05-16T22:34:21.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.950+0000 7f5267957640 1 -- 172.21.15.44:0/867818008 shutdown_connections 2024-05-16T22:34:21.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.950+0000 7f5267957640 1 --2- 172.21.15.44:0/867818008 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f5244076300 0x7f5244078810 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:21.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.950+0000 7f5267957640 1 --2- 172.21.15.44:0/867818008 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5260153420 0x7f5260146180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:21.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.950+0000 7f5267957640 1 --2- 172.21.15.44:0/867818008 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52600be290 0x7f5260145c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:21.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.950+0000 7f5267957640 1 --2- 172.21.15.44:0/867818008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52600b9540 0x7f526014fac0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:21.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.950+0000 7f5267957640 1 -- 172.21.15.44:0/867818008 >> 172.21.15.44:0/867818008 conn(0x7f52600c0570 msgr2=0x7f52600b9ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:21.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.950+0000 7f5267957640 1 -- 172.21.15.44:0/867818008 shutdown_connections 2024-05-16T22:34:21.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:18.950+0000 7f5267957640 1 -- 172.21.15.44:0/867818008 wait complete. 2024-05-16T22:34:21.781 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump tree /dir 0 2024-05-16T22:34:21.955 INFO:teuthology.orchestra.run.smithi044.stdout:[{"ino":1099511627780,"rdev":0,"ctime":"2024-05-16T22:34:15.249864+0000","btime":"2024-05-16T22:34:14.498880+0000","mode":16832,"uid":1000,"gid":1316,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-05-16T22:34:15.249864+0000","atime":"2024-05-16T22:34:14.498880+0000","time_warp_seq":0,"change_attr":3,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-05-16T22:34:15.249864+0000","num_files":1,"num_subdirs":0,"change_attr":1},"rstat":{"version":0,"rbytes":4096,"rfiles":1,"rsubdirs":1,"rsnaps":0,"rctime":"2024-05-16T22:34:15.251864+0000"},"accounted_rstat":{"version":0,"rbytes":4096,"rfiles":1,"rsubdirs":1,"rsnaps":0,"rctime":"2024-05-16T22:34:15.251864+0000"},"version":29,"file_data_version":0,"xattr_version":1,"backtrace_version":14,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"lock":0,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1,"authpin":0},"nref":4,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","type":"ifile","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":5184,"pending":"pAsLsXsFsx","issued":"pAsLsXsFsx","wanted":"pAsLsXsFsxcral","last_sent":4}],"loner":5184,"want_loner":5184,"mds_caps_wanted":[],"dirfrags":[{"path":"/dir","dirfrag":"0x10000000004","snapid_first":2,"projected_version":"5","version":"5","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"dirty":1,"authpin":0},"nref":2,"dentries":[{"path":"dir/bUHUwH9E8uiVaf8xZ+zONcB1CToj53x5aUUnKdnNj5U37zbh28l1AaWwHhbOT3HyzqKjmSKKW1o4odQJc7nF9xrKIB8D3b4qqb2Cs6s7t2106hHhQk5,YV7DtpeNPZnorcTqxPM,hExtWHSS4P+S+Dpwj62hMyh,77sGhiW1Filvv1gQjV+sN,GozPNwHgfleadkUuZ+PMLCaKQXhuid9WvmHanxJnaabYDLj4VEz+EX2WsG","alternate_name":"bUHUwH9E8uiVaf8xZ+zONcB1CToj53x5aUUnKdnNj5U37zbh28l1AaWwHhbOT3HyzqKjmSKKW1o4odQJc7nF9xrKIB8D3b4qqb2Cs6s7t2106hHhQk5/YV7DtpeNPZnorcTqxPM/hExtWHSS4P+S+Dpwj62hMyh/77sGhiW1Filvv1gQjV+sN/GozPNwHgfleadkUs1OkRkYtgWrCjbKP0MayRtiOLrVTRuYyOp/Qt3+XCIyiS87B9bUcOFjWratF+yR0kpJ0RYriix7NKVkBJ0kGWYSCY+PYjiLeMYJBMQcCxW/nwfVku+m6fgFJvb6pjEFxIk9zT5cunSImsjr","path_ino":1,"snap_first":2,"snap_last":18446744073709551614,"is_primary":true,"is_remote":false,"is_null":false,"is_new":false,"inode":1099511628283,"remote_type":"","version":4,"projected_version":4,"auth_pins":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"inodepin":1,"dirty":1,"authpin":0},"nref":2,"lock":{},"versionlock":{"gather_set":[],"state":"lock","type":"dversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty"]}]}],"is_subvolume":false}] 2024-05-16T22:34:22.023 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "accounted_rstat": { "rbytes": 4096, "rctime": "2024-05-16T22:34:15.251864+0000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-05-16T22:34:14.498880+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 14, "btime": "2024-05-16T22:34:14.498880+0000", "change_attr": 3, "client_caps": [ { "client_id": 5184, "issued": "pAsLsXsFsx", "last_sent": 4, "pending": "pAsLsXsFsx", "wanted": "pAsLsXsFsxcral" } ], "client_ranges": [], "ctime": "2024-05-16T22:34:15.249864+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfrags": [ { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dentries": [ { "alternate_name": "bUHUwH9E8uiVaf8xZ+zONcB1CToj53x5aUUnKdnNj5U37zbh28l1AaWwHhbOT3HyzqKjmSKKW1o4odQJc7nF9xrKIB8D3b4qqb2Cs6s7t2106hHhQk5/YV7DtpeNPZnorcTqxPM/hExtWHSS4P+S+Dpwj62hMyh/77sGhiW1Filvv1gQjV+sN/GozPNwHgfleadkUs1OkRkYtgWrCjbKP0MayRtiOLrVTRuYyOp/Qt3+XCIyiS87B9bUcOFjWratF+yR0kpJ0RYriix7NKVkBJ0kGWYSCY+PYjiLeMYJBMQcCxW/nwfVku+m6fgFJvb6pjEFxIk9zT5cunSImsjr", "auth_pins": 0, "auth_state": { "replicas": {} }, "inode": 1099511628283, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_new": false, "is_null": false, "is_primary": true, "is_remote": false, "lock": {}, "nref": 2, "path": "dir/bUHUwH9E8uiVaf8xZ+zONcB1CToj53x5aUUnKdnNj5U37zbh28l1AaWwHhbOT3HyzqKjmSKKW1o4odQJc7nF9xrKIB8D3b4qqb2Cs6s7t2106hHhQk5,YV7DtpeNPZnorcTqxPM,hExtWHSS4P+S+Dpwj62hMyh,77sGhiW1Filvv1gQjV+sN,GozPNwHgfleadkUuZ+PMLCaKQXhuid9WvmHanxJnaabYDLj4VEz+EX2WsG", "path_ino": 1, "pins": { "authpin": 0, "dirty": 1, "inodepin": 1, "lock": 0, "request": 0 }, "projected_version": 4, "remote_type": "", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snap_first": 2, "snap_last": 18446744073709551614, "states": [ "auth", "dirty" ], "version": 4, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "dversion", "xlock_by": {} } } ], "dir_auth": "", "dirfrag": "0x10000000004", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/dir", "pins": { "authpin": 0, "child": 1, "dirty": 1 }, "projected_version": "5", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" } ], "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 1, "mtime": "2024-05-16T22:34:15.249864+0000", "num_files": 1, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ifile", "xlock_by": {} }, "flocklock": {}, "gid": 1316, "ino": 1099511627780, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 5184, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16832, "mtime": "2024-05-16T22:34:15.249864+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "pins": { "authpin": 0, "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "lock": 0, "ptrwaiter": 0, "request": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 4096, "rctime": "2024-05-16T22:34:15.251864+0000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 29, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": 5184, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } ] 2024-05-16T22:34:22.056 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-16T22:34:22.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.204+0000 7f371bae0640 1 Processor -- start 2024-05-16T22:34:22.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.204+0000 7f371bae0640 1 -- start start 2024-05-16T22:34:22.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.205+0000 7f371bae0640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f37140b4500 0x7f37140b57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:22.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.205+0000 7f371bae0640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f37140b9ee0 0x7f37140a4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:22.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.205+0000 7f371bae0640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37140bba80 con 0x7f37140bb490 2024-05-16T22:34:22.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.205+0000 7f371bae0640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f37140bbd60 con 0x7f37140b4500 2024-05-16T22:34:22.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.205+0000 7f371bae0640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f37140b4ff0 con 0x7f37140b9ee0 2024-05-16T22:34:22.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.205+0000 7f371907b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f37140b4500 0x7f37140b57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:22.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.205+0000 7f371907b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f37140b4500 0x7f37140b57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43012/0 (socket says 172.21.15.44:43012) 2024-05-16T22:34:22.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.205+0000 7f371907b640 1 -- 172.21.15.44:0/4048908044 learned_addr learned my addr 172.21.15.44:0/4048908044 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:34:22.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.205+0000 7f371987c640 1 --1- 172.21.15.44:0/4048908044 >> v1:172.21.15.44:6789/0 conn(0x7f37140bb490 0x7f371406faa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57936/0 (socket says 172.21.15.44:57936) 2024-05-16T22:34:22.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.206+0000 7f371a07d640 1 --2- 172.21.15.44:0/4048908044 >> v2:172.21.15.70:3300/0 conn(0x7f37140b9ee0 0x7f37140a4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:22.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.206+0000 7f371907b640 1 -- 172.21.15.44:0/4048908044 >> v2:172.21.15.70:3300/0 conn(0x7f37140b9ee0 msgr2=0x7f37140a4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:34:22.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.206+0000 7f371907b640 1 --2- 172.21.15.44:0/4048908044 >> v2:172.21.15.70:3300/0 conn(0x7f37140b9ee0 0x7f37140a4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:22.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.206+0000 7f371887a640 1 -- 172.21.15.44:0/4048908044 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 31790367 0 0) 0x7f37140bba80 con 0x7f37140bb490 2024-05-16T22:34:22.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.206+0000 7f371907b640 1 -- 172.21.15.44:0/4048908044 >> v1:172.21.15.44:6789/0 conn(0x7f37140bb490 legacy=0x7f371406faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:22.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.206+0000 7f371907b640 1 -- 172.21.15.44:0/4048908044 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37140b52d0 con 0x7f37140b4500 2024-05-16T22:34:22.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.206+0000 7f371a07d640 1 --2- 172.21.15.44:0/4048908044 >> v2:172.21.15.70:3300/0 conn(0x7f37140b9ee0 0x7f37140a4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T22:34:22.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.207+0000 7f371907b640 1 --2- 172.21.15.44:0/4048908044 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37140b4500 0x7f37140b57f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f37140a0ce0 tx=0x7f370802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa9341d32942bc26 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:22.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.207+0000 7f371887a640 1 -- 172.21.15.44:0/4048908044 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3708037070 con 0x7f37140b4500 2024-05-16T22:34:22.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.207+0000 7f371887a640 1 -- 172.21.15.44:0/4048908044 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3708032440 con 0x7f37140b4500 2024-05-16T22:34:22.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.207+0000 7f371887a640 1 -- 172.21.15.44:0/4048908044 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3708032810 con 0x7f37140b4500 2024-05-16T22:34:22.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.207+0000 7f371bae0640 1 -- 172.21.15.44:0/4048908044 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37140b4500 msgr2=0x7f37140b57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:23.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.207+0000 7f371bae0640 1 --2- 172.21.15.44:0/4048908044 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37140b4500 0x7f37140b57f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f37140a0ce0 tx=0x7f370802a1e0 comp rx=0 tx=0).stop 2024-05-16T22:34:23.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.207+0000 7f371bae0640 1 -- 172.21.15.44:0/4048908044 shutdown_connections 2024-05-16T22:34:23.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.207+0000 7f371bae0640 1 --2- 172.21.15.44:0/4048908044 >> v2:172.21.15.70:3300/0 conn(0x7f37140b9ee0 0x7f37140a4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:23.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.207+0000 7f371bae0640 1 --2- 172.21.15.44:0/4048908044 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37140b4500 0x7f37140b57f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:23.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.207+0000 7f371bae0640 1 -- 172.21.15.44:0/4048908044 >> 172.21.15.44:0/4048908044 conn(0x7f37140a1ac0 msgr2=0x7f37140bbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:23.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.207+0000 7f371bae0640 1 -- 172.21.15.44:0/4048908044 shutdown_connections 2024-05-16T22:34:23.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.208+0000 7f371bae0640 1 -- 172.21.15.44:0/4048908044 wait complete. 2024-05-16T22:34:23.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.209+0000 7f371bae0640 1 Processor -- start 2024-05-16T22:34:23.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.209+0000 7f371bae0640 1 -- start start 2024-05-16T22:34:23.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.210+0000 7f371bae0640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f37140b4500 0x7f3714140a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:23.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.210+0000 7f371bae0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37140b9ee0 0x7f371413e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:23.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.210+0000 7f371bae0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37140bb490 0x7f371413cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:23.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.210+0000 7f371bae0640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f37140a45c0 con 0x7f37140b9ee0 2024-05-16T22:34:23.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.210+0000 7f371bae0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f37140ba2f0 con 0x7f37140bb490 2024-05-16T22:34:23.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.210+0000 7f371bae0640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f37140a4740 con 0x7f37140b4500 2024-05-16T22:34:23.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.210+0000 7f371907b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37140b9ee0 0x7f371413e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:23.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.210+0000 7f371907b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37140b9ee0 0x7f371413e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43016/0 (socket says 172.21.15.44:43016) 2024-05-16T22:34:23.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.210+0000 7f371907b640 1 -- 172.21.15.44:0/3941587085 learned_addr learned my addr 172.21.15.44:0/3941587085 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:34:23.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.210+0000 7f371987c640 1 --2- 172.21.15.44:0/3941587085 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f37140b4500 0x7f3714140a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:23.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.210+0000 7f371a07d640 1 --2- 172.21.15.44:0/3941587085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37140bb490 0x7f371413cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:23.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.210+0000 7f371907b640 1 -- 172.21.15.44:0/3941587085 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f37140b4500 msgr2=0x7f3714140a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:23.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.210+0000 7f371907b640 1 --2- 172.21.15.44:0/3941587085 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f37140b4500 0x7f3714140a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:23.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.210+0000 7f371907b640 1 -- 172.21.15.44:0/3941587085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37140bb490 msgr2=0x7f371413cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:23.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.210+0000 7f371907b640 1 --2- 172.21.15.44:0/3941587085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37140bb490 0x7f371413cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:23.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.210+0000 7f371907b640 1 -- 172.21.15.44:0/3941587085 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f371413fcc0 con 0x7f37140b9ee0 2024-05-16T22:34:23.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.211+0000 7f371907b640 1 --2- 172.21.15.44:0/3941587085 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37140b9ee0 0x7f371413e980 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f370802a220 tx=0x7f37080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:23.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.211+0000 7f37127fc640 1 -- 172.21.15.44:0/3941587085 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3708037040 con 0x7f37140b9ee0 2024-05-16T22:34:23.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.211+0000 7f37127fc640 1 -- 172.21.15.44:0/3941587085 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3708042070 con 0x7f37140b9ee0 2024-05-16T22:34:23.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.211+0000 7f371bae0640 1 -- 172.21.15.44:0/3941587085 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3714140f60 con 0x7f37140b9ee0 2024-05-16T22:34:24.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.211+0000 7f37127fc640 1 -- 172.21.15.44:0/3941587085 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3708030bb0 con 0x7f37140b9ee0 2024-05-16T22:34:24.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.211+0000 7f371bae0640 1 -- 172.21.15.44:0/3941587085 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3714140220 con 0x7f37140b9ee0 2024-05-16T22:34:24.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.212+0000 7f371bae0640 1 -- 172.21.15.44:0/3941587085 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37140a2690 con 0x7f37140b9ee0 2024-05-16T22:34:24.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.213+0000 7f37127fc640 1 -- 172.21.15.44:0/3941587085 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3708047460 con 0x7f37140b9ee0 2024-05-16T22:34:24.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.213+0000 7f37127fc640 1 --2- 172.21.15.44:0/3941587085 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f3700076300 0x7f3700078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:24.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.213+0000 7f37127fc640 1 -- 172.21.15.44:0/3941587085 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5767+0+0 (secure 0 0 0) 0x7f37080b8c40 con 0x7f37140b9ee0 2024-05-16T22:34:24.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.214+0000 7f371987c640 1 --2- 172.21.15.44:0/3941587085 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f3700076300 0x7f3700078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:24.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.214+0000 7f371987c640 1 --2- 172.21.15.44:0/3941587085 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f3700076300 0x7f3700078810 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f370c000f60 tx=0x7f370c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:24.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.217+0000 7f37127fc640 1 -- 172.21.15.44:0/3941587085 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f371413fcc0 con 0x7f37140b9ee0 2024-05-16T22:34:24.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.450+0000 7f371bae0640 1 -- 172.21.15.44:0/3941587085 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f37140bce70 con 0x7f37140b9ee0 2024-05-16T22:34:24.369 INFO:tasks.ceph.mon.a.smithi044.stderr:2024-05-16T22:34:22.451+0000 7facbfd75640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-16T22:34:24.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.452+0000 7f37127fc640 1 -- 172.21.15.44:0/3941587085 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v27) ==== 161+0+0 (secure 0 0 0) 0x7f37080827f0 con 0x7f37140b9ee0 2024-05-16T22:34:24.433 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-16T22:34:24.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.455+0000 7f371bae0640 1 -- 172.21.15.44:0/3941587085 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f3700076300 msgr2=0x7f3700078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:24.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.455+0000 7f371bae0640 1 --2- 172.21.15.44:0/3941587085 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f3700076300 0x7f3700078810 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f370c000f60 tx=0x7f370c009040 comp rx=0 tx=0).stop 2024-05-16T22:34:24.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.455+0000 7f371bae0640 1 -- 172.21.15.44:0/3941587085 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37140b9ee0 msgr2=0x7f371413e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:24.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.455+0000 7f371bae0640 1 --2- 172.21.15.44:0/3941587085 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37140b9ee0 0x7f371413e980 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f370802a220 tx=0x7f37080046c0 comp rx=0 tx=0).stop 2024-05-16T22:34:24.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.455+0000 7f371bae0640 1 -- 172.21.15.44:0/3941587085 shutdown_connections 2024-05-16T22:34:24.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.455+0000 7f371bae0640 1 --2- 172.21.15.44:0/3941587085 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f3700076300 0x7f3700078810 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:24.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.455+0000 7f371bae0640 1 --2- 172.21.15.44:0/3941587085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37140bb490 0x7f371413cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:24.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.455+0000 7f371bae0640 1 --2- 172.21.15.44:0/3941587085 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37140b9ee0 0x7f371413e980 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:24.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.455+0000 7f371bae0640 1 --2- 172.21.15.44:0/3941587085 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f37140b4500 0x7f3714140a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:24.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.455+0000 7f371bae0640 1 -- 172.21.15.44:0/3941587085 >> 172.21.15.44:0/3941587085 conn(0x7f37140a1ac0 msgr2=0x7f37140a3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:24.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.455+0000 7f371bae0640 1 -- 172.21.15.44:0/3941587085 shutdown_connections 2024-05-16T22:34:24.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:22.455+0000 7f371bae0640 1 -- 172.21.15.44:0/3941587085 wait complete. 2024-05-16T22:34:24.926 DEBUG:teuthology.orchestra.run.smithi044:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 event recover_dentries list 2024-05-16T22:34:24.959 INFO:tasks.ceph.mds.a.smithi044.stdout:starting mds.a at 2024-05-16T22:34:25.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.056+0000 7f75b8591280 1 -- start start 2024-05-16T22:34:25.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.056+0000 7f75b8591280 1 Processor -- start 2024-05-16T22:34:25.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.057+0000 7f75b8591280 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x564578b9e480 0x564577ea6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:25.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.057+0000 7f75b8591280 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564578b9e900 0x564577ea6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:25.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.057+0000 7f75b8591280 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564578b9ed80 0x564577ea6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:25.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.057+0000 7f75b8591280 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564577e90780 con 0x564578b9e900 2024-05-16T22:34:25.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.057+0000 7f75b8591280 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564577e90600 con 0x564578b9ed80 2024-05-16T22:34:25.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.057+0000 7f75b8591280 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x564577e90480 con 0x564578b9e480 2024-05-16T22:34:25.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.058+0000 7f75b653c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564578b9e900 0x564577ea6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:25.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.058+0000 7f75b653c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564578b9e900 0x564577ea6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43042/0 (socket says 172.21.15.44:43042) 2024-05-16T22:34:25.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.058+0000 7f75b653c640 1 -- 172.21.15.44:0/251529974 learned_addr learned my addr 172.21.15.44:0/251529974 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:34:25.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.058+0000 7f75b753e640 1 --2- 172.21.15.44:0/251529974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564578b9ed80 0x564577ea6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:25.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.058+0000 7f75b6d3d640 1 --2- 172.21.15.44:0/251529974 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x564578b9e480 0x564577ea6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:25.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.058+0000 7f75b653c640 1 -- 172.21.15.44:0/251529974 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x564578b9e480 msgr2=0x564577ea6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:34:25.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.058+0000 7f75b653c640 1 --2- 172.21.15.44:0/251529974 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x564578b9e480 0x564577ea6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:25.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.058+0000 7f75b653c640 1 -- 172.21.15.44:0/251529974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564578b9ed80 msgr2=0x564577ea6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:34:25.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.058+0000 7f75b653c640 1 --2- 172.21.15.44:0/251529974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564578b9ed80 0x564577ea6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:25.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.058+0000 7f75b653c640 1 -- 172.21.15.44:0/251529974 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564573dd6780 con 0x564578b9e900 2024-05-16T22:34:25.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.058+0000 7f75b653c640 1 --2- 172.21.15.44:0/251529974 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564578b9e900 0x564577ea6000 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x564578bd9590 tx=0x564577ecbe00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5593ee336fa9dc1 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:25.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.058+0000 7f75b4538640 1 -- 172.21.15.44:0/251529974 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564573dc6680 con 0x564578b9e900 2024-05-16T22:34:25.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.058+0000 7f75b4538640 1 -- 172.21.15.44:0/251529974 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x564573dcc700 con 0x564578b9e900 2024-05-16T22:34:25.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.058+0000 7f75b4538640 1 -- 172.21.15.44:0/251529974 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564573dc69c0 con 0x564578b9e900 2024-05-16T22:34:25.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.058+0000 7f75b8591280 1 -- 172.21.15.44:0/251529974 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564573dd7680 con 0x564578b9e900 2024-05-16T22:34:25.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.058+0000 7f75b8591280 1 -- 172.21.15.44:0/251529974 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) -- 0x564573dd6000 con 0x564578b9e900 2024-05-16T22:34:25.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.058+0000 7f75b8591280 4 waiting for MDS map... 2024-05-16T22:34:26.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.059+0000 7f75b4538640 1 -- 172.21.15.44:0/251529974 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(51..51 src has 1..51) ==== 5853+0+0 (secure 0 0 0) 0x564578ca0800 con 0x564578b9e900 2024-05-16T22:34:26.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.059+0000 7f75b4538640 1 -- 172.21.15.44:0/251529974 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 28) ==== 2885+0+0 (secure 0 0 0) 0x564577e2b180 con 0x564578b9e900 2024-05-16T22:34:26.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.059+0000 7f75b8591280 4 Got MDS map 28 2024-05-16T22:34:26.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.059+0000 7f75b8591280 10 main: JournalTool::main 2024-05-16T22:34:26.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.059+0000 7f75b8591280 4 main: JournalTool: connecting to RADOS... 2024-05-16T22:34:26.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.060+0000 7f75b8591280 1 Processor -- start 2024-05-16T22:34:26.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.060+0000 7f75b8591280 1 -- start start 2024-05-16T22:34:26.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.061+0000 7f75b8591280 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x564578b9f680 0x564577ea7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:26.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.061+0000 7f75b8591280 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564578b9fb00 0x564577ea7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:26.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.061+0000 7f75b8591280 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564578b9ff80 0x564577ea7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:26.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.061+0000 7f75b8591280 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564577e90300 con 0x564578b9ff80 2024-05-16T22:34:26.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.061+0000 7f75b8591280 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564577e90000 con 0x564578b9fb00 2024-05-16T22:34:26.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.061+0000 7f75b8591280 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x564577e33800 con 0x564578b9f680 2024-05-16T22:34:26.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.061+0000 7f75b653c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564578b9ff80 0x564577ea7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:26.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.061+0000 7f75b653c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564578b9ff80 0x564577ea7b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43050/0 (socket says 172.21.15.44:43050) 2024-05-16T22:34:26.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.061+0000 7f75b653c640 1 -- 172.21.15.44:0/2722905597 learned_addr learned my addr 172.21.15.44:0/2722905597 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:34:26.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.061+0000 7f75b753e640 1 --2- 172.21.15.44:0/2722905597 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x564578b9f680 0x564577ea7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:26.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.061+0000 7f75b6d3d640 1 --2- 172.21.15.44:0/2722905597 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564578b9fb00 0x564577ea7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:26.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.061+0000 7f75b653c640 1 -- 172.21.15.44:0/2722905597 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x564578b9f680 msgr2=0x564577ea7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:34:26.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.061+0000 7f75b653c640 1 --2- 172.21.15.44:0/2722905597 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x564578b9f680 0x564577ea7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:26.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.061+0000 7f75b653c640 1 -- 172.21.15.44:0/2722905597 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564578b9fb00 msgr2=0x564577ea7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:34:26.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.061+0000 7f75b653c640 1 --2- 172.21.15.44:0/2722905597 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564578b9fb00 0x564577ea7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:26.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.061+0000 7f75b653c640 1 -- 172.21.15.44:0/2722905597 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564573dd63c0 con 0x564578b9ff80 2024-05-16T22:34:26.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.061+0000 7f75b653c640 1 --2- 172.21.15.44:0/2722905597 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564578b9ff80 0x564577ea7b80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x564578bd9b90 tx=0x564577ecb980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63e56d8c4761fd2e server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:26.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.061+0000 7f75b2534640 1 -- 172.21.15.44:0/2722905597 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564573dc6680 con 0x564578b9ff80 2024-05-16T22:34:26.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.062+0000 7f75b2534640 1 -- 172.21.15.44:0/2722905597 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x564573dccfc0 con 0x564578b9ff80 2024-05-16T22:34:26.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.062+0000 7f75b2534640 1 -- 172.21.15.44:0/2722905597 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564573dc69c0 con 0x564578b9ff80 2024-05-16T22:34:26.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.062+0000 7f75b8591280 1 -- 172.21.15.44:0/2722905597 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564578b9ff80 msgr2=0x564577ea7b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:26.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.062+0000 7f75b8591280 1 --2- 172.21.15.44:0/2722905597 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564578b9ff80 0x564577ea7b80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x564578bd9b90 tx=0x564577ecb980 comp rx=0 tx=0).stop 2024-05-16T22:34:27.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.062+0000 7f75b8591280 1 -- 172.21.15.44:0/2722905597 shutdown_connections 2024-05-16T22:34:27.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.062+0000 7f75b8591280 1 --2- 172.21.15.44:0/2722905597 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564578b9ff80 0x564577ea7b80 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:27.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.062+0000 7f75b8591280 1 --2- 172.21.15.44:0/2722905597 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564578b9fb00 0x564577ea7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:27.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.062+0000 7f75b8591280 1 --2- 172.21.15.44:0/2722905597 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x564578b9f680 0x564577ea7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:27.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.062+0000 7f75b8591280 1 -- 172.21.15.44:0/2722905597 >> 172.21.15.44:0/2722905597 conn(0x564578b9f200 msgr2=0x564577eb9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:34:27.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.062+0000 7f75b8591280 1 -- 172.21.15.44:0/2722905597 shutdown_connections 2024-05-16T22:34:27.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.062+0000 7f75b8591280 1 -- 172.21.15.44:0/2722905597 wait complete. 2024-05-16T22:34:27.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.063+0000 7f75b8591280 1 Processor -- start 2024-05-16T22:34:27.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.063+0000 7f75b8591280 1 -- start start 2024-05-16T22:34:27.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.064+0000 7f75b8591280 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x564578b9f680 0x564577ea7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:27.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.064+0000 7f75b8591280 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564578b9fb00 0x564577ea7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:27.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.064+0000 7f75b8591280 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564578b9ff80 0x564577ea7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:27.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.064+0000 7f75b8591280 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564577e91380 con 0x564578b9ff80 2024-05-16T22:34:27.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.064+0000 7f75b8591280 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564577e91500 con 0x564578b9fb00 2024-05-16T22:34:27.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.064+0000 7f75b8591280 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x564577e90000 con 0x564578b9f680 2024-05-16T22:34:27.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.064+0000 7f75b653c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564578b9ff80 0x564577ea7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:27.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.064+0000 7f75b653c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564578b9ff80 0x564577ea7b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43054/0 (socket says 172.21.15.44:43054) 2024-05-16T22:34:27.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.064+0000 7f75b653c640 1 -- 172.21.15.44:0/2553534249 learned_addr learned my addr 172.21.15.44:0/2553534249 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:34:27.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.064+0000 7f75b753e640 1 --2- 172.21.15.44:0/2553534249 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x564578b9f680 0x564577ea7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:27.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.064+0000 7f75b6d3d640 1 --2- 172.21.15.44:0/2553534249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564578b9fb00 0x564577ea7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:27.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.064+0000 7f75b653c640 1 -- 172.21.15.44:0/2553534249 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x564578b9f680 msgr2=0x564577ea7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:27.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.064+0000 7f75b653c640 1 --2- 172.21.15.44:0/2553534249 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x564578b9f680 0x564577ea7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:27.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.064+0000 7f75b653c640 1 -- 172.21.15.44:0/2553534249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564578b9fb00 msgr2=0x564577ea7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:34:27.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.064+0000 7f75b653c640 1 --2- 172.21.15.44:0/2553534249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564578b9fb00 0x564577ea7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:34:27.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.064+0000 7f75b653c640 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564573dd74a0 con 0x564578b9ff80 2024-05-16T22:34:27.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.064+0000 7f75b753e640 1 --2- 172.21.15.44:0/2553534249 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x564578b9f680 0x564577ea7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T22:34:28.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.064+0000 7f75b6d3d640 1 --2- 172.21.15.44:0/2553534249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564578b9fb00 0x564577ea7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T22:34:28.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.065+0000 7f75b653c640 1 --2- 172.21.15.44:0/2553534249 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564578b9ff80 0x564577ea7b80 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x564578bbbc80 tx=0x564577ecb860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:28.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.065+0000 7f75b0d31640 1 -- 172.21.15.44:0/2553534249 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564573dc6b60 con 0x564578b9ff80 2024-05-16T22:34:28.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.065+0000 7f75b0d31640 1 -- 172.21.15.44:0/2553534249 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x564573dcce00 con 0x564578b9ff80 2024-05-16T22:34:28.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.065+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564573dd6780 con 0x564578b9ff80 2024-05-16T22:34:28.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.065+0000 7f75b0d31640 1 -- 172.21.15.44:0/2553534249 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564573dc6680 con 0x564578b9ff80 2024-05-16T22:34:28.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.065+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564573dd7680 con 0x564578b9ff80 2024-05-16T22:34:28.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.065+0000 7f75b8591280 4 main: JournalTool: resolving pool 6 2024-05-16T22:34:28.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.066+0000 7f75b0d31640 1 -- 172.21.15.44:0/2553534249 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x564578cf6c00 con 0x564578b9ff80 2024-05-16T22:34:28.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.067+0000 7f75b0d31640 1 --2- 172.21.15.44:0/2553534249 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x564578ba1600 0x564577ea8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:28.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.067+0000 7f75b0d31640 1 -- 172.21.15.44:0/2553534249 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5853+0+0 (secure 0 0 0) 0x564578d06200 con 0x564578b9ff80 2024-05-16T22:34:28.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.067+0000 7f75b8591280 4 main: JournalTool: creating IoCtx.. 2024-05-16T22:34:28.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.067+0000 7f75b8591280 4 main: Executing for rank 0 2024-05-16T22:34:28.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.067+0000 7f75b753e640 1 --2- 172.21.15.44:0/2553534249 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x564578ba1600 0x564577ea8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:28.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.067+0000 7f75b8591280 1 --2- 172.21.15.44:0/2553534249 >> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] conn(0x564578ba0400 0x564577ea8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:28.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.067+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578120000 con 0x564578ba0400 2024-05-16T22:34:28.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.067+0000 7f75b6d3d640 1 --2- 172.21.15.44:0/2553534249 >> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] conn(0x564578ba0400 0x564577ea8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:28.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.068+0000 7f75b753e640 1 --2- 172.21.15.44:0/2553534249 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x564578ba1600 0x564577ea8100 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x564577efcae0 tx=0x564577ecbc20 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:28.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.068+0000 7f75b6d3d640 1 --2- 172.21.15.44:0/2553534249 >> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] conn(0x564578ba0400 0x564577ea8680 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:28.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.068+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.2 v2:172.21.15.44:6800/2908194156 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x564577eba500 con 0x564578ba0400 2024-05-16T22:34:28.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.068+0000 7f75b8591280 4 Pointer 400.00000000 is readable 2024-05-16T22:34:28.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.068+0000 7f75b8591280 4 JournalScanner::scan: reading header object '200.00000000' 2024-05-16T22:34:28.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.068+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578120400 con 0x564578ba0400 2024-05-16T22:34:28.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.2 v2:172.21.15.44:6800/2908194156 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv24 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x564577eba500 con 0x564578ba0400 2024-05-16T22:34:28.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Header 0x400000 0x400000 0x4096fd 2024-05-16T22:34:28.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Starting journal scan from offset 0x400000 2024-05-16T22:34:28.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578120000 con 0x564578ba0400 2024-05-16T22:34:28.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.2 v2:172.21.15.44:6800/2908194156 3 ==== osd_op_reply(3 200.00000001 [read 0~51154 out=51154b] v0'0 uv29 ondisk = 0) ==== 156+0+51154 (crc 0 0 0) 0x564577eba500 con 0x564578ba0400 2024-05-16T22:34:29.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 4 Read 0xc7d2 bytes from 200.00000001 gap=0 2024-05-16T22:34:29.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Parsing data, 0xc7d2 bytes available 2024-05-16T22:34:29.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Attempting decode at 0x400000 2024-05-16T22:34:29.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Consumed 0x30 bytes 2024-05-16T22:34:29.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Valid entry at 0x400000 2024-05-16T22:34:29.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Attempting decode at 0x400030 2024-05-16T22:34:29.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Consumed 0x37c bytes 2024-05-16T22:34:29.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Valid entry at 0x400030 2024-05-16T22:34:29.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Attempting decode at 0x4003ac 2024-05-16T22:34:29.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Consumed 0x102 bytes 2024-05-16T22:34:29.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Valid entry at 0x4003ac 2024-05-16T22:34:29.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Attempting decode at 0x4004ae 2024-05-16T22:34:29.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Consumed 0xac bytes 2024-05-16T22:34:29.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Valid entry at 0x4004ae 2024-05-16T22:34:29.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Attempting decode at 0x40055a 2024-05-16T22:34:29.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Consumed 0x32f bytes 2024-05-16T22:34:29.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Valid entry at 0x40055a 2024-05-16T22:34:29.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Attempting decode at 0x400889 2024-05-16T22:34:29.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Consumed 0x823 bytes 2024-05-16T22:34:29.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Valid entry at 0x400889 2024-05-16T22:34:29.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Attempting decode at 0x4010ac 2024-05-16T22:34:29.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Consumed 0x95a bytes 2024-05-16T22:34:29.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Valid entry at 0x4010ac 2024-05-16T22:34:29.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Attempting decode at 0x401a06 2024-05-16T22:34:29.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Consumed 0x954 bytes 2024-05-16T22:34:29.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Valid entry at 0x401a06 2024-05-16T22:34:29.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Attempting decode at 0x40235a 2024-05-16T22:34:30.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Consumed 0x956 bytes 2024-05-16T22:34:30.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Valid entry at 0x40235a 2024-05-16T22:34:30.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Attempting decode at 0x402cb0 2024-05-16T22:34:30.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Consumed 0xa7f bytes 2024-05-16T22:34:30.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Valid entry at 0x402cb0 2024-05-16T22:34:30.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Attempting decode at 0x40372f 2024-05-16T22:34:30.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Consumed 0xba8 bytes 2024-05-16T22:34:30.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Valid entry at 0x40372f 2024-05-16T22:34:30.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Attempting decode at 0x4042d7 2024-05-16T22:34:30.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Consumed 0x472 bytes 2024-05-16T22:34:30.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Valid entry at 0x4042d7 2024-05-16T22:34:30.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Attempting decode at 0x404749 2024-05-16T22:34:30.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Consumed 0x808 bytes 2024-05-16T22:34:30.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Valid entry at 0x404749 2024-05-16T22:34:30.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Attempting decode at 0x404f51 2024-05-16T22:34:30.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Consumed 0xbbe bytes 2024-05-16T22:34:30.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Valid entry at 0x404f51 2024-05-16T22:34:30.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Attempting decode at 0x405b0f 2024-05-16T22:34:30.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Consumed 0x83b bytes 2024-05-16T22:34:30.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Valid entry at 0x405b0f 2024-05-16T22:34:30.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Attempting decode at 0x40634a 2024-05-16T22:34:30.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Consumed 0xaac bytes 2024-05-16T22:34:30.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Valid entry at 0x40634a 2024-05-16T22:34:30.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Attempting decode at 0x406df6 2024-05-16T22:34:30.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Consumed 0x83c bytes 2024-05-16T22:34:30.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Valid entry at 0x406df6 2024-05-16T22:34:30.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Attempting decode at 0x407632 2024-05-16T22:34:31.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Consumed 0x839 bytes 2024-05-16T22:34:31.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Valid entry at 0x407632 2024-05-16T22:34:31.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Attempting decode at 0x407e6b 2024-05-16T22:34:31.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Consumed 0xab8 bytes 2024-05-16T22:34:31.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Valid entry at 0x407e6b 2024-05-16T22:34:31.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Attempting decode at 0x408923 2024-05-16T22:34:31.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Consumed 0x6ed bytes 2024-05-16T22:34:31.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Valid entry at 0x408923 2024-05-16T22:34:31.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Attempting decode at 0x409010 2024-05-16T22:34:31.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Consumed 0x6ed bytes 2024-05-16T22:34:31.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Valid entry at 0x409010 2024-05-16T22:34:31.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Attempting decode at 0x4096fd 2024-05-16T22:34:31.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Consumed 0xa70 bytes 2024-05-16T22:34:31.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Valid entry at 0x4096fd 2024-05-16T22:34:31.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Attempting decode at 0x40a16d 2024-05-16T22:34:31.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Consumed 0x257 bytes 2024-05-16T22:34:31.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Valid entry at 0x40a16d 2024-05-16T22:34:31.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Attempting decode at 0x40a3c4 2024-05-16T22:34:31.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Consumed 0x673 bytes 2024-05-16T22:34:31.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Valid entry at 0x40a3c4 2024-05-16T22:34:31.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Attempting decode at 0x40aa37 2024-05-16T22:34:31.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Consumed 0x5b9 bytes 2024-05-16T22:34:31.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Valid entry at 0x40aa37 2024-05-16T22:34:31.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Attempting decode at 0x40aff0 2024-05-16T22:34:31.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Consumed 0x6b2 bytes 2024-05-16T22:34:31.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Valid entry at 0x40aff0 2024-05-16T22:34:32.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Attempting decode at 0x40b6a2 2024-05-16T22:34:32.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Consumed 0x472 bytes 2024-05-16T22:34:32.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Valid entry at 0x40b6a2 2024-05-16T22:34:32.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Attempting decode at 0x40bb14 2024-05-16T22:34:32.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Consumed 0xcbe bytes 2024-05-16T22:34:32.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 10 Valid entry at 0x40bb14 2024-05-16T22:34:32.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 1 --2- 172.21.15.44:0/2553534249 >> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] conn(0x564578ba0880 0x564577ea8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:32.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.069+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578120400 con 0x564578ba0880 2024-05-16T22:34:32.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.070+0000 7f75b753e640 1 --2- 172.21.15.44:0/2553534249 >> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] conn(0x564578ba0880 0x564577ea8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:32.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.070+0000 7f75b753e640 1 --2- 172.21.15.44:0/2553534249 >> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] conn(0x564578ba0880 0x564577ea8c00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:32.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.070+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:32.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.070+0000 7f75b8591280 4 Reached end of journal objects 2024-05-16T22:34:32.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.070+0000 7f75b8591280 4 Scanned objects, 0 missing, 1 valid 2024-05-16T22:34:32.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.070+0000 7f75b8591280 4 Events scanned, 0 gaps 2024-05-16T22:34:32.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.070+0000 7f75b8591280 4 Found 28 valid events 2024-05-16T22:34:32.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.070+0000 7f75b8591280 4 Selected 28 events events for processing 2024-05-16T22:34:32.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.070+0000 7f75b8591280 4 recover_dentries: inspecting lump 1.00000000 2024-05-16T22:34:32.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.070+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:5 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578120800 con 0x564578ba0880 2024-05-16T22:34:32.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.071+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 2 ==== osd_op_reply(5 1.00000000 [omap-get-header out=274b] v0'0 uv2 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:32.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.071+0000 7f75b8591280 4 recover_dentries: frag 1.00000000 fnode old v1 vs new v1 2024-05-16T22:34:32.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.071+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:6 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578120c00 con 0x564578ba0880 2024-05-16T22:34:32.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.071+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 3 ==== osd_op_reply(6 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv2 ondisk = 0) ==== 154+0+4 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:32.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.071+0000 7f75b8591280 4 recover_dentries: inspecting lump 100.00000000 2024-05-16T22:34:32.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.071+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:7 6.13 6:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578121000 con 0x564578ba0880 2024-05-16T22:34:32.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.071+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 4 ==== osd_op_reply(7 100.00000000 [omap-get-header out=274b] v0'0 uv1 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:32.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.071+0000 7f75b8591280 4 recover_dentries: frag 100.00000000 fnode old v1 vs new v1 2024-05-16T22:34:32.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.071+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:8 6.13 6:cd5a64a3:::100.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578121400 con 0x564578ba0880 2024-05-16T22:34:33.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.072+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 5 ==== osd_op_reply(8 100.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv1 ondisk = 0) ==== 156+0+4 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:33.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.072+0000 7f75b8591280 4 recover_dentries: updating root 0x0x1 2024-05-16T22:34:33.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.072+0000 7f75b8591280 4 recover_dentries: object id 1.00000000.inode 2024-05-16T22:34:33.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.072+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] -- osd_op(unknown.0.0:9 6.14 6:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578121800 con 0x564578ba0400 2024-05-16T22:34:33.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.072+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.2 v2:172.21.15.44:6800/2908194156 4 ==== osd_op_reply(9 1.00000000.inode [read 0~582 out=582b] v0'0 uv4 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x564577eba500 con 0x564578ba0400 2024-05-16T22:34:33.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.072+0000 7f75b8591280 4 recover_dentries: root exists, will modify (582) 2024-05-16T22:34:33.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.072+0000 7f75b8591280 4 recover_dentries: magic ok 2024-05-16T22:34:33.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.072+0000 7f75b8591280 4 recover_dentries: writing root ino 1.00000000.inode version 2 2024-05-16T22:34:33.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.072+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] -- osd_op(unknown.0.0:10 6.14 6:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578120400 con 0x564578ba0400 2024-05-16T22:34:33.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.074+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.2 v2:172.21.15.44:6800/2908194156 5 ==== osd_op_reply(10 1.00000000.inode [writefull 0~582] v51'30 uv30 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x564577eba500 con 0x564578ba0400 2024-05-16T22:34:33.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.074+0000 7f75b8591280 4 recover_dentries: inspecting lump 1.00000000 2024-05-16T22:34:33.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.074+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:11 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578120800 con 0x564578ba0880 2024-05-16T22:34:33.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.074+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 6 ==== osd_op_reply(11 1.00000000 [omap-get-header out=274b] v0'0 uv2 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:33.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.074+0000 7f75b8591280 4 recover_dentries: frag 1.00000000 fnode old v1 vs new v3 2024-05-16T22:34:33.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.074+0000 7f75b8591280 4 recover_dentries: writing fnode to omap header 2024-05-16T22:34:33.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.074+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:12 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578120c00 con 0x564578ba0880 2024-05-16T22:34:33.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.076+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 7 ==== osd_op_reply(12 1.00000000 [omap-set-header] v51'5 uv5 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:33.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.076+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:13 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=27b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578121000 con 0x564578ba0880 2024-05-16T22:34:33.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.076+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 8 ==== osd_op_reply(13 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv5 ondisk = 0) ==== 154+0+4 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:33.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.076+0000 7f75b8591280 4 recover_dentries: inspecting fullbit 1.00000000/.tmp2112225443 2024-05-16T22:34:33.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.076+0000 7f75b8591280 4 recover_dentries: dentry did not already exist, will create 2024-05-16T22:34:33.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.076+0000 7f75b8591280 4 recover_dentries: writing I dentry .tmp2112225443_head into frag 1.00000000 2024-05-16T22:34:33.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.076+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:14 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-vals in=576b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578121400 con 0x564578ba0880 2024-05-16T22:34:33.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.077+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 9 ==== osd_op_reply(14 1.00000000 [omap-set-vals] v51'6 uv6 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:33.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.077+0000 7f75b8591280 4 recover_dentries: inspecting lump 10000000000.00000000 2024-05-16T22:34:33.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.077+0000 7f75b8591280 1 --2- 172.21.15.44:0/2553534249 >> [v2:172.21.15.44:6824/1074109859,v1:172.21.15.44:6825/1074109859] conn(0x564578ba0d00 0x564577ea9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:33.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.077+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6824/1074109859,v1:172.21.15.44:6825/1074109859] -- osd_op(unknown.0.0:15 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578120000 con 0x564578ba0d00 2024-05-16T22:34:34.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.077+0000 7f75b6d3d640 1 --2- 172.21.15.44:0/2553534249 >> [v2:172.21.15.44:6824/1074109859,v1:172.21.15.44:6825/1074109859] conn(0x564578ba0d00 0x564577ea9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:34.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.078+0000 7f75b6d3d640 1 --2- 172.21.15.44:0/2553534249 >> [v2:172.21.15.44:6824/1074109859,v1:172.21.15.44:6825/1074109859] conn(0x564578ba0d00 0x564577ea9180 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:34.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.078+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.0 v2:172.21.15.44:6824/1074109859 1 ==== osd_op_reply(15 10000000000.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x564577eba500 con 0x564578ba0d00 2024-05-16T22:34:34.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.078+0000 7f75b8591280 4 recover_dentries: failed to read OMAP header from directory fragment 10000000000.00000000 (2) No such file or directory 2024-05-16T22:34:34.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.078+0000 7f75b8591280 4 recover_dentries: writing fnode to omap header 2024-05-16T22:34:34.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.078+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6824/1074109859,v1:172.21.15.44:6825/1074109859] -- osd_op(unknown.0.0:16 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578121800 con 0x564578ba0d00 2024-05-16T22:34:34.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.079+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.0 v2:172.21.15.44:6824/1074109859 2 ==== osd_op_reply(16 10000000000.00000000 [omap-set-header] v51'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x564577eba500 con 0x564578ba0d00 2024-05-16T22:34:34.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.079+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6824/1074109859,v1:172.21.15.44:6825/1074109859] -- osd_op(unknown.0.0:17 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578120400 con 0x564578ba0d00 2024-05-16T22:34:34.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.080+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.0 v2:172.21.15.44:6824/1074109859 3 ==== osd_op_reply(17 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv10 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x564577eba500 con 0x564578ba0d00 2024-05-16T22:34:34.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.080+0000 7f75b8591280 4 recover_dentries: updating root 0x0x1 2024-05-16T22:34:34.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.080+0000 7f75b8591280 4 recover_dentries: object id 1.00000000.inode 2024-05-16T22:34:34.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.080+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] -- osd_op(unknown.0.0:18 6.14 6:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578121c00 con 0x564578ba0400 2024-05-16T22:34:34.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.080+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.2 v2:172.21.15.44:6800/2908194156 6 ==== osd_op_reply(18 1.00000000.inode [read 0~582 out=582b] v0'0 uv30 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x564577eba500 con 0x564578ba0400 2024-05-16T22:34:34.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.080+0000 7f75b8591280 4 recover_dentries: root exists, will modify (582) 2024-05-16T22:34:34.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.080+0000 7f75b8591280 4 recover_dentries: magic ok 2024-05-16T22:34:34.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.080+0000 7f75b8591280 4 recover_dentries: writing root ino 1.00000000.inode version 3 2024-05-16T22:34:34.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.080+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] -- osd_op(unknown.0.0:19 6.14 6:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578120000 con 0x564578ba0400 2024-05-16T22:34:34.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.081+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.2 v2:172.21.15.44:6800/2908194156 7 ==== osd_op_reply(19 1.00000000.inode [writefull 0~582] v51'31 uv31 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x564577eba500 con 0x564578ba0400 2024-05-16T22:34:34.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.081+0000 7f75b8591280 4 recover_dentries: inspecting lump 1.00000000 2024-05-16T22:34:34.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.081+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:20 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578121800 con 0x564578ba0880 2024-05-16T22:34:34.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.082+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 10 ==== osd_op_reply(20 1.00000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:34.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.082+0000 7f75b8591280 4 recover_dentries: frag 1.00000000 fnode old v3 vs new v5 2024-05-16T22:34:34.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.082+0000 7f75b8591280 4 recover_dentries: writing fnode to omap header 2024-05-16T22:34:34.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.082+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:21 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578120400 con 0x564578ba0880 2024-05-16T22:34:34.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.083+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 11 ==== osd_op_reply(21 1.00000000 [omap-set-header] v51'7 uv7 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:34.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.083+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:22 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=27b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578121c00 con 0x564578ba0880 2024-05-16T22:34:35.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.083+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 12 ==== osd_op_reply(22 1.00000000 [omap-get-vals-by-keys out=576b] v0'0 uv7 ondisk = 0) ==== 154+0+576 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:35.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.083+0000 7f75b8591280 4 recover_dentries: inspecting fullbit 1.00000000/.tmp2112225443 2024-05-16T22:34:35.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.083+0000 7f75b8591280 4 recover_dentries: dentry .tmp2112225443_head existed already 2024-05-16T22:34:35.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.083+0000 7f75b8591280 4 recover_dentries: dentry exists, checking versions... 2024-05-16T22:34:35.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.083+0000 7f75b8591280 4 recover_dentries: decoded embedded inode version 2 vs fullbit version 4 2024-05-16T22:34:35.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.083+0000 7f75b8591280 4 recover_dentries: writing I dentry .tmp2112225443_head into frag 1.00000000 2024-05-16T22:34:35.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.083+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:23 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-vals in=576b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578120800 con 0x564578ba0880 2024-05-16T22:34:35.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.085+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 13 ==== osd_op_reply(23 1.00000000 [omap-set-vals] v51'8 uv8 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:35.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.085+0000 7f75b8591280 4 recover_dentries: inspecting lump 10000000000.00000000 2024-05-16T22:34:35.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.085+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6824/1074109859,v1:172.21.15.44:6825/1074109859] -- osd_op(unknown.0.0:24 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578120c00 con 0x564578ba0d00 2024-05-16T22:34:35.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.085+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.0 v2:172.21.15.44:6824/1074109859 4 ==== osd_op_reply(24 10000000000.00000000 [omap-get-header out=274b] v0'0 uv10 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x564577eba500 con 0x564578ba0d00 2024-05-16T22:34:35.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.085+0000 7f75b8591280 4 recover_dentries: frag 10000000000.00000000 fnode old v1 vs new v3 2024-05-16T22:34:35.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.085+0000 7f75b8591280 4 recover_dentries: writing fnode to omap header 2024-05-16T22:34:35.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.085+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6824/1074109859,v1:172.21.15.44:6825/1074109859] -- osd_op(unknown.0.0:25 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578121000 con 0x564578ba0d00 2024-05-16T22:34:35.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.086+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.0 v2:172.21.15.44:6824/1074109859 5 ==== osd_op_reply(25 10000000000.00000000 [omap-set-header] v51'11 uv11 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x564577eba500 con 0x564578ba0d00 2024-05-16T22:34:35.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.086+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6824/1074109859,v1:172.21.15.44:6825/1074109859] -- osd_op(unknown.0.0:26 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578121400 con 0x564578ba0d00 2024-05-16T22:34:35.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.087+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.0 v2:172.21.15.44:6824/1074109859 6 ==== osd_op_reply(26 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv11 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x564577eba500 con 0x564578ba0d00 2024-05-16T22:34:35.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.087+0000 7f75b8591280 4 recover_dentries: inspecting fullbit 10000000000.00000000/.fscrypt 2024-05-16T22:34:35.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.087+0000 7f75b8591280 4 recover_dentries: dentry did not already exist, will create 2024-05-16T22:34:35.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.087+0000 7f75b8591280 4 recover_dentries: writing I dentry .fscrypt_head into frag 10000000000.00000000 2024-05-16T22:34:35.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.087+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6824/1074109859,v1:172.21.15.44:6825/1074109859] -- osd_op(unknown.0.0:27 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=570b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578121800 con 0x564578ba0d00 2024-05-16T22:34:35.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.088+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.0 v2:172.21.15.44:6824/1074109859 7 ==== osd_op_reply(27 10000000000.00000000 [omap-set-vals] v51'12 uv12 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x564577eba500 con 0x564578ba0d00 2024-05-16T22:34:35.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.088+0000 7f75b8591280 4 recover_dentries: inspecting lump 10000000001.00000000 2024-05-16T22:34:35.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.088+0000 7f75b8591280 1 --2- 172.21.15.44:0/2553534249 >> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] conn(0x564578ba1180 0x564577ea9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:35.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.088+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] -- osd_op(unknown.0.0:28 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578120400 con 0x564578ba1180 2024-05-16T22:34:35.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.088+0000 7f75b653c640 1 --2- 172.21.15.44:0/2553534249 >> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] conn(0x564578ba1180 0x564577ea9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:35.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.088+0000 7f75b653c640 1 --2- 172.21.15.44:0/2553534249 >> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] conn(0x564578ba1180 0x564577ea9700 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:36.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.089+0000 7f75b653c640 1 -- 172.21.15.44:0/2553534249 <== osd.5 v2:172.21.15.70:6802/4218901987 1 ==== osd_op_reply(28 10000000001.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x5645781c9680 con 0x564578ba1180 2024-05-16T22:34:36.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.089+0000 7f75b8591280 4 recover_dentries: failed to read OMAP header from directory fragment 10000000001.00000000 (2) No such file or directory 2024-05-16T22:34:36.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.089+0000 7f75b8591280 4 recover_dentries: writing fnode to omap header 2024-05-16T22:34:36.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.089+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] -- osd_op(unknown.0.0:29 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578120000 con 0x564578ba1180 2024-05-16T22:34:36.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.090+0000 7f75b653c640 1 -- 172.21.15.44:0/2553534249 <== osd.5 v2:172.21.15.70:6802/4218901987 2 ==== osd_op_reply(29 10000000001.00000000 [omap-set-header] v51'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5645781c9680 con 0x564578ba1180 2024-05-16T22:34:36.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.090+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] -- osd_op(unknown.0.0:30 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578120c00 con 0x564578ba1180 2024-05-16T22:34:36.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.091+0000 7f75b653c640 1 -- 172.21.15.44:0/2553534249 <== osd.5 v2:172.21.15.70:6802/4218901987 3 ==== osd_op_reply(30 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv3 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x5645781c9680 con 0x564578ba1180 2024-05-16T22:34:36.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.091+0000 7f75b8591280 4 recover_dentries: inspecting lump 10000000000.00000000 2024-05-16T22:34:36.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.091+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6824/1074109859,v1:172.21.15.44:6825/1074109859] -- osd_op(unknown.0.0:31 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578121000 con 0x564578ba0d00 2024-05-16T22:34:36.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.091+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.0 v2:172.21.15.44:6824/1074109859 8 ==== osd_op_reply(31 10000000000.00000000 [omap-get-header out=274b] v0'0 uv12 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x564577eba500 con 0x564578ba0d00 2024-05-16T22:34:36.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.091+0000 7f75b8591280 4 recover_dentries: frag 10000000000.00000000 fnode old v3 vs new v5 2024-05-16T22:34:36.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.091+0000 7f75b8591280 4 recover_dentries: writing fnode to omap header 2024-05-16T22:34:36.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.091+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6824/1074109859,v1:172.21.15.44:6825/1074109859] -- osd_op(unknown.0.0:32 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578121400 con 0x564578ba0d00 2024-05-16T22:34:36.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.092+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.0 v2:172.21.15.44:6824/1074109859 9 ==== osd_op_reply(32 10000000000.00000000 [omap-set-header] v51'13 uv13 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x564577eba500 con 0x564578ba0d00 2024-05-16T22:34:36.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.092+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6824/1074109859,v1:172.21.15.44:6825/1074109859] -- osd_op(unknown.0.0:33 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578121800 con 0x564578ba0d00 2024-05-16T22:34:36.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.092+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.0 v2:172.21.15.44:6824/1074109859 10 ==== osd_op_reply(33 10000000000.00000000 [omap-get-vals-by-keys out=570b] v0'0 uv13 ondisk = 0) ==== 164+0+570 (crc 0 0 0) 0x564577eba500 con 0x564578ba0d00 2024-05-16T22:34:36.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.092+0000 7f75b8591280 4 recover_dentries: inspecting fullbit 10000000000.00000000/.fscrypt 2024-05-16T22:34:36.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.092+0000 7f75b8591280 4 recover_dentries: dentry .fscrypt_head existed already 2024-05-16T22:34:36.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.092+0000 7f75b8591280 4 recover_dentries: dentry exists, checking versions... 2024-05-16T22:34:36.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.092+0000 7f75b8591280 4 recover_dentries: decoded embedded inode version 2 vs fullbit version 4 2024-05-16T22:34:36.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.092+0000 7f75b8591280 4 recover_dentries: writing I dentry .fscrypt_head into frag 10000000000.00000000 2024-05-16T22:34:36.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.092+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6824/1074109859,v1:172.21.15.44:6825/1074109859] -- osd_op(unknown.0.0:34 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=570b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x5645781e2000 con 0x564578ba0d00 2024-05-16T22:34:36.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.094+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.0 v2:172.21.15.44:6824/1074109859 11 ==== osd_op_reply(34 10000000000.00000000 [omap-set-vals] v51'14 uv14 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x564577eba500 con 0x564578ba0d00 2024-05-16T22:34:36.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.094+0000 7f75b8591280 4 recover_dentries: inspecting lump 10000000001.00000000 2024-05-16T22:34:36.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.094+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] -- osd_op(unknown.0.0:35 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x5645781e2400 con 0x564578ba1180 2024-05-16T22:34:36.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.094+0000 7f75b653c640 1 -- 172.21.15.44:0/2553534249 <== osd.5 v2:172.21.15.70:6802/4218901987 4 ==== osd_op_reply(35 10000000001.00000000 [omap-get-header out=274b] v0'0 uv3 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5645781c9680 con 0x564578ba1180 2024-05-16T22:34:37.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.094+0000 7f75b8591280 4 recover_dentries: frag 10000000001.00000000 fnode old v1 vs new v3 2024-05-16T22:34:37.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.094+0000 7f75b8591280 4 recover_dentries: writing fnode to omap header 2024-05-16T22:34:37.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.094+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] -- osd_op(unknown.0.0:36 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x5645781e2800 con 0x564578ba1180 2024-05-16T22:34:37.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.095+0000 7f75b653c640 1 -- 172.21.15.44:0/2553534249 <== osd.5 v2:172.21.15.70:6802/4218901987 5 ==== osd_op_reply(36 10000000001.00000000 [omap-set-header] v51'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5645781c9680 con 0x564578ba1180 2024-05-16T22:34:37.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.095+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] -- osd_op(unknown.0.0:37 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x5645781e2c00 con 0x564578ba1180 2024-05-16T22:34:37.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.096+0000 7f75b653c640 1 -- 172.21.15.44:0/2553534249 <== osd.5 v2:172.21.15.70:6802/4218901987 6 ==== osd_op_reply(37 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv4 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x5645781c9680 con 0x564578ba1180 2024-05-16T22:34:37.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.096+0000 7f75b8591280 4 recover_dentries: inspecting fullbit 10000000001.00000000/policies 2024-05-16T22:34:37.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.096+0000 7f75b8591280 4 recover_dentries: dentry did not already exist, will create 2024-05-16T22:34:37.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.096+0000 7f75b8591280 4 recover_dentries: writing I dentry policies_head into frag 10000000001.00000000 2024-05-16T22:34:37.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.096+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] -- osd_op(unknown.0.0:38 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-vals in=570b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x5645781e3000 con 0x564578ba1180 2024-05-16T22:34:37.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.097+0000 7f75b653c640 1 -- 172.21.15.44:0/2553534249 <== osd.5 v2:172.21.15.70:6802/4218901987 7 ==== osd_op_reply(38 10000000001.00000000 [omap-set-vals] v51'5 uv5 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5645781c9680 con 0x564578ba1180 2024-05-16T22:34:37.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.097+0000 7f75b8591280 4 recover_dentries: inspecting lump 10000000002.00000000 2024-05-16T22:34:37.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.097+0000 7f75b8591280 1 --2- 172.21.15.44:0/2553534249 >> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] conn(0x564578ba1a80 0x5645781e4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:34:37.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.097+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] -- osd_op(unknown.0.0:39 6.12 6:4bec3886:::10000000002.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x5645781e3400 con 0x564578ba1a80 2024-05-16T22:34:37.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.097+0000 7f75b753e640 1 --2- 172.21.15.44:0/2553534249 >> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] conn(0x564578ba1a80 0x5645781e4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:34:37.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.098+0000 7f75b753e640 1 --2- 172.21.15.44:0/2553534249 >> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] conn(0x564578ba1a80 0x5645781e4000 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:34:37.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.098+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.7 v2:172.21.15.70:6816/3619691281 1 ==== osd_op_reply(39 10000000002.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x5645781c9400 con 0x564578ba1a80 2024-05-16T22:34:37.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.098+0000 7f75b8591280 4 recover_dentries: failed to read OMAP header from directory fragment 10000000002.00000000 (2) No such file or directory 2024-05-16T22:34:37.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.098+0000 7f75b8591280 4 recover_dentries: writing fnode to omap header 2024-05-16T22:34:37.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.098+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] -- osd_op(unknown.0.0:40 6.12 6:4bec3886:::10000000002.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x5645781e3800 con 0x564578ba1a80 2024-05-16T22:34:37.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.099+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.7 v2:172.21.15.70:6816/3619691281 2 ==== osd_op_reply(40 10000000002.00000000 [omap-set-header] v51'1 uv1 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5645781c9400 con 0x564578ba1a80 2024-05-16T22:34:37.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.099+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] -- osd_op(unknown.0.0:41 6.12 6:4bec3886:::10000000002.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x5645781e3c00 con 0x564578ba1a80 2024-05-16T22:34:37.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.100+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.7 v2:172.21.15.70:6816/3619691281 3 ==== osd_op_reply(41 10000000002.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv1 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x5645781c9400 con 0x564578ba1a80 2024-05-16T22:34:37.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.100+0000 7f75b8591280 4 recover_dentries: inspecting lump 10000000000.00000000 2024-05-16T22:34:37.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.100+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6824/1074109859,v1:172.21.15.44:6825/1074109859] -- osd_op(unknown.0.0:42 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x5645781e2400 con 0x564578ba0d00 2024-05-16T22:34:37.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.100+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.0 v2:172.21.15.44:6824/1074109859 12 ==== osd_op_reply(42 10000000000.00000000 [omap-get-header out=274b] v0'0 uv14 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x564577eba500 con 0x564578ba0d00 2024-05-16T22:34:37.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.100+0000 7f75b8591280 4 recover_dentries: frag 10000000000.00000000 fnode old v5 vs new v7 2024-05-16T22:34:38.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.100+0000 7f75b8591280 4 recover_dentries: writing fnode to omap header 2024-05-16T22:34:38.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.100+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6824/1074109859,v1:172.21.15.44:6825/1074109859] -- osd_op(unknown.0.0:43 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x5645781e2800 con 0x564578ba0d00 2024-05-16T22:34:38.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.101+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.0 v2:172.21.15.44:6824/1074109859 13 ==== osd_op_reply(43 10000000000.00000000 [omap-set-header] v51'15 uv15 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x564577eba500 con 0x564578ba0d00 2024-05-16T22:34:38.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.101+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6824/1074109859,v1:172.21.15.44:6825/1074109859] -- osd_op(unknown.0.0:44 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x5645781e2c00 con 0x564578ba0d00 2024-05-16T22:34:38.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.101+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.0 v2:172.21.15.44:6824/1074109859 14 ==== osd_op_reply(44 10000000000.00000000 [omap-get-vals-by-keys out=570b] v0'0 uv15 ondisk = 0) ==== 164+0+570 (crc 0 0 0) 0x564577eba500 con 0x564578ba0d00 2024-05-16T22:34:38.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.101+0000 7f75b8591280 4 recover_dentries: inspecting fullbit 10000000000.00000000/.fscrypt 2024-05-16T22:34:38.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.101+0000 7f75b8591280 4 recover_dentries: dentry .fscrypt_head existed already 2024-05-16T22:34:38.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.101+0000 7f75b8591280 4 recover_dentries: dentry exists, checking versions... 2024-05-16T22:34:38.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.101+0000 7f75b8591280 4 recover_dentries: decoded embedded inode version 4 vs fullbit version 6 2024-05-16T22:34:38.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.101+0000 7f75b8591280 4 recover_dentries: writing I dentry .fscrypt_head into frag 10000000000.00000000 2024-05-16T22:34:38.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.101+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6824/1074109859,v1:172.21.15.44:6825/1074109859] -- osd_op(unknown.0.0:45 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=570b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578120400 con 0x564578ba0d00 2024-05-16T22:34:38.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.103+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.0 v2:172.21.15.44:6824/1074109859 15 ==== osd_op_reply(45 10000000000.00000000 [omap-set-vals] v51'16 uv16 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x564577eba500 con 0x564578ba0d00 2024-05-16T22:34:38.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.103+0000 7f75b8591280 4 recover_dentries: inspecting lump 10000000001.00000000 2024-05-16T22:34:38.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.103+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] -- osd_op(unknown.0.0:46 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578120000 con 0x564578ba1180 2024-05-16T22:34:38.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.103+0000 7f75b653c640 1 -- 172.21.15.44:0/2553534249 <== osd.5 v2:172.21.15.70:6802/4218901987 8 ==== osd_op_reply(46 10000000001.00000000 [omap-get-header out=274b] v0'0 uv5 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5645781c9680 con 0x564578ba1180 2024-05-16T22:34:38.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.103+0000 7f75b8591280 4 recover_dentries: frag 10000000001.00000000 fnode old v3 vs new v5 2024-05-16T22:34:38.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.103+0000 7f75b8591280 4 recover_dentries: writing fnode to omap header 2024-05-16T22:34:38.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.103+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] -- osd_op(unknown.0.0:47 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578120c00 con 0x564578ba1180 2024-05-16T22:34:38.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.104+0000 7f75b653c640 1 -- 172.21.15.44:0/2553534249 <== osd.5 v2:172.21.15.70:6802/4218901987 9 ==== osd_op_reply(47 10000000001.00000000 [omap-set-header] v51'6 uv6 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5645781c9680 con 0x564578ba1180 2024-05-16T22:34:38.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.104+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] -- osd_op(unknown.0.0:48 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x5645781e2000 con 0x564578ba1180 2024-05-16T22:34:38.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.104+0000 7f75b653c640 1 -- 172.21.15.44:0/2553534249 <== osd.5 v2:172.21.15.70:6802/4218901987 10 ==== osd_op_reply(48 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv6 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x5645781c9680 con 0x564578ba1180 2024-05-16T22:34:38.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.105+0000 7f75b8591280 4 recover_dentries: inspecting fullbit 10000000001.00000000/protectors 2024-05-16T22:34:38.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.105+0000 7f75b8591280 4 recover_dentries: dentry did not already exist, will create 2024-05-16T22:34:38.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.105+0000 7f75b8591280 4 recover_dentries: writing I dentry protectors_head into frag 10000000001.00000000 2024-05-16T22:34:38.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.105+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] -- osd_op(unknown.0.0:49 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-vals in=572b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x5645781e2400 con 0x564578ba1180 2024-05-16T22:34:38.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.106+0000 7f75b653c640 1 -- 172.21.15.44:0/2553534249 <== osd.5 v2:172.21.15.70:6802/4218901987 11 ==== osd_op_reply(49 10000000001.00000000 [omap-set-vals] v51'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5645781c9680 con 0x564578ba1180 2024-05-16T22:34:38.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.106+0000 7f75b8591280 4 recover_dentries: inspecting lump 10000000003.00000000 2024-05-16T22:34:38.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.106+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] -- osd_op(unknown.0.0:50 6.12 6:4def72d4:::10000000003.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x5645781e2800 con 0x564578ba1a80 2024-05-16T22:34:39.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.106+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.7 v2:172.21.15.70:6816/3619691281 4 ==== osd_op_reply(50 10000000003.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x5645781c9400 con 0x564578ba1a80 2024-05-16T22:34:39.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.106+0000 7f75b8591280 4 recover_dentries: failed to read OMAP header from directory fragment 10000000003.00000000 (2) No such file or directory 2024-05-16T22:34:39.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.106+0000 7f75b8591280 4 recover_dentries: writing fnode to omap header 2024-05-16T22:34:39.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.106+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] -- osd_op(unknown.0.0:51 6.12 6:4def72d4:::10000000003.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578121000 con 0x564578ba1a80 2024-05-16T22:34:39.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.107+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.7 v2:172.21.15.70:6816/3619691281 5 ==== osd_op_reply(51 10000000003.00000000 [omap-set-header] v51'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5645781c9400 con 0x564578ba1a80 2024-05-16T22:34:39.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.107+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] -- osd_op(unknown.0.0:52 6.12 6:4def72d4:::10000000003.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578121400 con 0x564578ba1a80 2024-05-16T22:34:39.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.108+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.7 v2:172.21.15.70:6816/3619691281 6 ==== osd_op_reply(52 10000000003.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv2 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x5645781c9400 con 0x564578ba1a80 2024-05-16T22:34:39.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.108+0000 7f75b8591280 4 recover_dentries: inspecting lump 1.00000000 2024-05-16T22:34:39.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.108+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:53 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578121800 con 0x564578ba0880 2024-05-16T22:34:39.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.108+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 14 ==== osd_op_reply(53 1.00000000 [omap-get-header out=274b] v0'0 uv8 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:39.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.108+0000 7f75b8591280 4 recover_dentries: frag 1.00000000 fnode old v5 vs new v10 2024-05-16T22:34:39.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.108+0000 7f75b8591280 4 recover_dentries: writing fnode to omap header 2024-05-16T22:34:39.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.108+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:54 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578121c00 con 0x564578ba0880 2024-05-16T22:34:39.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.109+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 15 ==== osd_op_reply(54 1.00000000 [omap-set-header] v51'9 uv9 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:39.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.109+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:55 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=44b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578120800 con 0x564578ba0880 2024-05-16T22:34:39.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.109+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 16 ==== osd_op_reply(55 1.00000000 [omap-get-vals-by-keys out=576b] v0'0 uv9 ondisk = 0) ==== 154+0+576 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:39.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.110+0000 7f75b8591280 4 recover_dentries: inspecting fullbit 1.00000000/.tmp2112225443 2024-05-16T22:34:39.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.110+0000 7f75b8591280 4 recover_dentries: dentry .tmp2112225443_head existed already 2024-05-16T22:34:39.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.110+0000 7f75b8591280 4 recover_dentries: dentry exists, checking versions... 2024-05-16T22:34:39.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.110+0000 7f75b8591280 4 recover_dentries: decoded embedded inode version 4 vs fullbit version 8 2024-05-16T22:34:39.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.110+0000 7f75b8591280 4 recover_dentries: writing I dentry .tmp2112225443_head into frag 1.00000000 2024-05-16T22:34:39.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.110+0000 7f75b8591280 4 recover_dentries: inspecting fullbit 1.00000000/.fscrypt 2024-05-16T22:34:39.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.110+0000 7f75b8591280 4 recover_dentries: dentry did not already exist, will create 2024-05-16T22:34:39.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.110+0000 7f75b8591280 4 recover_dentries: writing I dentry .fscrypt_head into frag 1.00000000 2024-05-16T22:34:39.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.110+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:56 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-vals in=1142b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578121000 con 0x564578ba0880 2024-05-16T22:34:39.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.112+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 17 ==== osd_op_reply(56 1.00000000 [omap-set-vals] v51'10 uv10 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:39.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.112+0000 7f75b8591280 4 recover_dentries: inspecting lump 10000000000.00000000 2024-05-16T22:34:39.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.112+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6824/1074109859,v1:172.21.15.44:6825/1074109859] -- osd_op(unknown.0.0:57 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x5645781e3400 con 0x564578ba0d00 2024-05-16T22:34:40.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.112+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.0 v2:172.21.15.44:6824/1074109859 16 ==== osd_op_reply(57 10000000000.00000000 [omap-get-header out=274b] v0'0 uv16 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x564577eba500 con 0x564578ba0d00 2024-05-16T22:34:40.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.112+0000 7f75b8591280 4 recover_dentries: frag 10000000000.00000000 fnode old v7 vs new v9 2024-05-16T22:34:40.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.112+0000 7f75b8591280 4 recover_dentries: writing fnode to omap header 2024-05-16T22:34:40.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.112+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6824/1074109859,v1:172.21.15.44:6825/1074109859] -- osd_op(unknown.0.0:58 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x5645781e3800 con 0x564578ba0d00 2024-05-16T22:34:40.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.113+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.0 v2:172.21.15.44:6824/1074109859 17 ==== osd_op_reply(58 10000000000.00000000 [omap-set-header] v51'17 uv17 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x564577eba500 con 0x564578ba0d00 2024-05-16T22:34:40.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.113+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6824/1074109859,v1:172.21.15.44:6825/1074109859] -- osd_op(unknown.0.0:59 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x5645781e3c00 con 0x564578ba0d00 2024-05-16T22:34:40.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.113+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.0 v2:172.21.15.44:6824/1074109859 18 ==== osd_op_reply(59 10000000000.00000000 [omap-get-vals-by-keys out=570b] v0'0 uv17 ondisk = 0) ==== 164+0+570 (crc 0 0 0) 0x564577eba500 con 0x564578ba0d00 2024-05-16T22:34:40.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.113+0000 7f75b8591280 4 recover_dentries: inspecting nullbit 10000000000.00000000/.fscrypt 2024-05-16T22:34:40.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.113+0000 7f75b8591280 4 recover_dentries: dentry exists, will remove 2024-05-16T22:34:40.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.113+0000 7f75b8591280 10 recover_dentries: Existing full inode in slot to be (maybe) removed by null journal dn '.fscrypt' with lump fnode version 9vs existing fnode version 7 2024-05-16T22:34:40.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.113+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6824/1074109859,v1:172.21.15.44:6825/1074109859] -- osd_op(unknown.0.0:60 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-rm-keys in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x5645781e2800 con 0x564578ba0d00 2024-05-16T22:34:40.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.115+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.0 v2:172.21.15.44:6824/1074109859 19 ==== osd_op_reply(60 10000000000.00000000 [omap-rm-keys] v51'18 uv18 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x564577eba500 con 0x564578ba0d00 2024-05-16T22:34:40.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.115+0000 7f75b8591280 4 recover_dentries: updating root 0x0x1 2024-05-16T22:34:40.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.115+0000 7f75b8591280 4 recover_dentries: object id 1.00000000.inode 2024-05-16T22:34:40.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.115+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] -- osd_op(unknown.0.0:61 6.14 6:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x5645781f6000 con 0x564578ba0400 2024-05-16T22:34:40.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.115+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.2 v2:172.21.15.44:6800/2908194156 8 ==== osd_op_reply(61 1.00000000.inode [read 0~582 out=582b] v0'0 uv31 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x564577eba500 con 0x564578ba0400 2024-05-16T22:34:40.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.115+0000 7f75b8591280 4 recover_dentries: root exists, will modify (582) 2024-05-16T22:34:40.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.115+0000 7f75b8591280 4 recover_dentries: magic ok 2024-05-16T22:34:40.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.115+0000 7f75b8591280 4 recover_dentries: writing root ino 1.00000000.inode version 4 2024-05-16T22:34:40.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.115+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] -- osd_op(unknown.0.0:62 6.14 6:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x5645781f6400 con 0x564578ba0400 2024-05-16T22:34:40.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.116+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.2 v2:172.21.15.44:6800/2908194156 9 ==== osd_op_reply(62 1.00000000.inode [writefull 0~582] v51'32 uv32 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x564577eba500 con 0x564578ba0400 2024-05-16T22:34:40.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.116+0000 7f75b8591280 4 recover_dentries: inspecting lump 1.00000000 2024-05-16T22:34:40.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.116+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:63 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x5645781f6800 con 0x564578ba0880 2024-05-16T22:34:40.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.117+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 18 ==== osd_op_reply(63 1.00000000 [omap-get-header out=274b] v0'0 uv10 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:40.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.117+0000 7f75b8591280 4 recover_dentries: frag 1.00000000 fnode old v10 vs new v12 2024-05-16T22:34:40.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.117+0000 7f75b8591280 4 recover_dentries: writing fnode to omap header 2024-05-16T22:34:40.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.117+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:64 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x5645781f6c00 con 0x564578ba0880 2024-05-16T22:34:41.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.118+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 19 ==== osd_op_reply(64 1.00000000 [omap-set-header] v51'11 uv11 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:41.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.118+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:65 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=27b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x5645781f7000 con 0x564578ba0880 2024-05-16T22:34:41.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.118+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 20 ==== osd_op_reply(65 1.00000000 [omap-get-vals-by-keys out=576b] v0'0 uv11 ondisk = 0) ==== 154+0+576 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:41.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.118+0000 7f75b8591280 4 recover_dentries: inspecting nullbit 1.00000000/.tmp2112225443 2024-05-16T22:34:41.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.118+0000 7f75b8591280 4 recover_dentries: dentry exists, will remove 2024-05-16T22:34:41.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.118+0000 7f75b8591280 10 recover_dentries: Existing full inode in slot to be (maybe) removed by null journal dn '.tmp2112225443' with lump fnode version 12vs existing fnode version 10 2024-05-16T22:34:41.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.118+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:66 6.1f 6:ff5b34d6:::1.00000000:head [omap-rm-keys in=27b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x5645781f7400 con 0x564578ba0880 2024-05-16T22:34:41.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.119+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 21 ==== osd_op_reply(66 1.00000000 [omap-rm-keys] v51'12 uv12 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:41.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.119+0000 7f75b8591280 4 recover_dentries: inspecting lump 100.00000000 2024-05-16T22:34:41.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.119+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:67 6.13 6:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x5645781f7800 con 0x564578ba0880 2024-05-16T22:34:41.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.119+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 22 ==== osd_op_reply(67 100.00000000 [omap-get-header out=274b] v0'0 uv1 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:41.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.119+0000 7f75b8591280 4 recover_dentries: frag 100.00000000 fnode old v1 vs new v3 2024-05-16T22:34:41.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.119+0000 7f75b8591280 4 recover_dentries: writing fnode to omap header 2024-05-16T22:34:41.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.119+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:68 6.13 6:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x5645781f7c00 con 0x564578ba0880 2024-05-16T22:34:41.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.121+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 23 ==== osd_op_reply(68 100.00000000 [omap-set-header] v51'3 uv3 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:41.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.121+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:69 6.13 6:cd5a64a3:::100.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x5645781f6800 con 0x564578ba0880 2024-05-16T22:34:41.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.122+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 24 ==== osd_op_reply(69 100.00000000 [omap-get-vals-by-keys out=523b] v0'0 uv3 ondisk = 0) ==== 156+0+523 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:41.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.122+0000 7f75b8591280 4 recover_dentries: inspecting fullbit 100.00000000/stray2 2024-05-16T22:34:41.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.122+0000 7f75b8591280 4 recover_dentries: dentry stray2_head existed already 2024-05-16T22:34:41.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.122+0000 7f75b8591280 4 recover_dentries: dentry exists, checking versions... 2024-05-16T22:34:41.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.122+0000 7f75b8591280 4 recover_dentries: decoded embedded inode version 1 vs fullbit version 2 2024-05-16T22:34:41.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.122+0000 7f75b8591280 4 recover_dentries: writing I dentry stray2_head into frag 100.00000000 2024-05-16T22:34:41.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.122+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:70 6.13 6:cd5a64a3:::100.00000000:head [omap-set-vals in=507b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x5645781f6c00 con 0x564578ba0880 2024-05-16T22:34:41.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.123+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 25 ==== osd_op_reply(70 100.00000000 [omap-set-vals] v51'4 uv4 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:41.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.123+0000 7f75b8591280 4 recover_dentries: inspecting lump 602.00000000 2024-05-16T22:34:41.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.123+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6824/1074109859,v1:172.21.15.44:6825/1074109859] -- osd_op(unknown.0.0:71 6.10 6:0bd6d154:::602.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x5645781f7000 con 0x564578ba0d00 2024-05-16T22:34:41.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.123+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.0 v2:172.21.15.44:6824/1074109859 20 ==== osd_op_reply(71 602.00000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x564577eba500 con 0x564578ba0d00 2024-05-16T22:34:41.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.123+0000 7f75b8591280 4 recover_dentries: frag 602.00000000 fnode old v1 vs new v10 2024-05-16T22:34:42.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.123+0000 7f75b8591280 4 recover_dentries: writing fnode to omap header 2024-05-16T22:34:42.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.123+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6824/1074109859,v1:172.21.15.44:6825/1074109859] -- osd_op(unknown.0.0:72 6.10 6:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x5645781f6000 con 0x564578ba0d00 2024-05-16T22:34:42.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.125+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.0 v2:172.21.15.44:6824/1074109859 21 ==== osd_op_reply(72 602.00000000 [omap-set-header] v51'19 uv19 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x564577eba500 con 0x564578ba0d00 2024-05-16T22:34:42.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.125+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6824/1074109859,v1:172.21.15.44:6825/1074109859] -- osd_op(unknown.0.0:73 6.10 6:0bd6d154:::602.00000000:head [omap-get-vals-by-keys in=24b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x5645781e2c00 con 0x564578ba0d00 2024-05-16T22:34:42.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.126+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.0 v2:172.21.15.44:6824/1074109859 22 ==== osd_op_reply(73 602.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv19 ondisk = 0) ==== 156+0+4 (crc 0 0 0) 0x564577eba500 con 0x564578ba0d00 2024-05-16T22:34:42.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.126+0000 7f75b8591280 4 recover_dentries: inspecting fullbit 602.00000000/10000000000 2024-05-16T22:34:42.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.126+0000 7f75b8591280 4 recover_dentries: dentry did not already exist, will create 2024-05-16T22:34:42.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.126+0000 7f75b8591280 4 recover_dentries: writing I dentry 10000000000_head into frag 602.00000000 2024-05-16T22:34:42.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.126+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6824/1074109859,v1:172.21.15.44:6825/1074109859] -- osd_op(unknown.0.0:74 6.10 6:0bd6d154:::602.00000000:head [omap-set-vals in=588b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x5645781e3400 con 0x564578ba0d00 2024-05-16T22:34:42.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.127+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.0 v2:172.21.15.44:6824/1074109859 23 ==== osd_op_reply(74 602.00000000 [omap-set-vals] v51'20 uv20 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x564577eba500 con 0x564578ba0d00 2024-05-16T22:34:42.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.127+0000 7f75b8591280 4 recover_dentries: updating root 0x0x1 2024-05-16T22:34:42.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.127+0000 7f75b8591280 4 recover_dentries: object id 1.00000000.inode 2024-05-16T22:34:42.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.127+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] -- osd_op(unknown.0.0:75 6.14 6:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x5645781e3800 con 0x564578ba0400 2024-05-16T22:34:42.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.127+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.2 v2:172.21.15.44:6800/2908194156 10 ==== osd_op_reply(75 1.00000000.inode [read 0~582 out=582b] v0'0 uv32 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x564577eba500 con 0x564578ba0400 2024-05-16T22:34:42.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.127+0000 7f75b8591280 4 recover_dentries: root exists, will modify (582) 2024-05-16T22:34:42.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.127+0000 7f75b8591280 4 recover_dentries: magic ok 2024-05-16T22:34:42.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.127+0000 7f75b8591280 4 recover_dentries: writing root ino 1.00000000.inode version 5 2024-05-16T22:34:42.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.127+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] -- osd_op(unknown.0.0:76 6.14 6:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x5645781e3c00 con 0x564578ba0400 2024-05-16T22:34:42.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.128+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.2 v2:172.21.15.44:6800/2908194156 11 ==== osd_op_reply(76 1.00000000.inode [writefull 0~582] v51'33 uv33 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x564577eba500 con 0x564578ba0400 2024-05-16T22:34:42.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.128+0000 7f75b8591280 4 recover_dentries: inspecting lump 1.00000000 2024-05-16T22:34:42.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.128+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:77 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x5645781e2800 con 0x564578ba0880 2024-05-16T22:34:42.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.128+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 26 ==== osd_op_reply(77 1.00000000 [omap-get-header out=274b] v0'0 uv12 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:42.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.128+0000 7f75b8591280 4 recover_dentries: frag 1.00000000 fnode old v12 vs new v13 2024-05-16T22:34:42.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.128+0000 7f75b8591280 4 recover_dentries: writing fnode to omap header 2024-05-16T22:34:42.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.128+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:78 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578121400 con 0x564578ba0880 2024-05-16T22:34:42.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.130+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 27 ==== osd_op_reply(78 1.00000000 [omap-set-header] v51'13 uv13 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:43.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.130+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:79 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578121800 con 0x564578ba0880 2024-05-16T22:34:43.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.130+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 28 ==== osd_op_reply(79 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv13 ondisk = 0) ==== 154+0+4 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:43.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.130+0000 7f75b8591280 4 recover_dentries: updating root 0x0x1 2024-05-16T22:34:43.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.130+0000 7f75b8591280 4 recover_dentries: object id 1.00000000.inode 2024-05-16T22:34:43.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.130+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] -- osd_op(unknown.0.0:80 6.14 6:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578121c00 con 0x564578ba0400 2024-05-16T22:34:43.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.130+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.2 v2:172.21.15.44:6800/2908194156 12 ==== osd_op_reply(80 1.00000000.inode [read 0~582 out=582b] v0'0 uv33 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x564577eba500 con 0x564578ba0400 2024-05-16T22:34:43.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.130+0000 7f75b8591280 4 recover_dentries: root exists, will modify (582) 2024-05-16T22:34:43.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.130+0000 7f75b8591280 4 recover_dentries: magic ok 2024-05-16T22:34:43.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.130+0000 7f75b8591280 4 recover_dentries: writing root ino 1.00000000.inode version 6 2024-05-16T22:34:43.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.130+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] -- osd_op(unknown.0.0:81 6.14 6:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578120800 con 0x564578ba0400 2024-05-16T22:34:43.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.131+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.2 v2:172.21.15.44:6800/2908194156 13 ==== osd_op_reply(81 1.00000000.inode [writefull 0~582] v51'34 uv34 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x564577eba500 con 0x564578ba0400 2024-05-16T22:34:43.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.131+0000 7f75b8591280 4 recover_dentries: inspecting lump 1.00000000 2024-05-16T22:34:43.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.131+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:82 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578121000 con 0x564578ba0880 2024-05-16T22:34:43.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.132+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 29 ==== osd_op_reply(82 1.00000000 [omap-get-header out=274b] v0'0 uv13 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:43.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.132+0000 7f75b8591280 4 recover_dentries: frag 1.00000000 fnode old v13 vs new v15 2024-05-16T22:34:43.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.132+0000 7f75b8591280 4 recover_dentries: writing fnode to omap header 2024-05-16T22:34:43.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.132+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:83 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578120400 con 0x564578ba0880 2024-05-16T22:34:43.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.133+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 30 ==== osd_op_reply(83 1.00000000 [omap-set-header] v51'14 uv14 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:43.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.133+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:84 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578121400 con 0x564578ba0880 2024-05-16T22:34:43.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.133+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 31 ==== osd_op_reply(84 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv14 ondisk = 0) ==== 154+0+4 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:43.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.133+0000 7f75b8591280 4 recover_dentries: inspecting fullbit 1.00000000/dir 2024-05-16T22:34:43.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.133+0000 7f75b8591280 4 recover_dentries: dentry did not already exist, will create 2024-05-16T22:34:43.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.133+0000 7f75b8591280 4 recover_dentries: writing I dentry dir_head into frag 1.00000000 2024-05-16T22:34:43.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.133+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:85 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-vals in=565b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578121800 con 0x564578ba0880 2024-05-16T22:34:43.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.135+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 32 ==== osd_op_reply(85 1.00000000 [omap-set-vals] v51'15 uv15 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:43.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.135+0000 7f75b8591280 4 recover_dentries: inspecting lump 10000000004.00000000 2024-05-16T22:34:43.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.135+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] -- osd_op(unknown.0.0:86 6.5 6:a367a3e8:::10000000004.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578121000 con 0x564578ba1a80 2024-05-16T22:34:44.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.136+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.7 v2:172.21.15.70:6816/3619691281 7 ==== osd_op_reply(86 10000000004.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x5645781c9400 con 0x564578ba1a80 2024-05-16T22:34:44.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.136+0000 7f75b8591280 4 recover_dentries: failed to read OMAP header from directory fragment 10000000004.00000000 (2) No such file or directory 2024-05-16T22:34:44.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.136+0000 7f75b8591280 4 recover_dentries: writing fnode to omap header 2024-05-16T22:34:44.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.136+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] -- osd_op(unknown.0.0:87 6.5 6:a367a3e8:::10000000004.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578121c00 con 0x564578ba1a80 2024-05-16T22:34:44.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.137+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.7 v2:172.21.15.70:6816/3619691281 8 ==== osd_op_reply(87 10000000004.00000000 [omap-set-header] v51'1 uv1 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5645781c9400 con 0x564578ba1a80 2024-05-16T22:34:44.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.137+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] -- osd_op(unknown.0.0:88 6.5 6:a367a3e8:::10000000004.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x5645781e2800 con 0x564578ba1a80 2024-05-16T22:34:44.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.137+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.7 v2:172.21.15.70:6816/3619691281 9 ==== osd_op_reply(88 10000000004.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv1 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x5645781c9400 con 0x564578ba1a80 2024-05-16T22:34:44.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.138+0000 7f75b8591280 4 recover_dentries: updating root 0x0x1 2024-05-16T22:34:44.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.138+0000 7f75b8591280 4 recover_dentries: object id 1.00000000.inode 2024-05-16T22:34:44.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.138+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] -- osd_op(unknown.0.0:89 6.14 6:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x5645781e2c00 con 0x564578ba0400 2024-05-16T22:34:44.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.138+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.2 v2:172.21.15.44:6800/2908194156 14 ==== osd_op_reply(89 1.00000000.inode [read 0~582 out=582b] v0'0 uv34 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x564577eba500 con 0x564578ba0400 2024-05-16T22:34:44.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.138+0000 7f75b8591280 4 recover_dentries: root exists, will modify (582) 2024-05-16T22:34:44.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.138+0000 7f75b8591280 4 recover_dentries: magic ok 2024-05-16T22:34:44.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.138+0000 7f75b8591280 4 recover_dentries: writing root ino 1.00000000.inode version 7 2024-05-16T22:34:44.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.138+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] -- osd_op(unknown.0.0:90 6.14 6:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x5645781e3400 con 0x564578ba0400 2024-05-16T22:34:44.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.139+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.2 v2:172.21.15.44:6800/2908194156 15 ==== osd_op_reply(90 1.00000000.inode [writefull 0~582] v51'35 uv35 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x564577eba500 con 0x564578ba0400 2024-05-16T22:34:44.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.139+0000 7f75b8591280 4 recover_dentries: inspecting lump 1.00000000 2024-05-16T22:34:44.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.139+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:91 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x5645781e3800 con 0x564578ba0880 2024-05-16T22:34:44.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.139+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 33 ==== osd_op_reply(91 1.00000000 [omap-get-header out=274b] v0'0 uv15 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:44.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.139+0000 7f75b8591280 4 recover_dentries: frag 1.00000000 fnode old v15 vs new v17 2024-05-16T22:34:44.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.139+0000 7f75b8591280 4 recover_dentries: writing fnode to omap header 2024-05-16T22:34:44.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.139+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:92 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x5645781e3c00 con 0x564578ba0880 2024-05-16T22:34:44.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.140+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 34 ==== osd_op_reply(92 1.00000000 [omap-set-header] v51'16 uv16 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:44.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.141+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:93 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x5645781f6000 con 0x564578ba0880 2024-05-16T22:34:44.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.141+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 35 ==== osd_op_reply(93 1.00000000 [omap-get-vals-by-keys out=570b] v0'0 uv16 ondisk = 0) ==== 154+0+570 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:44.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.141+0000 7f75b8591280 4 recover_dentries: inspecting fullbit 1.00000000/.fscrypt 2024-05-16T22:34:44.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.141+0000 7f75b8591280 4 recover_dentries: dentry .fscrypt_head existed already 2024-05-16T22:34:45.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.141+0000 7f75b8591280 4 recover_dentries: dentry exists, checking versions... 2024-05-16T22:34:45.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.141+0000 7f75b8591280 4 recover_dentries: decoded embedded inode version 7 vs fullbit version 16 2024-05-16T22:34:45.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.141+0000 7f75b8591280 4 recover_dentries: writing I dentry .fscrypt_head into frag 1.00000000 2024-05-16T22:34:45.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.141+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:94 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-vals in=570b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x5645781f6400 con 0x564578ba0880 2024-05-16T22:34:45.153 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:34:45.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.143+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 36 ==== osd_op_reply(94 1.00000000 [omap-set-vals] v51'17 uv17 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:45.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.143+0000 7f75b8591280 4 recover_dentries: inspecting lump 10000000001.00000000 2024-05-16T22:34:45.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.143+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] -- osd_op(unknown.0.0:95 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x5645781f6800 con 0x564578ba1180 2024-05-16T22:34:45.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.143+0000 7f75b653c640 1 -- 172.21.15.44:0/2553534249 <== osd.5 v2:172.21.15.70:6802/4218901987 12 ==== osd_op_reply(95 10000000001.00000000 [omap-get-header out=274b] v0'0 uv7 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5645781c9680 con 0x564578ba1180 2024-05-16T22:34:45.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.143+0000 7f75b8591280 4 recover_dentries: frag 10000000001.00000000 fnode old v5 vs new v7 2024-05-16T22:34:45.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.143+0000 7f75b8591280 4 recover_dentries: writing fnode to omap header 2024-05-16T22:34:45.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.143+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] -- osd_op(unknown.0.0:96 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x5645781f6c00 con 0x564578ba1180 2024-05-16T22:34:45.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.145+0000 7f75b653c640 1 -- 172.21.15.44:0/2553534249 <== osd.5 v2:172.21.15.70:6802/4218901987 13 ==== osd_op_reply(96 10000000001.00000000 [omap-set-header] v51'8 uv8 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5645781c9680 con 0x564578ba1180 2024-05-16T22:34:45.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.145+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] -- osd_op(unknown.0.0:97 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x5645781f7000 con 0x564578ba1180 2024-05-16T22:34:45.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.146+0000 7f75b653c640 1 -- 172.21.15.44:0/2553534249 <== osd.5 v2:172.21.15.70:6802/4218901987 14 ==== osd_op_reply(97 10000000001.00000000 [omap-get-vals-by-keys out=572b] v0'0 uv8 ondisk = 0) ==== 164+0+572 (crc 0 0 0) 0x5645781c9680 con 0x564578ba1180 2024-05-16T22:34:45.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.146+0000 7f75b8591280 4 recover_dentries: inspecting fullbit 10000000001.00000000/protectors 2024-05-16T22:34:45.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.146+0000 7f75b8591280 4 recover_dentries: dentry protectors_head existed already 2024-05-16T22:34:45.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.146+0000 7f75b8591280 4 recover_dentries: dentry exists, checking versions... 2024-05-16T22:34:45.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.146+0000 7f75b8591280 4 recover_dentries: decoded embedded inode version 4 vs fullbit version 6 2024-05-16T22:34:45.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.146+0000 7f75b8591280 4 recover_dentries: writing I dentry protectors_head into frag 10000000001.00000000 2024-05-16T22:34:45.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.146+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] -- osd_op(unknown.0.0:98 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-vals in=572b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x5645781f7400 con 0x564578ba1180 2024-05-16T22:34:45.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.148+0000 7f75b653c640 1 -- 172.21.15.44:0/2553534249 <== osd.5 v2:172.21.15.70:6802/4218901987 15 ==== osd_op_reply(98 10000000001.00000000 [omap-set-vals] v51'9 uv9 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5645781c9680 con 0x564578ba1180 2024-05-16T22:34:45.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.148+0000 7f75b8591280 4 recover_dentries: inspecting lump 10000000003.00000000 2024-05-16T22:34:45.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.148+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] -- osd_op(unknown.0.0:99 6.12 6:4def72d4:::10000000003.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x5645781f7800 con 0x564578ba1a80 2024-05-16T22:34:45.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.148+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.7 v2:172.21.15.70:6816/3619691281 10 ==== osd_op_reply(99 10000000003.00000000 [omap-get-header out=274b] v0'0 uv2 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5645781c9400 con 0x564578ba1a80 2024-05-16T22:34:45.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.148+0000 7f75b8591280 4 recover_dentries: frag 10000000003.00000000 fnode old v1 vs new v3 2024-05-16T22:34:45.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.148+0000 7f75b8591280 4 recover_dentries: writing fnode to omap header 2024-05-16T22:34:46.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.148+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] -- osd_op(unknown.0.0:100 6.12 6:4def72d4:::10000000003.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x5645781f7c00 con 0x564578ba1a80 2024-05-16T22:34:46.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.150+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.7 v2:172.21.15.70:6816/3619691281 11 ==== osd_op_reply(100 10000000003.00000000 [omap-set-header] v51'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5645781c9400 con 0x564578ba1a80 2024-05-16T22:34:46.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.150+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] -- osd_op(unknown.0.0:101 6.12 6:4def72d4:::10000000003.00000000:head [omap-get-vals-by-keys in=27b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x5645781f6800 con 0x564578ba1a80 2024-05-16T22:34:46.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.150+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.7 v2:172.21.15.70:6816/3619691281 12 ==== osd_op_reply(101 10000000003.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv3 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x5645781c9400 con 0x564578ba1a80 2024-05-16T22:34:46.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.150+0000 7f75b8591280 4 recover_dentries: inspecting fullbit 10000000003.00000000/.tmp3443705943 2024-05-16T22:34:46.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.150+0000 7f75b8591280 4 recover_dentries: dentry did not already exist, will create 2024-05-16T22:34:46.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.150+0000 7f75b8591280 4 recover_dentries: writing I dentry .tmp3443705943_head into frag 10000000003.00000000 2024-05-16T22:34:46.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.150+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] -- osd_op(unknown.0.0:102 6.12 6:4def72d4:::10000000003.00000000:head [omap-set-vals in=614b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x5645781f6c00 con 0x564578ba1a80 2024-05-16T22:34:46.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.151+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.7 v2:172.21.15.70:6816/3619691281 13 ==== osd_op_reply(102 10000000003.00000000 [omap-set-vals] v51'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5645781c9400 con 0x564578ba1a80 2024-05-16T22:34:46.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.151+0000 7f75b8591280 4 recover_dentries: inspecting lump 10000000001.00000000 2024-05-16T22:34:46.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.151+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] -- osd_op(unknown.0.0:103 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x5645781f6000 con 0x564578ba1180 2024-05-16T22:34:46.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.151+0000 7f75b653c640 1 -- 172.21.15.44:0/2553534249 <== osd.5 v2:172.21.15.70:6802/4218901987 16 ==== osd_op_reply(103 10000000001.00000000 [omap-get-header out=274b] v0'0 uv9 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5645781c9680 con 0x564578ba1180 2024-05-16T22:34:46.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.151+0000 7f75b8591280 4 recover_dentries: frag 10000000001.00000000 fnode old v7 vs new v9 2024-05-16T22:34:46.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.151+0000 7f75b8591280 4 recover_dentries: writing fnode to omap header 2024-05-16T22:34:46.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.151+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] -- osd_op(unknown.0.0:104 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x5645781f6400 con 0x564578ba1180 2024-05-16T22:34:46.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.152+0000 7f75b653c640 1 -- 172.21.15.44:0/2553534249 <== osd.5 v2:172.21.15.70:6802/4218901987 17 ==== osd_op_reply(104 10000000001.00000000 [omap-set-header] v51'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5645781c9680 con 0x564578ba1180 2024-05-16T22:34:46.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.152+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] -- osd_op(unknown.0.0:105 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x5645781e3000 con 0x564578ba1180 2024-05-16T22:34:46.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.153+0000 7f75b653c640 1 -- 172.21.15.44:0/2553534249 <== osd.5 v2:172.21.15.70:6802/4218901987 18 ==== osd_op_reply(105 10000000001.00000000 [omap-get-vals-by-keys out=572b] v0'0 uv10 ondisk = 0) ==== 164+0+572 (crc 0 0 0) 0x5645781c9680 con 0x564578ba1180 2024-05-16T22:34:46.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.153+0000 7f75b8591280 4 recover_dentries: inspecting fullbit 10000000001.00000000/protectors 2024-05-16T22:34:46.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.153+0000 7f75b8591280 4 recover_dentries: dentry protectors_head existed already 2024-05-16T22:34:46.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.153+0000 7f75b8591280 4 recover_dentries: dentry exists, checking versions... 2024-05-16T22:34:46.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.153+0000 7f75b8591280 4 recover_dentries: decoded embedded inode version 6 vs fullbit version 8 2024-05-16T22:34:46.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.153+0000 7f75b8591280 4 recover_dentries: writing I dentry protectors_head into frag 10000000001.00000000 2024-05-16T22:34:46.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.153+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] -- osd_op(unknown.0.0:106 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-vals in=572b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x5645781e2000 con 0x564578ba1180 2024-05-16T22:34:46.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.154+0000 7f75b653c640 1 -- 172.21.15.44:0/2553534249 <== osd.5 v2:172.21.15.70:6802/4218901987 19 ==== osd_op_reply(106 10000000001.00000000 [omap-set-vals] v51'11 uv11 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5645781c9680 con 0x564578ba1180 2024-05-16T22:34:46.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.154+0000 7f75b8591280 4 recover_dentries: inspecting lump 10000000003.00000000 2024-05-16T22:34:46.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.154+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] -- osd_op(unknown.0.0:107 6.12 6:4def72d4:::10000000003.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x5645781e2400 con 0x564578ba1a80 2024-05-16T22:34:47.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.154+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.7 v2:172.21.15.70:6816/3619691281 14 ==== osd_op_reply(107 10000000003.00000000 [omap-get-header out=274b] v0'0 uv4 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5645781c9400 con 0x564578ba1a80 2024-05-16T22:34:47.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.154+0000 7f75b8591280 4 recover_dentries: frag 10000000003.00000000 fnode old v3 vs new v5 2024-05-16T22:34:47.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.154+0000 7f75b8591280 4 recover_dentries: writing fnode to omap header 2024-05-16T22:34:47.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.154+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] -- osd_op(unknown.0.0:108 6.12 6:4def72d4:::10000000003.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x5645781e2800 con 0x564578ba1a80 2024-05-16T22:34:47.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.155+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.7 v2:172.21.15.70:6816/3619691281 15 ==== osd_op_reply(108 10000000003.00000000 [omap-set-header] v51'5 uv5 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5645781c9400 con 0x564578ba1a80 2024-05-16T22:34:47.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.155+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] -- osd_op(unknown.0.0:109 6.12 6:4def72d4:::10000000003.00000000:head [omap-get-vals-by-keys in=27b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x5645781e3800 con 0x564578ba1a80 2024-05-16T22:34:47.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.156+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.7 v2:172.21.15.70:6816/3619691281 16 ==== osd_op_reply(109 10000000003.00000000 [omap-get-vals-by-keys out=614b] v0'0 uv5 ondisk = 0) ==== 164+0+614 (crc 0 0 0) 0x5645781c9400 con 0x564578ba1a80 2024-05-16T22:34:47.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.156+0000 7f75b8591280 4 recover_dentries: inspecting fullbit 10000000003.00000000/.tmp3443705943 2024-05-16T22:34:47.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.156+0000 7f75b8591280 4 recover_dentries: dentry .tmp3443705943_head existed already 2024-05-16T22:34:47.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.156+0000 7f75b8591280 4 recover_dentries: dentry exists, checking versions... 2024-05-16T22:34:47.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.156+0000 7f75b8591280 4 recover_dentries: decoded embedded inode version 2 vs fullbit version 4 2024-05-16T22:34:47.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.156+0000 7f75b8591280 4 recover_dentries: writing I dentry .tmp3443705943_head into frag 10000000003.00000000 2024-05-16T22:34:47.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.156+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] -- osd_op(unknown.0.0:110 6.12 6:4def72d4:::10000000003.00000000:head [omap-set-vals in=622b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x5645781e3c00 con 0x564578ba1a80 2024-05-16T22:34:47.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.157+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.7 v2:172.21.15.70:6816/3619691281 17 ==== osd_op_reply(110 10000000003.00000000 [omap-set-vals] v51'6 uv6 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5645781c9400 con 0x564578ba1a80 2024-05-16T22:34:47.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.157+0000 7f75b8591280 4 recover_dentries: inspecting lump 10000000001.00000000 2024-05-16T22:34:47.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.157+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] -- osd_op(unknown.0.0:111 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578120000 con 0x564578ba1180 2024-05-16T22:34:47.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.157+0000 7f75b653c640 1 -- 172.21.15.44:0/2553534249 <== osd.5 v2:172.21.15.70:6802/4218901987 20 ==== osd_op_reply(111 10000000001.00000000 [omap-get-header out=274b] v0'0 uv11 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5645781c9680 con 0x564578ba1180 2024-05-16T22:34:47.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.157+0000 7f75b8591280 4 recover_dentries: frag 10000000001.00000000 fnode old v9 vs new v13 2024-05-16T22:34:47.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.157+0000 7f75b8591280 4 recover_dentries: writing fnode to omap header 2024-05-16T22:34:47.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.157+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] -- osd_op(unknown.0.0:112 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578120c00 con 0x564578ba1180 2024-05-16T22:34:47.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.158+0000 7f75b653c640 1 -- 172.21.15.44:0/2553534249 <== osd.5 v2:172.21.15.70:6802/4218901987 21 ==== osd_op_reply(112 10000000001.00000000 [omap-set-header] v51'12 uv12 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5645781c9680 con 0x564578ba1180 2024-05-16T22:34:47.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.158+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] -- osd_op(unknown.0.0:113 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578120400 con 0x564578ba1180 2024-05-16T22:34:47.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.159+0000 7f75b653c640 1 -- 172.21.15.44:0/2553534249 <== osd.5 v2:172.21.15.70:6802/4218901987 22 ==== osd_op_reply(113 10000000001.00000000 [omap-get-vals-by-keys out=572b] v0'0 uv12 ondisk = 0) ==== 164+0+572 (crc 0 0 0) 0x5645781c9680 con 0x564578ba1180 2024-05-16T22:34:47.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.159+0000 7f75b8591280 4 recover_dentries: inspecting fullbit 10000000001.00000000/protectors 2024-05-16T22:34:47.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.159+0000 7f75b8591280 4 recover_dentries: dentry protectors_head existed already 2024-05-16T22:34:47.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.159+0000 7f75b8591280 4 recover_dentries: dentry exists, checking versions... 2024-05-16T22:34:48.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.159+0000 7f75b8591280 4 recover_dentries: decoded embedded inode version 8 vs fullbit version 12 2024-05-16T22:34:48.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.159+0000 7f75b8591280 4 recover_dentries: writing I dentry protectors_head into frag 10000000001.00000000 2024-05-16T22:34:48.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.159+0000 7f75b8591280 4 recover_dentries: inspecting fullbit 10000000001.00000000/protectors 2024-05-16T22:34:48.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.159+0000 7f75b8591280 4 recover_dentries: dentry protectors_head existed already 2024-05-16T22:34:48.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.159+0000 7f75b8591280 4 recover_dentries: dentry exists, checking versions... 2024-05-16T22:34:48.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.159+0000 7f75b8591280 4 recover_dentries: decoded embedded inode version 8 vs fullbit version 12 2024-05-16T22:34:48.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.159+0000 7f75b8591280 4 recover_dentries: writing I dentry protectors_head into frag 10000000001.00000000 2024-05-16T22:34:48.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.159+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] -- osd_op(unknown.0.0:114 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-vals in=572b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578121400 con 0x564578ba1180 2024-05-16T22:34:48.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.160+0000 7f75b653c640 1 -- 172.21.15.44:0/2553534249 <== osd.5 v2:172.21.15.70:6802/4218901987 23 ==== osd_op_reply(114 10000000001.00000000 [omap-set-vals] v51'13 uv13 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5645781c9680 con 0x564578ba1180 2024-05-16T22:34:48.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.160+0000 7f75b8591280 4 recover_dentries: inspecting lump 10000000003.00000000 2024-05-16T22:34:48.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.160+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] -- osd_op(unknown.0.0:115 6.12 6:4def72d4:::10000000003.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578121800 con 0x564578ba1a80 2024-05-16T22:34:48.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.160+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.7 v2:172.21.15.70:6816/3619691281 18 ==== osd_op_reply(115 10000000003.00000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5645781c9400 con 0x564578ba1a80 2024-05-16T22:34:48.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.160+0000 7f75b8591280 4 recover_dentries: frag 10000000003.00000000 fnode old v5 vs new v9 2024-05-16T22:34:48.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.160+0000 7f75b8591280 4 recover_dentries: writing fnode to omap header 2024-05-16T22:34:48.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.160+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] -- osd_op(unknown.0.0:116 6.12 6:4def72d4:::10000000003.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578121000 con 0x564578ba1a80 2024-05-16T22:34:48.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.161+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.7 v2:172.21.15.70:6816/3619691281 19 ==== osd_op_reply(116 10000000003.00000000 [omap-set-header] v51'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5645781c9400 con 0x564578ba1a80 2024-05-16T22:34:48.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.161+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] -- osd_op(unknown.0.0:117 6.12 6:4def72d4:::10000000003.00000000:head [omap-get-vals-by-keys in=52b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578121c00 con 0x564578ba1a80 2024-05-16T22:34:48.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.162+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.7 v2:172.21.15.70:6816/3619691281 20 ==== osd_op_reply(117 10000000003.00000000 [omap-get-vals-by-keys out=622b] v0'0 uv7 ondisk = 0) ==== 164+0+622 (crc 0 0 0) 0x5645781c9400 con 0x564578ba1a80 2024-05-16T22:34:48.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.162+0000 7f75b8591280 4 recover_dentries: inspecting fullbit 10000000003.00000000/ea1af8aab8775ae6 2024-05-16T22:34:48.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.162+0000 7f75b8591280 4 recover_dentries: dentry did not already exist, will create 2024-05-16T22:34:48.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.162+0000 7f75b8591280 4 recover_dentries: writing I dentry ea1af8aab8775ae6_head into frag 10000000003.00000000 2024-05-16T22:34:48.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.162+0000 7f75b8591280 4 recover_dentries: inspecting nullbit 10000000003.00000000/.tmp3443705943 2024-05-16T22:34:48.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.162+0000 7f75b8591280 4 recover_dentries: dentry exists, will remove 2024-05-16T22:34:48.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.162+0000 7f75b8591280 10 recover_dentries: Existing full inode in slot to be (maybe) removed by null journal dn '.tmp3443705943' with lump fnode version 9vs existing fnode version 5 2024-05-16T22:34:48.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.162+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] -- osd_op(unknown.0.0:118 6.12 6:4def72d4:::10000000003.00000000:head [omap-set-vals in=624b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578121800 con 0x564578ba1a80 2024-05-16T22:34:48.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.163+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.7 v2:172.21.15.70:6816/3619691281 21 ==== osd_op_reply(118 10000000003.00000000 [omap-set-vals] v51'8 uv8 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5645781c9400 con 0x564578ba1a80 2024-05-16T22:34:48.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.163+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] -- osd_op(unknown.0.0:119 6.12 6:4def72d4:::10000000003.00000000:head [omap-rm-keys in=27b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578121000 con 0x564578ba1a80 2024-05-16T22:34:48.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.164+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.7 v2:172.21.15.70:6816/3619691281 22 ==== osd_op_reply(119 10000000003.00000000 [omap-rm-keys] v51'9 uv9 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5645781c9400 con 0x564578ba1a80 2024-05-16T22:34:49.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.164+0000 7f75b8591280 4 recover_dentries: inspecting lump 10000000001.00000000 2024-05-16T22:34:49.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.164+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] -- osd_op(unknown.0.0:120 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578121c00 con 0x564578ba1180 2024-05-16T22:34:49.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.164+0000 7f75b653c640 1 -- 172.21.15.44:0/2553534249 <== osd.5 v2:172.21.15.70:6802/4218901987 24 ==== osd_op_reply(120 10000000001.00000000 [omap-get-header out=274b] v0'0 uv13 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5645781c9680 con 0x564578ba1180 2024-05-16T22:34:49.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.164+0000 7f75b8591280 4 recover_dentries: frag 10000000001.00000000 fnode old v13 vs new v15 2024-05-16T22:34:49.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.164+0000 7f75b8591280 4 recover_dentries: writing fnode to omap header 2024-05-16T22:34:49.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.164+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] -- osd_op(unknown.0.0:121 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578120000 con 0x564578ba1180 2024-05-16T22:34:49.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.166+0000 7f75b653c640 1 -- 172.21.15.44:0/2553534249 <== osd.5 v2:172.21.15.70:6802/4218901987 25 ==== osd_op_reply(121 10000000001.00000000 [omap-set-header] v51'14 uv14 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5645781c9680 con 0x564578ba1180 2024-05-16T22:34:49.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.166+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] -- osd_op(unknown.0.0:122 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578120c00 con 0x564578ba1180 2024-05-16T22:34:49.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.166+0000 7f75b653c640 1 -- 172.21.15.44:0/2553534249 <== osd.5 v2:172.21.15.70:6802/4218901987 26 ==== osd_op_reply(122 10000000001.00000000 [omap-get-vals-by-keys out=570b] v0'0 uv14 ondisk = 0) ==== 164+0+570 (crc 0 0 0) 0x5645781c9680 con 0x564578ba1180 2024-05-16T22:34:49.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.166+0000 7f75b8591280 4 recover_dentries: inspecting fullbit 10000000001.00000000/policies 2024-05-16T22:34:49.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.166+0000 7f75b8591280 4 recover_dentries: dentry policies_head existed already 2024-05-16T22:34:49.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.166+0000 7f75b8591280 4 recover_dentries: dentry exists, checking versions... 2024-05-16T22:34:49.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.166+0000 7f75b8591280 4 recover_dentries: decoded embedded inode version 2 vs fullbit version 14 2024-05-16T22:34:49.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.166+0000 7f75b8591280 4 recover_dentries: writing I dentry policies_head into frag 10000000001.00000000 2024-05-16T22:34:49.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.166+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] -- osd_op(unknown.0.0:123 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-vals in=570b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x5645781e2400 con 0x564578ba1180 2024-05-16T22:34:49.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.168+0000 7f75b653c640 1 -- 172.21.15.44:0/2553534249 <== osd.5 v2:172.21.15.70:6802/4218901987 27 ==== osd_op_reply(123 10000000001.00000000 [omap-set-vals] v51'15 uv15 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5645781c9680 con 0x564578ba1180 2024-05-16T22:34:49.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.168+0000 7f75b8591280 4 recover_dentries: inspecting lump 10000000002.00000000 2024-05-16T22:34:49.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.168+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] -- osd_op(unknown.0.0:124 6.12 6:4bec3886:::10000000002.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x5645781e2800 con 0x564578ba1a80 2024-05-16T22:34:49.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.168+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.7 v2:172.21.15.70:6816/3619691281 23 ==== osd_op_reply(124 10000000002.00000000 [omap-get-header out=274b] v0'0 uv1 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5645781c9400 con 0x564578ba1a80 2024-05-16T22:34:49.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.168+0000 7f75b8591280 4 recover_dentries: frag 10000000002.00000000 fnode old v1 vs new v3 2024-05-16T22:34:49.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.168+0000 7f75b8591280 4 recover_dentries: writing fnode to omap header 2024-05-16T22:34:49.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.168+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] -- osd_op(unknown.0.0:125 6.12 6:4bec3886:::10000000002.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x5645781e3800 con 0x564578ba1a80 2024-05-16T22:34:49.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.169+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.7 v2:172.21.15.70:6816/3619691281 24 ==== osd_op_reply(125 10000000002.00000000 [omap-set-header] v51'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5645781c9400 con 0x564578ba1a80 2024-05-16T22:34:49.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.169+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] -- osd_op(unknown.0.0:126 6.12 6:4bec3886:::10000000002.00000000:head [omap-get-vals-by-keys in=27b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x5645781e3c00 con 0x564578ba1a80 2024-05-16T22:34:49.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.169+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.7 v2:172.21.15.70:6816/3619691281 25 ==== osd_op_reply(126 10000000002.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv10 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x5645781c9400 con 0x564578ba1a80 2024-05-16T22:34:49.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.169+0000 7f75b8591280 4 recover_dentries: inspecting fullbit 10000000002.00000000/.tmp2746194693 2024-05-16T22:34:49.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.169+0000 7f75b8591280 4 recover_dentries: dentry did not already exist, will create 2024-05-16T22:34:49.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.169+0000 7f75b8591280 4 recover_dentries: writing I dentry .tmp2746194693_head into frag 10000000002.00000000 2024-05-16T22:34:50.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.169+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] -- osd_op(unknown.0.0:127 6.12 6:4bec3886:::10000000002.00000000:head [omap-set-vals in=614b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x5645781e3000 con 0x564578ba1a80 2024-05-16T22:34:50.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.171+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.7 v2:172.21.15.70:6816/3619691281 26 ==== osd_op_reply(127 10000000002.00000000 [omap-set-vals] v51'11 uv11 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5645781c9400 con 0x564578ba1a80 2024-05-16T22:34:50.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.171+0000 7f75b8591280 4 recover_dentries: inspecting lump 10000000001.00000000 2024-05-16T22:34:50.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.171+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] -- osd_op(unknown.0.0:128 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x5645781e2000 con 0x564578ba1180 2024-05-16T22:34:50.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.171+0000 7f75b653c640 1 -- 172.21.15.44:0/2553534249 <== osd.5 v2:172.21.15.70:6802/4218901987 28 ==== osd_op_reply(128 10000000001.00000000 [omap-get-header out=274b] v0'0 uv15 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5645781c9680 con 0x564578ba1180 2024-05-16T22:34:50.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.171+0000 7f75b8591280 4 recover_dentries: frag 10000000001.00000000 fnode old v15 vs new v17 2024-05-16T22:34:50.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.171+0000 7f75b8591280 4 recover_dentries: writing fnode to omap header 2024-05-16T22:34:50.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.171+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] -- osd_op(unknown.0.0:129 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578220000 con 0x564578ba1180 2024-05-16T22:34:50.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.173+0000 7f75b653c640 1 -- 172.21.15.44:0/2553534249 <== osd.5 v2:172.21.15.70:6802/4218901987 29 ==== osd_op_reply(129 10000000001.00000000 [omap-set-header] v51'16 uv16 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5645781c9680 con 0x564578ba1180 2024-05-16T22:34:50.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.173+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] -- osd_op(unknown.0.0:130 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578220400 con 0x564578ba1180 2024-05-16T22:34:50.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.173+0000 7f75b653c640 1 -- 172.21.15.44:0/2553534249 <== osd.5 v2:172.21.15.70:6802/4218901987 30 ==== osd_op_reply(130 10000000001.00000000 [omap-get-vals-by-keys out=570b] v0'0 uv16 ondisk = 0) ==== 164+0+570 (crc 0 0 0) 0x5645781c9680 con 0x564578ba1180 2024-05-16T22:34:50.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.173+0000 7f75b8591280 4 recover_dentries: inspecting fullbit 10000000001.00000000/policies 2024-05-16T22:34:50.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.173+0000 7f75b8591280 4 recover_dentries: dentry policies_head existed already 2024-05-16T22:34:50.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.173+0000 7f75b8591280 4 recover_dentries: dentry exists, checking versions... 2024-05-16T22:34:50.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.173+0000 7f75b8591280 4 recover_dentries: decoded embedded inode version 14 vs fullbit version 16 2024-05-16T22:34:50.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.173+0000 7f75b8591280 4 recover_dentries: writing I dentry policies_head into frag 10000000001.00000000 2024-05-16T22:34:50.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.173+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] -- osd_op(unknown.0.0:131 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-vals in=570b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578220800 con 0x564578ba1180 2024-05-16T22:34:50.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.174+0000 7f75b653c640 1 -- 172.21.15.44:0/2553534249 <== osd.5 v2:172.21.15.70:6802/4218901987 31 ==== osd_op_reply(131 10000000001.00000000 [omap-set-vals] v51'17 uv17 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5645781c9680 con 0x564578ba1180 2024-05-16T22:34:50.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.174+0000 7f75b8591280 4 recover_dentries: inspecting lump 10000000002.00000000 2024-05-16T22:34:50.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.174+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] -- osd_op(unknown.0.0:132 6.12 6:4bec3886:::10000000002.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578220c00 con 0x564578ba1a80 2024-05-16T22:34:50.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.174+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.7 v2:172.21.15.70:6816/3619691281 27 ==== osd_op_reply(132 10000000002.00000000 [omap-get-header out=274b] v0'0 uv11 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5645781c9400 con 0x564578ba1a80 2024-05-16T22:34:50.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.174+0000 7f75b8591280 4 recover_dentries: frag 10000000002.00000000 fnode old v3 vs new v5 2024-05-16T22:34:50.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.174+0000 7f75b8591280 4 recover_dentries: writing fnode to omap header 2024-05-16T22:34:50.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.175+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] -- osd_op(unknown.0.0:133 6.12 6:4bec3886:::10000000002.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578221000 con 0x564578ba1a80 2024-05-16T22:34:50.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.176+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.7 v2:172.21.15.70:6816/3619691281 28 ==== osd_op_reply(133 10000000002.00000000 [omap-set-header] v51'12 uv12 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5645781c9400 con 0x564578ba1a80 2024-05-16T22:34:50.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.176+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] -- osd_op(unknown.0.0:134 6.12 6:4bec3886:::10000000002.00000000:head [omap-get-vals-by-keys in=27b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578221400 con 0x564578ba1a80 2024-05-16T22:34:50.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.176+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.7 v2:172.21.15.70:6816/3619691281 29 ==== osd_op_reply(134 10000000002.00000000 [omap-get-vals-by-keys out=614b] v0'0 uv12 ondisk = 0) ==== 164+0+614 (crc 0 0 0) 0x5645781c9400 con 0x564578ba1a80 2024-05-16T22:34:50.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.176+0000 7f75b8591280 4 recover_dentries: inspecting fullbit 10000000002.00000000/.tmp2746194693 2024-05-16T22:34:51.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.176+0000 7f75b8591280 4 recover_dentries: dentry .tmp2746194693_head existed already 2024-05-16T22:34:51.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.176+0000 7f75b8591280 4 recover_dentries: dentry exists, checking versions... 2024-05-16T22:34:51.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.176+0000 7f75b8591280 4 recover_dentries: decoded embedded inode version 2 vs fullbit version 4 2024-05-16T22:34:51.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.176+0000 7f75b8591280 4 recover_dentries: writing I dentry .tmp2746194693_head into frag 10000000002.00000000 2024-05-16T22:34:51.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.176+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] -- osd_op(unknown.0.0:135 6.12 6:4bec3886:::10000000002.00000000:head [omap-set-vals in=622b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578221800 con 0x564578ba1a80 2024-05-16T22:34:51.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.177+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.7 v2:172.21.15.70:6816/3619691281 30 ==== osd_op_reply(135 10000000002.00000000 [omap-set-vals] v51'13 uv13 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5645781c9400 con 0x564578ba1a80 2024-05-16T22:34:51.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.177+0000 7f75b8591280 4 recover_dentries: inspecting lump 10000000001.00000000 2024-05-16T22:34:51.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.177+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] -- osd_op(unknown.0.0:136 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578221c00 con 0x564578ba1180 2024-05-16T22:34:51.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.177+0000 7f75b653c640 1 -- 172.21.15.44:0/2553534249 <== osd.5 v2:172.21.15.70:6802/4218901987 32 ==== osd_op_reply(136 10000000001.00000000 [omap-get-header out=274b] v0'0 uv17 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5645781c9680 con 0x564578ba1180 2024-05-16T22:34:51.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.177+0000 7f75b8591280 4 recover_dentries: frag 10000000001.00000000 fnode old v17 vs new v21 2024-05-16T22:34:51.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.177+0000 7f75b8591280 4 recover_dentries: writing fnode to omap header 2024-05-16T22:34:51.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.177+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] -- osd_op(unknown.0.0:137 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578220000 con 0x564578ba1180 2024-05-16T22:34:51.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.179+0000 7f75b653c640 1 -- 172.21.15.44:0/2553534249 <== osd.5 v2:172.21.15.70:6802/4218901987 33 ==== osd_op_reply(137 10000000001.00000000 [omap-set-header] v51'18 uv18 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5645781c9680 con 0x564578ba1180 2024-05-16T22:34:51.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.179+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] -- osd_op(unknown.0.0:138 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578220400 con 0x564578ba1180 2024-05-16T22:34:51.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.179+0000 7f75b653c640 1 -- 172.21.15.44:0/2553534249 <== osd.5 v2:172.21.15.70:6802/4218901987 34 ==== osd_op_reply(138 10000000001.00000000 [omap-get-vals-by-keys out=570b] v0'0 uv18 ondisk = 0) ==== 164+0+570 (crc 0 0 0) 0x5645781c9680 con 0x564578ba1180 2024-05-16T22:34:51.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.179+0000 7f75b8591280 4 recover_dentries: inspecting fullbit 10000000001.00000000/policies 2024-05-16T22:34:51.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.179+0000 7f75b8591280 4 recover_dentries: dentry policies_head existed already 2024-05-16T22:34:51.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.179+0000 7f75b8591280 4 recover_dentries: dentry exists, checking versions... 2024-05-16T22:34:51.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.179+0000 7f75b8591280 4 recover_dentries: decoded embedded inode version 16 vs fullbit version 20 2024-05-16T22:34:51.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.179+0000 7f75b8591280 4 recover_dentries: writing I dentry policies_head into frag 10000000001.00000000 2024-05-16T22:34:51.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.179+0000 7f75b8591280 4 recover_dentries: inspecting fullbit 10000000001.00000000/policies 2024-05-16T22:34:51.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.179+0000 7f75b8591280 4 recover_dentries: dentry policies_head existed already 2024-05-16T22:34:51.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.179+0000 7f75b8591280 4 recover_dentries: dentry exists, checking versions... 2024-05-16T22:34:51.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.179+0000 7f75b8591280 4 recover_dentries: decoded embedded inode version 16 vs fullbit version 20 2024-05-16T22:34:51.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.179+0000 7f75b8591280 4 recover_dentries: writing I dentry policies_head into frag 10000000001.00000000 2024-05-16T22:34:51.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.179+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] -- osd_op(unknown.0.0:139 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-vals in=570b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x5645781e2400 con 0x564578ba1180 2024-05-16T22:34:51.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.180+0000 7f75b653c640 1 -- 172.21.15.44:0/2553534249 <== osd.5 v2:172.21.15.70:6802/4218901987 35 ==== osd_op_reply(139 10000000001.00000000 [omap-set-vals] v51'19 uv19 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5645781c9680 con 0x564578ba1180 2024-05-16T22:34:51.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.180+0000 7f75b8591280 4 recover_dentries: inspecting lump 10000000002.00000000 2024-05-16T22:34:52.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.180+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] -- osd_op(unknown.0.0:140 6.12 6:4bec3886:::10000000002.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x5645781e2000 con 0x564578ba1a80 2024-05-16T22:34:52.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.181+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.7 v2:172.21.15.70:6816/3619691281 31 ==== osd_op_reply(140 10000000002.00000000 [omap-get-header out=274b] v0'0 uv13 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5645781c9400 con 0x564578ba1a80 2024-05-16T22:34:52.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.181+0000 7f75b8591280 4 recover_dentries: frag 10000000002.00000000 fnode old v5 vs new v9 2024-05-16T22:34:52.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.181+0000 7f75b8591280 4 recover_dentries: writing fnode to omap header 2024-05-16T22:34:52.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.181+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] -- osd_op(unknown.0.0:141 6.12 6:4bec3886:::10000000002.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578120400 con 0x564578ba1a80 2024-05-16T22:34:52.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.182+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.7 v2:172.21.15.70:6816/3619691281 32 ==== osd_op_reply(141 10000000002.00000000 [omap-set-header] v51'14 uv14 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5645781c9400 con 0x564578ba1a80 2024-05-16T22:34:52.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.182+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] -- osd_op(unknown.0.0:142 6.12 6:4bec3886:::10000000002.00000000:head [omap-get-vals-by-keys in=68b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578121400 con 0x564578ba1a80 2024-05-16T22:34:52.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.182+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.7 v2:172.21.15.70:6816/3619691281 33 ==== osd_op_reply(142 10000000002.00000000 [omap-get-vals-by-keys out=622b] v0'0 uv14 ondisk = 0) ==== 164+0+622 (crc 0 0 0) 0x5645781c9400 con 0x564578ba1a80 2024-05-16T22:34:52.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.182+0000 7f75b8591280 4 recover_dentries: inspecting fullbit 10000000002.00000000/59cd7ea472e281f80f1be4414d11a64f 2024-05-16T22:34:52.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.182+0000 7f75b8591280 4 recover_dentries: dentry did not already exist, will create 2024-05-16T22:34:52.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.182+0000 7f75b8591280 4 recover_dentries: writing I dentry 59cd7ea472e281f80f1be4414d11a64f_head into frag 10000000002.00000000 2024-05-16T22:34:52.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.182+0000 7f75b8591280 4 recover_dentries: inspecting nullbit 10000000002.00000000/.tmp2746194693 2024-05-16T22:34:52.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.182+0000 7f75b8591280 4 recover_dentries: dentry exists, will remove 2024-05-16T22:34:52.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.182+0000 7f75b8591280 10 recover_dentries: Existing full inode in slot to be (maybe) removed by null journal dn '.tmp2746194693' with lump fnode version 9vs existing fnode version 5 2024-05-16T22:34:52.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.182+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] -- osd_op(unknown.0.0:143 6.12 6:4bec3886:::10000000002.00000000:head [omap-set-vals in=640b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578121c00 con 0x564578ba1a80 2024-05-16T22:34:52.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.184+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.7 v2:172.21.15.70:6816/3619691281 34 ==== osd_op_reply(143 10000000002.00000000 [omap-set-vals] v51'15 uv15 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5645781c9400 con 0x564578ba1a80 2024-05-16T22:34:52.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.184+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] -- osd_op(unknown.0.0:144 6.12 6:4bec3886:::10000000002.00000000:head [omap-rm-keys in=27b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578120000 con 0x564578ba1a80 2024-05-16T22:34:52.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.185+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.7 v2:172.21.15.70:6816/3619691281 35 ==== osd_op_reply(144 10000000002.00000000 [omap-rm-keys] v51'16 uv16 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5645781c9400 con 0x564578ba1a80 2024-05-16T22:34:52.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.185+0000 7f75b8591280 4 recover_dentries: inspecting lump 1.00000000 2024-05-16T22:34:52.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.185+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:145 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578120c00 con 0x564578ba0880 2024-05-16T22:34:52.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.186+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 37 ==== osd_op_reply(145 1.00000000 [omap-get-header out=274b] v0'0 uv17 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:52.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.186+0000 7f75b8591280 4 recover_dentries: frag 1.00000000 fnode old v17 vs new v19 2024-05-16T22:34:52.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.186+0000 7f75b8591280 4 recover_dentries: writing fnode to omap header 2024-05-16T22:34:52.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.186+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:146 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578121800 con 0x564578ba0880 2024-05-16T22:34:52.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.187+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 38 ==== osd_op_reply(146 1.00000000 [omap-set-header] v51'18 uv18 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:52.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.187+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:147 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578121000 con 0x564578ba0880 2024-05-16T22:34:52.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.187+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 39 ==== osd_op_reply(147 1.00000000 [omap-get-vals-by-keys out=565b] v0'0 uv18 ondisk = 0) ==== 154+0+565 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:52.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.187+0000 7f75b8591280 4 recover_dentries: inspecting fullbit 1.00000000/dir 2024-05-16T22:34:53.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.187+0000 7f75b8591280 4 recover_dentries: dentry dir_head existed already 2024-05-16T22:34:53.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.187+0000 7f75b8591280 4 recover_dentries: dentry exists, checking versions... 2024-05-16T22:34:53.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.187+0000 7f75b8591280 4 recover_dentries: decoded embedded inode version 14 vs fullbit version 18 2024-05-16T22:34:53.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.187+0000 7f75b8591280 4 recover_dentries: writing I dentry dir_head into frag 1.00000000 2024-05-16T22:34:53.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.187+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:148 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-vals in=613b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578120400 con 0x564578ba0880 2024-05-16T22:34:53.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.188+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 40 ==== osd_op_reply(148 1.00000000 [omap-set-vals] v51'19 uv19 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:53.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.188+0000 7f75b8591280 4 recover_dentries: updating root 0x0x1 2024-05-16T22:34:53.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.188+0000 7f75b8591280 4 recover_dentries: object id 1.00000000.inode 2024-05-16T22:34:53.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.188+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] -- osd_op(unknown.0.0:149 6.14 6:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x5645781e2800 con 0x564578ba0400 2024-05-16T22:34:53.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.189+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.2 v2:172.21.15.44:6800/2908194156 16 ==== osd_op_reply(149 1.00000000.inode [read 0~582 out=582b] v0'0 uv35 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x564577eba500 con 0x564578ba0400 2024-05-16T22:34:53.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.189+0000 7f75b8591280 4 recover_dentries: root exists, will modify (582) 2024-05-16T22:34:53.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.189+0000 7f75b8591280 4 recover_dentries: magic ok 2024-05-16T22:34:53.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.189+0000 7f75b8591280 4 recover_dentries: writing root ino 1.00000000.inode version 8 2024-05-16T22:34:53.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.189+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] -- osd_op(unknown.0.0:150 6.14 6:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x5645781e3800 con 0x564578ba0400 2024-05-16T22:34:53.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.190+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.2 v2:172.21.15.44:6800/2908194156 17 ==== osd_op_reply(150 1.00000000.inode [writefull 0~582] v51'36 uv36 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x564577eba500 con 0x564578ba0400 2024-05-16T22:34:53.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.190+0000 7f75b8591280 4 recover_dentries: inspecting lump 1.00000000 2024-05-16T22:34:53.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.190+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:151 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x5645781e3c00 con 0x564578ba0880 2024-05-16T22:34:53.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.190+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 41 ==== osd_op_reply(151 1.00000000 [omap-get-header out=274b] v0'0 uv19 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:53.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.190+0000 7f75b8591280 4 recover_dentries: frag 1.00000000 fnode old v19 vs new v21 2024-05-16T22:34:53.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.190+0000 7f75b8591280 4 recover_dentries: writing fnode to omap header 2024-05-16T22:34:53.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.190+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:152 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x5645781e3000 con 0x564578ba0880 2024-05-16T22:34:53.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.191+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 42 ==== osd_op_reply(152 1.00000000 [omap-set-header] v51'20 uv20 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:53.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.191+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:153 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x5645781e2000 con 0x564578ba0880 2024-05-16T22:34:53.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.191+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 43 ==== osd_op_reply(153 1.00000000 [omap-get-vals-by-keys out=613b] v0'0 uv20 ondisk = 0) ==== 154+0+613 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:53.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.191+0000 7f75b8591280 4 recover_dentries: inspecting fullbit 1.00000000/dir 2024-05-16T22:34:53.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.191+0000 7f75b8591280 4 recover_dentries: dentry dir_head existed already 2024-05-16T22:34:53.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.191+0000 7f75b8591280 4 recover_dentries: dentry exists, checking versions... 2024-05-16T22:34:54.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.191+0000 7f75b8591280 4 recover_dentries: decoded embedded inode version 18 vs fullbit version 20 2024-05-16T22:34:54.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.191+0000 7f75b8591280 4 recover_dentries: writing I dentry dir_head into frag 1.00000000 2024-05-16T22:34:54.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.191+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:154 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-vals in=613b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578220c00 con 0x564578ba0880 2024-05-16T22:34:54.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.192+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 44 ==== osd_op_reply(154 1.00000000 [omap-set-vals] v51'21 uv21 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:54.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.192+0000 7f75b8591280 4 recover_dentries: updating root 0x0x1 2024-05-16T22:34:54.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.192+0000 7f75b8591280 4 recover_dentries: object id 1.00000000.inode 2024-05-16T22:34:54.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.192+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] -- osd_op(unknown.0.0:155 6.14 6:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578221000 con 0x564578ba0400 2024-05-16T22:34:54.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.192+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.2 v2:172.21.15.44:6800/2908194156 18 ==== osd_op_reply(155 1.00000000.inode [read 0~582 out=582b] v0'0 uv36 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x564577eba500 con 0x564578ba0400 2024-05-16T22:34:54.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.193+0000 7f75b8591280 4 recover_dentries: root exists, will modify (582) 2024-05-16T22:34:54.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.193+0000 7f75b8591280 4 recover_dentries: magic ok 2024-05-16T22:34:54.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.193+0000 7f75b8591280 4 recover_dentries: writing root ino 1.00000000.inode version 9 2024-05-16T22:34:54.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.193+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] -- osd_op(unknown.0.0:156 6.14 6:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578221400 con 0x564578ba0400 2024-05-16T22:34:54.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.194+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.2 v2:172.21.15.44:6800/2908194156 19 ==== osd_op_reply(156 1.00000000.inode [writefull 0~582] v51'37 uv37 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x564577eba500 con 0x564578ba0400 2024-05-16T22:34:54.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.194+0000 7f75b8591280 4 recover_dentries: inspecting lump 1.00000000 2024-05-16T22:34:54.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.194+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:157 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578221800 con 0x564578ba0880 2024-05-16T22:34:54.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.194+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 45 ==== osd_op_reply(157 1.00000000 [omap-get-header out=274b] v0'0 uv21 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:54.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.194+0000 7f75b8591280 4 recover_dentries: frag 1.00000000 fnode old v21 vs new v23 2024-05-16T22:34:54.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.194+0000 7f75b8591280 4 recover_dentries: writing fnode to omap header 2024-05-16T22:34:54.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.194+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:158 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578232000 con 0x564578ba0880 2024-05-16T22:34:54.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.195+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 46 ==== osd_op_reply(158 1.00000000 [omap-set-header] v51'22 uv22 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:54.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.195+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:159 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578232400 con 0x564578ba0880 2024-05-16T22:34:54.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.195+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 47 ==== osd_op_reply(159 1.00000000 [omap-get-vals-by-keys out=613b] v0'0 uv22 ondisk = 0) ==== 154+0+613 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:54.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.195+0000 7f75b8591280 4 recover_dentries: inspecting fullbit 1.00000000/dir 2024-05-16T22:34:55.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.195+0000 7f75b8591280 4 recover_dentries: dentry dir_head existed already 2024-05-16T22:34:55.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.195+0000 7f75b8591280 4 recover_dentries: dentry exists, checking versions... 2024-05-16T22:34:55.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.195+0000 7f75b8591280 4 recover_dentries: decoded embedded inode version 20 vs fullbit version 22 2024-05-16T22:34:55.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.195+0000 7f75b8591280 4 recover_dentries: writing I dentry dir_head into frag 1.00000000 2024-05-16T22:34:55.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.195+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:160 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-vals in=613b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578232800 con 0x564578ba0880 2024-05-16T22:34:55.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.196+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 48 ==== osd_op_reply(160 1.00000000 [omap-set-vals] v51'23 uv23 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:55.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.196+0000 7f75b8591280 4 recover_dentries: inspecting lump 10000000004.00000000 2024-05-16T22:34:55.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.196+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] -- osd_op(unknown.0.0:161 6.5 6:a367a3e8:::10000000004.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578232c00 con 0x564578ba1a80 2024-05-16T22:34:55.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.196+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.7 v2:172.21.15.70:6816/3619691281 36 ==== osd_op_reply(161 10000000004.00000000 [omap-get-header out=274b] v0'0 uv1 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5645781c9400 con 0x564578ba1a80 2024-05-16T22:34:55.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.196+0000 7f75b8591280 4 recover_dentries: frag 10000000004.00000000 fnode old v1 vs new v3 2024-05-16T22:34:55.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.196+0000 7f75b8591280 4 recover_dentries: writing fnode to omap header 2024-05-16T22:34:55.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.196+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] -- osd_op(unknown.0.0:162 6.5 6:a367a3e8:::10000000004.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578233000 con 0x564578ba1a80 2024-05-16T22:34:55.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.197+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.7 v2:172.21.15.70:6816/3619691281 37 ==== osd_op_reply(162 10000000004.00000000 [omap-set-header] v51'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5645781c9400 con 0x564578ba1a80 2024-05-16T22:34:55.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.198+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] -- osd_op(unknown.0.0:163 6.5 6:a367a3e8:::10000000004.00000000:head [omap-get-vals-by-keys in=253b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578233400 con 0x564578ba1a80 2024-05-16T22:34:55.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.198+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.7 v2:172.21.15.70:6816/3619691281 38 ==== osd_op_reply(163 10000000004.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv2 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x5645781c9400 con 0x564578ba1a80 2024-05-16T22:34:55.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.198+0000 7f75b8591280 4 recover_dentries: inspecting fullbit 10000000004.00000000/bUHUwH9E8uiVaf8xZ+zONcB1CToj53x5aUUnKdnNj5U37zbh28l1AaWwHhbOT3HyzqKjmSKKW1o4odQJc7nF9xrKIB8D3b4qqb2Cs6s7t2106hHhQk5,YV7DtpeNPZnorcTqxPM,hExtWHSS4P+S+Dpwj62hMyh,77sGhiW1Filvv1gQjV+sN,GozPNwHgfleadkUuZ+PMLCaKQXhuid9WvmHanxJnaabYDLj4VEz+EX2WsG 2024-05-16T22:34:55.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.198+0000 7f75b8591280 4 recover_dentries: dentry did not already exist, will create 2024-05-16T22:34:55.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.198+0000 7f75b8591280 4 recover_dentries: writing I dentry bUHUwH9E8uiVaf8xZ+zONcB1CToj53x5aUUnKdnNj5U37zbh28l1AaWwHhbOT3HyzqKjmSKKW1o4odQJc7nF9xrKIB8D3b4qqb2Cs6s7t2106hHhQk5,YV7DtpeNPZnorcTqxPM,hExtWHSS4P+S+Dpwj62hMyh,77sGhiW1Filvv1gQjV+sN,GozPNwHgfleadkUuZ+PMLCaKQXhuid9WvmHanxJnaabYDLj4VEz+EX2WsG_head into frag 10000000004.00000000 2024-05-16T22:34:55.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.198+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] -- osd_op(unknown.0.0:164 6.5 6:a367a3e8:::10000000004.00000000:head [omap-set-vals in=896b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578233c00 con 0x564578ba1a80 2024-05-16T22:34:55.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.199+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.7 v2:172.21.15.70:6816/3619691281 39 ==== osd_op_reply(164 10000000004.00000000 [omap-set-vals] v51'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5645781c9400 con 0x564578ba1a80 2024-05-16T22:34:55.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.199+0000 7f75b8591280 4 recover_dentries: inspecting lump 602.00000000 2024-05-16T22:34:55.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.199+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6824/1074109859,v1:172.21.15.44:6825/1074109859] -- osd_op(unknown.0.0:165 6.10 6:0bd6d154:::602.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578232000 con 0x564578ba0d00 2024-05-16T22:34:55.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.200+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.0 v2:172.21.15.44:6824/1074109859 24 ==== osd_op_reply(165 602.00000000 [omap-get-header out=274b] v0'0 uv20 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x564577eba500 con 0x564578ba0d00 2024-05-16T22:34:55.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.200+0000 7f75b8591280 4 recover_dentries: frag 602.00000000 fnode old v10 vs new v12 2024-05-16T22:34:55.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.200+0000 7f75b8591280 4 recover_dentries: writing fnode to omap header 2024-05-16T22:34:55.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.200+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6824/1074109859,v1:172.21.15.44:6825/1074109859] -- osd_op(unknown.0.0:166 6.10 6:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578220c00 con 0x564578ba0d00 2024-05-16T22:34:55.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.201+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.0 v2:172.21.15.44:6824/1074109859 25 ==== osd_op_reply(166 602.00000000 [omap-set-header] v51'21 uv21 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x564577eba500 con 0x564578ba0d00 2024-05-16T22:34:55.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.201+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6824/1074109859,v1:172.21.15.44:6825/1074109859] -- osd_op(unknown.0.0:167 6.10 6:0bd6d154:::602.00000000:head [omap-get-vals-by-keys in=24b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578221800 con 0x564578ba0d00 2024-05-16T22:34:56.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.201+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.0 v2:172.21.15.44:6824/1074109859 26 ==== osd_op_reply(167 602.00000000 [omap-get-vals-by-keys out=588b] v0'0 uv21 ondisk = 0) ==== 156+0+588 (crc 0 0 0) 0x564577eba500 con 0x564578ba0d00 2024-05-16T22:34:56.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.201+0000 7f75b8591280 4 recover_dentries: inspecting nullbit 602.00000000/10000000000 2024-05-16T22:34:56.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.201+0000 7f75b8591280 4 recover_dentries: dentry exists, will remove 2024-05-16T22:34:56.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.201+0000 7f75b8591280 10 recover_dentries: Existing full inode in slot to be (maybe) removed by null journal dn '10000000000' with lump fnode version 12vs existing fnode version 10 2024-05-16T22:34:56.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.201+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6824/1074109859,v1:172.21.15.44:6825/1074109859] -- osd_op(unknown.0.0:168 6.10 6:0bd6d154:::602.00000000:head [omap-rm-keys in=24b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x5645781e3c00 con 0x564578ba0d00 2024-05-16T22:34:56.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.202+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.0 v2:172.21.15.44:6824/1074109859 27 ==== osd_op_reply(168 602.00000000 [omap-rm-keys] v51'22 uv22 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x564577eba500 con 0x564578ba0d00 2024-05-16T22:34:56.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.202+0000 7f75b8591280 4 recover_dentries: inspecting lump 100.00000000 2024-05-16T22:34:56.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.202+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:169 6.13 6:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x5645781e3000 con 0x564578ba0880 2024-05-16T22:34:56.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.202+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 49 ==== osd_op_reply(169 100.00000000 [omap-get-header out=274b] v0'0 uv4 ondisk = 0) ==== 156+0+274 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:56.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.202+0000 7f75b8591280 4 recover_dentries: frag 100.00000000 fnode old v3 vs new v5 2024-05-16T22:34:56.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.202+0000 7f75b8591280 4 recover_dentries: writing fnode to omap header 2024-05-16T22:34:56.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.202+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:170 6.13 6:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x5645781e2000 con 0x564578ba0880 2024-05-16T22:34:56.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.203+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 50 ==== osd_op_reply(170 100.00000000 [omap-set-header] v51'5 uv5 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:56.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.203+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:171 6.13 6:cd5a64a3:::100.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578121400 con 0x564578ba0880 2024-05-16T22:34:56.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.204+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 51 ==== osd_op_reply(171 100.00000000 [omap-get-vals-by-keys out=507b] v0'0 uv5 ondisk = 0) ==== 156+0+507 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:56.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.204+0000 7f75b8591280 4 recover_dentries: inspecting fullbit 100.00000000/stray2 2024-05-16T22:34:56.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.204+0000 7f75b8591280 4 recover_dentries: dentry stray2_head existed already 2024-05-16T22:34:56.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.204+0000 7f75b8591280 4 recover_dentries: dentry exists, checking versions... 2024-05-16T22:34:56.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.204+0000 7f75b8591280 4 recover_dentries: decoded embedded inode version 2 vs fullbit version 4 2024-05-16T22:34:56.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.204+0000 7f75b8591280 4 recover_dentries: writing I dentry stray2_head into frag 100.00000000 2024-05-16T22:34:56.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.204+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:172 6.13 6:cd5a64a3:::100.00000000:head [omap-set-vals in=507b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578121c00 con 0x564578ba0880 2024-05-16T22:34:56.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.206+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 52 ==== osd_op_reply(172 100.00000000 [omap-set-vals] v51'6 uv6 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5645781c9400 con 0x564578ba0880 2024-05-16T22:34:56.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.206+0000 7f75b8591280 4 recover_dentries: updating root 0x0x100 2024-05-16T22:34:56.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.206+0000 7f75b8591280 4 recover_dentries: object id 100.00000000.inode 2024-05-16T22:34:56.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.206+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:173 6.1f 6:fe07bba1:::100.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578120000 con 0x564578ba0880 2024-05-16T22:34:56.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.206+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 53 ==== osd_op_reply(173 100.00000000.inode [read 0~582 out=582b] v0'0 uv3 ondisk = 0) ==== 162+0+582 (crc 0 0 0) 0x5645781c8500 con 0x564578ba0880 2024-05-16T22:34:56.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.207+0000 7f75b8591280 4 recover_dentries: root exists, will modify (582) 2024-05-16T22:34:57.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.207+0000 7f75b8591280 4 recover_dentries: magic ok 2024-05-16T22:34:57.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.207+0000 7f75b8591280 4 recover_dentries: writing root ino 100.00000000.inode version 2 2024-05-16T22:34:57.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.207+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:174 6.1f 6:fe07bba1:::100.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578120c00 con 0x564578ba0880 2024-05-16T22:34:57.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.209+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 54 ==== osd_op_reply(174 100.00000000.inode [writefull 0~582] v51'24 uv24 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x5645781c8500 con 0x564578ba0880 2024-05-16T22:34:57.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.209+0000 7f75b8591280 4 recover_dentries: inspecting lump 1.00000000 2024-05-16T22:34:57.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.209+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:175 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578121800 con 0x564578ba0880 2024-05-16T22:34:57.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.209+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 55 ==== osd_op_reply(175 1.00000000 [omap-get-header out=274b] v0'0 uv23 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5645781c8500 con 0x564578ba0880 2024-05-16T22:34:57.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.209+0000 7f75b8591280 4 recover_dentries: frag 1.00000000 fnode old v23 vs new v25 2024-05-16T22:34:57.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.209+0000 7f75b8591280 4 recover_dentries: writing fnode to omap header 2024-05-16T22:34:57.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.209+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:176 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578121000 con 0x564578ba0880 2024-05-16T22:34:57.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.212+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 56 ==== osd_op_reply(176 1.00000000 [omap-set-header] v51'25 uv25 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5645781c8500 con 0x564578ba0880 2024-05-16T22:34:57.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.212+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:177 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578120400 con 0x564578ba0880 2024-05-16T22:34:57.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.212+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 57 ==== osd_op_reply(177 1.00000000 [omap-get-vals-by-keys out=570b] v0'0 uv25 ondisk = 0) ==== 154+0+570 (crc 0 0 0) 0x5645781c8500 con 0x564578ba0880 2024-05-16T22:34:57.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.212+0000 7f75b8591280 4 recover_dentries: inspecting fullbit 1.00000000/.fscrypt 2024-05-16T22:34:57.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.212+0000 7f75b8591280 4 recover_dentries: dentry .fscrypt_head existed already 2024-05-16T22:34:57.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.212+0000 7f75b8591280 4 recover_dentries: dentry exists, checking versions... 2024-05-16T22:34:57.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.212+0000 7f75b8591280 4 recover_dentries: decoded embedded inode version 16 vs fullbit version 24 2024-05-16T22:34:57.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.212+0000 7f75b8591280 4 recover_dentries: writing I dentry .fscrypt_head into frag 1.00000000 2024-05-16T22:34:57.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.212+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:178 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-vals in=570b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578221000 con 0x564578ba0880 2024-05-16T22:34:57.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.214+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 58 ==== osd_op_reply(178 1.00000000 [omap-set-vals] v51'26 uv26 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5645781c8500 con 0x564578ba0880 2024-05-16T22:34:57.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.214+0000 7f75b8591280 4 recover_dentries: inspecting lump 10000000001.00000000 2024-05-16T22:34:57.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.214+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] -- osd_op(unknown.0.0:179 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578221400 con 0x564578ba1180 2024-05-16T22:34:57.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.214+0000 7f75b653c640 1 -- 172.21.15.44:0/2553534249 <== osd.5 v2:172.21.15.70:6802/4218901987 36 ==== osd_op_reply(179 10000000001.00000000 [omap-get-header out=274b] v0'0 uv19 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5645781c9680 con 0x564578ba1180 2024-05-16T22:34:57.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.215+0000 7f75b8591280 4 recover_dentries: frag 10000000001.00000000 fnode old v21 vs new v22 2024-05-16T22:34:57.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.215+0000 7f75b8591280 4 recover_dentries: writing fnode to omap header 2024-05-16T22:34:57.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.215+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] -- osd_op(unknown.0.0:180 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578220c00 con 0x564578ba1180 2024-05-16T22:34:57.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.217+0000 7f75b653c640 1 -- 172.21.15.44:0/2553534249 <== osd.5 v2:172.21.15.70:6802/4218901987 37 ==== osd_op_reply(180 10000000001.00000000 [omap-set-header] v51'20 uv20 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5645781c9680 con 0x564578ba1180 2024-05-16T22:34:58.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.217+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] -- osd_op(unknown.0.0:181 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x5645781e3000 con 0x564578ba1180 2024-05-16T22:34:58.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.217+0000 7f75b653c640 1 -- 172.21.15.44:0/2553534249 <== osd.5 v2:172.21.15.70:6802/4218901987 38 ==== osd_op_reply(181 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv20 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x5645781c9680 con 0x564578ba1180 2024-05-16T22:34:58.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.217+0000 7f75b8591280 4 recover_dentries: inspecting lump 1.00000000 2024-05-16T22:34:58.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.217+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:182 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x5645781e2000 con 0x564578ba0880 2024-05-16T22:34:58.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.218+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 59 ==== osd_op_reply(182 1.00000000 [omap-get-header out=274b] v0'0 uv26 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5645781c8500 con 0x564578ba0880 2024-05-16T22:34:58.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.218+0000 7f75b8591280 4 recover_dentries: frag 1.00000000 fnode old v25 vs new v27 2024-05-16T22:34:58.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.218+0000 7f75b8591280 4 recover_dentries: writing fnode to omap header 2024-05-16T22:34:58.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.218+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:183 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x5645781e2c00 con 0x564578ba0880 2024-05-16T22:34:58.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.220+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 60 ==== osd_op_reply(183 1.00000000 [omap-set-header] v51'27 uv27 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5645781c8500 con 0x564578ba0880 2024-05-16T22:34:58.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.220+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:184 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x5645781e3400 con 0x564578ba0880 2024-05-16T22:34:58.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.220+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 61 ==== osd_op_reply(184 1.00000000 [omap-get-vals-by-keys out=570b] v0'0 uv27 ondisk = 0) ==== 154+0+570 (crc 0 0 0) 0x5645781c8500 con 0x564578ba0880 2024-05-16T22:34:58.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.220+0000 7f75b8591280 4 recover_dentries: inspecting fullbit 1.00000000/.fscrypt 2024-05-16T22:34:58.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.220+0000 7f75b8591280 4 recover_dentries: dentry .fscrypt_head existed already 2024-05-16T22:34:58.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.220+0000 7f75b8591280 4 recover_dentries: dentry exists, checking versions... 2024-05-16T22:34:58.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.220+0000 7f75b8591280 4 recover_dentries: decoded embedded inode version 24 vs fullbit version 26 2024-05-16T22:34:58.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.220+0000 7f75b8591280 4 recover_dentries: writing I dentry .fscrypt_head into frag 1.00000000 2024-05-16T22:34:58.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.220+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:185 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-vals in=570b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x5645781e2800 con 0x564578ba0880 2024-05-16T22:34:58.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.222+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 62 ==== osd_op_reply(185 1.00000000 [omap-set-vals] v51'28 uv28 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5645781c8500 con 0x564578ba0880 2024-05-16T22:34:58.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.222+0000 7f75b8591280 4 recover_dentries: updating root 0x0x1 2024-05-16T22:34:58.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.222+0000 7f75b8591280 4 recover_dentries: object id 1.00000000.inode 2024-05-16T22:34:58.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.222+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] -- osd_op(unknown.0.0:186 6.14 6:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x5645781e3800 con 0x564578ba0400 2024-05-16T22:34:58.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.223+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.2 v2:172.21.15.44:6800/2908194156 20 ==== osd_op_reply(186 1.00000000.inode [read 0~582 out=582b] v0'0 uv37 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x564577eba500 con 0x564578ba0400 2024-05-16T22:34:58.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.223+0000 7f75b8591280 4 recover_dentries: root exists, will modify (582) 2024-05-16T22:34:58.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.223+0000 7f75b8591280 4 recover_dentries: magic ok 2024-05-16T22:34:58.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.223+0000 7f75b8591280 4 recover_dentries: writing root ino 1.00000000.inode version 10 2024-05-16T22:34:58.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.223+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] -- osd_op(unknown.0.0:187 6.14 6:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578121400 con 0x564578ba0400 2024-05-16T22:34:59.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.224+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.2 v2:172.21.15.44:6800/2908194156 21 ==== osd_op_reply(187 1.00000000.inode [writefull 0~582] v51'38 uv38 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x564577eba500 con 0x564578ba0400 2024-05-16T22:34:59.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.224+0000 7f75b8591280 4 recover_dentries: inspecting lump 1.00000000 2024-05-16T22:34:59.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.224+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:188 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578121c00 con 0x564578ba0880 2024-05-16T22:34:59.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.224+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 63 ==== osd_op_reply(188 1.00000000 [omap-get-header out=274b] v0'0 uv28 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5645781c8500 con 0x564578ba0880 2024-05-16T22:34:59.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.224+0000 7f75b8591280 4 recover_dentries: frag 1.00000000 fnode old v27 vs new v28 2024-05-16T22:34:59.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.224+0000 7f75b8591280 4 recover_dentries: writing fnode to omap header 2024-05-16T22:34:59.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.224+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:189 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578120000 con 0x564578ba0880 2024-05-16T22:34:59.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.225+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 64 ==== osd_op_reply(189 1.00000000 [omap-set-header] v51'29 uv29 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5645781c8500 con 0x564578ba0880 2024-05-16T22:34:59.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.225+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:190 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578120c00 con 0x564578ba0880 2024-05-16T22:34:59.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.225+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 65 ==== osd_op_reply(190 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv29 ondisk = 0) ==== 154+0+4 (crc 0 0 0) 0x5645781c8500 con 0x564578ba0880 2024-05-16T22:34:59.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.225+0000 7f75b8591280 4 recover_dentries: updating root 0x0x1 2024-05-16T22:34:59.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.225+0000 7f75b8591280 4 recover_dentries: object id 1.00000000.inode 2024-05-16T22:34:59.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.225+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] -- osd_op(unknown.0.0:191 6.14 6:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578121800 con 0x564578ba0400 2024-05-16T22:34:59.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.226+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.2 v2:172.21.15.44:6800/2908194156 22 ==== osd_op_reply(191 1.00000000.inode [read 0~582 out=582b] v0'0 uv38 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x564577eba500 con 0x564578ba0400 2024-05-16T22:34:59.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.226+0000 7f75b8591280 4 recover_dentries: root exists, will modify (582) 2024-05-16T22:34:59.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.226+0000 7f75b8591280 4 recover_dentries: magic ok 2024-05-16T22:34:59.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.226+0000 7f75b8591280 4 recover_dentries: writing root ino 1.00000000.inode version 11 2024-05-16T22:34:59.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.226+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] -- osd_op(unknown.0.0:192 6.14 6:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578120800 con 0x564578ba0400 2024-05-16T22:34:59.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.227+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.2 v2:172.21.15.44:6800/2908194156 23 ==== osd_op_reply(192 1.00000000.inode [writefull 0~582] v51'39 uv39 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x564577eba500 con 0x564578ba0400 2024-05-16T22:34:59.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.227+0000 7f75b8591280 4 recover_dentries: inspecting lump 1.00000000 2024-05-16T22:34:59.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.227+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:193 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578232000 con 0x564578ba0880 2024-05-16T22:34:59.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.227+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 66 ==== osd_op_reply(193 1.00000000 [omap-get-header out=274b] v0'0 uv29 ondisk = 0) ==== 154+0+274 (crc 0 0 0) 0x5645781c8500 con 0x564578ba0880 2024-05-16T22:34:59.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.227+0000 7f75b8591280 4 recover_dentries: frag 1.00000000 fnode old v28 vs new v30 2024-05-16T22:34:59.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.227+0000 7f75b8591280 4 recover_dentries: writing fnode to omap header 2024-05-16T22:34:59.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.227+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:194 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578232400 con 0x564578ba0880 2024-05-16T22:34:59.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.228+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 67 ==== osd_op_reply(194 1.00000000 [omap-set-header] v51'30 uv30 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5645781c8500 con 0x564578ba0880 2024-05-16T22:34:59.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.228+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:195 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578232800 con 0x564578ba0880 2024-05-16T22:35:00.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.228+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 68 ==== osd_op_reply(195 1.00000000 [omap-get-vals-by-keys out=613b] v0'0 uv30 ondisk = 0) ==== 154+0+613 (crc 0 0 0) 0x5645781c8500 con 0x564578ba0880 2024-05-16T22:35:00.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.228+0000 7f75b8591280 4 recover_dentries: inspecting fullbit 1.00000000/dir 2024-05-16T22:35:00.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.228+0000 7f75b8591280 4 recover_dentries: dentry dir_head existed already 2024-05-16T22:35:00.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.228+0000 7f75b8591280 4 recover_dentries: dentry exists, checking versions... 2024-05-16T22:35:00.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.228+0000 7f75b8591280 4 recover_dentries: decoded embedded inode version 22 vs fullbit version 29 2024-05-16T22:35:00.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.228+0000 7f75b8591280 4 recover_dentries: writing I dentry dir_head into frag 1.00000000 2024-05-16T22:35:00.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.228+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:196 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-vals in=613b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578232c00 con 0x564578ba0880 2024-05-16T22:35:00.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.231+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 69 ==== osd_op_reply(196 1.00000000 [omap-set-vals] v51'31 uv31 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5645781c8500 con 0x564578ba0880 2024-05-16T22:35:00.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.231+0000 7f75b8591280 4 recover_dentries: inspecting lump 10000000004.00000000 2024-05-16T22:35:00.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.231+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] -- osd_op(unknown.0.0:197 6.5 6:a367a3e8:::10000000004.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578233000 con 0x564578ba1a80 2024-05-16T22:35:00.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.231+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.7 v2:172.21.15.70:6816/3619691281 40 ==== osd_op_reply(197 10000000004.00000000 [omap-get-header out=274b] v0'0 uv3 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5645781c8500 con 0x564578ba1a80 2024-05-16T22:35:00.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.231+0000 7f75b8591280 4 recover_dentries: frag 10000000004.00000000 fnode old v3 vs new v5 2024-05-16T22:35:00.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.231+0000 7f75b8591280 4 recover_dentries: writing fnode to omap header 2024-05-16T22:35:00.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.231+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] -- osd_op(unknown.0.0:198 6.5 6:a367a3e8:::10000000004.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578233400 con 0x564578ba1a80 2024-05-16T22:35:00.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.232+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.7 v2:172.21.15.70:6816/3619691281 41 ==== osd_op_reply(198 10000000004.00000000 [omap-set-header] v51'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5645781c8500 con 0x564578ba1a80 2024-05-16T22:35:00.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.232+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] -- osd_op(unknown.0.0:199 6.5 6:a367a3e8:::10000000004.00000000:head [omap-get-vals-by-keys in=253b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578233800 con 0x564578ba1a80 2024-05-16T22:35:00.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.232+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.7 v2:172.21.15.70:6816/3619691281 42 ==== osd_op_reply(199 10000000004.00000000 [omap-get-vals-by-keys out=896b] v0'0 uv4 ondisk = 0) ==== 164+0+896 (crc 0 0 0) 0x5645781c8500 con 0x564578ba1a80 2024-05-16T22:35:00.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.232+0000 7f75b8591280 4 recover_dentries: inspecting fullbit 10000000004.00000000/bUHUwH9E8uiVaf8xZ+zONcB1CToj53x5aUUnKdnNj5U37zbh28l1AaWwHhbOT3HyzqKjmSKKW1o4odQJc7nF9xrKIB8D3b4qqb2Cs6s7t2106hHhQk5,YV7DtpeNPZnorcTqxPM,hExtWHSS4P+S+Dpwj62hMyh,77sGhiW1Filvv1gQjV+sN,GozPNwHgfleadkUuZ+PMLCaKQXhuid9WvmHanxJnaabYDLj4VEz+EX2WsG 2024-05-16T22:35:00.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.232+0000 7f75b8591280 4 recover_dentries: dentry bUHUwH9E8uiVaf8xZ+zONcB1CToj53x5aUUnKdnNj5U37zbh28l1AaWwHhbOT3HyzqKjmSKKW1o4odQJc7nF9xrKIB8D3b4qqb2Cs6s7t2106hHhQk5,YV7DtpeNPZnorcTqxPM,hExtWHSS4P+S+Dpwj62hMyh,77sGhiW1Filvv1gQjV+sN,GozPNwHgfleadkUuZ+PMLCaKQXhuid9WvmHanxJnaabYDLj4VEz+EX2WsG_head existed already 2024-05-16T22:35:00.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.232+0000 7f75b8591280 4 recover_dentries: dentry exists, checking versions... 2024-05-16T22:35:00.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.232+0000 7f75b8591280 4 recover_dentries: decoded embedded inode version 2 vs fullbit version 4 2024-05-16T22:35:00.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.232+0000 7f75b8591280 4 recover_dentries: writing I dentry bUHUwH9E8uiVaf8xZ+zONcB1CToj53x5aUUnKdnNj5U37zbh28l1AaWwHhbOT3HyzqKjmSKKW1o4odQJc7nF9xrKIB8D3b4qqb2Cs6s7t2106hHhQk5,YV7DtpeNPZnorcTqxPM,hExtWHSS4P+S+Dpwj62hMyh,77sGhiW1Filvv1gQjV+sN,GozPNwHgfleadkUuZ+PMLCaKQXhuid9WvmHanxJnaabYDLj4VEz+EX2WsG_head into frag 10000000004.00000000 2024-05-16T22:35:00.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.232+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] -- osd_op(unknown.0.0:200 6.5 6:a367a3e8:::10000000004.00000000:head [omap-set-vals in=896b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578232000 con 0x564578ba1a80 2024-05-16T22:35:00.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.233+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.7 v2:172.21.15.70:6816/3619691281 43 ==== osd_op_reply(200 10000000004.00000000 [omap-set-vals] v51'5 uv5 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5645781c8500 con 0x564578ba1a80 2024-05-16T22:35:01.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.233+0000 7f75b8591280 4 recover_dentries: updating root 0x0x1 2024-05-16T22:35:01.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.233+0000 7f75b8591280 4 recover_dentries: object id 1.00000000.inode 2024-05-16T22:35:01.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.233+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] -- osd_op(unknown.0.0:201 6.14 6:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578232400 con 0x564578ba0400 2024-05-16T22:35:01.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.234+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.2 v2:172.21.15.44:6800/2908194156 24 ==== osd_op_reply(201 1.00000000.inode [read 0~582 out=582b] v0'0 uv39 ondisk = 0) ==== 160+0+582 (crc 0 0 0) 0x564577eba500 con 0x564578ba0400 2024-05-16T22:35:01.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.234+0000 7f75b8591280 4 recover_dentries: root exists, will modify (582) 2024-05-16T22:35:01.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.234+0000 7f75b8591280 4 recover_dentries: magic ok 2024-05-16T22:35:01.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.234+0000 7f75b8591280 4 recover_dentries: writing root ino 1.00000000.inode version 12 2024-05-16T22:35:01.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.234+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] -- osd_op(unknown.0.0:202 6.14 6:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578232800 con 0x564578ba0400 2024-05-16T22:35:01.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.235+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 <== osd.2 v2:172.21.15.44:6800/2908194156 25 ==== osd_op_reply(202 1.00000000.inode [writefull 0~582] v51'40 uv40 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x564577eba500 con 0x564578ba0400 2024-05-16T22:35:01.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.235+0000 7f75b8591280 4 main_event: consumed 9 inodes 2024-05-16T22:35:01.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.235+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:203 6.13 6:c91d4a1d:::mds0_inotable:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x564578232c00 con 0x564578ba0880 2024-05-16T22:35:01.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.235+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 70 ==== osd_op_reply(203 mds0_inotable [read 0~34 out=34b] v0'0 uv2 ondisk = 0) ==== 157+0+34 (crc 0 0 0) 0x5645781c8500 con 0x564578ba0880 2024-05-16T22:35:01.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.235+0000 7f75b8591280 4 consume_inos: Used ino 0x0x10000000000 requires inotable update 2024-05-16T22:35:01.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.235+0000 7f75b8591280 4 consume_inos: Used ino 0x0x10000000001 requires inotable update 2024-05-16T22:35:01.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.235+0000 7f75b8591280 4 consume_inos: Used ino 0x0x10000000002 requires inotable update 2024-05-16T22:35:01.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.235+0000 7f75b8591280 4 consume_inos: Used ino 0x0x10000000003 requires inotable update 2024-05-16T22:35:01.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.235+0000 7f75b8591280 4 consume_inos: Used ino 0x0x10000000004 requires inotable update 2024-05-16T22:35:01.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.235+0000 7f75b8591280 4 consume_inos: Used ino 0x0x10000000005 requires inotable update 2024-05-16T22:35:01.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.235+0000 7f75b8591280 4 consume_inos: Used ino 0x0x100000001fa requires inotable update 2024-05-16T22:35:01.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.235+0000 7f75b8591280 4 consume_inos: Used ino 0x0x100000001fb requires inotable update 2024-05-16T22:35:01.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.235+0000 7f75b8591280 4 consume_inos: writing modified inotable version 1 2024-05-16T22:35:01.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.235+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:204 6.13 6:c91d4a1d:::mds0_inotable:head [writefull 0~50 in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x564578233000 con 0x564578ba0880 2024-05-16T22:35:01.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.236+0000 7f75b753e640 1 -- 172.21.15.44:0/2553534249 <== osd.3 v2:172.21.15.44:6808/2168695793 71 ==== osd_op_reply(204 mds0_inotable [writefull 0~50] v51'7 uv7 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x5645781c8500 con 0x564578ba0880 2024-05-16T22:35:01.879 INFO:teuthology.orchestra.run.smithi044.stdout:0.000000 0x400000 LID: () 2024-05-16T22:35:01.911 INFO:teuthology.orchestra.run.smithi044.stdout:2024-05-16T22:33:11.806107+0000 0x400030 SUBTREEMAP: () 2024-05-16T22:35:01.944 INFO:teuthology.orchestra.run.smithi044.stdout:2024-05-16T22:34:05.115723+0000 0x4003ac SESSION: () 2024-05-16T22:35:01.977 INFO:teuthology.orchestra.run.smithi044.stdout:2024-05-16T22:34:06.124692+0000 0x4004ae OPEN: () 2024-05-16T22:35:02.011 INFO:teuthology.orchestra.run.smithi044.stdout:2024-05-16T22:34:06.124960+0000 0x40055a UPDATE: (setattr) 2024-05-16T22:35:02.050 INFO:teuthology.orchestra.run.smithi044.stdout: / 2024-05-16T22:35:02.111 INFO:teuthology.orchestra.run.smithi044.stdout:2024-05-16T22:34:13.517451+0000 0x400889 UPDATE: (mkdir) 2024-05-16T22:35:02.144 INFO:teuthology.orchestra.run.smithi044.stdout: .tmp2112225443 2024-05-16T22:35:02.177 INFO:teuthology.orchestra.run.smithi044.stdout:2024-05-16T22:34:13.521303+0000 0x4010ac UPDATE: (mkdir) 2024-05-16T22:35:02.211 INFO:teuthology.orchestra.run.smithi044.stdout: .tmp2112225443/.fscrypt 2024-05-16T22:35:02.267 INFO:teuthology.orchestra.run.smithi044.stdout:2024-05-16T22:34:13.522488+0000 0x401a06 UPDATE: (mkdir) 2024-05-16T22:35:02.302 INFO:teuthology.orchestra.run.smithi044.stdout: .fscrypt/policies 2024-05-16T22:35:02.336 INFO:teuthology.orchestra.run.smithi044.stdout:2024-05-16T22:34:13.523723+0000 0x40235a UPDATE: (mkdir) 2024-05-16T22:35:02.386 INFO:teuthology.orchestra.run.smithi044.stdout: .fscrypt/protectors 2024-05-16T22:35:02.419 INFO:teuthology.orchestra.run.smithi044.stdout:2024-05-16T22:34:13.529171+0000 0x402cb0 UPDATE: (rename) 2024-05-16T22:35:02.475 INFO:teuthology.orchestra.run.smithi044.stdout: .fscrypt 2024-05-16T22:35:02.511 INFO:teuthology.orchestra.run.smithi044.stdout: .tmp2112225443/.fscrypt 2024-05-16T22:35:02.544 INFO:teuthology.orchestra.run.smithi044.stdout:2024-05-16T22:34:13.534625+0000 0x40372f UPDATE: (unlink_local) 2024-05-16T22:35:02.578 INFO:teuthology.orchestra.run.smithi044.stdout: .tmp2112225443 2024-05-16T22:35:02.611 INFO:teuthology.orchestra.run.smithi044.stdout: stray2/10000000000 2024-05-16T22:35:02.644 INFO:teuthology.orchestra.run.smithi044.stdout:2024-05-16T22:34:13.672722+0000 0x4042d7 UPDATE: (scatter_writebehind) 2024-05-16T22:35:02.678 INFO:teuthology.orchestra.run.smithi044.stdout:2024-05-16T22:34:14.500425+0000 0x404749 UPDATE: (mkdir) 2024-05-16T22:35:02.736 INFO:teuthology.orchestra.run.smithi044.stdout: dir 2024-05-16T22:35:02.770 INFO:teuthology.orchestra.run.smithi044.stdout:2024-05-16T22:34:14.763438+0000 0x404f51 UPDATE: (openc) 2024-05-16T22:35:02.803 INFO:teuthology.orchestra.run.smithi044.stdout: .fscrypt/protectors/.tmp3443705943 2024-05-16T22:35:02.836 INFO:teuthology.orchestra.run.smithi044.stdout:2024-05-16T22:34:14.769322+0000 0x405b0f UPDATE: (cap update) 2024-05-16T22:35:02.870 INFO:teuthology.orchestra.run.smithi044.stdout: protectors/.tmp3443705943 2024-05-16T22:35:02.908 INFO:teuthology.orchestra.run.smithi044.stdout:2024-05-16T22:34:14.773180+0000 0x40634a UPDATE: (rename) 2024-05-16T22:35:02.945 INFO:teuthology.orchestra.run.smithi044.stdout: protectors/ea1af8aab8775ae6 2024-05-16T22:35:02.978 INFO:teuthology.orchestra.run.smithi044.stdout: protectors/.tmp3443705943 2024-05-16T22:35:03.012 INFO:teuthology.orchestra.run.smithi044.stdout:2024-05-16T22:34:14.777423+0000 0x406df6 UPDATE: (openc) 2024-05-16T22:35:03.045 INFO:teuthology.orchestra.run.smithi044.stdout: policies/.tmp2746194693 2024-05-16T22:35:03.078 INFO:teuthology.orchestra.run.smithi044.stdout:2024-05-16T22:34:14.780773+0000 0x407632 UPDATE: (cap update) 2024-05-16T22:35:03.112 INFO:teuthology.orchestra.run.smithi044.stdout: policies/.tmp2746194693 2024-05-16T22:35:03.145 INFO:teuthology.orchestra.run.smithi044.stdout:2024-05-16T22:34:14.784029+0000 0x407e6b UPDATE: (rename) 2024-05-16T22:35:03.179 INFO:teuthology.orchestra.run.smithi044.stdout: policies/59cd7ea472e281f80f1be4414d11a64f 2024-05-16T22:35:03.212 INFO:teuthology.orchestra.run.smithi044.stdout: policies/.tmp2746194693 2024-05-16T22:35:03.245 INFO:teuthology.orchestra.run.smithi044.stdout:2024-05-16T22:34:14.787143+0000 0x408923 UPDATE: (cap update) 2024-05-16T22:35:03.295 INFO:teuthology.orchestra.run.smithi044.stdout: dir 2024-05-16T22:35:03.366 INFO:teuthology.orchestra.run.smithi044.stdout:2024-05-16T22:34:14.789557+0000 0x409010 UPDATE: (cap update) 2024-05-16T22:35:03.404 INFO:teuthology.orchestra.run.smithi044.stdout: dir 2024-05-16T22:35:03.437 INFO:teuthology.orchestra.run.smithi044.stdout:2024-05-16T22:34:15.251822+0000 0x4096fd UPDATE: (openc) 2024-05-16T22:35:03.470 INFO:teuthology.orchestra.run.smithi044.stdout: dir/bUHUwH9E8uiVaf8xZ+zONcB1CToj53x5aUUnKdnNj5U37zbh28l1AaWwHhbOT3HyzqKjmSKKW1o4odQJc7nF9xrKIB8D3b4qqb2Cs6s7t2106hHhQk5,YV7DtpeNPZnorcTqxPM,hExtWHSS4P+S+Dpwj62hMyh,77sGhiW1Filvv1gQjV+sN,GozPNwHgfleadkUuZ+PMLCaKQXhuid9WvmHanxJnaabYDLj4VEz+EX2WsG 2024-05-16T22:35:03.504 INFO:teuthology.orchestra.run.smithi044.stdout:2024-05-16T22:34:17.844329+0000 0x40a16d UPDATE: (purge_stray) 2024-05-16T22:35:03.564 INFO:teuthology.orchestra.run.smithi044.stdout: 10000000000 2024-05-16T22:35:03.609 INFO:teuthology.orchestra.run.smithi044.stdout:2024-05-16T22:34:20.152521+0000 0x40a3c4 UPDATE: (scatter_writebehind) 2024-05-16T22:35:03.646 INFO:teuthology.orchestra.run.smithi044.stdout: stray2 2024-05-16T22:35:03.679 INFO:teuthology.orchestra.run.smithi044.stdout:2024-05-16T22:34:20.152948+0000 0x40aa37 UPDATE: (scatter_writebehind) 2024-05-16T22:35:03.713 INFO:teuthology.orchestra.run.smithi044.stdout: .fscrypt 2024-05-16T22:35:03.765 INFO:teuthology.orchestra.run.smithi044.stdout:2024-05-16T22:34:20.156182+0000 0x40aff0 UPDATE: (scatter_writebehind) 2024-05-16T22:35:03.804 INFO:teuthology.orchestra.run.smithi044.stdout: .fscrypt 2024-05-16T22:35:03.838 INFO:teuthology.orchestra.run.smithi044.stdout:2024-05-16T22:34:20.158613+0000 0x40b6a2 UPDATE: (scatter_writebehind) 2024-05-16T22:35:03.871 INFO:teuthology.orchestra.run.smithi044.stdout:2024-05-16T22:34:20.234138+0000 0x40bb14 UPDATE: (cap update) 2024-05-16T22:35:03.904 INFO:teuthology.orchestra.run.smithi044.stdout: dir/bUHUwH9E8uiVaf8xZ+zONcB1CToj53x5aUUnKdnNj5U37zbh28l1AaWwHhbOT3HyzqKjmSKKW1o4odQJc7nF9xrKIB8D3b4qqb2Cs6s7t2106hHhQk5,YV7DtpeNPZnorcTqxPM,hExtWHSS4P+S+Dpwj62hMyh,77sGhiW1Filvv1gQjV+sN,GozPNwHgfleadkUuZ+PMLCaKQXhuid9WvmHanxJnaabYDLj4VEz+EX2WsG 2024-05-16T22:35:03.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.236+0000 7f75b8591280 4 28 events 2024-05-16T22:35:03.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.237+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 >> [v2:172.21.15.44:6824/1074109859,v1:172.21.15.44:6825/1074109859] conn(0x564578ba0d00 msgr2=0x564577ea9180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:04.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.237+0000 7f75b8591280 1 --2- 172.21.15.44:0/2553534249 >> [v2:172.21.15.44:6824/1074109859,v1:172.21.15.44:6825/1074109859] conn(0x564578ba0d00 0x564577ea9180 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:04.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.237+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 >> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] conn(0x564578ba0400 msgr2=0x564577ea8680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:04.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.237+0000 7f75b8591280 1 --2- 172.21.15.44:0/2553534249 >> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] conn(0x564578ba0400 0x564577ea8680 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:04.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.237+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 >> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] conn(0x564578ba0880 msgr2=0x564577ea8c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:04.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.237+0000 7f75b8591280 1 --2- 172.21.15.44:0/2553534249 >> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] conn(0x564578ba0880 0x564577ea8c00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:04.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.237+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 >> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] conn(0x564578ba1180 msgr2=0x564577ea9700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:04.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.237+0000 7f75b8591280 1 --2- 172.21.15.44:0/2553534249 >> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] conn(0x564578ba1180 0x564577ea9700 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:04.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.237+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 >> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] conn(0x564578ba1a80 msgr2=0x5645781e4000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:04.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.237+0000 7f75b8591280 1 --2- 172.21.15.44:0/2553534249 >> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] conn(0x564578ba1a80 0x5645781e4000 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:04.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.237+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 reap_dead start 2024-05-16T22:35:04.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.237+0000 7f75b6d3d640 1 -- 172.21.15.44:0/2553534249 reap_dead start 2024-05-16T22:35:04.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.237+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x564578ba1600 msgr2=0x564577ea8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:04.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.237+0000 7f75b8591280 1 --2- 172.21.15.44:0/2553534249 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x564578ba1600 0x564577ea8100 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x564577efcae0 tx=0x564577ecbc20 comp rx=0 tx=0).stop 2024-05-16T22:35:04.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.237+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564578b9ff80 msgr2=0x564577ea7b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:04.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.237+0000 7f75b8591280 1 --2- 172.21.15.44:0/2553534249 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564578b9ff80 0x564577ea7b80 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x564578bbbc80 tx=0x564577ecb860 comp rx=0 tx=0).stop 2024-05-16T22:35:04.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.237+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 shutdown_connections 2024-05-16T22:35:04.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.237+0000 7f75b8591280 1 --2- 172.21.15.44:0/2553534249 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x564578ba1600 0x564577ea8100 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:04.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.237+0000 7f75b8591280 1 --2- 172.21.15.44:0/2553534249 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564578b9ff80 0x564577ea7b80 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:04.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.237+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 >> 172.21.15.44:0/2553534249 conn(0x564578b9f200 msgr2=0x564577eb9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:35:04.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.237+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 shutdown_connections 2024-05-16T22:35:04.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.237+0000 7f75b8591280 1 -- 172.21.15.44:0/2553534249 wait complete. 2024-05-16T22:35:04.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.237+0000 7f75b8591280 1 -- 172.21.15.44:0/251529974 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564578b9e900 msgr2=0x564577ea6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:04.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.237+0000 7f75b8591280 1 --2- 172.21.15.44:0/251529974 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564578b9e900 0x564577ea6000 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x564578bd9590 tx=0x564577ecbe00 comp rx=0 tx=0).stop 2024-05-16T22:35:05.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.237+0000 7f75b8591280 1 -- 172.21.15.44:0/251529974 shutdown_connections 2024-05-16T22:35:05.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.237+0000 7f75b8591280 1 --2- 172.21.15.44:0/251529974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564578b9ed80 0x564577ea6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:05.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.237+0000 7f75b8591280 1 --2- 172.21.15.44:0/251529974 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564578b9e900 0x564577ea6000 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:05.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.237+0000 7f75b8591280 1 --2- 172.21.15.44:0/251529974 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x564578b9e480 0x564577ea6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:05.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.237+0000 7f75b8591280 1 -- 172.21.15.44:0/251529974 >> 172.21.15.44:0/251529974 conn(0x564578b9e000 msgr2=0x564577eb9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:35:05.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.237+0000 7f75b8591280 1 -- 172.21.15.44:0/251529974 shutdown_connections 2024-05-16T22:35:05.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:34:25.237+0000 7f75b8591280 1 -- 172.21.15.44:0/251529974 wait complete. 2024-05-16T22:35:05.373 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'event', 'recover_dentries', 'list'] in time 0:00:40.446898, result: 0.000000 0x400000 LID: () 2024-05-16T22:33:11.806107+0000 0x400030 SUBTREEMAP: () 2024-05-16T22:34:05.115723+0000 0x4003ac SESSION: () 2024-05-16T22:34:06.124692+0000 0x4004ae OPEN: () 2024-05-16T22:34:06.124960+0000 0x40055a UPDATE: (setattr) / 2024-05-16T22:34:13.517451+0000 0x400889 UPDATE: (mkdir) .tmp2112225443 2024-05-16T22:34:13.521303+0000 0x4010ac UPDATE: (mkdir) .tmp2112225443/.fscrypt 2024-05-16T22:34:13.522488+0000 0x401a06 UPDATE: (mkdir) .fscrypt/policies 2024-05-16T22:34:13.523723+0000 0x40235a UPDATE: (mkdir) .fscrypt/protectors 2024-05-16T22:34:13.529171+0000 0x402cb0 UPDATE: (rename) .fscrypt .tmp2112225443/.fscrypt 2024-05-16T22:34:13.534625+0000 0x40372f UPDATE: (unlink_local) .tmp2112225443 stray2/10000000000 2024-05-16T22:34:13.672722+0000 0x4042d7 UPDATE: (scatter_writebehind) 2024-05-16T22:34:14.500425+0000 0x404749 UPDATE: (mkdir) dir 2024-05-16T22:34:14.763438+0000 0x404f51 UPDATE: (openc) .fscrypt/protectors/.tmp3443705943 2024-05-16T22:34:14.769322+0000 0x405b0f UPDATE: (cap update) protectors/.tmp3443705943 2024-05-16T22:34:14.773180+0000 0x40634a UPDATE: (rename) protectors/ea1af8aab8775ae6 protectors/.tmp3443705943 2024-05-16T22:34:14.777423+0000 0x406df6 UPDATE: (openc) policies/.tmp2746194693 2024-05-16T22:34:14.780773+0000 0x407632 UPDATE: (cap update) policies/.tmp2746194693 2024-05-16T22:34:14.784029+0000 0x407e6b UPDATE: (rename) policies/59cd7ea472e281f80f1be4414d11a64f policies/.tmp2746194693 2024-05-16T22:34:14.787143+0000 0x408923 UPDATE: (cap update) dir 2024-05-16T22:34:14.789557+0000 0x409010 UPDATE: (cap update) dir 2024-05-16T22:34:15.251822+0000 0x4096fd UPDATE: (openc) dir/bUHUwH9E8uiVaf8xZ+zONcB1CToj53x5aUUnKdnNj5U37zbh28l1AaWwHhbOT3HyzqKjmSKKW1o4odQJc7nF9xrKIB8D3b4qqb2Cs6s7t2106hHhQk5,YV7DtpeNPZnorcTqxPM,hExtWHSS4P+S+Dpwj62hMyh,77sGhiW1Filvv1gQjV+sN,GozPNwHgfleadkUuZ+PMLCaKQXhuid9WvmHanxJnaabYDLj4VEz+EX2WsG 2024-05-16T22:34:17.844329+0000 0x40a16d UPDATE: (purge_stray) 10000000000 2024-05-16T22:34:20.152521+0000 0x40a3c4 UPDATE: (scatter_writebehind) stray2 2024-05-16T22:34:20.152948+0000 0x40aa37 UPDATE: (scatter_writebehind) .fscrypt 2024-05-16T22:34:20.156182+0000 0x40aff0 UPDATE: (scatter_writebehind) .fscrypt 2024-05-16T22:34:20.158613+0000 0x40b6a2 UPDATE: (scatter_writebehind) 2024-05-16T22:34:20.234138+0000 0x40bb14 UPDATE: (cap update) dir/bUHUwH9E8uiVaf8xZ+zONcB1CToj53x5aUUnKdnNj5U37zbh28l1AaWwHhbOT3HyzqKjmSKKW1o4odQJc7nF9xrKIB8D3b4qqb2Cs6s7t2106hHhQk5,YV7DtpeNPZnorcTqxPM,hExtWHSS4P+S+Dpwj62hMyh,77sGhiW1Filvv1gQjV+sN,GozPNwHgfleadkUuZ+PMLCaKQXhuid9WvmHanxJnaabYDLj4VEz+EX2WsG 2024-05-16T22:35:05.406 DEBUG:teuthology.orchestra.run.smithi044:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 journal reset 2024-05-16T22:35:05.440 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:35:05.475 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:35:05.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.576+0000 7eff12979280 1 -- start start 2024-05-16T22:35:05.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.576+0000 7eff12979280 1 Processor -- start 2024-05-16T22:35:05.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.577+0000 7eff12979280 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be59a5c480 0x55be59a68580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:05.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.577+0000 7eff12979280 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55be59a5c900 0x55be59a68000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:05.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.577+0000 7eff12979280 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55be59a5cd80 0x55be59a68b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:05.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.577+0000 7eff12979280 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55be5a85c180 con 0x55be59a5c480 2024-05-16T22:35:05.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.577+0000 7eff12979280 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55be5a85c300 con 0x55be59a5c900 2024-05-16T22:35:05.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.577+0000 7eff12979280 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x55be5a85c480 con 0x55be59a5cd80 2024-05-16T22:35:05.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.577+0000 7eff11127640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be59a5c480 0x55be59a68580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:05.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.577+0000 7eff11127640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be59a5c480 0x55be59a68580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57970/0 (socket says 172.21.15.44:57970) 2024-05-16T22:35:05.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.577+0000 7eff11127640 1 -- 172.21.15.44:0/116138808 learned_addr learned my addr 172.21.15.44:0/116138808 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:35:05.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.577+0000 7eff10926640 1 --2- 172.21.15.44:0/116138808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55be59a5c900 0x55be59a68000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:06.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.578+0000 7eff11928640 1 --2- 172.21.15.44:0/116138808 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55be59a5cd80 0x55be59a68b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:06.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.578+0000 7eff11127640 1 -- 172.21.15.44:0/116138808 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55be59a5cd80 msgr2=0x55be59a68b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:35:06.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.578+0000 7eff11127640 1 --2- 172.21.15.44:0/116138808 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55be59a5cd80 0x55be59a68b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:06.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.578+0000 7eff11127640 1 -- 172.21.15.44:0/116138808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55be59a5c900 msgr2=0x55be59a68000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:35:06.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.578+0000 7eff11127640 1 --2- 172.21.15.44:0/116138808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55be59a5c900 0x55be59a68000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:06.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.578+0000 7eff11127640 1 -- 172.21.15.44:0/116138808 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be559b2780 con 0x55be59a5c480 2024-05-16T22:35:06.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.578+0000 7eff10926640 1 --2- 172.21.15.44:0/116138808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55be59a5c900 0x55be59a68000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:35:06.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.578+0000 7eff11928640 1 --2- 172.21.15.44:0/116138808 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55be59a5cd80 0x55be59a68b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:35:06.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.578+0000 7eff11127640 1 --2- 172.21.15.44:0/116138808 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be59a5c480 0x55be59a68580 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x55be5a7b9590 tx=0x55be59aa7e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0448ffa49823408 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:06.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.578+0000 7eff0e922640 1 -- 172.21.15.44:0/116138808 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55be559a2680 con 0x55be59a5c480 2024-05-16T22:35:06.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.578+0000 7eff0e922640 1 -- 172.21.15.44:0/116138808 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55be559a8a80 con 0x55be59a5c480 2024-05-16T22:35:06.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.578+0000 7eff0e922640 1 -- 172.21.15.44:0/116138808 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55be559a2b60 con 0x55be59a5c480 2024-05-16T22:35:06.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.578+0000 7eff12979280 1 -- 172.21.15.44:0/116138808 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be559b34a0 con 0x55be59a5c480 2024-05-16T22:35:06.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.578+0000 7eff12979280 1 -- 172.21.15.44:0/116138808 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55be559b2000 con 0x55be59a5c480 2024-05-16T22:35:06.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.578+0000 7eff12979280 4 waiting for MDS map... 2024-05-16T22:35:06.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.578+0000 7eff0e922640 1 -- 172.21.15.44:0/116138808 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(51..51 src has 1..51) ==== 5853+0+0 (secure 0 0 0) 0x55be5a878600 con 0x55be59a5c480 2024-05-16T22:35:06.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.578+0000 7eff0e922640 1 -- 172.21.15.44:0/116138808 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 28) ==== 2885+0+0 (secure 0 0 0) 0x55be59a07180 con 0x55be59a5c480 2024-05-16T22:35:06.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.579+0000 7eff12979280 4 Got MDS map 28 2024-05-16T22:35:06.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.579+0000 7eff12979280 10 main: JournalTool::main 2024-05-16T22:35:06.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.579+0000 7eff12979280 4 main: JournalTool: connecting to RADOS... 2024-05-16T22:35:06.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.579+0000 7eff12979280 1 Processor -- start 2024-05-16T22:35:06.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.580+0000 7eff12979280 1 -- start start 2024-05-16T22:35:06.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.580+0000 7eff12979280 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55be59a5d680 0x55be59a69080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:06.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.580+0000 7eff12979280 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be59a5db00 0x55be59a69600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:06.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.580+0000 7eff12979280 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55be59a5df80 0x55be59a69b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:06.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.581+0000 7eff12979280 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55be5a85c600 con 0x55be59a5db00 2024-05-16T22:35:06.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.581+0000 7eff12979280 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55be5a85c780 con 0x55be59a5d680 2024-05-16T22:35:07.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.581+0000 7eff12979280 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x55be5a85c900 con 0x55be59a5df80 2024-05-16T22:35:07.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.581+0000 7eff11127640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be59a5db00 0x55be59a69600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:07.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.581+0000 7eff11127640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be59a5db00 0x55be59a69600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57976/0 (socket says 172.21.15.44:57976) 2024-05-16T22:35:07.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.581+0000 7eff11127640 1 -- 172.21.15.44:0/1369534519 learned_addr learned my addr 172.21.15.44:0/1369534519 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:35:07.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.581+0000 7eff11928640 1 --2- 172.21.15.44:0/1369534519 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55be59a5d680 0x55be59a69080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:07.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.581+0000 7eff10926640 1 --2- 172.21.15.44:0/1369534519 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55be59a5df80 0x55be59a69b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:07.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.581+0000 7eff11127640 1 -- 172.21.15.44:0/1369534519 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55be59a5df80 msgr2=0x55be59a69b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:35:07.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.581+0000 7eff11127640 1 --2- 172.21.15.44:0/1369534519 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55be59a5df80 0x55be59a69b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:07.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.581+0000 7eff11127640 1 -- 172.21.15.44:0/1369534519 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55be59a5d680 msgr2=0x55be59a69080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:35:07.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.581+0000 7eff11127640 1 --2- 172.21.15.44:0/1369534519 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55be59a5d680 0x55be59a69080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:07.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.581+0000 7eff11127640 1 -- 172.21.15.44:0/1369534519 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be559b23c0 con 0x55be59a5db00 2024-05-16T22:35:07.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.581+0000 7eff11127640 1 --2- 172.21.15.44:0/1369534519 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be59a5db00 0x55be59a69600 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x55be5a8928a0 tx=0x55be59aa78c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97c7394851e90fb0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:07.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.581+0000 7eff0c91e640 1 -- 172.21.15.44:0/1369534519 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55be559a2820 con 0x55be59a5db00 2024-05-16T22:35:07.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.581+0000 7eff0c91e640 1 -- 172.21.15.44:0/1369534519 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55be559a8fc0 con 0x55be59a5db00 2024-05-16T22:35:07.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.581+0000 7eff0c91e640 1 -- 172.21.15.44:0/1369534519 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55be559a2680 con 0x55be59a5db00 2024-05-16T22:35:07.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.582+0000 7eff12979280 1 -- 172.21.15.44:0/1369534519 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be59a5db00 msgr2=0x55be59a69600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:07.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.582+0000 7eff12979280 1 --2- 172.21.15.44:0/1369534519 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be59a5db00 0x55be59a69600 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x55be5a8928a0 tx=0x55be59aa78c0 comp rx=0 tx=0).stop 2024-05-16T22:35:07.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.582+0000 7eff12979280 1 -- 172.21.15.44:0/1369534519 shutdown_connections 2024-05-16T22:35:07.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.582+0000 7eff12979280 1 --2- 172.21.15.44:0/1369534519 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55be59a5df80 0x55be59a69b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:07.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.582+0000 7eff12979280 1 --2- 172.21.15.44:0/1369534519 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be59a5db00 0x55be59a69600 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:07.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.582+0000 7eff12979280 1 --2- 172.21.15.44:0/1369534519 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55be59a5d680 0x55be59a69080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:07.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.582+0000 7eff12979280 1 -- 172.21.15.44:0/1369534519 >> 172.21.15.44:0/1369534519 conn(0x55be59a5d200 msgr2=0x55be59a95800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:35:07.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.582+0000 7eff12979280 1 -- 172.21.15.44:0/1369534519 shutdown_connections 2024-05-16T22:35:07.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.582+0000 7eff12979280 1 -- 172.21.15.44:0/1369534519 wait complete. 2024-05-16T22:35:08.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.583+0000 7eff12979280 1 Processor -- start 2024-05-16T22:35:08.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.583+0000 7eff12979280 1 -- start start 2024-05-16T22:35:08.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.584+0000 7eff12979280 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55be59a5d680 0x55be59a69080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:08.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.584+0000 7eff12979280 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55be59a5db00 0x55be59a69600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:08.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.584+0000 7eff12979280 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be59a5df80 0x55be59a69b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:08.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.584+0000 7eff12979280 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55be5a85dc80 con 0x55be59a5df80 2024-05-16T22:35:08.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.584+0000 7eff12979280 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55be5a85db00 con 0x55be59a5d680 2024-05-16T22:35:08.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.584+0000 7eff12979280 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x55be5a85d980 con 0x55be59a5db00 2024-05-16T22:35:08.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.584+0000 7eff10926640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be59a5df80 0x55be59a69b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:08.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.584+0000 7eff10926640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be59a5df80 0x55be59a69b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57982/0 (socket says 172.21.15.44:57982) 2024-05-16T22:35:08.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.584+0000 7eff10926640 1 -- 172.21.15.44:0/4144990553 learned_addr learned my addr 172.21.15.44:0/4144990553 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:35:08.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.584+0000 7eff11928640 1 --2- 172.21.15.44:0/4144990553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55be59a5d680 0x55be59a69080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:08.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.584+0000 7eff11127640 1 --2- 172.21.15.44:0/4144990553 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55be59a5db00 0x55be59a69600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:08.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.584+0000 7eff10926640 1 -- 172.21.15.44:0/4144990553 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55be59a5db00 msgr2=0x55be59a69600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:08.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.584+0000 7eff10926640 1 --2- 172.21.15.44:0/4144990553 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55be59a5db00 0x55be59a69600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:08.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.584+0000 7eff10926640 1 -- 172.21.15.44:0/4144990553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55be59a5d680 msgr2=0x55be59a69080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:08.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.584+0000 7eff10926640 1 --2- 172.21.15.44:0/4144990553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55be59a5d680 0x55be59a69080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:08.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.584+0000 7eff10926640 1 -- 172.21.15.44:0/4144990553 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be559b2780 con 0x55be59a5df80 2024-05-16T22:35:08.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.584+0000 7eff11928640 1 --2- 172.21.15.44:0/4144990553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55be59a5d680 0x55be59a69080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:35:08.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.584+0000 7eff10926640 1 --2- 172.21.15.44:0/4144990553 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be59a5df80 0x55be59a69b80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x55be5a893b90 tx=0x55be5a8e6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:08.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.585+0000 7eff0b11b640 1 -- 172.21.15.44:0/4144990553 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55be559a2820 con 0x55be59a5df80 2024-05-16T22:35:08.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.585+0000 7eff0b11b640 1 -- 172.21.15.44:0/4144990553 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55be559a8e00 con 0x55be59a5df80 2024-05-16T22:35:08.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.585+0000 7eff0b11b640 1 -- 172.21.15.44:0/4144990553 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55be559a2680 con 0x55be59a5df80 2024-05-16T22:35:08.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.585+0000 7eff12979280 1 -- 172.21.15.44:0/4144990553 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55be559b34a0 con 0x55be59a5df80 2024-05-16T22:35:08.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.585+0000 7eff12979280 1 -- 172.21.15.44:0/4144990553 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be559b2960 con 0x55be59a5df80 2024-05-16T22:35:08.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.585+0000 7eff12979280 4 main: JournalTool: resolving pool 6 2024-05-16T22:35:08.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.586+0000 7eff0b11b640 1 -- 172.21.15.44:0/4144990553 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x55be5a77ac00 con 0x55be59a5df80 2024-05-16T22:35:08.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.587+0000 7eff0b11b640 1 --2- 172.21.15.44:0/4144990553 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x55be59a5f600 0x55be59a6a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:09.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.587+0000 7eff0b11b640 1 -- 172.21.15.44:0/4144990553 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5853+0+0 (secure 0 0 0) 0x55be5a872a00 con 0x55be59a5df80 2024-05-16T22:35:09.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.587+0000 7eff12979280 4 main: JournalTool: creating IoCtx.. 2024-05-16T22:35:09.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.587+0000 7eff12979280 4 main: Executing for rank 0 2024-05-16T22:35:09.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.587+0000 7eff11928640 1 --2- 172.21.15.44:0/4144990553 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x55be59a5f600 0x55be59a6a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:09.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.588+0000 7eff11928640 1 --2- 172.21.15.44:0/4144990553 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x55be59a5f600 0x55be59a6a100 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x55be59ad8a20 tx=0x55be59aa7c20 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:09.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.588+0000 7eff12979280 1 -- start start 2024-05-16T22:35:09.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.588+0000 7eff12979280 1 Processor -- start 2024-05-16T22:35:09.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.589+0000 7eff12979280 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55be59a5e880 0x55be59a6a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:09.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.589+0000 7eff12979280 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be59a5ed00 0x55be59a6ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:09.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.589+0000 7eff12979280 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55be59a5f180 0x55be59a6b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:09.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.589+0000 7eff12979280 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55be5a85c780 con 0x55be59a5ed00 2024-05-16T22:35:09.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.589+0000 7eff12979280 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55be5a85c900 con 0x55be59a5e880 2024-05-16T22:35:09.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.589+0000 7eff12979280 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x55be5a85d680 con 0x55be59a5f180 2024-05-16T22:35:09.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.589+0000 7eff11127640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be59a5ed00 0x55be59a6ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:09.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.589+0000 7eff11127640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be59a5ed00 0x55be59a6ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57994/0 (socket says 172.21.15.44:57994) 2024-05-16T22:35:09.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.589+0000 7eff11127640 1 -- 172.21.15.44:0/3734217935 learned_addr learned my addr 172.21.15.44:0/3734217935 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:35:09.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.589+0000 7eff11928640 1 --2- 172.21.15.44:0/3734217935 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55be59a5e880 0x55be59a6a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:09.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.589+0000 7eff10926640 1 --2- 172.21.15.44:0/3734217935 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55be59a5f180 0x55be59a6b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:09.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.589+0000 7eff11127640 1 -- 172.21.15.44:0/3734217935 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55be59a5f180 msgr2=0x55be59a6b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:35:09.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.589+0000 7eff11127640 1 --2- 172.21.15.44:0/3734217935 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55be59a5f180 0x55be59a6b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:09.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.589+0000 7eff11127640 1 -- 172.21.15.44:0/3734217935 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55be59a5e880 msgr2=0x55be59a6a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:35:09.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.589+0000 7eff11127640 1 --2- 172.21.15.44:0/3734217935 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55be59a5e880 0x55be59a6a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:09.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.589+0000 7eff11127640 1 -- 172.21.15.44:0/3734217935 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be559b3680 con 0x55be59a5ed00 2024-05-16T22:35:09.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.589+0000 7eff11928640 1 --2- 172.21.15.44:0/3734217935 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55be59a5e880 0x55be59a6a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:35:09.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.590+0000 7eff11127640 1 --2- 172.21.15.44:0/3734217935 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be59a5ed00 0x55be59a6ac00 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x55be59d19a40 tx=0x55be59aa7ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ab143a9ccde9eb5 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:09.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.590+0000 7eff08115640 1 -- 172.21.15.44:0/3734217935 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55be559a2b60 con 0x55be59a5ed00 2024-05-16T22:35:10.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.590+0000 7eff08115640 1 -- 172.21.15.44:0/3734217935 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55be559a8c40 con 0x55be59a5ed00 2024-05-16T22:35:10.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.590+0000 7eff08115640 1 -- 172.21.15.44:0/3734217935 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55be559a24e0 con 0x55be59a5ed00 2024-05-16T22:35:10.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.590+0000 7eff12979280 1 -- 172.21.15.44:0/3734217935 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be559b2000 con 0x55be59a5ed00 2024-05-16T22:35:10.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.590+0000 7eff12979280 1 -- 172.21.15.44:0/3734217935 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55be559b23c0 con 0x55be59a5ed00 2024-05-16T22:35:10.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.590+0000 7eff12979280 4 waiting for MDS map... 2024-05-16T22:35:10.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.590+0000 7eff08115640 1 -- 172.21.15.44:0/3734217935 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(51..51 src has 1..51) ==== 5853+0+0 (secure 0 0 0) 0x55be59dc8200 con 0x55be59a5ed00 2024-05-16T22:35:10.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.590+0000 7eff08115640 1 -- 172.21.15.44:0/3734217935 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 28) ==== 2885+0+0 (secure 0 0 0) 0x55be59a07500 con 0x55be59a5ed00 2024-05-16T22:35:10.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.590+0000 7eff12979280 4 Got MDS map 28 2024-05-16T22:35:10.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.590+0000 7eff12979280 1 --2- 172.21.15.44:0/3734217935 >> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] conn(0x55be59a5fa80 0x55be59a6b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:10.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.590+0000 7eff12979280 1 -- 172.21.15.44:0/3734217935 --> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x55be59dd2800 con 0x55be59a5fa80 2024-05-16T22:35:10.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.590+0000 7eff11928640 1 --2- 172.21.15.44:0/3734217935 >> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] conn(0x55be59a5fa80 0x55be59a6b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:10.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.591+0000 7eff11928640 1 --2- 172.21.15.44:0/3734217935 >> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] conn(0x55be59a5fa80 0x55be59a6b700 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=8ef6ac598d81fc8f server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:10.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.591+0000 7eff11928640 1 -- 172.21.15.44:0/3734217935 <== osd.2 v2:172.21.15.44:6800/2908194156 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x55be59a96500 con 0x55be59a5fa80 2024-05-16T22:35:10.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.591+0000 7eff12979280 1 -- 172.21.15.44:0/3734217935 --> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51) -- 0x55be59dd2c00 con 0x55be59a5fa80 2024-05-16T22:35:10.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.592+0000 7eff11928640 1 -- 172.21.15.44:0/3734217935 <== osd.2 v2:172.21.15.44:6800/2908194156 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv24 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x55be59a96500 con 0x55be59a5fa80 2024-05-16T22:35:10.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.592+0000 7eff06912640 1 -- 172.21.15.44:0/3734217935 --> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e51) -- 0x55be59dd3000 con 0x55be59a5fa80 2024-05-16T22:35:10.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.592+0000 7eff06912640 1 --2- 172.21.15.44:0/3734217935 >> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] conn(0x55be59de2000 0x55be59dea000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:10.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.592+0000 7eff06912640 1 -- 172.21.15.44:0/3734217935 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e51) -- 0x55be59dd3400 con 0x55be59de2000 2024-05-16T22:35:10.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.592+0000 7eff10926640 1 --2- 172.21.15.44:0/3734217935 >> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] conn(0x55be59de2000 0x55be59dea000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:10.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.592+0000 7eff11928640 1 -- 172.21.15.44:0/3734217935 <== osd.2 v2:172.21.15.44:6800/2908194156 3 ==== osd_op_reply(3 200.00000001 [stat out=16b] v0'0 uv29 ondisk = 0) ==== 156+0+16 (crc 0 0 0) 0x55be59a96500 con 0x55be59a5fa80 2024-05-16T22:35:10.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.592+0000 7eff10926640 1 --2- 172.21.15.44:0/3734217935 >> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] conn(0x55be59de2000 0x55be59dea000 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=463846c2987b4a59 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:10.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.593+0000 7eff10926640 1 -- 172.21.15.44:0/3734217935 <== osd.3 v2:172.21.15.44:6808/2168695793 1 ==== osd_op_reply(4 200.00000002 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55be59a96780 con 0x55be59de2000 2024-05-16T22:35:10.664 INFO:teuthology.orchestra.run.smithi044.stdout:old journal was 4194304~51154 2024-05-16T22:35:10.722 INFO:teuthology.orchestra.run.smithi044.stdout:new journal start will be 8388608 (4143150 bytes past old end) 2024-05-16T22:35:10.764 INFO:teuthology.orchestra.run.smithi044.stdout:writing journal head 2024-05-16T22:35:10.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.593+0000 7eff12979280 1 -- 172.21.15.44:0/3734217935 --> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] -- osd_op(unknown.0.0:5 6.14 6:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x55be59dd3c00 con 0x55be59a5fa80 2024-05-16T22:35:10.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.595+0000 7eff11928640 1 -- 172.21.15.44:0/3734217935 <== osd.2 v2:172.21.15.44:6800/2908194156 4 ==== osd_op_reply(5 200.00000000 [writefull 0~90] v51'41 uv41 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x55be59a96500 con 0x55be59a5fa80 2024-05-16T22:35:10.822 INFO:teuthology.orchestra.run.smithi044.stdout:writing EResetJournal entry 2024-05-16T22:35:10.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.595+0000 7eff12979280 1 -- 172.21.15.44:0/3734217935 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:6 6.1b 6:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x55be59dd2800 con 0x55be59de2000 2024-05-16T22:35:10.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.595+0000 7eff12979280 1 -- 172.21.15.44:0/3734217935 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:7 6.b 6:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x55be59dd2c00 con 0x55be59de2000 2024-05-16T22:35:10.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.595+0000 7eff12979280 1 -- 172.21.15.44:0/3734217935 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:8 6.1f 6:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x55be5a8e5400 con 0x55be59de2000 2024-05-16T22:35:10.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.595+0000 7eff12979280 1 --2- 172.21.15.44:0/3734217935 >> [v2:172.21.15.70:6821/1540297751,v1:172.21.15.70:6823/1540297751] conn(0x55be59de2480 0x55be59dea580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:10.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.595+0000 7eff12979280 1 -- 172.21.15.44:0/3734217935 --> [v2:172.21.15.70:6821/1540297751,v1:172.21.15.70:6823/1540297751] -- osd_op(unknown.0.0:9 6.1a 6:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x55be5a8e5000 con 0x55be59de2480 2024-05-16T22:35:10.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.595+0000 7eff12979280 1 -- 172.21.15.44:0/3734217935 --> [v2:172.21.15.70:6821/1540297751,v1:172.21.15.70:6823/1540297751] -- osd_op(unknown.0.0:10 6.1e 6:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x55be59dd3400 con 0x55be59de2480 2024-05-16T22:35:10.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.595+0000 7eff12979280 1 --2- 172.21.15.44:0/3734217935 >> [v2:172.21.15.44:6816/2909429972,v1:172.21.15.44:6817/2909429972] conn(0x55be59de2900 0x55be59deab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:10.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.595+0000 7eff12979280 1 -- 172.21.15.44:0/3734217935 --> [v2:172.21.15.44:6816/2909429972,v1:172.21.15.44:6817/2909429972] -- osd_op(unknown.0.0:11 6.1d 6:bec1251c:::200.00000007:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x55be59dd2800 con 0x55be59de2900 2024-05-16T22:35:11.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.595+0000 7eff11928640 1 --2- 172.21.15.44:0/3734217935 >> [v2:172.21.15.70:6821/1540297751,v1:172.21.15.70:6823/1540297751] conn(0x55be59de2480 0x55be59dea580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:11.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.595+0000 7eff11127640 1 --2- 172.21.15.44:0/3734217935 >> [v2:172.21.15.44:6816/2909429972,v1:172.21.15.44:6817/2909429972] conn(0x55be59de2900 0x55be59deab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:11.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.595+0000 7eff11127640 1 --2- 172.21.15.44:0/3734217935 >> [v2:172.21.15.44:6816/2909429972,v1:172.21.15.44:6817/2909429972] conn(0x55be59de2900 0x55be59deab00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=51c2376984805b75 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:11.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.596+0000 7eff11928640 1 --2- 172.21.15.44:0/3734217935 >> [v2:172.21.15.70:6821/1540297751,v1:172.21.15.70:6823/1540297751] conn(0x55be59de2480 0x55be59dea580 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=ed67bdccb6204844 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:11.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.596+0000 7eff10926640 1 -- 172.21.15.44:0/3734217935 <== osd.3 v2:172.21.15.44:6808/2168695793 2 ==== osd_op_reply(6 200.00000002 [delete] v51'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55be59a96780 con 0x55be59de2000 2024-05-16T22:35:11.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.596+0000 7eff10926640 1 -- 172.21.15.44:0/3734217935 <== osd.3 v2:172.21.15.44:6808/2168695793 3 ==== osd_op_reply(8 200.00000004 [delete] v51'32 uv31 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55be59a96780 con 0x55be59de2000 2024-05-16T22:35:11.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.596+0000 7eff10926640 1 -- 172.21.15.44:0/3734217935 <== osd.3 v2:172.21.15.44:6808/2168695793 4 ==== osd_op_reply(7 200.00000003 [delete] v51'4 uv1 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55be59a96780 con 0x55be59de2000 2024-05-16T22:35:11.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.596+0000 7eff06912640 1 -- 172.21.15.44:0/3734217935 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- osd_op(unknown.0.0:12 6.1b 6:ddb4e4d7:::200.00000002:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51) -- 0x55be59dd3800 con 0x55be59de2000 2024-05-16T22:35:11.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.597+0000 7eff11127640 1 -- 172.21.15.44:0/3734217935 <== osd.1 v2:172.21.15.44:6816/2909429972 1 ==== osd_op_reply(11 200.00000007 [delete] v51'4 uv2 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55be59a96a00 con 0x55be59de2900 2024-05-16T22:35:11.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.597+0000 7eff11928640 1 -- 172.21.15.44:0/3734217935 <== osd.4 v2:172.21.15.70:6821/1540297751 1 ==== osd_op_reply(10 200.00000006 [delete] v51'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55be59a96500 con 0x55be59de2480 2024-05-16T22:35:11.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.597+0000 7eff11928640 1 -- 172.21.15.44:0/3734217935 <== osd.4 v2:172.21.15.70:6821/1540297751 2 ==== osd_op_reply(9 200.00000005 [delete] v51'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55be59a96500 con 0x55be59de2480 2024-05-16T22:35:11.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.598+0000 7eff10926640 1 -- 172.21.15.44:0/3734217935 <== osd.3 v2:172.21.15.44:6808/2168695793 5 ==== osd_op_reply(12 200.00000002 [write 0~48] v51'3 uv3 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x55be59a96780 con 0x55be59de2000 2024-05-16T22:35:11.307 INFO:teuthology.orchestra.run.smithi044.stdout:done 2024-05-16T22:35:11.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.598+0000 7eff12979280 1 -- 172.21.15.44:0/3734217935 >> [v2:172.21.15.44:6816/2909429972,v1:172.21.15.44:6817/2909429972] conn(0x55be59de2900 msgr2=0x55be59deab00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:11.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.598+0000 7eff12979280 1 --2- 172.21.15.44:0/3734217935 >> [v2:172.21.15.44:6816/2909429972,v1:172.21.15.44:6817/2909429972] conn(0x55be59de2900 0x55be59deab00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:11.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.598+0000 7eff12979280 1 -- 172.21.15.44:0/3734217935 >> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] conn(0x55be59a5fa80 msgr2=0x55be59a6b700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:11.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.598+0000 7eff12979280 1 --2- 172.21.15.44:0/3734217935 >> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] conn(0x55be59a5fa80 0x55be59a6b700 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:11.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.598+0000 7eff12979280 1 -- 172.21.15.44:0/3734217935 >> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] conn(0x55be59de2000 msgr2=0x55be59dea000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:11.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.598+0000 7eff12979280 1 --2- 172.21.15.44:0/3734217935 >> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] conn(0x55be59de2000 0x55be59dea000 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:11.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.598+0000 7eff12979280 1 -- 172.21.15.44:0/3734217935 >> [v2:172.21.15.70:6821/1540297751,v1:172.21.15.70:6823/1540297751] conn(0x55be59de2480 msgr2=0x55be59dea580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:11.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.598+0000 7eff12979280 1 --2- 172.21.15.44:0/3734217935 >> [v2:172.21.15.70:6821/1540297751,v1:172.21.15.70:6823/1540297751] conn(0x55be59de2480 0x55be59dea580 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:11.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.598+0000 7eff11127640 1 -- 172.21.15.44:0/3734217935 reap_dead start 2024-05-16T22:35:11.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.598+0000 7eff12979280 1 -- 172.21.15.44:0/3734217935 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be59a5ed00 msgr2=0x55be59a6ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:11.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.598+0000 7eff12979280 1 --2- 172.21.15.44:0/3734217935 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be59a5ed00 0x55be59a6ac00 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x55be59d19a40 tx=0x55be59aa7ec0 comp rx=0 tx=0).stop 2024-05-16T22:35:11.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.598+0000 7eff12979280 1 -- 172.21.15.44:0/3734217935 shutdown_connections 2024-05-16T22:35:11.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.598+0000 7eff12979280 1 --2- 172.21.15.44:0/3734217935 >> [v2:172.21.15.70:6821/1540297751,v1:172.21.15.70:6823/1540297751] conn(0x55be59de2480 0x55be59dea580 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:11.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.598+0000 7eff12979280 1 --2- 172.21.15.44:0/3734217935 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be59a5ed00 0x55be59a6ac00 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:11.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.598+0000 7eff12979280 1 -- 172.21.15.44:0/3734217935 >> 172.21.15.44:0/3734217935 conn(0x55be59a5e400 msgr2=0x55be59d84800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:35:11.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.598+0000 7eff12979280 1 -- 172.21.15.44:0/3734217935 shutdown_connections 2024-05-16T22:35:11.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.598+0000 7eff12979280 1 -- 172.21.15.44:0/3734217935 wait complete. 2024-05-16T22:35:11.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.598+0000 7eff12979280 1 -- 172.21.15.44:0/4144990553 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x55be59a5f600 msgr2=0x55be59a6a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:11.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.598+0000 7eff12979280 1 --2- 172.21.15.44:0/4144990553 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x55be59a5f600 0x55be59a6a100 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x55be59ad8a20 tx=0x55be59aa7c20 comp rx=0 tx=0).stop 2024-05-16T22:35:11.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.598+0000 7eff12979280 1 -- 172.21.15.44:0/4144990553 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be59a5df80 msgr2=0x55be59a69b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:11.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.598+0000 7eff12979280 1 --2- 172.21.15.44:0/4144990553 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be59a5df80 0x55be59a69b80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x55be5a893b90 tx=0x55be5a8e6000 comp rx=0 tx=0).stop 2024-05-16T22:35:11.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.599+0000 7eff12979280 1 -- 172.21.15.44:0/4144990553 shutdown_connections 2024-05-16T22:35:11.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.599+0000 7eff12979280 1 --2- 172.21.15.44:0/4144990553 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x55be59a5f600 0x55be59a6a100 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:11.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.599+0000 7eff12979280 1 --2- 172.21.15.44:0/4144990553 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55be59a5db00 0x55be59a69600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:12.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.599+0000 7eff12979280 1 --2- 172.21.15.44:0/4144990553 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be59a5df80 0x55be59a69b80 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:12.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.599+0000 7eff12979280 1 --2- 172.21.15.44:0/4144990553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55be59a5d680 0x55be59a69080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:12.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.599+0000 7eff12979280 1 -- 172.21.15.44:0/4144990553 >> 172.21.15.44:0/4144990553 conn(0x55be59a5d200 msgr2=0x55be59a95800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:35:12.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.599+0000 7eff12979280 1 -- 172.21.15.44:0/4144990553 shutdown_connections 2024-05-16T22:35:12.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.599+0000 7eff12979280 1 -- 172.21.15.44:0/4144990553 wait complete. 2024-05-16T22:35:12.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.599+0000 7eff12979280 1 -- 172.21.15.44:0/116138808 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be59a5c480 msgr2=0x55be59a68580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:12.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.599+0000 7eff12979280 1 --2- 172.21.15.44:0/116138808 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be59a5c480 0x55be59a68580 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x55be5a7b9590 tx=0x55be59aa7e60 comp rx=0 tx=0).stop 2024-05-16T22:35:12.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.599+0000 7eff12979280 1 -- 172.21.15.44:0/116138808 shutdown_connections 2024-05-16T22:35:12.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.599+0000 7eff12979280 1 --2- 172.21.15.44:0/116138808 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55be59a5cd80 0x55be59a68b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:12.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.599+0000 7eff12979280 1 --2- 172.21.15.44:0/116138808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55be59a5c900 0x55be59a68000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:12.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.599+0000 7eff12979280 1 --2- 172.21.15.44:0/116138808 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be59a5c480 0x55be59a68580 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:12.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.599+0000 7eff12979280 1 -- 172.21.15.44:0/116138808 >> 172.21.15.44:0/116138808 conn(0x55be59a5c000 msgr2=0x55be59a95000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:35:12.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.599+0000 7eff12979280 1 -- 172.21.15.44:0/116138808 shutdown_connections 2024-05-16T22:35:12.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:05.599+0000 7eff12979280 1 -- 172.21.15.44:0/116138808 wait complete. 2024-05-16T22:35:12.388 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'journal', 'reset'] in time 0:00:06.982589, result: old journal was 4194304~51154 new journal start will be 8388608 (4143150 bytes past old end) writing journal head writing EResetJournal entry done 2024-05-16T22:35:12.442 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-05-16T22:35:12.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.588+0000 7f7e4524c640 1 Processor -- start 2024-05-16T22:35:12.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.588+0000 7f7e4524c640 1 -- start start 2024-05-16T22:35:12.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.589+0000 7f7e4524c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7e4006f8c0 0x7f7e400bc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:12.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.589+0000 7f7e4524c640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e400b52c0 con 0x7f7e400b4eb0 2024-05-16T22:35:12.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.589+0000 7f7e4524c640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e400bb0e0 con 0x7f7e400b4aa0 2024-05-16T22:35:12.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.589+0000 7f7e4524c640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f7e40071f40 con 0x7f7e4006f8c0 2024-05-16T22:35:12.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.589+0000 7f7e3f59e640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f7e400b4eb0 0x7f7e4014ee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:42278/0 (socket says 172.21.15.44:42278) 2024-05-16T22:35:12.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.589+0000 7f7e3f59e640 1 -- 172.21.15.44:0/3063206971 learned_addr learned my addr 172.21.15.44:0/3063206971 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:35:12.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.590+0000 7f7e3ed9d640 1 --2- 172.21.15.44:0/3063206971 >> v2:172.21.15.70:3300/0 conn(0x7f7e4006f8c0 0x7f7e400bc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:12.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.590+0000 7f7e3dd9b640 1 -- 172.21.15.44:0/3063206971 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 331358644 0 0) 0x7f7e400b52c0 con 0x7f7e400b4eb0 2024-05-16T22:35:12.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.590+0000 7f7e3dd9b640 1 -- 172.21.15.44:0/3063206971 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e28003520 con 0x7f7e400b4eb0 2024-05-16T22:35:12.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.590+0000 7f7e3ed9d640 1 -- 172.21.15.44:0/3063206971 >> v1:172.21.15.70:6789/0 conn(0x7f7e400b4aa0 legacy=0x7f7e4014e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:12.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.590+0000 7f7e3ed9d640 1 -- 172.21.15.44:0/3063206971 >> v1:172.21.15.44:6789/0 conn(0x7f7e400b4eb0 legacy=0x7f7e4014ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:12.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.590+0000 7f7e3ed9d640 1 -- 172.21.15.44:0/3063206971 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e4014f540 con 0x7f7e4006f8c0 2024-05-16T22:35:12.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.591+0000 7f7e3ed9d640 1 --2- 172.21.15.44:0/3063206971 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e4006f8c0 0x7f7e400bc6f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7e300097d0 tx=0x7f7e3002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d91c9167e0adaf41 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:12.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.591+0000 7f7e3dd9b640 1 -- 172.21.15.44:0/3063206971 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e30037070 con 0x7f7e4006f8c0 2024-05-16T22:35:13.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.591+0000 7f7e3dd9b640 1 -- 172.21.15.44:0/3063206971 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e30032440 con 0x7f7e4006f8c0 2024-05-16T22:35:13.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.591+0000 7f7e3dd9b640 1 -- 172.21.15.44:0/3063206971 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e300327f0 con 0x7f7e4006f8c0 2024-05-16T22:35:13.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.592+0000 7f7e4524c640 1 -- 172.21.15.44:0/3063206971 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e4006f8c0 msgr2=0x7f7e400bc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:13.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.592+0000 7f7e4524c640 1 --2- 172.21.15.44:0/3063206971 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e4006f8c0 0x7f7e400bc6f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7e300097d0 tx=0x7f7e3002a1c0 comp rx=0 tx=0).stop 2024-05-16T22:35:13.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.592+0000 7f7e4524c640 1 -- 172.21.15.44:0/3063206971 shutdown_connections 2024-05-16T22:35:13.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.592+0000 7f7e4524c640 1 --2- 172.21.15.44:0/3063206971 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e4006f8c0 0x7f7e400bc6f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:13.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.592+0000 7f7e4524c640 1 -- 172.21.15.44:0/3063206971 >> 172.21.15.44:0/3063206971 conn(0x7f7e400a1ac0 msgr2=0x7f7e400bbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:35:13.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.592+0000 7f7e4524c640 1 -- 172.21.15.44:0/3063206971 shutdown_connections 2024-05-16T22:35:13.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.592+0000 7f7e4524c640 1 -- 172.21.15.44:0/3063206971 wait complete. 2024-05-16T22:35:13.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.594+0000 7f7e4524c640 1 Processor -- start 2024-05-16T22:35:13.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.594+0000 7f7e4524c640 1 -- start start 2024-05-16T22:35:13.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.595+0000 7f7e4524c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e4006f8c0 0x7f7e400b8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:13.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.595+0000 7f7e4524c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7e400b4aa0 0x7f7e400b94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:13.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.595+0000 7f7e4524c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e400b4eb0 0x7f7e4009ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:13.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.595+0000 7f7e4524c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7e400bab60 con 0x7f7e4006f8c0 2024-05-16T22:35:13.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.595+0000 7f7e4524c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7e400b9ee0 con 0x7f7e400b4eb0 2024-05-16T22:35:13.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.595+0000 7f7e4524c640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f7e400ba060 con 0x7f7e400b4aa0 2024-05-16T22:35:13.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.595+0000 7f7e3ed9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e4006f8c0 0x7f7e400b8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:13.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.595+0000 7f7e3ed9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e4006f8c0 0x7f7e400b8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46576/0 (socket says 172.21.15.44:46576) 2024-05-16T22:35:13.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.595+0000 7f7e3ed9d640 1 -- 172.21.15.44:0/3734248312 learned_addr learned my addr 172.21.15.44:0/3734248312 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:35:13.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.595+0000 7f7e3f59e640 1 --2- 172.21.15.44:0/3734248312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e400b4eb0 0x7f7e4009ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:13.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.595+0000 7f7e3e59c640 1 --2- 172.21.15.44:0/3734248312 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7e400b4aa0 0x7f7e400b94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:13.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.595+0000 7f7e3ed9d640 1 -- 172.21.15.44:0/3734248312 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7e400b4aa0 msgr2=0x7f7e400b94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:13.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.595+0000 7f7e3ed9d640 1 --2- 172.21.15.44:0/3734248312 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7e400b4aa0 0x7f7e400b94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:13.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.595+0000 7f7e3ed9d640 1 -- 172.21.15.44:0/3734248312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e400b4eb0 msgr2=0x7f7e4009ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:13.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.595+0000 7f7e3ed9d640 1 --2- 172.21.15.44:0/3734248312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e400b4eb0 0x7f7e4009ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:13.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.595+0000 7f7e3ed9d640 1 -- 172.21.15.44:0/3734248312 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e4014ccb0 con 0x7f7e4006f8c0 2024-05-16T22:35:13.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.595+0000 7f7e3ed9d640 1 --2- 172.21.15.44:0/3734248312 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e4006f8c0 0x7f7e400b8fb0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7e300098f0 tx=0x7f7e300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:13.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.596+0000 7f7e277fe640 1 -- 172.21.15.44:0/3734248312 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e30037050 con 0x7f7e4006f8c0 2024-05-16T22:35:13.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.596+0000 7f7e277fe640 1 -- 172.21.15.44:0/3734248312 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e30038040 con 0x7f7e4006f8c0 2024-05-16T22:35:13.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.596+0000 7f7e277fe640 1 -- 172.21.15.44:0/3734248312 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e30004450 con 0x7f7e4006f8c0 2024-05-16T22:35:13.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.596+0000 7f7e4524c640 1 -- 172.21.15.44:0/3734248312 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e400b9b80 con 0x7f7e4006f8c0 2024-05-16T22:35:13.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.596+0000 7f7e4524c640 1 -- 172.21.15.44:0/3734248312 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e401e1c80 con 0x7f7e4006f8c0 2024-05-16T22:35:13.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.597+0000 7f7e4524c640 1 -- 172.21.15.44:0/3734248312 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e400b4500 con 0x7f7e4006f8c0 2024-05-16T22:35:13.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.597+0000 7f7e277fe640 1 -- 172.21.15.44:0/3734248312 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7e3003c6d0 con 0x7f7e4006f8c0 2024-05-16T22:35:13.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.598+0000 7f7e277fe640 1 --2- 172.21.15.44:0/3734248312 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f7e2c0762d0 0x7f7e2c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:13.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.598+0000 7f7e277fe640 1 -- 172.21.15.44:0/3734248312 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5853+0+0 (secure 0 0 0) 0x7f7e300b7f60 con 0x7f7e4006f8c0 2024-05-16T22:35:13.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.598+0000 7f7e3e59c640 1 --2- 172.21.15.44:0/3734248312 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f7e2c0762d0 0x7f7e2c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:13.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.599+0000 7f7e3e59c640 1 --2- 172.21.15.44:0/3734248312 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f7e2c0762d0 0x7f7e2c0787e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7e400b7770 tx=0x7f7e34009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:13.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.603+0000 7f7e277fe640 1 -- 172.21.15.44:0/3734248312 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7e400b4500 con 0x7f7e4006f8c0 2024-05-16T22:35:13.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:12.833+0000 7f7e4524c640 1 -- 172.21.15.44:0/3734248312 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f7e40050940 con 0x7f7e4006f8c0 2024-05-16T22:35:13.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:13.092+0000 7f7e277fe640 1 -- 172.21.15.44:0/3734248312 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v29) ==== 162+0+0 (secure 0 0 0) 0x7f7e300811e0 con 0x7f7e4006f8c0 2024-05-16T22:35:13.877 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked joinable; MDS may join as newly active. 2024-05-16T22:35:13.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:13.094+0000 7f7e4524c640 1 -- 172.21.15.44:0/3734248312 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f7e2c0762d0 msgr2=0x7f7e2c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:13.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:13.094+0000 7f7e4524c640 1 --2- 172.21.15.44:0/3734248312 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f7e2c0762d0 0x7f7e2c0787e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7e400b7770 tx=0x7f7e34009040 comp rx=0 tx=0).stop 2024-05-16T22:35:13.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:13.094+0000 7f7e4524c640 1 -- 172.21.15.44:0/3734248312 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e4006f8c0 msgr2=0x7f7e400b8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:13.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:13.094+0000 7f7e4524c640 1 --2- 172.21.15.44:0/3734248312 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e4006f8c0 0x7f7e400b8fb0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7e300098f0 tx=0x7f7e300046c0 comp rx=0 tx=0).stop 2024-05-16T22:35:13.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:13.094+0000 7f7e4524c640 1 -- 172.21.15.44:0/3734248312 shutdown_connections 2024-05-16T22:35:14.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:13.094+0000 7f7e4524c640 1 --2- 172.21.15.44:0/3734248312 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f7e2c0762d0 0x7f7e2c0787e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:14.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:13.094+0000 7f7e4524c640 1 --2- 172.21.15.44:0/3734248312 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7e400b4aa0 0x7f7e400b94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:14.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:13.094+0000 7f7e4524c640 1 --2- 172.21.15.44:0/3734248312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e400b4eb0 0x7f7e4009ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:14.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:13.094+0000 7f7e4524c640 1 --2- 172.21.15.44:0/3734248312 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e4006f8c0 0x7f7e400b8fb0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:14.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:13.094+0000 7f7e4524c640 1 -- 172.21.15.44:0/3734248312 >> 172.21.15.44:0/3734248312 conn(0x7f7e400a1ac0 msgr2=0x7f7e4014bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:35:14.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:13.094+0000 7f7e4524c640 1 -- 172.21.15.44:0/3734248312 shutdown_connections 2024-05-16T22:35:14.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:13.094+0000 7f7e4524c640 1 -- 172.21.15.44:0/3734248312 wait complete. 2024-05-16T22:35:14.175 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T22:35:14.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.328+0000 7f9ca0186640 1 Processor -- start 2024-05-16T22:35:14.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.329+0000 7f9ca0186640 1 -- start start 2024-05-16T22:35:14.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.330+0000 7f9ca0186640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f9c9814e530 0x7f9c980ba320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:14.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.330+0000 7f9ca0186640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9c980bd440 0x7f9c980bd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:14.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.330+0000 7f9ca0186640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9c980b8d70 0x7f9c980b9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:14.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.330+0000 7f9ca0186640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f9c980b88e0 con 0x7f9c980b8d70 2024-05-16T22:35:14.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.330+0000 7f9ca0186640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f9c980ba860 con 0x7f9c9814e530 2024-05-16T22:35:14.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.330+0000 7f9ca0186640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f9c980bdd90 con 0x7f9c980bd440 2024-05-16T22:35:14.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.330+0000 7f9c9e723640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9c980b8d70 0x7f9c980b9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:14.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.330+0000 7f9c9e723640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9c980b8d70 0x7f9c980b9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46586/0 (socket says 172.21.15.44:46586) 2024-05-16T22:35:14.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.330+0000 7f9c9e723640 1 -- 172.21.15.44:0/3598620371 learned_addr learned my addr 172.21.15.44:0/3598620371 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:35:14.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.330+0000 7f9c9df22640 1 --2- 172.21.15.44:0/3598620371 >> v2:172.21.15.70:3300/0 conn(0x7f9c9814e530 0x7f9c980ba320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:14.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.330+0000 7f9c9d721640 1 --2- 172.21.15.44:0/3598620371 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9c980bd440 0x7f9c980bd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:14.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.330+0000 7f9c9e723640 1 -- 172.21.15.44:0/3598620371 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9c980bd440 msgr2=0x7f9c980bd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:35:14.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.330+0000 7f9c9e723640 1 --2- 172.21.15.44:0/3598620371 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9c980bd440 0x7f9c980bd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:14.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.330+0000 7f9c9e723640 1 -- 172.21.15.44:0/3598620371 >> v2:172.21.15.70:3300/0 conn(0x7f9c9814e530 msgr2=0x7f9c980ba320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:35:14.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.330+0000 7f9c9e723640 1 --2- 172.21.15.44:0/3598620371 >> v2:172.21.15.70:3300/0 conn(0x7f9c9814e530 0x7f9c980ba320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:14.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.330+0000 7f9c9e723640 1 -- 172.21.15.44:0/3598620371 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c9814ece0 con 0x7f9c980b8d70 2024-05-16T22:35:14.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.331+0000 7f9c9e723640 1 --2- 172.21.15.44:0/3598620371 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c980b8d70 0x7f9c980b9180 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9c9808d0d0 tx=0x7f9c8802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21570a312d63be8 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:14.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.331+0000 7f9c9cf20640 1 -- 172.21.15.44:0/3598620371 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c88036070 con 0x7f9c980b8d70 2024-05-16T22:35:14.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.331+0000 7f9c9cf20640 1 -- 172.21.15.44:0/3598620371 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c88031600 con 0x7f9c980b8d70 2024-05-16T22:35:14.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.331+0000 7f9c9cf20640 1 -- 172.21.15.44:0/3598620371 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c880319d0 con 0x7f9c980b8d70 2024-05-16T22:35:14.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.332+0000 7f9ca0186640 1 -- 172.21.15.44:0/3598620371 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c980b8d70 msgr2=0x7f9c980b9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:14.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.332+0000 7f9ca0186640 1 --2- 172.21.15.44:0/3598620371 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c980b8d70 0x7f9c980b9180 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9c9808d0d0 tx=0x7f9c8802a6c0 comp rx=0 tx=0).stop 2024-05-16T22:35:14.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.332+0000 7f9ca0186640 1 -- 172.21.15.44:0/3598620371 shutdown_connections 2024-05-16T22:35:14.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.332+0000 7f9ca0186640 1 --2- 172.21.15.44:0/3598620371 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c980b8d70 0x7f9c980b9180 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:14.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.332+0000 7f9ca0186640 1 --2- 172.21.15.44:0/3598620371 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9c980bd440 0x7f9c980bd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:14.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.332+0000 7f9ca0186640 1 --2- 172.21.15.44:0/3598620371 >> v2:172.21.15.70:3300/0 conn(0x7f9c9814e530 0x7f9c980ba320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:15.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.332+0000 7f9ca0186640 1 -- 172.21.15.44:0/3598620371 >> 172.21.15.44:0/3598620371 conn(0x7f9c980c0570 msgr2=0x7f9c980c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:35:15.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.332+0000 7f9ca0186640 1 -- 172.21.15.44:0/3598620371 shutdown_connections 2024-05-16T22:35:15.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.332+0000 7f9ca0186640 1 -- 172.21.15.44:0/3598620371 wait complete. 2024-05-16T22:35:15.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.333+0000 7f9ca0186640 1 Processor -- start 2024-05-16T22:35:15.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.333+0000 7f9ca0186640 1 -- start start 2024-05-16T22:35:15.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.334+0000 7f9ca0186640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c980b8d70 0x7f9c981e4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:15.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.334+0000 7f9ca0186640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9c980bd440 0x7f9c981411a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:15.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.334+0000 7f9ca0186640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c9814e530 0x7f9c9813de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:15.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.334+0000 7f9ca0186640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9c980bbb70 con 0x7f9c9814e530 2024-05-16T22:35:15.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.334+0000 7f9ca0186640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9c9814f2a0 con 0x7f9c980b8d70 2024-05-16T22:35:15.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.334+0000 7f9ca0186640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f9c980b96c0 con 0x7f9c980bd440 2024-05-16T22:35:15.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.335+0000 7f9c9e723640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c9814e530 0x7f9c9813de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:15.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.335+0000 7f9c9e723640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c9814e530 0x7f9c9813de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46592/0 (socket says 172.21.15.44:46592) 2024-05-16T22:35:15.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.335+0000 7f9c9e723640 1 -- 172.21.15.44:0/3634370982 learned_addr learned my addr 172.21.15.44:0/3634370982 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:35:15.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.335+0000 7f9c9d721640 1 --2- 172.21.15.44:0/3634370982 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9c980bd440 0x7f9c981411a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:15.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.335+0000 7f9c9df22640 1 --2- 172.21.15.44:0/3634370982 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c980b8d70 0x7f9c981e4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:15.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.335+0000 7f9c9e723640 1 -- 172.21.15.44:0/3634370982 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9c980bd440 msgr2=0x7f9c981411a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:15.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.335+0000 7f9c9e723640 1 --2- 172.21.15.44:0/3634370982 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9c980bd440 0x7f9c981411a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:15.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.335+0000 7f9c9e723640 1 -- 172.21.15.44:0/3634370982 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c980b8d70 msgr2=0x7f9c981e4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:15.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.335+0000 7f9c9e723640 1 --2- 172.21.15.44:0/3634370982 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c980b8d70 0x7f9c981e4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:15.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.335+0000 7f9c9e723640 1 -- 172.21.15.44:0/3634370982 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c981416e0 con 0x7f9c9814e530 2024-05-16T22:35:15.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.335+0000 7f9c9e723640 1 --2- 172.21.15.44:0/3634370982 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c9814e530 0x7f9c9813de80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9c88009f70 tx=0x7f9c88004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:15.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.335+0000 7f9c967fc640 1 -- 172.21.15.44:0/3634370982 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c8803f020 con 0x7f9c9814e530 2024-05-16T22:35:15.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.335+0000 7f9c967fc640 1 -- 172.21.15.44:0/3634370982 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c88037040 con 0x7f9c9814e530 2024-05-16T22:35:15.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.335+0000 7f9ca0186640 1 -- 172.21.15.44:0/3634370982 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c9813ff10 con 0x7f9c9814e530 2024-05-16T22:35:15.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.335+0000 7f9c967fc640 1 -- 172.21.15.44:0/3634370982 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c88036070 con 0x7f9c9814e530 2024-05-16T22:35:15.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.335+0000 7f9ca0186640 1 -- 172.21.15.44:0/3634370982 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c981e46d0 con 0x7f9c9814e530 2024-05-16T22:35:15.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.336+0000 7f9ca0186640 1 -- 172.21.15.44:0/3634370982 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c98140500 con 0x7f9c9814e530 2024-05-16T22:35:15.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.337+0000 7f9c967fc640 1 -- 172.21.15.44:0/3634370982 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9c88042020 con 0x7f9c9814e530 2024-05-16T22:35:15.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.338+0000 7f9c967fc640 1 --2- 172.21.15.44:0/3634370982 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f9c84076300 0x7f9c84078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:15.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.338+0000 7f9c967fc640 1 -- 172.21.15.44:0/3634370982 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5853+0+0 (secure 0 0 0) 0x7f9c880b7870 con 0x7f9c9814e530 2024-05-16T22:35:15.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.338+0000 7f9c9df22640 1 --2- 172.21.15.44:0/3634370982 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f9c84076300 0x7f9c84078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:15.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.338+0000 7f9c9df22640 1 --2- 172.21.15.44:0/3634370982 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f9c84076300 0x7f9c84078810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9c90009a90 tx=0x7f9c90009110 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:15.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.343+0000 7f9c967fc640 1 -- 172.21.15.44:0/3634370982 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9c88049030 con 0x7f9c9814e530 2024-05-16T22:35:15.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.570+0000 7f9ca0186640 1 -- 172.21.15.44:0/3634370982 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9c9813fd40 con 0x7f9c9814e530 2024-05-16T22:35:15.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.570+0000 7f9c967fc640 1 -- 172.21.15.44:0/3634370982 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+4348 (secure 0 0 0) 0x7f9c88080af0 con 0x7f9c9814e530 2024-05-16T22:35:15.805 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:35:15.821 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":31,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4954,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2432336323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2432336323},{"type":"v1","addr":"172.21.15.70:6835","nonce":2432336323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4972,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/454770375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":454770375},{"type":"v1","addr":"172.21.15.44:6835","nonce":454770375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T22:33:10.855194+0000","modified":"2024-05-16T22:35:13.103205+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":51,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"a","rank":0,"incarnation":30,"state":"up:reconnect","state_seq":14,"addr":"172.21.15.44:6834/153528185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":153528185},{"type":"v1","addr":"172.21.15.44:6834","nonce":153528185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":3}]} 2024-05-16T22:35:15.840 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 31 2024-05-16T22:35:15.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.572+0000 7f9ca0186640 1 -- 172.21.15.44:0/3634370982 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f9c84076300 msgr2=0x7f9c84078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:15.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.572+0000 7f9ca0186640 1 --2- 172.21.15.44:0/3634370982 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f9c84076300 0x7f9c84078810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9c90009a90 tx=0x7f9c90009110 comp rx=0 tx=0).stop 2024-05-16T22:35:15.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.572+0000 7f9ca0186640 1 -- 172.21.15.44:0/3634370982 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c9814e530 msgr2=0x7f9c9813de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:15.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.572+0000 7f9ca0186640 1 --2- 172.21.15.44:0/3634370982 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c9814e530 0x7f9c9813de80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9c88009f70 tx=0x7f9c88004a40 comp rx=0 tx=0).stop 2024-05-16T22:35:15.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.572+0000 7f9ca0186640 1 -- 172.21.15.44:0/3634370982 shutdown_connections 2024-05-16T22:35:15.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.572+0000 7f9ca0186640 1 --2- 172.21.15.44:0/3634370982 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f9c84076300 0x7f9c84078810 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:15.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.572+0000 7f9ca0186640 1 --2- 172.21.15.44:0/3634370982 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9c980bd440 0x7f9c981411a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:16.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.572+0000 7f9ca0186640 1 --2- 172.21.15.44:0/3634370982 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c9814e530 0x7f9c9813de80 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:16.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.572+0000 7f9ca0186640 1 --2- 172.21.15.44:0/3634370982 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c980b8d70 0x7f9c981e4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:16.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.572+0000 7f9ca0186640 1 -- 172.21.15.44:0/3634370982 >> 172.21.15.44:0/3634370982 conn(0x7f9c980c0570 msgr2=0x7f9c980c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:35:16.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.572+0000 7f9ca0186640 1 -- 172.21.15.44:0/3634370982 shutdown_connections 2024-05-16T22:35:16.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:14.572+0000 7f9ca0186640 1 -- 172.21.15.44:0/3634370982 wait complete. 2024-05-16T22:35:16.109 INFO:tasks.ceph.mds.a.smithi044.stderr:2024-05-16T22:35:15.110+0000 7f43468ab640 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x10000000001 2024-05-16T22:35:16.130 INFO:tasks.ceph.mds.a.smithi044.stderr:2024-05-16T22:35:15.110+0000 7f43468ab640 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x10000000004 2024-05-16T22:35:16.147 INFO:tasks.ceph.mds.a.smithi044.stderr:2024-05-16T22:35:15.111+0000 7f43468ab640 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x10000000003 2024-05-16T22:35:16.163 INFO:tasks.ceph.mds.a.smithi044.stderr:2024-05-16T22:35:15.111+0000 7f43468ab640 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x10000000002 2024-05-16T22:35:16.411 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 31, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-16T22:33:10.855194+0000', 'modified': '2024-05-16T22:35:13.103205+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 51, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5211}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5211': {'gid': 5211, 'name': 'a', 'rank': 0, 'incarnation': 30, 'state': 'up:reconnect', 'state_seq': 14, 'addr': '172.21.15.44:6834/153528185', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6832', 'nonce': 153528185}, {'type': 'v1', 'addr': '172.21.15.44:6834', 'nonce': 153528185}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-05-16T22:35:16.472 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5211:up:reconnect 2024-05-16T22:35:17.490 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T22:35:17.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.664+0000 7fb1d1772640 1 Processor -- start 2024-05-16T22:35:17.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.664+0000 7fb1d1772640 1 -- start start 2024-05-16T22:35:17.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.666+0000 7fb1d1772640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb1cc09fb90 0x7fb1cc14b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:17.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.666+0000 7fb1d1772640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb1cc14bb60 0x7fb1cc155a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:17.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.666+0000 7fb1d1772640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1cc0bf8d0 con 0x7fb1cc145660 2024-05-16T22:35:17.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.666+0000 7fb1d1772640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fb1cc070080 con 0x7fb1cc14bb60 2024-05-16T22:35:17.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.666+0000 7fb1d1772640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fb1cc0befa0 con 0x7fb1cc09fb90 2024-05-16T22:35:17.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.666+0000 7fb1cb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb1cc14bb60 0x7fb1cc155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:17.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.666+0000 7fb1cb7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb1cc14bb60 0x7fb1cc155a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46594/0 (socket says 172.21.15.44:46594) 2024-05-16T22:35:17.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.666+0000 7fb1cb7fe640 1 -- 172.21.15.44:0/3627067908 learned_addr learned my addr 172.21.15.44:0/3627067908 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:35:17.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.666+0000 7fb1ca7fc640 1 --2- 172.21.15.44:0/3627067908 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb1cc09fb90 0x7fb1cc14b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:17.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.666+0000 7fb1cb7fe640 1 -- 172.21.15.44:0/3627067908 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb1cc09fb90 msgr2=0x7fb1cc14b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:35:17.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.666+0000 7fb1cb7fe640 1 --2- 172.21.15.44:0/3627067908 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb1cc09fb90 0x7fb1cc14b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:17.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.666+0000 7fb1cb7fe640 1 -- 172.21.15.44:0/3627067908 >> v1:172.21.15.70:6789/0 conn(0x7fb1cc145660 legacy=0x7fb1cc06f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:18.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.666+0000 7fb1cb7fe640 1 -- 172.21.15.44:0/3627067908 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1cc0bf280 con 0x7fb1cc14bb60 2024-05-16T22:35:18.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.666+0000 7fb1ca7fc640 1 --2- 172.21.15.44:0/3627067908 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb1cc09fb90 0x7fb1cc14b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:35:18.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.667+0000 7fb1cb7fe640 1 --2- 172.21.15.44:0/3627067908 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1cc14bb60 0x7fb1cc155a90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc009e50 tx=0x7fb1bc02c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1798a56deec775a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:18.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.667+0000 7fb1c9ffb640 1 -- 172.21.15.44:0/3627067908 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1bc032610 con 0x7fb1cc14bb60 2024-05-16T22:35:18.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.667+0000 7fb1c9ffb640 1 -- 172.21.15.44:0/3627067908 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1bc037070 con 0x7fb1cc14bb60 2024-05-16T22:35:18.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.667+0000 7fb1c9ffb640 1 -- 172.21.15.44:0/3627067908 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1bc0329d0 con 0x7fb1cc14bb60 2024-05-16T22:35:18.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.668+0000 7fb1d1772640 1 -- 172.21.15.44:0/3627067908 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1cc14bb60 msgr2=0x7fb1cc155a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:18.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.668+0000 7fb1d1772640 1 --2- 172.21.15.44:0/3627067908 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1cc14bb60 0x7fb1cc155a90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc009e50 tx=0x7fb1bc02c920 comp rx=0 tx=0).stop 2024-05-16T22:35:18.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.668+0000 7fb1d1772640 1 -- 172.21.15.44:0/3627067908 shutdown_connections 2024-05-16T22:35:18.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.668+0000 7fb1d1772640 1 --2- 172.21.15.44:0/3627067908 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1cc14bb60 0x7fb1cc155a90 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:18.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.668+0000 7fb1d1772640 1 --2- 172.21.15.44:0/3627067908 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb1cc09fb90 0x7fb1cc14b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:18.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.668+0000 7fb1d1772640 1 -- 172.21.15.44:0/3627067908 >> 172.21.15.44:0/3627067908 conn(0x7fb1cc0bd1d0 msgr2=0x7fb1cc0bd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:35:18.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.668+0000 7fb1d1772640 1 -- 172.21.15.44:0/3627067908 shutdown_connections 2024-05-16T22:35:18.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.668+0000 7fb1d1772640 1 -- 172.21.15.44:0/3627067908 wait complete. 2024-05-16T22:35:18.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.670+0000 7fb1d1772640 1 Processor -- start 2024-05-16T22:35:18.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.670+0000 7fb1d1772640 1 -- start start 2024-05-16T22:35:18.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.671+0000 7fb1d1772640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1cc09fb90 0x7fb1cc06dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:18.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.671+0000 7fb1d1772640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb1cc145660 0x7fb1cc147e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:18.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.671+0000 7fb1d1772640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb1cc14bb60 0x7fb1cc1447c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:18.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.671+0000 7fb1d1772640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb1cc09ffa0 con 0x7fb1cc09fb90 2024-05-16T22:35:18.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.671+0000 7fb1d1772640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb1cc14bf70 con 0x7fb1cc14bb60 2024-05-16T22:35:18.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.671+0000 7fb1d1772640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fb1cc0be6f0 con 0x7fb1cc145660 2024-05-16T22:35:18.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.671+0000 7fb1caffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1cc09fb90 0x7fb1cc06dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:18.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.671+0000 7fb1caffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1cc09fb90 0x7fb1cc06dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46610/0 (socket says 172.21.15.44:46610) 2024-05-16T22:35:18.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.671+0000 7fb1caffd640 1 -- 172.21.15.44:0/2987270739 learned_addr learned my addr 172.21.15.44:0/2987270739 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:35:18.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.671+0000 7fb1ca7fc640 1 --2- 172.21.15.44:0/2987270739 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb1cc145660 0x7fb1cc147e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:18.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.671+0000 7fb1cb7fe640 1 --2- 172.21.15.44:0/2987270739 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb1cc14bb60 0x7fb1cc1447c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:18.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.671+0000 7fb1caffd640 1 -- 172.21.15.44:0/2987270739 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb1cc145660 msgr2=0x7fb1cc147e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:18.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.671+0000 7fb1caffd640 1 --2- 172.21.15.44:0/2987270739 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb1cc145660 0x7fb1cc147e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:18.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.671+0000 7fb1caffd640 1 -- 172.21.15.44:0/2987270739 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb1cc14bb60 msgr2=0x7fb1cc1447c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:18.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.671+0000 7fb1caffd640 1 --2- 172.21.15.44:0/2987270739 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb1cc14bb60 0x7fb1cc1447c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:18.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.671+0000 7fb1caffd640 1 -- 172.21.15.44:0/2987270739 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1cc06e400 con 0x7fb1cc09fb90 2024-05-16T22:35:18.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.671+0000 7fb1caffd640 1 --2- 172.21.15.44:0/2987270739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1cc09fb90 0x7fb1cc06dec0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb1c400c400 tx=0x7fb1c400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:18.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.671+0000 7fb1b37fe640 1 -- 172.21.15.44:0/2987270739 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c4017070 con 0x7fb1cc09fb90 2024-05-16T22:35:18.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.672+0000 7fb1b37fe640 1 -- 172.21.15.44:0/2987270739 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1c40052d0 con 0x7fb1cc09fb90 2024-05-16T22:35:18.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.672+0000 7fb1d1772640 1 -- 172.21.15.44:0/2987270739 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1cc148340 con 0x7fb1cc09fb90 2024-05-16T22:35:18.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.672+0000 7fb1b37fe640 1 -- 172.21.15.44:0/2987270739 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c4003830 con 0x7fb1cc09fb90 2024-05-16T22:35:18.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.672+0000 7fb1d1772640 1 -- 172.21.15.44:0/2987270739 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1cc146440 con 0x7fb1cc09fb90 2024-05-16T22:35:18.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.672+0000 7fb1d1772640 1 -- 172.21.15.44:0/2987270739 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1cc069b50 con 0x7fb1cc09fb90 2024-05-16T22:35:18.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.674+0000 7fb1b37fe640 1 -- 172.21.15.44:0/2987270739 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb1c401a070 con 0x7fb1cc09fb90 2024-05-16T22:35:18.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.674+0000 7fb1b37fe640 1 --2- 172.21.15.44:0/2987270739 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fb1b8076300 0x7fb1b8078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:19.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.674+0000 7fb1b37fe640 1 -- 172.21.15.44:0/2987270739 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5853+0+0 (secure 0 0 0) 0x7fb1c4096d00 con 0x7fb1cc09fb90 2024-05-16T22:35:19.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.674+0000 7fb1ca7fc640 1 --2- 172.21.15.44:0/2987270739 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fb1b8076300 0x7fb1b8078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:19.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.675+0000 7fb1ca7fc640 1 --2- 172.21.15.44:0/2987270739 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fb1b8076300 0x7fb1b8078810 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc0a6b80 tx=0x7fb1c0008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:19.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.678+0000 7fb1b37fe640 1 -- 172.21.15.44:0/2987270739 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb1c4021020 con 0x7fb1cc09fb90 2024-05-16T22:35:19.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.909+0000 7fb1d1772640 1 -- 172.21.15.44:0/2987270739 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb1cc0be4d0 con 0x7fb1cc09fb90 2024-05-16T22:35:19.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.910+0000 7fb1b37fe640 1 -- 172.21.15.44:0/2987270739 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+4352 (secure 0 0 0) 0x7fb1cc0bf8d0 con 0x7fb1cc09fb90 2024-05-16T22:35:19.132 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:35:19.150 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":33,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4954,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2432336323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2432336323},{"type":"v1","addr":"172.21.15.70:6835","nonce":2432336323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4972,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/454770375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":454770375},{"type":"v1","addr":"172.21.15.44:6835","nonce":454770375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T22:33:10.855194+0000","modified":"2024-05-16T22:35:16.110684+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":51,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":16,"addr":"172.21.15.44:6834/153528185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":153528185},{"type":"v1","addr":"172.21.15.44:6834","nonce":153528185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5211,"qdb_cluster":[5211]},"id":3}]} 2024-05-16T22:35:19.184 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 33 2024-05-16T22:35:19.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.911+0000 7fb1d1772640 1 -- 172.21.15.44:0/2987270739 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fb1b8076300 msgr2=0x7fb1b8078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:19.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.911+0000 7fb1d1772640 1 --2- 172.21.15.44:0/2987270739 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fb1b8076300 0x7fb1b8078810 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc0a6b80 tx=0x7fb1c0008040 comp rx=0 tx=0).stop 2024-05-16T22:35:19.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.911+0000 7fb1d1772640 1 -- 172.21.15.44:0/2987270739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1cc09fb90 msgr2=0x7fb1cc06dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:19.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.911+0000 7fb1d1772640 1 --2- 172.21.15.44:0/2987270739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1cc09fb90 0x7fb1cc06dec0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb1c400c400 tx=0x7fb1c400c8c0 comp rx=0 tx=0).stop 2024-05-16T22:35:19.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.912+0000 7fb1d1772640 1 -- 172.21.15.44:0/2987270739 shutdown_connections 2024-05-16T22:35:19.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.912+0000 7fb1d1772640 1 --2- 172.21.15.44:0/2987270739 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fb1b8076300 0x7fb1b8078810 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:19.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.912+0000 7fb1d1772640 1 --2- 172.21.15.44:0/2987270739 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb1cc145660 0x7fb1cc147e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:19.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.912+0000 7fb1d1772640 1 --2- 172.21.15.44:0/2987270739 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb1cc14bb60 0x7fb1cc1447c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:19.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.912+0000 7fb1d1772640 1 --2- 172.21.15.44:0/2987270739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1cc09fb90 0x7fb1cc06dec0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:19.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.912+0000 7fb1d1772640 1 -- 172.21.15.44:0/2987270739 >> 172.21.15.44:0/2987270739 conn(0x7fb1cc0bd1d0 msgr2=0x7fb1cc0a16e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:35:19.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.912+0000 7fb1d1772640 1 -- 172.21.15.44:0/2987270739 shutdown_connections 2024-05-16T22:35:19.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:17.912+0000 7fb1d1772640 1 -- 172.21.15.44:0/2987270739 wait complete. 2024-05-16T22:35:19.802 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 33, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-16T22:33:10.855194+0000', 'modified': '2024-05-16T22:35:16.110684+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 51, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5211}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5211': {'gid': 5211, 'name': 'a', 'rank': 0, 'incarnation': 30, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.44:6834/153528185', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6832', 'nonce': 153528185}, {'type': 'v1', 'addr': '172.21.15.44:6834', 'nonce': 153528185}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5211, 'qdb_cluster': [5211]} 2024-05-16T22:35:19.817 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-16T22:35:19.857 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-16T22:35:20.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.001+0000 7f468fbf2640 1 Processor -- start 2024-05-16T22:35:20.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.002+0000 7f468fbf2640 1 -- start start 2024-05-16T22:35:20.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.003+0000 7f468fbf2640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4688151fc0 0x7f46880bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:20.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.003+0000 7f468fbf2640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46880c36f0 con 0x7f46880bf050 2024-05-16T22:35:20.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.003+0000 7f468fbf2640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4688152530 con 0x7f468806da30 2024-05-16T22:35:20.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.003+0000 7f468fbf2640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f46880bdc10 con 0x7f4688151fc0 2024-05-16T22:35:20.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.003+0000 7f468e18f640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f46880bf050 0x7f4688158e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:48894/0 (socket says 172.21.15.44:48894) 2024-05-16T22:35:20.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.003+0000 7f468e18f640 1 -- 172.21.15.44:0/1941090459 learned_addr learned my addr 172.21.15.44:0/1941090459 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:35:20.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.003+0000 7f468d98e640 1 --2- 172.21.15.44:0/1941090459 >> v2:172.21.15.70:3300/0 conn(0x7f4688151fc0 0x7f46880bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:20.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.003+0000 7f468c98c640 1 -- 172.21.15.44:0/1941090459 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4016199847 0 0) 0x7f46880c36f0 con 0x7f46880bf050 2024-05-16T22:35:20.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.003+0000 7f468c98c640 1 -- 172.21.15.44:0/1941090459 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4670003520 con 0x7f46880bf050 2024-05-16T22:35:20.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.003+0000 7f468c98c640 1 -- 172.21.15.44:0/1941090459 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 223455782 0 0) 0x7f4688152530 con 0x7f468806da30 2024-05-16T22:35:20.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.003+0000 7f468c98c640 1 -- 172.21.15.44:0/1941090459 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46880c36f0 con 0x7f468806da30 2024-05-16T22:35:20.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.003+0000 7f468d98e640 1 -- 172.21.15.44:0/1941090459 >> v1:172.21.15.70:6789/0 conn(0x7f468806da30 legacy=0x7f46880be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:20.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.003+0000 7f468d98e640 1 -- 172.21.15.44:0/1941090459 >> v1:172.21.15.44:6789/0 conn(0x7f46880bf050 legacy=0x7f4688158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:20.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.003+0000 7f468d98e640 1 -- 172.21.15.44:0/1941090459 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4688152810 con 0x7f4688151fc0 2024-05-16T22:35:20.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.004+0000 7f468d98e640 1 --2- 172.21.15.44:0/1941090459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4688151fc0 0x7f46880bd6d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f46800097a0 tx=0x7f468002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=688f95b1b31ccd4e server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:20.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.004+0000 7f468c98c640 1 -- 172.21.15.44:0/1941090459 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4680037070 con 0x7f4688151fc0 2024-05-16T22:35:20.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.004+0000 7f468c98c640 1 -- 172.21.15.44:0/1941090459 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4680032440 con 0x7f4688151fc0 2024-05-16T22:35:20.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.004+0000 7f468c98c640 1 -- 172.21.15.44:0/1941090459 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46800327f0 con 0x7f4688151fc0 2024-05-16T22:35:20.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.005+0000 7f468fbf2640 1 -- 172.21.15.44:0/1941090459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4688151fc0 msgr2=0x7f46880bd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:20.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.005+0000 7f468fbf2640 1 --2- 172.21.15.44:0/1941090459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4688151fc0 0x7f46880bd6d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f46800097a0 tx=0x7f468002a230 comp rx=0 tx=0).stop 2024-05-16T22:35:20.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.005+0000 7f468fbf2640 1 -- 172.21.15.44:0/1941090459 shutdown_connections 2024-05-16T22:35:20.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.005+0000 7f468fbf2640 1 --2- 172.21.15.44:0/1941090459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4688151fc0 0x7f46880bd6d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:20.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.005+0000 7f468fbf2640 1 -- 172.21.15.44:0/1941090459 >> 172.21.15.44:0/1941090459 conn(0x7f46880c3d20 msgr2=0x7f46880c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:35:20.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.005+0000 7f468fbf2640 1 -- 172.21.15.44:0/1941090459 shutdown_connections 2024-05-16T22:35:20.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.005+0000 7f468fbf2640 1 -- 172.21.15.44:0/1941090459 wait complete. 2024-05-16T22:35:20.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.007+0000 7f468fbf2640 1 Processor -- start 2024-05-16T22:35:20.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.007+0000 7f468fbf2640 1 -- start start 2024-05-16T22:35:20.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.008+0000 7f468fbf2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f468806da30 0x7f468814c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:20.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.008+0000 7f468fbf2640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f46880bf050 0x7f46880b7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:20.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.008+0000 7f468fbf2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4688151fc0 0x7f468814b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:20.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.008+0000 7f468fbf2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f46880a3050 con 0x7f468806da30 2024-05-16T22:35:20.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.008+0000 7f468fbf2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f46880a2ed0 con 0x7f4688151fc0 2024-05-16T22:35:20.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.008+0000 7f468fbf2640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f468806de40 con 0x7f46880bf050 2024-05-16T22:35:20.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.008+0000 7f468d98e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f468806da30 0x7f468814c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:20.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.008+0000 7f468d98e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f468806da30 0x7f468814c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44500/0 (socket says 172.21.15.44:44500) 2024-05-16T22:35:20.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.008+0000 7f468d98e640 1 -- 172.21.15.44:0/796161082 learned_addr learned my addr 172.21.15.44:0/796161082 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:35:20.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.008+0000 7f468e18f640 1 --2- 172.21.15.44:0/796161082 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4688151fc0 0x7f468814b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:20.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.008+0000 7f468d18d640 1 --2- 172.21.15.44:0/796161082 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f46880bf050 0x7f46880b7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:20.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.008+0000 7f468d98e640 1 -- 172.21.15.44:0/796161082 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f46880bf050 msgr2=0x7f46880b7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:20.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.008+0000 7f468d98e640 1 --2- 172.21.15.44:0/796161082 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f46880bf050 0x7f46880b7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:20.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.008+0000 7f468d98e640 1 -- 172.21.15.44:0/796161082 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4688151fc0 msgr2=0x7f468814b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:21.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.008+0000 7f468d98e640 1 --2- 172.21.15.44:0/796161082 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4688151fc0 0x7f468814b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:21.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.008+0000 7f468d98e640 1 -- 172.21.15.44:0/796161082 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f468814c780 con 0x7f468806da30 2024-05-16T22:35:21.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.009+0000 7f468d98e640 1 --2- 172.21.15.44:0/796161082 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f468806da30 0x7f468814c240 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4680000c00 tx=0x7f46800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:21.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.009+0000 7f46867fc640 1 -- 172.21.15.44:0/796161082 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4680041020 con 0x7f468806da30 2024-05-16T22:35:21.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.009+0000 7f46867fc640 1 -- 172.21.15.44:0/796161082 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f468003d620 con 0x7f468806da30 2024-05-16T22:35:21.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.009+0000 7f46867fc640 1 -- 172.21.15.44:0/796161082 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4680037040 con 0x7f468806da30 2024-05-16T22:35:21.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.009+0000 7f468fbf2640 1 -- 172.21.15.44:0/796161082 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46880ba3b0 con 0x7f468806da30 2024-05-16T22:35:21.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.009+0000 7f468fbf2640 1 -- 172.21.15.44:0/796161082 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46881e8560 con 0x7f468806da30 2024-05-16T22:35:21.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.011+0000 7f46867fc640 1 -- 172.21.15.44:0/796161082 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4680044020 con 0x7f468806da30 2024-05-16T22:35:21.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.011+0000 7f46867fc640 1 --2- 172.21.15.44:0/796161082 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4674076300 0x7f4674078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:21.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.011+0000 7f46867fc640 1 -- 172.21.15.44:0/796161082 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5853+0+0 (secure 0 0 0) 0x7f46800b7b80 con 0x7f468806da30 2024-05-16T22:35:21.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.011+0000 7f468d18d640 1 --2- 172.21.15.44:0/796161082 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4674076300 0x7f4674078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:21.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.012+0000 7f468d18d640 1 --2- 172.21.15.44:0/796161082 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4674076300 0x7f4674078810 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f46881e22b0 tx=0x7f467c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:21.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.012+0000 7f4696b77740 1 Processor -- start 2024-05-16T22:35:21.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.012+0000 7f4696b77740 1 -- start start 2024-05-16T22:35:21.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.013+0000 7f4696b77740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55975f05a270 0x55975f4331b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:21.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.013+0000 7f4696b77740 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55975f0313b0 0x55975f3f7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:21.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.013+0000 7f4696b77740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55975f039590 0x55975f4282a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:21.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.013+0000 7f4696b77740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55975f36df10 con 0x55975f039590 2024-05-16T22:35:21.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.013+0000 7f4696b77740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55975f35dab0 con 0x55975f05a270 2024-05-16T22:35:21.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.013+0000 7f4696b77740 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x55975f361af0 con 0x55975f0313b0 2024-05-16T22:35:21.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.014+0000 7f468e18f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55975f039590 0x55975f4282a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:21.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.014+0000 7f468d98e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55975f05a270 0x55975f4331b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:21.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.014+0000 7f468e18f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55975f039590 0x55975f4282a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44512/0 (socket says 172.21.15.44:44512) 2024-05-16T22:35:21.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.014+0000 7f468e18f640 1 -- 172.21.15.44:0/1093206340 learned_addr learned my addr 172.21.15.44:0/1093206340 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:35:21.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.014+0000 7f468d18d640 1 --2- 172.21.15.44:0/1093206340 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55975f0313b0 0x55975f3f7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:21.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.014+0000 7f468e18f640 1 -- 172.21.15.44:0/1093206340 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55975f0313b0 msgr2=0x55975f3f7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:35:21.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.014+0000 7f468e18f640 1 --2- 172.21.15.44:0/1093206340 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55975f0313b0 0x55975f3f7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:21.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.014+0000 7f468e18f640 1 -- 172.21.15.44:0/1093206340 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55975f05a270 msgr2=0x55975f4331b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:35:21.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.014+0000 7f468e18f640 1 --2- 172.21.15.44:0/1093206340 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55975f05a270 0x55975f4331b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:21.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.014+0000 7f468e18f640 1 -- 172.21.15.44:0/1093206340 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55975f3215d0 con 0x55975f039590 2024-05-16T22:35:21.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.014+0000 7f468d98e640 1 --2- 172.21.15.44:0/1093206340 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55975f05a270 0x55975f4331b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:35:21.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.014+0000 7f468e18f640 1 --2- 172.21.15.44:0/1093206340 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55975f039590 0x55975f4282a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4678001fa0 tx=0x7f467800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3bfa3c066334aa7 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:21.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.014+0000 7f466f7fe640 1 -- 172.21.15.44:0/1093206340 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4678019070 con 0x55975f039590 2024-05-16T22:35:21.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.014+0000 7f466f7fe640 1 -- 172.21.15.44:0/1093206340 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f467800ee50 con 0x55975f039590 2024-05-16T22:35:21.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.014+0000 7f466f7fe640 1 -- 172.21.15.44:0/1093206340 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4678014680 con 0x55975f039590 2024-05-16T22:35:21.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.015+0000 7f4696b77740 1 -- 172.21.15.44:0/1093206340 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55975f039590 msgr2=0x55975f4282a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:21.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.015+0000 7f4696b77740 1 --2- 172.21.15.44:0/1093206340 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55975f039590 0x55975f4282a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4678001fa0 tx=0x7f467800e530 comp rx=0 tx=0).stop 2024-05-16T22:35:21.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.015+0000 7f4696b77740 1 -- 172.21.15.44:0/1093206340 shutdown_connections 2024-05-16T22:35:21.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.015+0000 7f4696b77740 1 --2- 172.21.15.44:0/1093206340 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55975f0313b0 0x55975f3f7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:21.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.015+0000 7f4696b77740 1 --2- 172.21.15.44:0/1093206340 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55975f039590 0x55975f4282a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:21.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.015+0000 7f4696b77740 1 --2- 172.21.15.44:0/1093206340 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55975f05a270 0x55975f4331b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:21.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.015+0000 7f4696b77740 1 -- 172.21.15.44:0/1093206340 >> 172.21.15.44:0/1093206340 conn(0x55975f04e3c0 msgr2=0x55975f4328b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:35:21.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.015+0000 7f4696b77740 1 -- 172.21.15.44:0/1093206340 shutdown_connections 2024-05-16T22:35:21.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.015+0000 7f4696b77740 1 -- 172.21.15.44:0/1093206340 wait complete. 2024-05-16T22:35:21.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.016+0000 7f4696b77740 1 -- start start 2024-05-16T22:35:21.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.016+0000 7f4696b77740 1 Processor -- start 2024-05-16T22:35:22.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.017+0000 7f4696b77740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55975f0313b0 0x55975f41b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:22.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.017+0000 7f4696b77740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55975f039590 0x55975f41bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:22.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.017+0000 7f4696b77740 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55975f05a270 0x55975f43f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:22.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.017+0000 7f4696b77740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55975f043850 con 0x55975f039590 2024-05-16T22:35:22.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.017+0000 7f4696b77740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55975f319c10 con 0x55975f0313b0 2024-05-16T22:35:22.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.017+0000 7f4696b77740 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x55975f3f8080 con 0x55975f05a270 2024-05-16T22:35:22.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.017+0000 7f4696b77740 10 client.0 _ll_register_callbacks cb 0x55975f31d150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-16T22:35:22.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.017+0000 7f468d18d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55975f039590 0x55975f41bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:22.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.017+0000 7f468d18d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55975f039590 0x55975f41bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44522/0 (socket says 172.21.15.44:44522) 2024-05-16T22:35:22.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.017+0000 7f468d18d640 1 -- 172.21.15.44:0/2636511011 learned_addr learned my addr 172.21.15.44:0/2636511011 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:35:22.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.018+0000 7f468e18f640 1 --2- 172.21.15.44:0/2636511011 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55975f05a270 0x55975f43f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:22.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.018+0000 7f468d98e640 1 --2- 172.21.15.44:0/2636511011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55975f0313b0 0x55975f41b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:22.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.018+0000 7f468d18d640 1 -- 172.21.15.44:0/2636511011 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55975f05a270 msgr2=0x55975f43f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:35:22.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.018+0000 7f468d18d640 1 --2- 172.21.15.44:0/2636511011 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55975f05a270 0x55975f43f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:22.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.018+0000 7f468d18d640 1 -- 172.21.15.44:0/2636511011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55975f0313b0 msgr2=0x55975f41b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:35:22.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.018+0000 7f468d18d640 1 --2- 172.21.15.44:0/2636511011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55975f0313b0 0x55975f41b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:22.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.018+0000 7f468d18d640 1 -- 172.21.15.44:0/2636511011 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55975f0722d0 con 0x55975f039590 2024-05-16T22:35:22.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.018+0000 7f468d18d640 1 --2- 172.21.15.44:0/2636511011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55975f039590 0x55975f41bde0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f468806d590 tx=0x7f467c000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f899c1c00a9b12a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:22.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.018+0000 7f466cff9640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-05-16T22:35:22.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.018+0000 7f466cff9640 1 -- 172.21.15.44:0/2636511011 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f467c014b90 con 0x55975f039590 2024-05-16T22:35:22.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.018+0000 7f466cff9640 1 -- 172.21.15.44:0/2636511011 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(51..51 src has 1..51) ==== 5853+0+0 (secure 0 0 0) 0x7f467c010040 con 0x55975f039590 2024-05-16T22:35:22.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.018+0000 7f4696b77740 1 -- 172.21.15.44:0/2636511011 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f467800ee50 con 0x55975f039590 2024-05-16T22:35:23.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.018+0000 7f466cff9640 1 -- 172.21.15.44:0/2636511011 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f467c02e050 con 0x55975f039590 2024-05-16T22:35:23.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.018+0000 7f4696b77740 10 client.5268 fetch_fsmap learned FSMap version 33 2024-05-16T22:35:23.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.018+0000 7f4696b77740 1 -- 172.21.15.44:0/2636511011 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) -- 0x55975f13c6b0 con 0x55975f039590 2024-05-16T22:35:23.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.019+0000 7f466cff9640 1 -- 172.21.15.44:0/2636511011 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f467800ee50 con 0x55975f039590 2024-05-16T22:35:23.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.019+0000 7f466cff9640 1 -- 172.21.15.44:0/2636511011 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 2889+0+0 (secure 0 0 0) 0x7f467c031020 con 0x55975f039590 2024-05-16T22:35:23.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.019+0000 7f4696b77740 10 client.5268 fetch_fsmap finished waiting for FSMap version 33 2024-05-16T22:35:23.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.019+0000 7f4696b77740 10 client.5268 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-16T22:35:23.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.019+0000 7f4696b77740 20 client.5268 populate_metadata read hostname 'smithi044' 2024-05-16T22:35:23.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.019+0000 7f4696b77740 1 --2- 172.21.15.44:0/2636511011 >> [v2:172.21.15.44:6832/153528185,v1:172.21.15.44:6834/153528185] conn(0x55975f018e40 0x55975f43fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:23.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.019+0000 7f4696b77740 4 client.5268 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-16T22:35:23.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.019+0000 7f4696b77740 1 -- 172.21.15.44:0/2636511011 --> [v2:172.21.15.44:6832/153528185,v1:172.21.15.44:6834/153528185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55975f36fe60 con 0x55975f018e40 2024-05-16T22:35:23.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.019+0000 7f468d98e640 1 --2- 172.21.15.44:0/2636511011 >> [v2:172.21.15.44:6832/153528185,v1:172.21.15.44:6834/153528185] conn(0x55975f018e40 0x55975f43fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:23.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.019+0000 7f466cff9640 10 client.5268 ms_handle_connect on v2:172.21.15.44:6832/153528185 2024-05-16T22:35:23.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.019+0000 7f468d98e640 1 --2- 172.21.15.44:0/2636511011 >> [v2:172.21.15.44:6832/153528185,v1:172.21.15.44:6834/153528185] conn(0x55975f018e40 0x55975f43fd70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f608e597ac15435 server_cookie=316fd306034fc7be in_seq=0 out_seq=0 2024-05-16T22:35:23.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.020+0000 7f466cff9640 1 -- 172.21.15.44:0/2636511011 <== mds.0 v2:172.21.15.44:6832/153528185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55975f36fe60 con 0x55975f018e40 2024-05-16T22:35:23.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.020+0000 7f466cff9640 10 client.5268 handle_command_reply: tid=0 2024-05-16T22:35:23.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.020+0000 7f4696b77740 1 client.5268 shutdown 2024-05-16T22:35:23.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.020+0000 7f4696b77740 1 -- 172.21.15.44:0/2636511011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55975f039590 msgr2=0x55975f41bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:23.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.020+0000 7f4696b77740 1 --2- 172.21.15.44:0/2636511011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55975f039590 0x55975f41bde0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f468806d590 tx=0x7f467c000fe0 comp rx=0 tx=0).stop 2024-05-16T22:35:23.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.020+0000 7f4696b77740 1 -- 172.21.15.44:0/2636511011 shutdown_connections 2024-05-16T22:35:23.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.020+0000 7f4696b77740 1 --2- 172.21.15.44:0/2636511011 >> [v2:172.21.15.44:6832/153528185,v1:172.21.15.44:6834/153528185] conn(0x55975f018e40 0x55975f43fd70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:23.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.020+0000 7f4696b77740 1 --2- 172.21.15.44:0/2636511011 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55975f05a270 0x55975f43f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:23.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.020+0000 7f4696b77740 1 --2- 172.21.15.44:0/2636511011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55975f039590 0x55975f41bde0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:23.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.020+0000 7f466cff9640 0 client.5268 ms_handle_reset on v2:172.21.15.44:6832/153528185 2024-05-16T22:35:23.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.020+0000 7f4696b77740 1 --2- 172.21.15.44:0/2636511011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55975f0313b0 0x55975f41b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:23.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.020+0000 7f4696b77740 1 -- 172.21.15.44:0/2636511011 >> 172.21.15.44:0/2636511011 conn(0x55975f04e3c0 msgr2=0x55975f4234c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:35:23.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.020+0000 7f4696b77740 1 -- 172.21.15.44:0/2636511011 shutdown_connections 2024-05-16T22:35:23.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.020+0000 7f4696b77740 1 -- 172.21.15.44:0/2636511011 wait complete. 2024-05-16T22:35:24.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.021+0000 7f4696b77740 20 client.5268 trim_cache size 0 max 16384 2024-05-16T22:35:24.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.040+0000 7f4696b77740 1 Processor -- start 2024-05-16T22:35:24.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.040+0000 7f4696b77740 1 -- start start 2024-05-16T22:35:24.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.041+0000 7f4696b77740 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55975f0313b0 0x55975f4393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:24.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.041+0000 7f4696b77740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55975f039590 0x55975f423260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:24.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.041+0000 7f4696b77740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55975f05a270 0x55975f41b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:24.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.041+0000 7f4696b77740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f46881f1240 con 0x55975f05a270 2024-05-16T22:35:24.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.041+0000 7f4696b77740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f46880b8ef0 con 0x55975f039590 2024-05-16T22:35:24.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.041+0000 7f4696b77740 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f46881f0370 con 0x55975f0313b0 2024-05-16T22:35:24.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.041+0000 7f468e18f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55975f05a270 0x55975f41b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:24.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.041+0000 7f468e18f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55975f05a270 0x55975f41b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44534/0 (socket says 172.21.15.44:44534) 2024-05-16T22:35:24.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.041+0000 7f468e18f640 1 -- 172.21.15.44:0/402257302 learned_addr learned my addr 172.21.15.44:0/402257302 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:35:24.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.041+0000 7f468d98e640 1 --2- 172.21.15.44:0/402257302 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55975f0313b0 0x55975f4393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:24.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.041+0000 7f468d18d640 1 --2- 172.21.15.44:0/402257302 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55975f039590 0x55975f423260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:24.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.041+0000 7f468e18f640 1 -- 172.21.15.44:0/402257302 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55975f0313b0 msgr2=0x55975f4393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:35:24.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.041+0000 7f468e18f640 1 --2- 172.21.15.44:0/402257302 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55975f0313b0 0x55975f4393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:24.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.041+0000 7f468e18f640 1 -- 172.21.15.44:0/402257302 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55975f039590 msgr2=0x55975f423260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:35:24.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.041+0000 7f468e18f640 1 --2- 172.21.15.44:0/402257302 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55975f039590 0x55975f423260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:24.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.041+0000 7f468e18f640 1 -- 172.21.15.44:0/402257302 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55975f432c80 con 0x55975f05a270 2024-05-16T22:35:24.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.041+0000 7f468e18f640 1 --2- 172.21.15.44:0/402257302 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55975f05a270 0x55975f41b540 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4678001f40 tx=0x7f467800a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98a9e1330f5a99e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:24.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.041+0000 7f466effd640 1 -- 172.21.15.44:0/402257302 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4678019070 con 0x55975f05a270 2024-05-16T22:35:24.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.041+0000 7f466effd640 1 -- 172.21.15.44:0/402257302 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f467801a040 con 0x55975f05a270 2024-05-16T22:35:24.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.041+0000 7f466effd640 1 -- 172.21.15.44:0/402257302 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f467800fe60 con 0x55975f05a270 2024-05-16T22:35:24.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.042+0000 7f4696b77740 1 -- 172.21.15.44:0/402257302 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55975f05a270 msgr2=0x55975f41b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:24.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.042+0000 7f4696b77740 1 --2- 172.21.15.44:0/402257302 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55975f05a270 0x55975f41b540 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4678001f40 tx=0x7f467800a000 comp rx=0 tx=0).stop 2024-05-16T22:35:24.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.042+0000 7f4696b77740 1 -- 172.21.15.44:0/402257302 shutdown_connections 2024-05-16T22:35:25.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.042+0000 7f4696b77740 1 --2- 172.21.15.44:0/402257302 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55975f05a270 0x55975f41b540 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:25.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.042+0000 7f4696b77740 1 --2- 172.21.15.44:0/402257302 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55975f039590 0x55975f423260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:25.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.042+0000 7f4696b77740 1 --2- 172.21.15.44:0/402257302 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55975f0313b0 0x55975f4393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:25.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.042+0000 7f4696b77740 1 -- 172.21.15.44:0/402257302 >> 172.21.15.44:0/402257302 conn(0x55975f04e3c0 msgr2=0x55975f423f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:35:25.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.042+0000 7f4696b77740 1 -- 172.21.15.44:0/402257302 shutdown_connections 2024-05-16T22:35:25.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.042+0000 7f4696b77740 1 -- 172.21.15.44:0/402257302 wait complete. 2024-05-16T22:35:25.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.043+0000 7f4696b77740 1 -- start start 2024-05-16T22:35:25.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.043+0000 7f4696b77740 1 Processor -- start 2024-05-16T22:35:25.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.044+0000 7f4696b77740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55975f0313b0 0x55975f429710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:25.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.044+0000 7f4696b77740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55975f039590 0x55975f4a6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:25.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.044+0000 7f4696b77740 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55975f05a270 0x55975f4a6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:25.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.044+0000 7f4696b77740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55975f41b2f0 con 0x55975f039590 2024-05-16T22:35:25.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.044+0000 7f4696b77740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55975f442fe0 con 0x55975f0313b0 2024-05-16T22:35:25.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.044+0000 7f4696b77740 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x55975f41a9c0 con 0x55975f05a270 2024-05-16T22:35:25.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.044+0000 7f4696b77740 10 client.0 _ll_register_callbacks cb 0x7f467c0035f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-16T22:35:25.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.044+0000 7f468d18d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55975f039590 0x55975f4a6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:25.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.044+0000 7f468d18d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55975f039590 0x55975f4a6a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44542/0 (socket says 172.21.15.44:44542) 2024-05-16T22:35:25.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.044+0000 7f468d18d640 1 -- 172.21.15.44:0/121700754 learned_addr learned my addr 172.21.15.44:0/121700754 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:35:25.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.044+0000 7f468e18f640 1 --2- 172.21.15.44:0/121700754 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55975f05a270 0x55975f4a6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:25.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.044+0000 7f468d98e640 1 --2- 172.21.15.44:0/121700754 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55975f0313b0 0x55975f429710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:25.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.045+0000 7f468d18d640 1 -- 172.21.15.44:0/121700754 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55975f05a270 msgr2=0x55975f4a6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:35:25.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.045+0000 7f468d18d640 1 --2- 172.21.15.44:0/121700754 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55975f05a270 0x55975f4a6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:25.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.045+0000 7f468d18d640 1 -- 172.21.15.44:0/121700754 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55975f0313b0 msgr2=0x55975f429710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:35:25.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.045+0000 7f468d18d640 1 --2- 172.21.15.44:0/121700754 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55975f0313b0 0x55975f429710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:25.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.045+0000 7f468d18d640 1 -- 172.21.15.44:0/121700754 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55975f429c50 con 0x55975f039590 2024-05-16T22:35:25.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.045+0000 7f468d18d640 1 --2- 172.21.15.44:0/121700754 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55975f039590 0x55975f4a6a90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f468806d590 tx=0x7f467c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a28103bcfe4244c server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:26.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.045+0000 7f466cff9640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-05-16T22:35:26.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.045+0000 7f466cff9640 1 -- 172.21.15.44:0/121700754 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f467c0036a0 con 0x55975f039590 2024-05-16T22:35:26.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.045+0000 7f466cff9640 1 -- 172.21.15.44:0/121700754 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(51..51 src has 1..51) ==== 5853+0+0 (secure 0 0 0) 0x7f467c00ebc0 con 0x55975f039590 2024-05-16T22:35:26.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.045+0000 7f4696b77740 1 -- 172.21.15.44:0/121700754 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f467801a040 con 0x55975f039590 2024-05-16T22:35:26.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.045+0000 7f466cff9640 1 -- 172.21.15.44:0/121700754 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f467c014da0 con 0x55975f039590 2024-05-16T22:35:26.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.045+0000 7f4696b77740 10 client.5274 fetch_fsmap learned FSMap version 33 2024-05-16T22:35:26.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.045+0000 7f4696b77740 1 -- 172.21.15.44:0/121700754 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) -- 0x55975f43fd70 con 0x55975f039590 2024-05-16T22:35:26.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.045+0000 7f466cff9640 1 -- 172.21.15.44:0/121700754 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f467801a040 con 0x55975f039590 2024-05-16T22:35:26.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.045+0000 7f466cff9640 1 -- 172.21.15.44:0/121700754 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 2889+0+0 (secure 0 0 0) 0x7f467c031040 con 0x55975f039590 2024-05-16T22:35:26.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.045+0000 7f4696b77740 10 client.5274 fetch_fsmap finished waiting for FSMap version 33 2024-05-16T22:35:26.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.045+0000 7f4696b77740 10 client.5274 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-16T22:35:26.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.045+0000 7f4696b77740 20 client.5274 populate_metadata read hostname 'smithi044' 2024-05-16T22:35:26.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.046+0000 7f4696b77740 1 --2- 172.21.15.44:0/121700754 >> [v2:172.21.15.44:6832/153528185,v1:172.21.15.44:6834/153528185] conn(0x55975f419800 0x55975f419c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:26.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.046+0000 7f4696b77740 4 client.5274 mds_command: new command op to 5211 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-16T22:35:26.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.046+0000 7f4696b77740 1 -- 172.21.15.44:0/121700754 --> [v2:172.21.15.44:6832/153528185,v1:172.21.15.44:6834/153528185] -- command(tid 0: {"prefix": "status"}) -- 0x55975f369640 con 0x55975f419800 2024-05-16T22:35:26.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.046+0000 7f468d98e640 1 --2- 172.21.15.44:0/121700754 >> [v2:172.21.15.44:6832/153528185,v1:172.21.15.44:6834/153528185] conn(0x55975f419800 0x55975f419c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:26.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.046+0000 7f466cff9640 10 client.5274 ms_handle_connect on v2:172.21.15.44:6832/153528185 2024-05-16T22:35:26.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.046+0000 7f468d98e640 1 --2- 172.21.15.44:0/121700754 >> [v2:172.21.15.44:6832/153528185,v1:172.21.15.44:6834/153528185] conn(0x55975f419800 0x55975f419c10 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1a2a79494c9386b server_cookie=88de5351d4e921fe in_seq=0 out_seq=0 2024-05-16T22:35:26.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.046+0000 7f466cff9640 1 -- 172.21.15.44:0/121700754 <== mds.0 v2:172.21.15.44:6832/153528185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55975f369640 con 0x55975f419800 2024-05-16T22:35:26.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.046+0000 7f466cff9640 10 client.5274 handle_command_reply: tid=0 2024-05-16T22:35:26.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.046+0000 7f4696b77740 1 client.5274 shutdown 2024-05-16T22:35:26.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.046+0000 7f4696b77740 1 -- 172.21.15.44:0/121700754 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55975f039590 msgr2=0x55975f4a6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:26.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.046+0000 7f4696b77740 1 --2- 172.21.15.44:0/121700754 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55975f039590 0x55975f4a6a90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f468806d590 tx=0x7f467c013000 comp rx=0 tx=0).stop 2024-05-16T22:35:26.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.046+0000 7f4696b77740 1 -- 172.21.15.44:0/121700754 shutdown_connections 2024-05-16T22:35:26.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.046+0000 7f4696b77740 1 --2- 172.21.15.44:0/121700754 >> [v2:172.21.15.44:6832/153528185,v1:172.21.15.44:6834/153528185] conn(0x55975f419800 0x55975f419c10 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:26.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.047+0000 7f4696b77740 1 --2- 172.21.15.44:0/121700754 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55975f05a270 0x55975f4a6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:26.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.047+0000 7f466cff9640 0 client.5274 ms_handle_reset on v2:172.21.15.44:6832/153528185 2024-05-16T22:35:26.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.047+0000 7f4696b77740 1 --2- 172.21.15.44:0/121700754 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55975f039590 0x55975f4a6a90 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:26.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.047+0000 7f4696b77740 1 --2- 172.21.15.44:0/121700754 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55975f0313b0 0x55975f429710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:26.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.047+0000 7f4696b77740 1 -- 172.21.15.44:0/121700754 >> 172.21.15.44:0/121700754 conn(0x55975f04e3c0 msgr2=0x55975f43f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:35:26.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.047+0000 7f4696b77740 1 -- 172.21.15.44:0/121700754 shutdown_connections 2024-05-16T22:35:26.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.047+0000 7f4696b77740 1 -- 172.21.15.44:0/121700754 wait complete. 2024-05-16T22:35:26.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.047+0000 7f4696b77740 20 client.5274 trim_cache size 0 max 16384 2024-05-16T22:35:26.711 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-05-16T22:35:26.734 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "572ab7cc-b103-4548-ae8f-c6614d57f0c8", 2024-05-16T22:35:26.751 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2024-05-16T22:35:26.792 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 5211, 2024-05-16T22:35:26.809 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-05-16T22:35:26.826 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-05-16T22:35:26.843 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-05-16T22:35:26.859 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 6.9517217420000001, 2024-05-16T22:35:26.876 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 33, 2024-05-16T22:35:26.893 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 51, 2024-05-16T22:35:26.909 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 51, 2024-05-16T22:35:26.926 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 57.527781830999999 2024-05-16T22:35:26.960 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-05-16T22:35:26.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.047+0000 7f468fbf2640 1 -- 172.21.15.44:0/796161082 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4674076300 msgr2=0x7f4674078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:26.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.047+0000 7f468fbf2640 1 --2- 172.21.15.44:0/796161082 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4674076300 0x7f4674078810 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f46881e22b0 tx=0x7f467c009040 comp rx=0 tx=0).stop 2024-05-16T22:35:27.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.047+0000 7f468fbf2640 1 -- 172.21.15.44:0/796161082 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f468806da30 msgr2=0x7f468814c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:27.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.047+0000 7f468fbf2640 1 --2- 172.21.15.44:0/796161082 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f468806da30 0x7f468814c240 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4680000c00 tx=0x7f46800046c0 comp rx=0 tx=0).stop 2024-05-16T22:35:27.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.047+0000 7f468fbf2640 1 -- 172.21.15.44:0/796161082 shutdown_connections 2024-05-16T22:35:27.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.047+0000 7f468fbf2640 1 --2- 172.21.15.44:0/796161082 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4674076300 0x7f4674078810 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:27.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.047+0000 7f468fbf2640 1 --2- 172.21.15.44:0/796161082 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f46880bf050 0x7f46880b7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:27.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.047+0000 7f468fbf2640 1 --2- 172.21.15.44:0/796161082 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4688151fc0 0x7f468814b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:27.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.047+0000 7f468fbf2640 1 --2- 172.21.15.44:0/796161082 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f468806da30 0x7f468814c240 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:27.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.047+0000 7f468fbf2640 1 -- 172.21.15.44:0/796161082 >> 172.21.15.44:0/796161082 conn(0x7f46880c3d20 msgr2=0x7f46880c09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:35:27.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.047+0000 7f468fbf2640 1 -- 172.21.15.44:0/796161082 shutdown_connections 2024-05-16T22:35:27.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:20.047+0000 7f468fbf2640 1 -- 172.21.15.44:0/796161082 wait complete. 2024-05-16T22:35:27.252 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T22:35:27.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.394+0000 7f7d7ccb6640 1 Processor -- start 2024-05-16T22:35:27.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.394+0000 7f7d7ccb6640 1 -- start start 2024-05-16T22:35:27.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.396+0000 7f7d7ccb6640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7d7814e360 0x7f7d781522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:27.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.396+0000 7f7d7ccb6640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7d78148770 0x7f7d780c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:27.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.396+0000 7f7d7ccb6640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7d780bf9b0 0x7f7d780bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:27.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.396+0000 7f7d7ccb6640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f7d78151e40 con 0x7f7d7814e360 2024-05-16T22:35:27.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.396+0000 7f7d7ccb6640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f7d780c0620 con 0x7f7d780bf9b0 2024-05-16T22:35:27.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.396+0000 7f7d7ccb6640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f7d78151ad0 con 0x7f7d78148770 2024-05-16T22:35:27.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.396+0000 7f7d7659c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7d7814e360 0x7f7d781522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:27.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.396+0000 7f7d7659c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7d7814e360 0x7f7d781522d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44550/0 (socket says 172.21.15.44:44550) 2024-05-16T22:35:27.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.396+0000 7f7d7659c640 1 -- 172.21.15.44:0/2370506739 learned_addr learned my addr 172.21.15.44:0/2370506739 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:35:27.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.396+0000 7f7d75d9b640 1 --2- 172.21.15.44:0/2370506739 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7d78148770 0x7f7d780c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:27.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.396+0000 7f7d76d9d640 1 --2- 172.21.15.44:0/2370506739 >> v2:172.21.15.70:3300/0 conn(0x7f7d780bf9b0 0x7f7d780bfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:27.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.396+0000 7f7d7659c640 1 -- 172.21.15.44:0/2370506739 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7d78148770 msgr2=0x7f7d780c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:35:27.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.396+0000 7f7d7659c640 1 --2- 172.21.15.44:0/2370506739 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7d78148770 0x7f7d780c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:27.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.396+0000 7f7d7659c640 1 -- 172.21.15.44:0/2370506739 >> v2:172.21.15.70:3300/0 conn(0x7f7d780bf9b0 msgr2=0x7f7d780bfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:35:27.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.396+0000 7f7d7659c640 1 --2- 172.21.15.44:0/2370506739 >> v2:172.21.15.70:3300/0 conn(0x7f7d780bf9b0 0x7f7d780bfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:27.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.396+0000 7f7d7659c640 1 -- 172.21.15.44:0/2370506739 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d78152810 con 0x7f7d7814e360 2024-05-16T22:35:27.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.396+0000 7f7d76d9d640 1 --2- 172.21.15.44:0/2370506739 >> v2:172.21.15.70:3300/0 conn(0x7f7d780bf9b0 0x7f7d780bfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:35:27.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.397+0000 7f7d7659c640 1 --2- 172.21.15.44:0/2370506739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d7814e360 0x7f7d781522d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7d78073130 tx=0x7f7d6002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69aba0715eb829f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:27.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.397+0000 7f7d7559a640 1 -- 172.21.15.44:0/2370506739 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d60037070 con 0x7f7d7814e360 2024-05-16T22:35:27.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.397+0000 7f7d7559a640 1 -- 172.21.15.44:0/2370506739 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d60032440 con 0x7f7d7814e360 2024-05-16T22:35:27.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.397+0000 7f7d7559a640 1 -- 172.21.15.44:0/2370506739 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d60032810 con 0x7f7d7814e360 2024-05-16T22:35:27.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.398+0000 7f7d7ccb6640 1 -- 172.21.15.44:0/2370506739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d7814e360 msgr2=0x7f7d781522d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:27.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.398+0000 7f7d7ccb6640 1 --2- 172.21.15.44:0/2370506739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d7814e360 0x7f7d781522d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7d78073130 tx=0x7f7d6002a270 comp rx=0 tx=0).stop 2024-05-16T22:35:28.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.398+0000 7f7d7ccb6640 1 -- 172.21.15.44:0/2370506739 shutdown_connections 2024-05-16T22:35:28.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.398+0000 7f7d7ccb6640 1 --2- 172.21.15.44:0/2370506739 >> v2:172.21.15.70:3300/0 conn(0x7f7d780bf9b0 0x7f7d780bfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:28.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.398+0000 7f7d7ccb6640 1 --2- 172.21.15.44:0/2370506739 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7d78148770 0x7f7d780c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:28.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.398+0000 7f7d7ccb6640 1 --2- 172.21.15.44:0/2370506739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d7814e360 0x7f7d781522d0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:28.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.398+0000 7f7d7ccb6640 1 -- 172.21.15.44:0/2370506739 >> 172.21.15.44:0/2370506739 conn(0x7f7d780c17c0 msgr2=0x7f7d780c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:35:28.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.398+0000 7f7d7ccb6640 1 -- 172.21.15.44:0/2370506739 shutdown_connections 2024-05-16T22:35:28.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.398+0000 7f7d7ccb6640 1 -- 172.21.15.44:0/2370506739 wait complete. 2024-05-16T22:35:28.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.400+0000 7f7d7ccb6640 1 Processor -- start 2024-05-16T22:35:28.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.400+0000 7f7d7ccb6640 1 -- start start 2024-05-16T22:35:28.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.401+0000 7f7d7ccb6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d780bf9b0 0x7f7d781e7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:28.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.401+0000 7f7d7ccb6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d78148770 0x7f7d78147580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:28.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.401+0000 7f7d7ccb6640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7d7814e360 0x7f7d78147ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:28.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.401+0000 7f7d7ccb6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7d780c1340 con 0x7f7d78148770 2024-05-16T22:35:28.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.401+0000 7f7d7ccb6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7d780c11c0 con 0x7f7d780bf9b0 2024-05-16T22:35:28.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.401+0000 7f7d7ccb6640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f7d7809fd50 con 0x7f7d7814e360 2024-05-16T22:35:28.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.401+0000 7f7d75d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d78148770 0x7f7d78147580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:28.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.401+0000 7f7d75d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d78148770 0x7f7d78147580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44566/0 (socket says 172.21.15.44:44566) 2024-05-16T22:35:28.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.401+0000 7f7d75d9b640 1 -- 172.21.15.44:0/1667267425 learned_addr learned my addr 172.21.15.44:0/1667267425 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:35:28.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.401+0000 7f7d76d9d640 1 --2- 172.21.15.44:0/1667267425 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7d7814e360 0x7f7d78147ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:28.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.401+0000 7f7d7659c640 1 --2- 172.21.15.44:0/1667267425 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d780bf9b0 0x7f7d781e7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:28.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.401+0000 7f7d75d9b640 1 -- 172.21.15.44:0/1667267425 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7d7814e360 msgr2=0x7f7d78147ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:28.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.401+0000 7f7d75d9b640 1 --2- 172.21.15.44:0/1667267425 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7d7814e360 0x7f7d78147ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:28.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.401+0000 7f7d75d9b640 1 -- 172.21.15.44:0/1667267425 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d780bf9b0 msgr2=0x7f7d781e7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:28.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.401+0000 7f7d75d9b640 1 --2- 172.21.15.44:0/1667267425 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d780bf9b0 0x7f7d781e7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:28.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.401+0000 7f7d75d9b640 1 -- 172.21.15.44:0/1667267425 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d78151460 con 0x7f7d78148770 2024-05-16T22:35:28.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.401+0000 7f7d75d9b640 1 --2- 172.21.15.44:0/1667267425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d78148770 0x7f7d78147580 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7d6800e8a0 tx=0x7f7d6800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:28.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.402+0000 7f7d6effd640 1 -- 172.21.15.44:0/1667267425 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d68017070 con 0x7f7d78148770 2024-05-16T22:35:28.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.402+0000 7f7d6effd640 1 -- 172.21.15.44:0/1667267425 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d6800c940 con 0x7f7d78148770 2024-05-16T22:35:28.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.402+0000 7f7d7ccb6640 1 -- 172.21.15.44:0/1667267425 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d78072be0 con 0x7f7d78148770 2024-05-16T22:35:28.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.402+0000 7f7d6effd640 1 -- 172.21.15.44:0/1667267425 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d6800cd30 con 0x7f7d78148770 2024-05-16T22:35:28.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.402+0000 7f7d7ccb6640 1 -- 172.21.15.44:0/1667267425 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d780a2360 con 0x7f7d78148770 2024-05-16T22:35:28.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.403+0000 7f7d7ccb6640 1 -- 172.21.15.44:0/1667267425 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d780a1540 con 0x7f7d78148770 2024-05-16T22:35:28.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.403+0000 7f7d6effd640 1 -- 172.21.15.44:0/1667267425 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7d6801a070 con 0x7f7d78148770 2024-05-16T22:35:28.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.404+0000 7f7d6effd640 1 --2- 172.21.15.44:0/1667267425 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f7d580762d0 0x7f7d580787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:28.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.404+0000 7f7d6effd640 1 -- 172.21.15.44:0/1667267425 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5853+0+0 (secure 0 0 0) 0x7f7d68097530 con 0x7f7d78148770 2024-05-16T22:35:28.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.404+0000 7f7d7659c640 1 --2- 172.21.15.44:0/1667267425 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f7d580762d0 0x7f7d580787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:28.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.404+0000 7f7d7659c640 1 --2- 172.21.15.44:0/1667267425 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f7d580762d0 0x7f7d580787e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7d60034000 tx=0x7f7d6002e000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:28.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.409+0000 7f7d6effd640 1 -- 172.21.15.44:0/1667267425 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7d780a1540 con 0x7f7d78148770 2024-05-16T22:35:28.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.635+0000 7f7d7ccb6640 1 -- 172.21.15.44:0/1667267425 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7d780bf790 con 0x7f7d78148770 2024-05-16T22:35:28.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.636+0000 7f7d6effd640 1 -- 172.21.15.44:0/1667267425 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+4352 (secure 0 0 0) 0x7f7d68060710 con 0x7f7d78148770 2024-05-16T22:35:28.879 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:35:28.896 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":33,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4954,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2432336323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2432336323},{"type":"v1","addr":"172.21.15.70:6835","nonce":2432336323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4972,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/454770375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":454770375},{"type":"v1","addr":"172.21.15.44:6835","nonce":454770375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T22:33:10.855194+0000","modified":"2024-05-16T22:35:16.110684+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":51,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":16,"addr":"172.21.15.44:6834/153528185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":153528185},{"type":"v1","addr":"172.21.15.44:6834","nonce":153528185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5211,"qdb_cluster":[5211]},"id":3}]} 2024-05-16T22:35:28.914 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 33 2024-05-16T22:35:28.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.638+0000 7f7d7ccb6640 1 -- 172.21.15.44:0/1667267425 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f7d580762d0 msgr2=0x7f7d580787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:28.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.638+0000 7f7d7ccb6640 1 --2- 172.21.15.44:0/1667267425 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f7d580762d0 0x7f7d580787e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7d60034000 tx=0x7f7d6002e000 comp rx=0 tx=0).stop 2024-05-16T22:35:28.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.638+0000 7f7d7ccb6640 1 -- 172.21.15.44:0/1667267425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d78148770 msgr2=0x7f7d78147580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:28.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.638+0000 7f7d7ccb6640 1 --2- 172.21.15.44:0/1667267425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d78148770 0x7f7d78147580 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7d6800e8a0 tx=0x7f7d6800eca0 comp rx=0 tx=0).stop 2024-05-16T22:35:29.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.638+0000 7f7d7ccb6640 1 -- 172.21.15.44:0/1667267425 shutdown_connections 2024-05-16T22:35:29.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.638+0000 7f7d7ccb6640 1 --2- 172.21.15.44:0/1667267425 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f7d580762d0 0x7f7d580787e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:29.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.638+0000 7f7d7ccb6640 1 --2- 172.21.15.44:0/1667267425 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7d7814e360 0x7f7d78147ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:29.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.638+0000 7f7d7ccb6640 1 --2- 172.21.15.44:0/1667267425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d78148770 0x7f7d78147580 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:29.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.638+0000 7f7d7ccb6640 1 --2- 172.21.15.44:0/1667267425 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d780bf9b0 0x7f7d781e7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:29.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.638+0000 7f7d7ccb6640 1 -- 172.21.15.44:0/1667267425 >> 172.21.15.44:0/1667267425 conn(0x7f7d780c17c0 msgr2=0x7f7d780c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:35:29.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.638+0000 7f7d7ccb6640 1 -- 172.21.15.44:0/1667267425 shutdown_connections 2024-05-16T22:35:29.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:27.638+0000 7f7d7ccb6640 1 -- 172.21.15.44:0/1667267425 wait complete. 2024-05-16T22:35:29.180 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T22:35:29.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.323+0000 7f078ca0c640 1 Processor -- start 2024-05-16T22:35:29.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.323+0000 7f078ca0c640 1 -- start start 2024-05-16T22:35:29.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.325+0000 7f078ca0c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f078814e360 0x7f07881522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:29.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.325+0000 7f078ca0c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0788148770 0x7f07880c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:29.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.325+0000 7f078ca0c640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07880c0620 con 0x7f07880bf9b0 2024-05-16T22:35:29.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.325+0000 7f078ca0c640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f0788151e40 con 0x7f078814e360 2024-05-16T22:35:29.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.325+0000 7f078ca0c640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f0788151ad0 con 0x7f0788148770 2024-05-16T22:35:29.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.325+0000 7f0786d9d640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f07880bf9b0 0x7f07880bfdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:48896/0 (socket says 172.21.15.44:48896) 2024-05-16T22:35:29.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.325+0000 7f0786d9d640 1 -- 172.21.15.44:0/1170942787 learned_addr learned my addr 172.21.15.44:0/1170942787 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:35:29.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.325+0000 7f0785d9b640 1 --2- 172.21.15.44:0/1170942787 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0788148770 0x7f07880c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:29.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.325+0000 7f078659c640 1 --2- 172.21.15.44:0/1170942787 >> v2:172.21.15.70:3300/0 conn(0x7f078814e360 0x7f07881522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:29.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.325+0000 7f078559a640 1 -- 172.21.15.44:0/1170942787 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1611677464 0 0) 0x7f07880c0620 con 0x7f07880bf9b0 2024-05-16T22:35:29.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.325+0000 7f078559a640 1 -- 172.21.15.44:0/1170942787 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0770003520 con 0x7f07880bf9b0 2024-05-16T22:35:29.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.325+0000 7f078559a640 1 -- 172.21.15.44:0/1170942787 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 612473624 0 0) 0x7f0770003520 con 0x7f07880bf9b0 2024-05-16T22:35:29.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.325+0000 7f078659c640 1 -- 172.21.15.44:0/1170942787 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0788148770 msgr2=0x7f07880c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:35:29.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.325+0000 7f078659c640 1 --2- 172.21.15.44:0/1170942787 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0788148770 0x7f07880c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:29.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.325+0000 7f078659c640 1 -- 172.21.15.44:0/1170942787 >> v1:172.21.15.44:6789/0 conn(0x7f07880bf9b0 legacy=0x7f07880bfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:29.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.325+0000 7f078659c640 1 -- 172.21.15.44:0/1170942787 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0788152810 con 0x7f078814e360 2024-05-16T22:35:29.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.325+0000 7f0785d9b640 1 --2- 172.21.15.44:0/1170942787 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0788148770 0x7f07880c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:35:29.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.326+0000 7f078659c640 1 --2- 172.21.15.44:0/1170942787 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f078814e360 0x7f07881522d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f07780097a0 tx=0x7f077802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a29cf8b2d4a5ef16 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:29.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.326+0000 7f078559a640 1 -- 172.21.15.44:0/1170942787 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0778037070 con 0x7f078814e360 2024-05-16T22:35:29.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.326+0000 7f078559a640 1 -- 172.21.15.44:0/1170942787 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f077802ac30 con 0x7f078814e360 2024-05-16T22:35:29.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.326+0000 7f078559a640 1 -- 172.21.15.44:0/1170942787 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0780001a90 con 0x7f078814e360 2024-05-16T22:35:29.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.327+0000 7f078ca0c640 1 -- 172.21.15.44:0/1170942787 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f078814e360 msgr2=0x7f07881522d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:29.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.327+0000 7f078ca0c640 1 --2- 172.21.15.44:0/1170942787 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f078814e360 0x7f07881522d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f07780097a0 tx=0x7f077802a1a0 comp rx=0 tx=0).stop 2024-05-16T22:35:29.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.327+0000 7f078ca0c640 1 -- 172.21.15.44:0/1170942787 shutdown_connections 2024-05-16T22:35:29.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.327+0000 7f078ca0c640 1 --2- 172.21.15.44:0/1170942787 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0788148770 0x7f07880c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:29.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.327+0000 7f078ca0c640 1 --2- 172.21.15.44:0/1170942787 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f078814e360 0x7f07881522d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:29.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.327+0000 7f078ca0c640 1 -- 172.21.15.44:0/1170942787 >> 172.21.15.44:0/1170942787 conn(0x7f07880c17c0 msgr2=0x7f07880c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:35:29.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.327+0000 7f078ca0c640 1 -- 172.21.15.44:0/1170942787 shutdown_connections 2024-05-16T22:35:29.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.327+0000 7f078ca0c640 1 -- 172.21.15.44:0/1170942787 wait complete. 2024-05-16T22:35:30.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.329+0000 7f078ca0c640 1 Processor -- start 2024-05-16T22:35:30.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.329+0000 7f078ca0c640 1 -- start start 2024-05-16T22:35:30.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.330+0000 7f078ca0c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07880bf9b0 0x7f07881e7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:30.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.330+0000 7f078ca0c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0788148770 0x7f0788150780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:30.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.330+0000 7f078ca0c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f078814e360 0x7f078813d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:30.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.330+0000 7f078ca0c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0788158cc0 con 0x7f078814e360 2024-05-16T22:35:30.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.330+0000 7f078ca0c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f07880c13d0 con 0x7f07880bf9b0 2024-05-16T22:35:30.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.330+0000 7f078ca0c640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f0788158e40 con 0x7f0788148770 2024-05-16T22:35:30.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.330+0000 7f0786d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f078814e360 0x7f078813d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:30.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.330+0000 7f0786d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f078814e360 0x7f078813d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44582/0 (socket says 172.21.15.44:44582) 2024-05-16T22:35:30.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.330+0000 7f0786d9d640 1 -- 172.21.15.44:0/568247062 learned_addr learned my addr 172.21.15.44:0/568247062 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:35:30.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.330+0000 7f078659c640 1 --2- 172.21.15.44:0/568247062 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07880bf9b0 0x7f07881e7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:30.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.330+0000 7f0785d9b640 1 --2- 172.21.15.44:0/568247062 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0788148770 0x7f0788150780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:30.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.331+0000 7f0786d9d640 1 -- 172.21.15.44:0/568247062 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0788148770 msgr2=0x7f0788150780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:30.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.331+0000 7f0786d9d640 1 --2- 172.21.15.44:0/568247062 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0788148770 0x7f0788150780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:30.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.331+0000 7f0786d9d640 1 -- 172.21.15.44:0/568247062 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07880bf9b0 msgr2=0x7f07881e7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:30.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.331+0000 7f0786d9d640 1 --2- 172.21.15.44:0/568247062 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07880bf9b0 0x7f07881e7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:30.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.331+0000 7f0786d9d640 1 -- 172.21.15.44:0/568247062 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07881e83e0 con 0x7f078814e360 2024-05-16T22:35:30.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.331+0000 7f0786d9d640 1 --2- 172.21.15.44:0/568247062 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f078814e360 0x7f078813d9c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f078000c730 tx=0x7f078000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:30.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.331+0000 7f0776ffd640 1 -- 172.21.15.44:0/568247062 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0780018070 con 0x7f078814e360 2024-05-16T22:35:30.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.331+0000 7f0776ffd640 1 -- 172.21.15.44:0/568247062 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f078000ce40 con 0x7f078814e360 2024-05-16T22:35:30.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.331+0000 7f078ca0c640 1 -- 172.21.15.44:0/568247062 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f078806f290 con 0x7f078814e360 2024-05-16T22:35:30.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.331+0000 7f0776ffd640 1 -- 172.21.15.44:0/568247062 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f078000a880 con 0x7f078814e360 2024-05-16T22:35:30.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.331+0000 7f078ca0c640 1 -- 172.21.15.44:0/568247062 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0788070a70 con 0x7f078814e360 2024-05-16T22:35:30.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.332+0000 7f078ca0c640 1 -- 172.21.15.44:0/568247062 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0788151430 con 0x7f078814e360 2024-05-16T22:35:30.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.333+0000 7f0776ffd640 1 -- 172.21.15.44:0/568247062 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f078001b070 con 0x7f078814e360 2024-05-16T22:35:30.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.333+0000 7f0776ffd640 1 --2- 172.21.15.44:0/568247062 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f07680762d0 0x7f07680787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:30.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.334+0000 7f0776ffd640 1 -- 172.21.15.44:0/568247062 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5853+0+0 (secure 0 0 0) 0x7f0780096c20 con 0x7f078814e360 2024-05-16T22:35:30.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.334+0000 7f078659c640 1 --2- 172.21.15.44:0/568247062 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f07680762d0 0x7f07680787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:30.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.334+0000 7f078659c640 1 --2- 172.21.15.44:0/568247062 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f07680762d0 0x7f07680787e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0778034000 tx=0x7f077802e000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:30.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.338+0000 7f0776ffd640 1 -- 172.21.15.44:0/568247062 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f078005fe00 con 0x7f078814e360 2024-05-16T22:35:30.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.572+0000 7f078ca0c640 1 -- 172.21.15.44:0/568247062 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f07880bf790 con 0x7f078814e360 2024-05-16T22:35:30.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.572+0000 7f0776ffd640 1 -- 172.21.15.44:0/568247062 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+4352 (secure 0 0 0) 0x7f0780064100 con 0x7f078814e360 2024-05-16T22:35:30.740 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:35:30.757 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":33,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4954,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2432336323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2432336323},{"type":"v1","addr":"172.21.15.70:6835","nonce":2432336323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4972,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/454770375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":454770375},{"type":"v1","addr":"172.21.15.44:6835","nonce":454770375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T22:33:10.855194+0000","modified":"2024-05-16T22:35:16.110684+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":51,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":16,"addr":"172.21.15.44:6834/153528185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":153528185},{"type":"v1","addr":"172.21.15.44:6834","nonce":153528185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5211,"qdb_cluster":[5211]},"id":3}]} 2024-05-16T22:35:30.775 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 33 2024-05-16T22:35:30.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.575+0000 7f078ca0c640 1 -- 172.21.15.44:0/568247062 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f07680762d0 msgr2=0x7f07680787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:30.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.575+0000 7f078ca0c640 1 --2- 172.21.15.44:0/568247062 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f07680762d0 0x7f07680787e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0778034000 tx=0x7f077802e000 comp rx=0 tx=0).stop 2024-05-16T22:35:30.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.575+0000 7f078ca0c640 1 -- 172.21.15.44:0/568247062 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f078814e360 msgr2=0x7f078813d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:30.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.575+0000 7f078ca0c640 1 --2- 172.21.15.44:0/568247062 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f078814e360 0x7f078813d9c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f078000c730 tx=0x7f078000cbf0 comp rx=0 tx=0).stop 2024-05-16T22:35:30.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.575+0000 7f078ca0c640 1 -- 172.21.15.44:0/568247062 shutdown_connections 2024-05-16T22:35:30.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.575+0000 7f078ca0c640 1 --2- 172.21.15.44:0/568247062 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f07680762d0 0x7f07680787e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:30.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.575+0000 7f078ca0c640 1 --2- 172.21.15.44:0/568247062 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0788148770 0x7f0788150780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:30.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.575+0000 7f078ca0c640 1 --2- 172.21.15.44:0/568247062 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f078814e360 0x7f078813d9c0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:31.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.575+0000 7f078ca0c640 1 --2- 172.21.15.44:0/568247062 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07880bf9b0 0x7f07881e7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:31.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.575+0000 7f078ca0c640 1 -- 172.21.15.44:0/568247062 >> 172.21.15.44:0/568247062 conn(0x7f07880c17c0 msgr2=0x7f0788140680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:35:31.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.575+0000 7f078ca0c640 1 -- 172.21.15.44:0/568247062 shutdown_connections 2024-05-16T22:35:31.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:29.575+0000 7f078ca0c640 1 -- 172.21.15.44:0/568247062 wait complete. 2024-05-16T22:35:31.077 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump tree /dir 0 2024-05-16T22:35:31.239 INFO:teuthology.orchestra.run.smithi044.stdout:[{"ino":1099511627780,"rdev":0,"ctime":"2024-05-16T22:34:15.249864+0000","btime":"2024-05-16T22:34:14.498880+0000","mode":16832,"uid":1000,"gid":1316,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-05-16T22:34:15.249864+0000","atime":"2024-05-16T22:34:14.498880+0000","time_warp_seq":0,"change_attr":3,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-05-16T22:34:15.249864+0000","num_files":1,"num_subdirs":0,"change_attr":1},"rstat":{"version":1,"rbytes":4096,"rfiles":1,"rsubdirs":1,"rsnaps":0,"rctime":"2024-05-16T22:34:15.251864+0000"},"accounted_rstat":{"version":0,"rbytes":4096,"rfiles":1,"rsubdirs":1,"rsnaps":0,"rctime":"2024-05-16T22:34:15.251864+0000"},"version":34,"file_data_version":0,"xattr_version":1,"backtrace_version":14,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dirtyscattered":0,"lock":0,"dirfrag":1,"dirtyrstat":1,"dirtyparent":1,"dirty":1,"authpin":0},"nref":4,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyparent","dirtyrstat"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"dirfrags":[{"path":"/dir","dirfrag":"0x10000000004","snapid_first":2,"projected_version":"10","version":"10","committing_version":"5","committed_version":"5","is_rep":false,"dir_auth":"","states":["auth","dirty"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dnwaiter":0,"child":1,"dirty":1,"authpin":0},"nref":2,"dentries":[{"path":"dir/bUHUwH9E8uiVaf8xZ+zONcB1CToj53x5aUUnKdnNj5U37zbh28l1AaWwHhbOT3HyzqKjmSKKW1o4odQJc7nF9xrKIB8D3b4qqb2Cs6s7t2106hHhQk5,YV7DtpeNPZnorcTqxPM,hExtWHSS4P+S+Dpwj62hMyh,77sGhiW1Filvv1gQjV+sN,GozPNwHgfleadkUuZ+PMLCaKQXhuid9WvmHanxJnaabYDLj4VEz+EX2WsG","alternate_name":"","path_ino":1,"snap_first":2,"snap_last":18446744073709551614,"is_primary":true,"is_remote":false,"is_null":false,"is_new":false,"inode":1099511628283,"remote_type":"","version":9,"projected_version":9,"auth_pins":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"inodepin":1,"dirty":1},"nref":2,"lock":{},"versionlock":{"gather_set":[],"state":"lock","type":"dversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty"]}]}],"is_subvolume":false}] 2024-05-16T22:35:31.258 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "accounted_rstat": { "rbytes": 4096, "rctime": "2024-05-16T22:34:15.251864+0000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-05-16T22:34:14.498880+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 14, "btime": "2024-05-16T22:34:14.498880+0000", "change_attr": 3, "client_caps": [], "client_ranges": [], "ctime": "2024-05-16T22:34:15.249864+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfrags": [ { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "5", "committing_version": "5", "dentries": [ { "alternate_name": "", "auth_pins": 0, "auth_state": { "replicas": {} }, "inode": 1099511628283, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_new": false, "is_null": false, "is_primary": true, "is_remote": false, "lock": {}, "nref": 2, "path": "dir/bUHUwH9E8uiVaf8xZ+zONcB1CToj53x5aUUnKdnNj5U37zbh28l1AaWwHhbOT3HyzqKjmSKKW1o4odQJc7nF9xrKIB8D3b4qqb2Cs6s7t2106hHhQk5,YV7DtpeNPZnorcTqxPM,hExtWHSS4P+S+Dpwj62hMyh,77sGhiW1Filvv1gQjV+sN,GozPNwHgfleadkUuZ+PMLCaKQXhuid9WvmHanxJnaabYDLj4VEz+EX2WsG", "path_ino": 1, "pins": { "dirty": 1, "inodepin": 1 }, "projected_version": 9, "remote_type": "", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snap_first": 2, "snap_last": 18446744073709551614, "states": [ "auth", "dirty" ], "version": 9, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "dversion", "xlock_by": {} } } ], "dir_auth": "", "dirfrag": "0x10000000004", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/dir", "pins": { "authpin": 0, "child": 1, "dirty": 1, "dnwaiter": 0 }, "projected_version": "10", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty" ], "version": "10" } ], "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 1, "mtime": "2024-05-16T22:34:15.249864+0000", "num_files": 1, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1316, "ino": 1099511627780, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16832, "mtime": "2024-05-16T22:34:15.249864+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "pins": { "authpin": 0, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "dirtyrstat": 1, "dirtyscattered": 0, "lock": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 4096, "rctime": "2024-05-16T22:34:15.251864+0000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 1, "version": 1 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtyrstat" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 34, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } ] 2024-05-16T22:35:31.275 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'sudo fscrypt purge --force --quiet /home/ubuntu/cephtest/mnt.0') 2024-05-16T22:35:31.694 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:35:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-16T22:35:31.855 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-16T22:35:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-16T22:35:31.875 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-16T22:35:31.891 DEBUG:teuthology.orchestra.run.smithi044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-16T22:35:31.939 DEBUG:teuthology.orchestra.run.smithi070:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-16T22:35:31.987 DEBUG:teuthology.orchestra.run.smithi196:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-16T22:35:32.115 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-16T22:35:32.141 INFO:tasks.cephfs.mount:Terminating background process 2024-05-16T22:35:32.158 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-16T22:35:32.175 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-16T22:35:32.250 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-16T22:35:32.275 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-16T22:35:32.348 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-16T22:35:32.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.493+0000 7fe302815640 1 Processor -- start 2024-05-16T22:35:32.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.493+0000 7fe302815640 1 -- start start 2024-05-16T22:35:32.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.494+0000 7fe302815640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe2fc14e360 0x7fe2fc1522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:32.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.494+0000 7fe302815640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2fc0c1390 con 0x7fe2fc148770 2024-05-16T22:35:32.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.494+0000 7fe302815640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2fc0c0620 con 0x7fe2fc0bf9b0 2024-05-16T22:35:32.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.494+0000 7fe302815640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fe2fc151e40 con 0x7fe2fc14e360 2024-05-16T22:35:32.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.495+0000 7fe2fb7fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fe2fc148770 0x7fe2fc0c0c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:36114/0 (socket says 172.21.15.44:36114) 2024-05-16T22:35:32.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.495+0000 7fe2fb7fe640 1 -- 172.21.15.44:0/4291739556 learned_addr learned my addr 172.21.15.44:0/4291739556 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:35:32.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.495+0000 7fe2fbfff640 1 --2- 172.21.15.44:0/4291739556 >> v2:172.21.15.70:3300/0 conn(0x7fe2fc14e360 0x7fe2fc1522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:32.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.495+0000 7fe2faffd640 1 -- 172.21.15.44:0/4291739556 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 764606375 0 0) 0x7fe2ec001110 con 0x7fe2fc148770 2024-05-16T22:35:32.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.495+0000 7fe2faffd640 1 -- 172.21.15.44:0/4291739556 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2e8003520 con 0x7fe2fc148770 2024-05-16T22:35:32.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.495+0000 7fe2faffd640 1 -- 172.21.15.44:0/4291739556 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3900039748 0 0) 0x7fe2fc0c0620 con 0x7fe2fc0bf9b0 2024-05-16T22:35:32.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.495+0000 7fe2faffd640 1 -- 172.21.15.44:0/4291739556 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2ec001110 con 0x7fe2fc0bf9b0 2024-05-16T22:35:32.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.495+0000 7fe2fbfff640 1 -- 172.21.15.44:0/4291739556 >> v1:172.21.15.70:6789/0 conn(0x7fe2fc0bf9b0 legacy=0x7fe2fc0bfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:32.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.495+0000 7fe2fbfff640 1 -- 172.21.15.44:0/4291739556 >> v1:172.21.15.44:6789/0 conn(0x7fe2fc148770 legacy=0x7fe2fc0c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:32.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.495+0000 7fe2fbfff640 1 -- 172.21.15.44:0/4291739556 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2fc151ad0 con 0x7fe2fc14e360 2024-05-16T22:35:32.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.496+0000 7fe2fbfff640 1 --2- 172.21.15.44:0/4291739556 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2fc14e360 0x7fe2fc1522d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe2e40097d0 tx=0x7fe2e402a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a35e805094fcfd89 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:32.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.496+0000 7fe2faffd640 1 -- 172.21.15.44:0/4291739556 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e4037070 con 0x7fe2fc14e360 2024-05-16T22:35:32.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.496+0000 7fe2faffd640 1 -- 172.21.15.44:0/4291739556 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2e4032640 con 0x7fe2fc14e360 2024-05-16T22:35:33.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.496+0000 7fe2faffd640 1 -- 172.21.15.44:0/4291739556 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e4032a10 con 0x7fe2fc14e360 2024-05-16T22:35:33.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.497+0000 7fe302815640 1 -- 172.21.15.44:0/4291739556 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2fc14e360 msgr2=0x7fe2fc1522d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:33.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.497+0000 7fe302815640 1 --2- 172.21.15.44:0/4291739556 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2fc14e360 0x7fe2fc1522d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe2e40097d0 tx=0x7fe2e402a300 comp rx=0 tx=0).stop 2024-05-16T22:35:33.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.497+0000 7fe302815640 1 -- 172.21.15.44:0/4291739556 shutdown_connections 2024-05-16T22:35:33.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.497+0000 7fe302815640 1 --2- 172.21.15.44:0/4291739556 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2fc14e360 0x7fe2fc1522d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:33.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.497+0000 7fe302815640 1 -- 172.21.15.44:0/4291739556 >> 172.21.15.44:0/4291739556 conn(0x7fe2fc0c17c0 msgr2=0x7fe2fc0c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:35:33.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.497+0000 7fe302815640 1 -- 172.21.15.44:0/4291739556 shutdown_connections 2024-05-16T22:35:33.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.497+0000 7fe302815640 1 -- 172.21.15.44:0/4291739556 wait complete. 2024-05-16T22:35:33.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.498+0000 7fe302815640 1 Processor -- start 2024-05-16T22:35:33.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.499+0000 7fe302815640 1 -- start start 2024-05-16T22:35:33.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.500+0000 7fe302815640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe2fc0bf9b0 0x7fe2fc0a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:33.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.500+0000 7fe302815640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2fc148770 0x7fe2fc14f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:33.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.500+0000 7fe302815640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2fc14e360 0x7fe2fc13c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:33.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.500+0000 7fe302815640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe2fc159e50 con 0x7fe2fc148770 2024-05-16T22:35:33.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.500+0000 7fe302815640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe2fc159cd0 con 0x7fe2fc14e360 2024-05-16T22:35:33.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.500+0000 7fe302815640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fe2fc159fd0 con 0x7fe2fc0bf9b0 2024-05-16T22:35:33.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.500+0000 7fe2fb7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2fc148770 0x7fe2fc14f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:33.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.500+0000 7fe2fb7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2fc148770 0x7fe2fc14f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59792/0 (socket says 172.21.15.44:59792) 2024-05-16T22:35:33.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.500+0000 7fe2fb7fe640 1 -- 172.21.15.44:0/4222226793 learned_addr learned my addr 172.21.15.44:0/4222226793 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:35:33.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.500+0000 7fe2fbfff640 1 --2- 172.21.15.44:0/4222226793 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe2fc0bf9b0 0x7fe2fc0a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:33.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.500+0000 7fe300db2640 1 --2- 172.21.15.44:0/4222226793 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2fc14e360 0x7fe2fc13c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:33.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.500+0000 7fe2fb7fe640 1 -- 172.21.15.44:0/4222226793 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe2fc0bf9b0 msgr2=0x7fe2fc0a5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:33.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.500+0000 7fe2fb7fe640 1 --2- 172.21.15.44:0/4222226793 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe2fc0bf9b0 0x7fe2fc0a5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:33.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.500+0000 7fe2fb7fe640 1 -- 172.21.15.44:0/4222226793 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2fc14e360 msgr2=0x7fe2fc13c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:33.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.500+0000 7fe2fb7fe640 1 --2- 172.21.15.44:0/4222226793 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2fc14e360 0x7fe2fc13c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:33.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.500+0000 7fe2fb7fe640 1 -- 172.21.15.44:0/4222226793 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2fc14fbf0 con 0x7fe2fc148770 2024-05-16T22:35:33.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.500+0000 7fe300db2640 1 --2- 172.21.15.44:0/4222226793 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2fc14e360 0x7fe2fc13c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:35:33.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.500+0000 7fe2fb7fe640 1 --2- 172.21.15.44:0/4222226793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2fc148770 0x7fe2fc14f6b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec00c790 tx=0x7fe2ec00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:33.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.501+0000 7fe2f8ff9640 1 -- 172.21.15.44:0/4222226793 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec017070 con 0x7fe2fc148770 2024-05-16T22:35:33.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.501+0000 7fe2f8ff9640 1 -- 172.21.15.44:0/4222226793 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2ec005ce0 con 0x7fe2fc148770 2024-05-16T22:35:33.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.501+0000 7fe302815640 1 -- 172.21.15.44:0/4222226793 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2fc0a6d40 con 0x7fe2fc148770 2024-05-16T22:35:33.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.501+0000 7fe2f8ff9640 1 -- 172.21.15.44:0/4222226793 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec0072b0 con 0x7fe2fc148770 2024-05-16T22:35:33.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.501+0000 7fe302815640 1 -- 172.21.15.44:0/4222226793 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2fc1e4a80 con 0x7fe2fc148770 2024-05-16T22:35:33.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.502+0000 7fe302815640 1 -- 172.21.15.44:0/4222226793 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2fc050940 con 0x7fe2fc148770 2024-05-16T22:35:33.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.502+0000 7fe2f8ff9640 1 -- 172.21.15.44:0/4222226793 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe2ec01a070 con 0x7fe2fc148770 2024-05-16T22:35:33.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.503+0000 7fe2f8ff9640 1 --2- 172.21.15.44:0/4222226793 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fe2dc0762d0 0x7fe2dc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:33.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.503+0000 7fe2f8ff9640 1 -- 172.21.15.44:0/4222226793 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5853+0+0 (secure 0 0 0) 0x7fe2ec0969d0 con 0x7fe2fc148770 2024-05-16T22:35:33.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.503+0000 7fe2fbfff640 1 --2- 172.21.15.44:0/4222226793 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fe2dc0762d0 0x7fe2dc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:33.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.504+0000 7fe2fbfff640 1 --2- 172.21.15.44:0/4222226793 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fe2dc0762d0 0x7fe2dc0787e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4034000 tx=0x7fe2e402e000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:33.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.508+0000 7fe2f8ff9640 1 -- 172.21.15.44:0/4222226793 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe2fc0c1390 con 0x7fe2fc148770 2024-05-16T22:35:34.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.714+0000 7fe302815640 1 -- 172.21.15.44:0/4222226793 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe2fc0bf790 con 0x7fe2fc148770 2024-05-16T22:35:34.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.714+0000 7fe2f8ff9640 1 -- 172.21.15.44:0/4222226793 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v51) ==== 80+0+118 (secure 0 0 0) 0x7fe2ec05fce0 con 0x7fe2fc148770 2024-05-16T22:35:34.035 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6834/97015923 2024-05-17T22:34:22.451767+0000 2024-05-16T22:35:34.052 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6832/97015923 2024-05-17T22:34:22.451767+0000 2024-05-16T22:35:34.070 INFO:teuthology.orchestra.run.smithi044.stderr:listed 2 entries 2024-05-16T22:35:34.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.716+0000 7fe302815640 1 -- 172.21.15.44:0/4222226793 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fe2dc0762d0 msgr2=0x7fe2dc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:34.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.716+0000 7fe302815640 1 --2- 172.21.15.44:0/4222226793 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fe2dc0762d0 0x7fe2dc0787e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4034000 tx=0x7fe2e402e000 comp rx=0 tx=0).stop 2024-05-16T22:35:34.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.716+0000 7fe302815640 1 -- 172.21.15.44:0/4222226793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2fc148770 msgr2=0x7fe2fc14f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:34.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.716+0000 7fe302815640 1 --2- 172.21.15.44:0/4222226793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2fc148770 0x7fe2fc14f6b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec00c790 tx=0x7fe2ec00cc50 comp rx=0 tx=0).stop 2024-05-16T22:35:34.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.716+0000 7fe302815640 1 -- 172.21.15.44:0/4222226793 shutdown_connections 2024-05-16T22:35:34.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.716+0000 7fe302815640 1 --2- 172.21.15.44:0/4222226793 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fe2dc0762d0 0x7fe2dc0787e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:34.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.716+0000 7fe302815640 1 --2- 172.21.15.44:0/4222226793 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2fc14e360 0x7fe2fc13c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:34.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.716+0000 7fe302815640 1 --2- 172.21.15.44:0/4222226793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2fc148770 0x7fe2fc14f6b0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:34.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.716+0000 7fe302815640 1 --2- 172.21.15.44:0/4222226793 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe2fc0bf9b0 0x7fe2fc0a5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:34.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.716+0000 7fe302815640 1 -- 172.21.15.44:0/4222226793 >> 172.21.15.44:0/4222226793 conn(0x7fe2fc0c17c0 msgr2=0x7fe2fc0be740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:35:34.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.716+0000 7fe302815640 1 -- 172.21.15.44:0/4222226793 shutdown_connections 2024-05-16T22:35:34.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:32.716+0000 7fe302815640 1 -- 172.21.15.44:0/4222226793 wait complete. 2024-05-16T22:35:34.419 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-16T22:35:34.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T22:35:34.452 DEBUG:teuthology.orchestra.run.smithi196:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-16T22:35:34.564 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi196.front.sepia.ceph.com 2024-05-16T22:35:34.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T22:35:34.646 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-16T22:35:34.728 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T22:35:34.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.871+0000 7fd4869a5640 1 Processor -- start 2024-05-16T22:35:34.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.871+0000 7fd4869a5640 1 -- start start 2024-05-16T22:35:34.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.872+0000 7fd4869a5640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd48014fa20 0x7fd48014fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:34.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.872+0000 7fd4869a5640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4801469c0 con 0x7fd4800bb940 2024-05-16T22:35:34.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.872+0000 7fd4869a5640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4800a40b0 con 0x7fd4800a3bd0 2024-05-16T22:35:35.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.872+0000 7fd4869a5640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fd4800a49e0 con 0x7fd48014fa20 2024-05-16T22:35:35.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.872+0000 7fd47f7fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fd4800bb940 0x7fd4801462b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:36116/0 (socket says 172.21.15.44:36116) 2024-05-16T22:35:35.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.872+0000 7fd47f7fe640 1 -- 172.21.15.44:0/669685989 learned_addr learned my addr 172.21.15.44:0/669685989 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:35:35.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.873+0000 7fd484f42640 1 --2- 172.21.15.44:0/669685989 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd48014fa20 0x7fd48014fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:35.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.873+0000 7fd47effd640 1 -- 172.21.15.44:0/669685989 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3255171297 0 0) 0x7fd4801469c0 con 0x7fd4800bb940 2024-05-16T22:35:35.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.873+0000 7fd47effd640 1 -- 172.21.15.44:0/669685989 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd46c003520 con 0x7fd4800bb940 2024-05-16T22:35:35.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.873+0000 7fd47effd640 1 -- 172.21.15.44:0/669685989 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2952009515 0 0) 0x7fd4800a40b0 con 0x7fd4800a3bd0 2024-05-16T22:35:35.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.873+0000 7fd47effd640 1 -- 172.21.15.44:0/669685989 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4801469c0 con 0x7fd4800a3bd0 2024-05-16T22:35:35.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.873+0000 7fd47effd640 1 -- 172.21.15.44:0/669685989 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2857406255 0 0) 0x7fd46c003520 con 0x7fd4800bb940 2024-05-16T22:35:35.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.873+0000 7fd484f42640 1 -- 172.21.15.44:0/669685989 >> v1:172.21.15.70:6789/0 conn(0x7fd4800a3bd0 legacy=0x7fd4800bc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:35.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.873+0000 7fd484f42640 1 -- 172.21.15.44:0/669685989 >> v1:172.21.15.44:6789/0 conn(0x7fd4800bb940 legacy=0x7fd4801462b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:35.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.873+0000 7fd484f42640 1 -- 172.21.15.44:0/669685989 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4800a4390 con 0x7fd48014fa20 2024-05-16T22:35:35.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.874+0000 7fd484f42640 1 --2- 172.21.15.44:0/669685989 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd48014fa20 0x7fd48014fe30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd478009dc0 tx=0x7fd47802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d312737a747079e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:35.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.874+0000 7fd47effd640 1 -- 172.21.15.44:0/669685989 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4700016f0 con 0x7fd48014fa20 2024-05-16T22:35:35.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.874+0000 7fd47effd640 1 -- 172.21.15.44:0/669685989 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd478007540 con 0x7fd48014fa20 2024-05-16T22:35:35.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.874+0000 7fd47effd640 1 -- 172.21.15.44:0/669685989 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4780078f0 con 0x7fd48014fa20 2024-05-16T22:35:35.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.875+0000 7fd4869a5640 1 -- 172.21.15.44:0/669685989 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd48014fa20 msgr2=0x7fd48014fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:35.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.875+0000 7fd4869a5640 1 --2- 172.21.15.44:0/669685989 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd48014fa20 0x7fd48014fe30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd478009dc0 tx=0x7fd47802a660 comp rx=0 tx=0).stop 2024-05-16T22:35:35.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.875+0000 7fd4869a5640 1 -- 172.21.15.44:0/669685989 shutdown_connections 2024-05-16T22:35:35.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.875+0000 7fd4869a5640 1 --2- 172.21.15.44:0/669685989 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd48014fa20 0x7fd48014fe30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:35.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.875+0000 7fd4869a5640 1 -- 172.21.15.44:0/669685989 >> 172.21.15.44:0/669685989 conn(0x7fd4800a1ac0 msgr2=0x7fd4800bbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:35:35.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.875+0000 7fd4869a5640 1 -- 172.21.15.44:0/669685989 shutdown_connections 2024-05-16T22:35:35.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.875+0000 7fd4869a5640 1 -- 172.21.15.44:0/669685989 wait complete. 2024-05-16T22:35:35.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.876+0000 7fd4869a5640 1 Processor -- start 2024-05-16T22:35:35.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.877+0000 7fd4869a5640 1 -- start start 2024-05-16T22:35:35.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.878+0000 7fd4869a5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4800a3bd0 0x7fd48006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:35.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.878+0000 7fd4869a5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4800bb940 0x7fd4800be8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:35.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.878+0000 7fd4869a5640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd48014fa20 0x7fd48013e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:35.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.878+0000 7fd4869a5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd4800a28b0 con 0x7fd4800a3bd0 2024-05-16T22:35:35.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.878+0000 7fd4869a5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd480150370 con 0x7fd4800bb940 2024-05-16T22:35:35.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.878+0000 7fd4869a5640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fd4800a2a30 con 0x7fd48014fa20 2024-05-16T22:35:35.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.878+0000 7fd47ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4800a3bd0 0x7fd48006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:35.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.878+0000 7fd47ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4800a3bd0 0x7fd48006f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59800/0 (socket says 172.21.15.44:59800) 2024-05-16T22:35:35.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.878+0000 7fd47ffff640 1 -- 172.21.15.44:0/1070007811 learned_addr learned my addr 172.21.15.44:0/1070007811 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:35:35.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.878+0000 7fd47f7fe640 1 --2- 172.21.15.44:0/1070007811 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4800bb940 0x7fd4800be8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:35.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.878+0000 7fd484f42640 1 --2- 172.21.15.44:0/1070007811 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd48014fa20 0x7fd48013e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:35.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.878+0000 7fd47ffff640 1 -- 172.21.15.44:0/1070007811 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd48014fa20 msgr2=0x7fd48013e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:35.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.878+0000 7fd47ffff640 1 --2- 172.21.15.44:0/1070007811 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd48014fa20 0x7fd48013e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:36.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.878+0000 7fd47ffff640 1 -- 172.21.15.44:0/1070007811 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4800bb940 msgr2=0x7fd4800be8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:36.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.878+0000 7fd47ffff640 1 --2- 172.21.15.44:0/1070007811 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4800bb940 0x7fd4800be8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:36.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.878+0000 7fd47ffff640 1 -- 172.21.15.44:0/1070007811 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd48006f860 con 0x7fd4800a3bd0 2024-05-16T22:35:36.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.878+0000 7fd47ffff640 1 --2- 172.21.15.44:0/1070007811 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4800a3bd0 0x7fd48006f320 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd46800c3c0 tx=0x7fd46800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:36.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.878+0000 7fd47cff9640 1 -- 172.21.15.44:0/1070007811 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd468017070 con 0x7fd4800a3bd0 2024-05-16T22:35:36.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.878+0000 7fd47cff9640 1 -- 172.21.15.44:0/1070007811 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4680052d0 con 0x7fd4800a3bd0 2024-05-16T22:35:36.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.878+0000 7fd47cff9640 1 -- 172.21.15.44:0/1070007811 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd468003830 con 0x7fd4800a3bd0 2024-05-16T22:35:36.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.878+0000 7fd4869a5640 1 -- 172.21.15.44:0/1070007811 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4800bee10 con 0x7fd4800a3bd0 2024-05-16T22:35:36.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.878+0000 7fd4869a5640 1 -- 172.21.15.44:0/1070007811 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd48014e030 con 0x7fd4800a3bd0 2024-05-16T22:35:36.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.879+0000 7fd4869a5640 1 -- 172.21.15.44:0/1070007811 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd480050940 con 0x7fd4800a3bd0 2024-05-16T22:35:36.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.880+0000 7fd47cff9640 1 -- 172.21.15.44:0/1070007811 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd46801a070 con 0x7fd4800a3bd0 2024-05-16T22:35:36.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.881+0000 7fd47cff9640 1 --2- 172.21.15.44:0/1070007811 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd4600762d0 0x7fd4600787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:36.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.881+0000 7fd47cff9640 1 -- 172.21.15.44:0/1070007811 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5853+0+0 (secure 0 0 0) 0x7fd468096ac0 con 0x7fd4800a3bd0 2024-05-16T22:35:36.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.881+0000 7fd47f7fe640 1 --2- 172.21.15.44:0/1070007811 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd4600762d0 0x7fd4600787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:36.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.881+0000 7fd47f7fe640 1 --2- 172.21.15.44:0/1070007811 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd4600762d0 0x7fd4600787e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd48013edd0 tx=0x7fd470009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:36.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:34.885+0000 7fd47cff9640 1 -- 172.21.15.44:0/1070007811 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd468060260 con 0x7fd4800a3bd0 2024-05-16T22:35:36.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:35.115+0000 7fd4869a5640 1 -- 172.21.15.44:0/1070007811 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd480145a10 con 0x7fd4800a3bd0 2024-05-16T22:35:36.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:35.115+0000 7fd47cff9640 1 -- 172.21.15.44:0/1070007811 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+4352 (secure 0 0 0) 0x7fd4680682e0 con 0x7fd4800a3bd0 2024-05-16T22:35:36.663 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:35:36.696 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":33,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4954,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2432336323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2432336323},{"type":"v1","addr":"172.21.15.70:6835","nonce":2432336323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4972,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/454770375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":454770375},{"type":"v1","addr":"172.21.15.44:6835","nonce":454770375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T22:33:10.855194+0000","modified":"2024-05-16T22:35:16.110684+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":51,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":16,"addr":"172.21.15.44:6834/153528185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":153528185},{"type":"v1","addr":"172.21.15.44:6834","nonce":153528185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5211,"qdb_cluster":[5211]},"id":3}]} 2024-05-16T22:35:36.731 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 33 2024-05-16T22:35:36.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:35.117+0000 7fd4869a5640 1 -- 172.21.15.44:0/1070007811 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd4600762d0 msgr2=0x7fd4600787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:36.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:35.117+0000 7fd4869a5640 1 --2- 172.21.15.44:0/1070007811 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd4600762d0 0x7fd4600787e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd48013edd0 tx=0x7fd470009040 comp rx=0 tx=0).stop 2024-05-16T22:35:36.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:35.117+0000 7fd4869a5640 1 -- 172.21.15.44:0/1070007811 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4800a3bd0 msgr2=0x7fd48006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:36.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:35.117+0000 7fd4869a5640 1 --2- 172.21.15.44:0/1070007811 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4800a3bd0 0x7fd48006f320 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd46800c3c0 tx=0x7fd46800c880 comp rx=0 tx=0).stop 2024-05-16T22:35:36.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:35.117+0000 7fd4869a5640 1 -- 172.21.15.44:0/1070007811 shutdown_connections 2024-05-16T22:35:36.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:35.117+0000 7fd4869a5640 1 --2- 172.21.15.44:0/1070007811 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd4600762d0 0x7fd4600787e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:36.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:35.117+0000 7fd4869a5640 1 --2- 172.21.15.44:0/1070007811 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd48014fa20 0x7fd48013e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:37.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:35.117+0000 7fd4869a5640 1 --2- 172.21.15.44:0/1070007811 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4800bb940 0x7fd4800be8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:37.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:35.117+0000 7fd4869a5640 1 --2- 172.21.15.44:0/1070007811 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4800a3bd0 0x7fd48006f320 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:37.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:35.117+0000 7fd4869a5640 1 -- 172.21.15.44:0/1070007811 >> 172.21.15.44:0/1070007811 conn(0x7fd4800a1ac0 msgr2=0x7fd480144ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:35:37.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:35.117+0000 7fd4869a5640 1 -- 172.21.15.44:0/1070007811 shutdown_connections 2024-05-16T22:35:37.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:35.117+0000 7fd4869a5640 1 -- 172.21.15.44:0/1070007811 wait complete. 2024-05-16T22:35:37.214 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T22:35:37.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.373+0000 7fd938451640 1 Processor -- start 2024-05-16T22:35:37.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.373+0000 7fd938451640 1 -- start start 2024-05-16T22:35:37.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.374+0000 7fd938451640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd930074b00 0x7fd93006c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:37.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.374+0000 7fd938451640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd93014fad0 0x7fd93014fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:37.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.374+0000 7fd938451640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd93006ce00 con 0x7fd9300be3f0 2024-05-16T22:35:37.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.374+0000 7fd938451640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fd9300bb470 con 0x7fd93014fad0 2024-05-16T22:35:37.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.374+0000 7fd938451640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fd93014d230 con 0x7fd930074b00 2024-05-16T22:35:37.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.375+0000 7fd9369ee640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd93014fad0 0x7fd93014fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:37.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.375+0000 7fd9369ee640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd93014fad0 0x7fd93014fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59808/0 (socket says 172.21.15.44:59808) 2024-05-16T22:35:37.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.375+0000 7fd9369ee640 1 -- 172.21.15.44:0/3263898820 learned_addr learned my addr 172.21.15.44:0/3263898820 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:35:37.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.375+0000 7fd9361ed640 1 --2- 172.21.15.44:0/3263898820 >> v2:172.21.15.70:3300/0 conn(0x7fd930074b00 0x7fd93006c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:37.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.375+0000 7fd9369ee640 1 -- 172.21.15.44:0/3263898820 >> v2:172.21.15.70:3300/0 conn(0x7fd930074b00 msgr2=0x7fd93006c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:35:37.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.375+0000 7fd9369ee640 1 --2- 172.21.15.44:0/3263898820 >> v2:172.21.15.70:3300/0 conn(0x7fd930074b00 0x7fd93006c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:37.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.375+0000 7fd9369ee640 1 -- 172.21.15.44:0/3263898820 >> v1:172.21.15.70:6789/0 conn(0x7fd9300be3f0 legacy=0x7fd93014cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:38.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.375+0000 7fd9369ee640 1 -- 172.21.15.44:0/3263898820 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9300bb890 con 0x7fd93014fad0 2024-05-16T22:35:38.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.376+0000 7fd9369ee640 1 --2- 172.21.15.44:0/3263898820 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd93014fad0 0x7fd93014fee0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd93006d7a0 tx=0x7fd92002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bb253d88274c69d server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:38.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.376+0000 7fd9351eb640 1 -- 172.21.15.44:0/3263898820 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd920036070 con 0x7fd93014fad0 2024-05-16T22:35:38.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.376+0000 7fd9351eb640 1 -- 172.21.15.44:0/3263898820 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd920031600 con 0x7fd93014fad0 2024-05-16T22:35:38.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.376+0000 7fd9351eb640 1 -- 172.21.15.44:0/3263898820 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9200319d0 con 0x7fd93014fad0 2024-05-16T22:35:38.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.377+0000 7fd938451640 1 -- 172.21.15.44:0/3263898820 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd93014fad0 msgr2=0x7fd93014fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:38.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.377+0000 7fd938451640 1 --2- 172.21.15.44:0/3263898820 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd93014fad0 0x7fd93014fee0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd93006d7a0 tx=0x7fd92002a6a0 comp rx=0 tx=0).stop 2024-05-16T22:35:38.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.377+0000 7fd938451640 1 -- 172.21.15.44:0/3263898820 shutdown_connections 2024-05-16T22:35:38.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.377+0000 7fd938451640 1 --2- 172.21.15.44:0/3263898820 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd93014fad0 0x7fd93014fee0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:38.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.377+0000 7fd938451640 1 --2- 172.21.15.44:0/3263898820 >> v2:172.21.15.70:3300/0 conn(0x7fd930074b00 0x7fd93006c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:38.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.377+0000 7fd938451640 1 -- 172.21.15.44:0/3263898820 >> 172.21.15.44:0/3263898820 conn(0x7fd9300bd0f0 msgr2=0x7fd9300bd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:35:38.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.377+0000 7fd938451640 1 -- 172.21.15.44:0/3263898820 shutdown_connections 2024-05-16T22:35:38.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.377+0000 7fd938451640 1 -- 172.21.15.44:0/3263898820 wait complete. 2024-05-16T22:35:38.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.378+0000 7fd938451640 1 Processor -- start 2024-05-16T22:35:38.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.378+0000 7fd938451640 1 -- start start 2024-05-16T22:35:38.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.379+0000 7fd938451640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd930074b00 0x7fd93014efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:38.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.379+0000 7fd938451640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd9300be3f0 0x7fd9301e5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:38.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.379+0000 7fd938451640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd93014fad0 0x7fd9301d5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:38.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.379+0000 7fd938451640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd9300bc0f0 con 0x7fd93014fad0 2024-05-16T22:35:38.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.379+0000 7fd938451640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd9300bbe10 con 0x7fd930074b00 2024-05-16T22:35:38.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.379+0000 7fd938451640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fd930150420 con 0x7fd9300be3f0 2024-05-16T22:35:38.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.380+0000 7fd9369ee640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd93014fad0 0x7fd9301d5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:38.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.380+0000 7fd9369ee640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd93014fad0 0x7fd9301d5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59812/0 (socket says 172.21.15.44:59812) 2024-05-16T22:35:38.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.380+0000 7fd9369ee640 1 -- 172.21.15.44:0/4170489564 learned_addr learned my addr 172.21.15.44:0/4170489564 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:35:38.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.380+0000 7fd9361ed640 1 --2- 172.21.15.44:0/4170489564 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd930074b00 0x7fd93014efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:38.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.380+0000 7fd9359ec640 1 --2- 172.21.15.44:0/4170489564 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd9300be3f0 0x7fd9301e5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:38.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.380+0000 7fd9369ee640 1 -- 172.21.15.44:0/4170489564 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd9300be3f0 msgr2=0x7fd9301e5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:38.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.380+0000 7fd9369ee640 1 --2- 172.21.15.44:0/4170489564 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd9300be3f0 0x7fd9301e5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:39.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.380+0000 7fd9369ee640 1 -- 172.21.15.44:0/4170489564 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd930074b00 msgr2=0x7fd93014efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:39.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.380+0000 7fd9369ee640 1 --2- 172.21.15.44:0/4170489564 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd930074b00 0x7fd93014efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:39.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.380+0000 7fd9369ee640 1 -- 172.21.15.44:0/4170489564 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd93014f520 con 0x7fd93014fad0 2024-05-16T22:35:39.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.380+0000 7fd9369ee640 1 --2- 172.21.15.44:0/4170489564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd93014fad0 0x7fd9301d5ef0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd920034040 tx=0x7fd920004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:39.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.380+0000 7fd92effd640 1 -- 172.21.15.44:0/4170489564 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd920036050 con 0x7fd93014fad0 2024-05-16T22:35:39.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.380+0000 7fd92effd640 1 -- 172.21.15.44:0/4170489564 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd920042070 con 0x7fd93014fad0 2024-05-16T22:35:39.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.380+0000 7fd938451640 1 -- 172.21.15.44:0/4170489564 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9301e62c0 con 0x7fd93014fad0 2024-05-16T22:35:39.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.380+0000 7fd92effd640 1 -- 172.21.15.44:0/4170489564 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd920009510 con 0x7fd93014fad0 2024-05-16T22:35:39.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.380+0000 7fd938451640 1 -- 172.21.15.44:0/4170489564 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9301d6430 con 0x7fd93014fad0 2024-05-16T22:35:39.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.382+0000 7fd938451640 1 -- 172.21.15.44:0/4170489564 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd930050940 con 0x7fd93014fad0 2024-05-16T22:35:39.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.382+0000 7fd92effd640 1 -- 172.21.15.44:0/4170489564 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd920007bf0 con 0x7fd93014fad0 2024-05-16T22:35:39.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.383+0000 7fd92effd640 1 --2- 172.21.15.44:0/4170489564 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd91c0762d0 0x7fd91c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:39.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.383+0000 7fd92effd640 1 -- 172.21.15.44:0/4170489564 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5853+0+0 (secure 0 0 0) 0x7fd9200b84e0 con 0x7fd93014fad0 2024-05-16T22:35:39.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.383+0000 7fd9361ed640 1 --2- 172.21.15.44:0/4170489564 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd91c0762d0 0x7fd91c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:39.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.384+0000 7fd9361ed640 1 --2- 172.21.15.44:0/4170489564 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd91c0762d0 0x7fd91c0787e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd928009a30 tx=0x7fd928008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:39.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.388+0000 7fd92effd640 1 -- 172.21.15.44:0/4170489564 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd920081db0 con 0x7fd93014fad0 2024-05-16T22:35:39.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.617+0000 7fd938451640 1 -- 172.21.15.44:0/4170489564 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd9300742e0 con 0x7fd93014fad0 2024-05-16T22:35:39.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.618+0000 7fd92effd640 1 -- 172.21.15.44:0/4170489564 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+4352 (secure 0 0 0) 0x7fd9200816b0 con 0x7fd93014fad0 2024-05-16T22:35:39.716 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:35:39.749 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":33,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4954,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2432336323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2432336323},{"type":"v1","addr":"172.21.15.70:6835","nonce":2432336323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4972,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/454770375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":454770375},{"type":"v1","addr":"172.21.15.44:6835","nonce":454770375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T22:33:10.855194+0000","modified":"2024-05-16T22:35:16.110684+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":51,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":16,"addr":"172.21.15.44:6834/153528185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":153528185},{"type":"v1","addr":"172.21.15.44:6834","nonce":153528185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5211,"qdb_cluster":[5211]},"id":3}]} 2024-05-16T22:35:39.784 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 33 2024-05-16T22:35:39.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.620+0000 7fd938451640 1 -- 172.21.15.44:0/4170489564 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd91c0762d0 msgr2=0x7fd91c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:39.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.620+0000 7fd938451640 1 --2- 172.21.15.44:0/4170489564 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd91c0762d0 0x7fd91c0787e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd928009a30 tx=0x7fd928008040 comp rx=0 tx=0).stop 2024-05-16T22:35:39.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.620+0000 7fd938451640 1 -- 172.21.15.44:0/4170489564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd93014fad0 msgr2=0x7fd9301d5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:39.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.620+0000 7fd938451640 1 --2- 172.21.15.44:0/4170489564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd93014fad0 0x7fd9301d5ef0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd920034040 tx=0x7fd920004a40 comp rx=0 tx=0).stop 2024-05-16T22:35:39.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.620+0000 7fd938451640 1 -- 172.21.15.44:0/4170489564 shutdown_connections 2024-05-16T22:35:40.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.620+0000 7fd938451640 1 --2- 172.21.15.44:0/4170489564 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd91c0762d0 0x7fd91c0787e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:40.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.620+0000 7fd938451640 1 --2- 172.21.15.44:0/4170489564 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd9300be3f0 0x7fd9301e5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:40.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.620+0000 7fd938451640 1 --2- 172.21.15.44:0/4170489564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd93014fad0 0x7fd9301d5ef0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:40.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.620+0000 7fd938451640 1 --2- 172.21.15.44:0/4170489564 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd930074b00 0x7fd93014efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:40.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.620+0000 7fd938451640 1 -- 172.21.15.44:0/4170489564 >> 172.21.15.44:0/4170489564 conn(0x7fd9300bd0f0 msgr2=0x7fd930149d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:35:40.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.620+0000 7fd938451640 1 -- 172.21.15.44:0/4170489564 shutdown_connections 2024-05-16T22:35:40.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:37.620+0000 7fd938451640 1 -- 172.21.15.44:0/4170489564 wait complete. 2024-05-16T22:35:40.275 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-16T22:35:40.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.434+0000 7fa1b224c640 1 Processor -- start 2024-05-16T22:35:40.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.434+0000 7fa1b224c640 1 -- start start 2024-05-16T22:35:40.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.435+0000 7fa1b224c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa1ac14e360 0x7fa1ac1522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:40.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.435+0000 7fa1b224c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa1ac148770 0x7fa1ac0c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:40.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.435+0000 7fa1b224c640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1ac0c0620 con 0x7fa1ac0bf9b0 2024-05-16T22:35:40.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.435+0000 7fa1b224c640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fa1ac151e40 con 0x7fa1ac14e360 2024-05-16T22:35:40.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.436+0000 7fa1b224c640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fa1ac151ad0 con 0x7fa1ac148770 2024-05-16T22:35:40.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.436+0000 7fa1ab7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa1ac14e360 0x7fa1ac1522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:40.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.436+0000 7fa1ab7fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa1ac14e360 0x7fa1ac1522d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33116/0 (socket says 172.21.15.44:33116) 2024-05-16T22:35:40.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.436+0000 7fa1ab7fe640 1 -- 172.21.15.44:0/708046931 learned_addr learned my addr 172.21.15.44:0/708046931 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:35:40.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.436+0000 7fa1aaffd640 1 --2- 172.21.15.44:0/708046931 >> v2:172.21.15.70:3300/0 conn(0x7fa1ac148770 0x7fa1ac0c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:40.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.436+0000 7fa1ab7fe640 1 -- 172.21.15.44:0/708046931 >> v2:172.21.15.70:3300/0 conn(0x7fa1ac148770 msgr2=0x7fa1ac0c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:35:40.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.436+0000 7fa1ab7fe640 1 --2- 172.21.15.44:0/708046931 >> v2:172.21.15.70:3300/0 conn(0x7fa1ac148770 0x7fa1ac0c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:40.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.436+0000 7fa1ab7fe640 1 -- 172.21.15.44:0/708046931 >> v1:172.21.15.70:6789/0 conn(0x7fa1ac0bf9b0 legacy=0x7fa1ac0bfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:40.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.436+0000 7fa1ab7fe640 1 -- 172.21.15.44:0/708046931 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1ac152810 con 0x7fa1ac14e360 2024-05-16T22:35:41.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.436+0000 7fa1aaffd640 1 --2- 172.21.15.44:0/708046931 >> v2:172.21.15.70:3300/0 conn(0x7fa1ac148770 0x7fa1ac0c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:35:41.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.437+0000 7fa1ab7fe640 1 --2- 172.21.15.44:0/708046931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1ac14e360 0x7fa1ac1522d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa194009870 tx=0x7fa19402a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74f85ec7684d3c65 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:41.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.437+0000 7fa1aa7fc640 1 -- 172.21.15.44:0/708046931 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa194037070 con 0x7fa1ac14e360 2024-05-16T22:35:41.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.437+0000 7fa1aa7fc640 1 -- 172.21.15.44:0/708046931 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa194032640 con 0x7fa1ac14e360 2024-05-16T22:35:41.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.437+0000 7fa1aa7fc640 1 -- 172.21.15.44:0/708046931 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa194032a10 con 0x7fa1ac14e360 2024-05-16T22:35:41.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.438+0000 7fa1b224c640 1 -- 172.21.15.44:0/708046931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1ac14e360 msgr2=0x7fa1ac1522d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:41.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.438+0000 7fa1b224c640 1 --2- 172.21.15.44:0/708046931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1ac14e360 0x7fa1ac1522d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa194009870 tx=0x7fa19402a330 comp rx=0 tx=0).stop 2024-05-16T22:35:41.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.438+0000 7fa1b224c640 1 -- 172.21.15.44:0/708046931 shutdown_connections 2024-05-16T22:35:41.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.438+0000 7fa1b224c640 1 --2- 172.21.15.44:0/708046931 >> v2:172.21.15.70:3300/0 conn(0x7fa1ac148770 0x7fa1ac0c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:41.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.438+0000 7fa1b224c640 1 --2- 172.21.15.44:0/708046931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1ac14e360 0x7fa1ac1522d0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:41.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.438+0000 7fa1b224c640 1 -- 172.21.15.44:0/708046931 >> 172.21.15.44:0/708046931 conn(0x7fa1ac0c17c0 msgr2=0x7fa1ac0c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:35:41.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.438+0000 7fa1b224c640 1 -- 172.21.15.44:0/708046931 shutdown_connections 2024-05-16T22:35:41.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.438+0000 7fa1b224c640 1 -- 172.21.15.44:0/708046931 wait complete. 2024-05-16T22:35:41.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.439+0000 7fa1b224c640 1 Processor -- start 2024-05-16T22:35:41.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.440+0000 7fa1b224c640 1 -- start start 2024-05-16T22:35:41.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.440+0000 7fa1b224c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa1ac0bf9b0 0x7fa1ac0b6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:41.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.441+0000 7fa1b224c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1ac148770 0x7fa1ac13b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:41.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.441+0000 7fa1b224c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1ac14e360 0x7fa1ac0721a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:41.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.441+0000 7fa1b224c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa1ac158cc0 con 0x7fa1ac14e360 2024-05-16T22:35:41.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.441+0000 7fa1b224c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa1ac0c13d0 con 0x7fa1ac148770 2024-05-16T22:35:41.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.441+0000 7fa1b224c640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fa1ac158e40 con 0x7fa1ac0bf9b0 2024-05-16T22:35:41.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.441+0000 7fa1abfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1ac14e360 0x7fa1ac0721a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:41.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.441+0000 7fa1ab7fe640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa1ac0bf9b0 0x7fa1ac0b6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:42.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.441+0000 7fa1abfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1ac14e360 0x7fa1ac0721a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33118/0 (socket says 172.21.15.44:33118) 2024-05-16T22:35:42.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.441+0000 7fa1aaffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1ac148770 0x7fa1ac13b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:42.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.441+0000 7fa1abfff640 1 -- 172.21.15.44:0/4115113010 learned_addr learned my addr 172.21.15.44:0/4115113010 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:35:42.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.441+0000 7fa1abfff640 1 -- 172.21.15.44:0/4115113010 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa1ac0bf9b0 msgr2=0x7fa1ac0b6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:42.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.441+0000 7fa1abfff640 1 --2- 172.21.15.44:0/4115113010 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa1ac0bf9b0 0x7fa1ac0b6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:42.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.441+0000 7fa1abfff640 1 -- 172.21.15.44:0/4115113010 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1ac148770 msgr2=0x7fa1ac13b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:42.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.441+0000 7fa1abfff640 1 --2- 172.21.15.44:0/4115113010 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1ac148770 0x7fa1ac13b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:42.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.441+0000 7fa1abfff640 1 -- 172.21.15.44:0/4115113010 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1ac1e7b20 con 0x7fa1ac14e360 2024-05-16T22:35:42.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.441+0000 7fa1abfff640 1 --2- 172.21.15.44:0/4115113010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1ac14e360 0x7fa1ac0721a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa1a400c700 tx=0x7fa1a400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:42.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.441+0000 7fa1a3fff640 1 -- 172.21.15.44:0/4115113010 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a4003b70 con 0x7fa1ac14e360 2024-05-16T22:35:42.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.441+0000 7fa1a3fff640 1 -- 172.21.15.44:0/4115113010 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1a4003d10 con 0x7fa1ac14e360 2024-05-16T22:35:42.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.441+0000 7fa1b224c640 1 -- 172.21.15.44:0/4115113010 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1ac1e7e00 con 0x7fa1ac14e360 2024-05-16T22:35:42.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.442+0000 7fa1a3fff640 1 -- 172.21.15.44:0/4115113010 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a400aa50 con 0x7fa1ac14e360 2024-05-16T22:35:42.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.442+0000 7fa1b224c640 1 -- 172.21.15.44:0/4115113010 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1ac0b7080 con 0x7fa1ac14e360 2024-05-16T22:35:42.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.442+0000 7fa1b224c640 1 -- 172.21.15.44:0/4115113010 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1ac0b72e0 con 0x7fa1ac14e360 2024-05-16T22:35:42.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.443+0000 7fa1a3fff640 1 -- 172.21.15.44:0/4115113010 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa1a400abf0 con 0x7fa1ac14e360 2024-05-16T22:35:42.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.444+0000 7fa1a3fff640 1 --2- 172.21.15.44:0/4115113010 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fa18c076300 0x7fa18c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:42.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.444+0000 7fa1a3fff640 1 -- 172.21.15.44:0/4115113010 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5853+0+0 (secure 0 0 0) 0x7fa1a40973b0 con 0x7fa1ac14e360 2024-05-16T22:35:42.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.444+0000 7fa1ab7fe640 1 --2- 172.21.15.44:0/4115113010 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fa18c076300 0x7fa18c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:42.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.445+0000 7fa1ab7fe640 1 --2- 172.21.15.44:0/4115113010 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fa18c076300 0x7fa18c078810 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa194034000 tx=0x7fa19402e000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:42.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.449+0000 7fa1a3fff640 1 -- 172.21.15.44:0/4115113010 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa1a4060630 con 0x7fa1ac14e360 2024-05-16T22:35:42.768 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:35:42.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.645+0000 7fa1b224c640 1 -- 172.21.15.44:0/4115113010 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa1ac050940 con 0x7fa1ac14e360 2024-05-16T22:35:42.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.646+0000 7fa1a3fff640 1 -- 172.21.15.44:0/4115113010 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+16853 (secure 0 0 0) 0x7fa1a4064930 con 0x7fa1ac14e360 2024-05-16T22:35:42.868 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:35:42.926 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":51,"fsid":"572ab7cc-b103-4548-ae8f-c6614d57f0c8","created":"2024-05-16T22:27:02.216874+0000","modified":"2024-05-16T22:34:22.451797+0000","last_up_change":"2024-05-16T22:27:13.693953+0000","last_in_change":"2024-05-16T22:27:04.455119+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-16T22:27:14.562409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-05-16T22:33:02.085011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-05-16T22:33:06.543396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a7003e89-c706-4562-9f25-670bb35ae108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6825","nonce":1074109859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6827","nonce":1074109859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6831","nonce":1074109859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6829","nonce":1074109859}]},"public_addr":"172.21.15.44:6825/1074109859","cluster_addr":"172.21.15.44:6827/1074109859","heartbeat_back_addr":"172.21.15.44:6831/1074109859","heartbeat_front_addr":"172.21.15.44:6829/1074109859","state":["exists","up"]},{"osd":1,"uuid":"a4d5169d-8327-4494-9c7c-58db21b00636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6817","nonce":2909429972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6819","nonce":2909429972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6823","nonce":2909429972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6821","nonce":2909429972}]},"public_addr":"172.21.15.44:6817/2909429972","cluster_addr":"172.21.15.44:6819/2909429972","heartbeat_back_addr":"172.21.15.44:6823/2909429972","heartbeat_front_addr":"172.21.15.44:6821/2909429972","state":["exists","up"]},{"osd":2,"uuid":"d4a834f8-83a5-400f-9814-eb0a25124df4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6801","nonce":2908194156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6803","nonce":2908194156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6807","nonce":2908194156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6805","nonce":2908194156}]},"public_addr":"172.21.15.44:6801/2908194156","cluster_addr":"172.21.15.44:6803/2908194156","heartbeat_back_addr":"172.21.15.44:6807/2908194156","heartbeat_front_addr":"172.21.15.44:6805/2908194156","state":["exists","up"]},{"osd":3,"uuid":"b9d24a56-ad43-4674-a395-5ec24d135ae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6809","nonce":2168695793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6811","nonce":2168695793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6815","nonce":2168695793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6813","nonce":2168695793}]},"public_addr":"172.21.15.44:6809/2168695793","cluster_addr":"172.21.15.44:6811/2168695793","heartbeat_back_addr":"172.21.15.44:6815/2168695793","heartbeat_front_addr":"172.21.15.44:6813/2168695793","state":["exists","up"]},{"osd":4,"uuid":"9bd94af5-3e17-4cbe-995a-8f837a66c653","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6823","nonce":1540297751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6825","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6827","nonce":1540297751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6831","nonce":1540297751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6829","nonce":1540297751}]},"public_addr":"172.21.15.70:6823/1540297751","cluster_addr":"172.21.15.70:6827/1540297751","heartbeat_back_addr":"172.21.15.70:6831/1540297751","heartbeat_front_addr":"172.21.15.70:6829/1540297751","state":["exists","up"]},{"osd":5,"uuid":"a5b0cfa5-b259-48bd-98b6-96b44f5ebabd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6804","nonce":4218901987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6808","nonce":4218901987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6815","nonce":4218901987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6812","nonce":4218901987}]},"public_addr":"172.21.15.70:6804/4218901987","cluster_addr":"172.21.15.70:6808/4218901987","heartbeat_back_addr":"172.21.15.70:6815/4218901987","heartbeat_front_addr":"172.21.15.70:6812/4218901987","state":["exists","up"]},{"osd":6,"uuid":"0b6af6df-1358-4fc6-a62c-ba57e02914ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6801","nonce":2389556489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6805","nonce":2389556489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6813","nonce":2389556489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6807","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6809","nonce":2389556489}]},"public_addr":"172.21.15.70:6801/2389556489","cluster_addr":"172.21.15.70:6805/2389556489","heartbeat_back_addr":"172.21.15.70:6813/2389556489","heartbeat_front_addr":"172.21.15.70:6809/2389556489","state":["exists","up"]},{"osd":7,"uuid":"eb1a2c5d-42cf-47d0-9e03-b9d26944a589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6817","nonce":3619691281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6819","nonce":3619691281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6826","nonce":3619691281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6822","nonce":3619691281}]},"public_addr":"172.21.15.70:6817/3619691281","cluster_addr":"172.21.15.70:6819/3619691281","heartbeat_back_addr":"172.21.15.70:6826/3619691281","heartbeat_front_addr":"172.21.15.70:6822/3619691281","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.652256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.613348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.528454+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.625204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.678845+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.680829+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.556200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.647030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.4","mappings":[{"from":0,"to":5}]},{"pgid":"7.2e","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6834/97015923":"2024-05-17T22:34:22.451767+0000","172.21.15.44:6832/97015923":"2024-05-17T22:34:22.451767+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T22:35:42.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.649+0000 7fa1b224c640 1 -- 172.21.15.44:0/4115113010 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fa18c076300 msgr2=0x7fa18c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:42.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.649+0000 7fa1b224c640 1 --2- 172.21.15.44:0/4115113010 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fa18c076300 0x7fa18c078810 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa194034000 tx=0x7fa19402e000 comp rx=0 tx=0).stop 2024-05-16T22:35:43.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.649+0000 7fa1b224c640 1 -- 172.21.15.44:0/4115113010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1ac14e360 msgr2=0x7fa1ac0721a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:43.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.649+0000 7fa1b224c640 1 --2- 172.21.15.44:0/4115113010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1ac14e360 0x7fa1ac0721a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa1a400c700 tx=0x7fa1a400cbc0 comp rx=0 tx=0).stop 2024-05-16T22:35:43.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.649+0000 7fa1b224c640 1 -- 172.21.15.44:0/4115113010 shutdown_connections 2024-05-16T22:35:43.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.649+0000 7fa1b224c640 1 --2- 172.21.15.44:0/4115113010 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fa18c076300 0x7fa18c078810 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:43.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.649+0000 7fa1b224c640 1 --2- 172.21.15.44:0/4115113010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1ac14e360 0x7fa1ac0721a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:43.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.649+0000 7fa1b224c640 1 --2- 172.21.15.44:0/4115113010 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1ac148770 0x7fa1ac13b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:43.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.649+0000 7fa1b224c640 1 --2- 172.21.15.44:0/4115113010 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa1ac0bf9b0 0x7fa1ac0b6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:43.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.649+0000 7fa1b224c640 1 -- 172.21.15.44:0/4115113010 >> 172.21.15.44:0/4115113010 conn(0x7fa1ac0c17c0 msgr2=0x7fa1ac0be6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:35:43.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.649+0000 7fa1b224c640 1 -- 172.21.15.44:0/4115113010 shutdown_connections 2024-05-16T22:35:43.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:40.649+0000 7fa1b224c640 1 -- 172.21.15.44:0/4115113010 wait complete. 2024-05-16T22:35:43.387 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-16T22:35:43.418 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T22:35:43.453 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:35:43.530 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:35:43.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.693+0000 7f60775b2640 1 Processor -- start 2024-05-16T22:35:43.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.693+0000 7f60775b2640 1 -- start start 2024-05-16T22:35:43.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.694+0000 7f60775b2640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f60700bd6d0 0x7f60700be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:43.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.694+0000 7f60775b2640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f607006e140 con 0x7f60700bee80 2024-05-16T22:35:43.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.694+0000 7f60775b2640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60700c36f0 con 0x7f6070151fc0 2024-05-16T22:35:43.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.694+0000 7f60775b2640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f6070152530 con 0x7f60700bd6d0 2024-05-16T22:35:43.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.694+0000 7f6075b4f640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f60700bee80 0x7f6070158e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:45432/0 (socket says 172.21.15.44:45432) 2024-05-16T22:35:43.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.694+0000 7f6075b4f640 1 -- 172.21.15.44:0/80980098 learned_addr learned my addr 172.21.15.44:0/80980098 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:35:44.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.694+0000 7f6074b4d640 1 --2- 172.21.15.44:0/80980098 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f60700bd6d0 0x7f60700be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:44.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.695+0000 7f6067fff640 1 -- 172.21.15.44:0/80980098 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3545878423 0 0) 0x7f6068001490 con 0x7f60700bee80 2024-05-16T22:35:44.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.695+0000 7f6067fff640 1 -- 172.21.15.44:0/80980098 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f605c003520 con 0x7f60700bee80 2024-05-16T22:35:44.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.695+0000 7f6067fff640 1 -- 172.21.15.44:0/80980098 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 312877264 0 0) 0x7f60700c36f0 con 0x7f6070151fc0 2024-05-16T22:35:44.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.695+0000 7f6067fff640 1 -- 172.21.15.44:0/80980098 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6068001490 con 0x7f6070151fc0 2024-05-16T22:35:44.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.695+0000 7f6074b4d640 1 -- 172.21.15.44:0/80980098 >> v1:172.21.15.70:6789/0 conn(0x7f6070151fc0 legacy=0x7f607006da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:44.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.695+0000 7f6074b4d640 1 -- 172.21.15.44:0/80980098 >> v1:172.21.15.44:6789/0 conn(0x7f60700bee80 legacy=0x7f6070158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:44.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.695+0000 7f6074b4d640 1 -- 172.21.15.44:0/80980098 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6070152810 con 0x7f60700bd6d0 2024-05-16T22:35:44.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.696+0000 7f6074b4d640 1 --2- 172.21.15.44:0/80980098 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f60700bd6d0 0x7f60700be940 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f60600097d0 tx=0x7f606002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=197d7a9313ff034a server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:44.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.696+0000 7f6067fff640 1 -- 172.21.15.44:0/80980098 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6060037070 con 0x7f60700bd6d0 2024-05-16T22:35:44.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.696+0000 7f6067fff640 1 -- 172.21.15.44:0/80980098 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6060032440 con 0x7f60700bd6d0 2024-05-16T22:35:44.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.696+0000 7f6067fff640 1 -- 172.21.15.44:0/80980098 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6060032810 con 0x7f60700bd6d0 2024-05-16T22:35:44.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.696+0000 7f60775b2640 1 -- 172.21.15.44:0/80980098 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f60700bd6d0 msgr2=0x7f60700be940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:44.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.696+0000 7f60775b2640 1 --2- 172.21.15.44:0/80980098 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f60700bd6d0 0x7f60700be940 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f60600097d0 tx=0x7f606002a210 comp rx=0 tx=0).stop 2024-05-16T22:35:44.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.697+0000 7f60775b2640 1 -- 172.21.15.44:0/80980098 shutdown_connections 2024-05-16T22:35:44.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.697+0000 7f60775b2640 1 --2- 172.21.15.44:0/80980098 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f60700bd6d0 0x7f60700be940 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:44.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.697+0000 7f60775b2640 1 -- 172.21.15.44:0/80980098 >> 172.21.15.44:0/80980098 conn(0x7f60700c3d20 msgr2=0x7f60700c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:35:44.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.697+0000 7f60775b2640 1 -- 172.21.15.44:0/80980098 shutdown_connections 2024-05-16T22:35:44.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.697+0000 7f60775b2640 1 -- 172.21.15.44:0/80980098 wait complete. 2024-05-16T22:35:44.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.698+0000 7f60775b2640 1 Processor -- start 2024-05-16T22:35:44.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.698+0000 7f60775b2640 1 -- start start 2024-05-16T22:35:44.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.699+0000 7f60775b2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60700bd6d0 0x7f60701e7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:44.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.699+0000 7f60775b2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60700bee80 0x7f60701d8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:44.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.699+0000 7f60775b2640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6070151fc0 0x7f60701e4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:44.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.699+0000 7f60775b2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f60700bdae0 con 0x7f60700bd6d0 2024-05-16T22:35:44.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.699+0000 7f60775b2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f60700c0070 con 0x7f60700bee80 2024-05-16T22:35:44.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.699+0000 7f60775b2640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f60700a2ed0 con 0x7f6070151fc0 2024-05-16T22:35:45.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.699+0000 7f607534e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60700bd6d0 0x7f60701e7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:45.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.699+0000 7f607534e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60700bd6d0 0x7f60701e7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33122/0 (socket says 172.21.15.44:33122) 2024-05-16T22:35:45.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.699+0000 7f607534e640 1 -- 172.21.15.44:0/2759666907 learned_addr learned my addr 172.21.15.44:0/2759666907 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:35:45.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.700+0000 7f6074b4d640 1 --2- 172.21.15.44:0/2759666907 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60700bee80 0x7f60701d8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:45.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.700+0000 7f6075b4f640 1 --2- 172.21.15.44:0/2759666907 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6070151fc0 0x7f60701e4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:45.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.700+0000 7f607534e640 1 -- 172.21.15.44:0/2759666907 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6070151fc0 msgr2=0x7f60701e4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:45.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.700+0000 7f607534e640 1 --2- 172.21.15.44:0/2759666907 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6070151fc0 0x7f60701e4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:45.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.700+0000 7f607534e640 1 -- 172.21.15.44:0/2759666907 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60700bee80 msgr2=0x7f60701d8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:45.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.700+0000 7f607534e640 1 --2- 172.21.15.44:0/2759666907 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60700bee80 0x7f60701d8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:45.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.700+0000 7f607534e640 1 -- 172.21.15.44:0/2759666907 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60701e8170 con 0x7f60700bd6d0 2024-05-16T22:35:45.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.700+0000 7f607534e640 1 --2- 172.21.15.44:0/2759666907 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60700bd6d0 0x7f60701e7c30 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f606c00c460 tx=0x7f606c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:45.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.700+0000 7f6065ffb640 1 -- 172.21.15.44:0/2759666907 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f606c0052d0 con 0x7f60700bd6d0 2024-05-16T22:35:45.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.700+0000 7f6065ffb640 1 -- 172.21.15.44:0/2759666907 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f606c005490 con 0x7f60700bd6d0 2024-05-16T22:35:45.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.700+0000 7f60775b2640 1 -- 172.21.15.44:0/2759666907 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60701da690 con 0x7f60700bd6d0 2024-05-16T22:35:45.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.700+0000 7f6065ffb640 1 -- 172.21.15.44:0/2759666907 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f606c012870 con 0x7f60700bd6d0 2024-05-16T22:35:45.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.700+0000 7f60775b2640 1 -- 172.21.15.44:0/2759666907 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60701d7b90 con 0x7f60700bd6d0 2024-05-16T22:35:45.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.701+0000 7f60775b2640 1 -- 172.21.15.44:0/2759666907 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6070050940 con 0x7f60700bd6d0 2024-05-16T22:35:45.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.702+0000 7f6065ffb640 1 -- 172.21.15.44:0/2759666907 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f606c012a10 con 0x7f60700bd6d0 2024-05-16T22:35:45.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.702+0000 7f6065ffb640 1 --2- 172.21.15.44:0/2759666907 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f60540762d0 0x7f60540787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:45.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.703+0000 7f6065ffb640 1 -- 172.21.15.44:0/2759666907 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5853+0+0 (secure 0 0 0) 0x7f606c097060 con 0x7f60700bd6d0 2024-05-16T22:35:45.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.703+0000 7f6074b4d640 1 --2- 172.21.15.44:0/2759666907 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f60540762d0 0x7f60540787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:45.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.703+0000 7f6074b4d640 1 --2- 172.21.15.44:0/2759666907 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f60540762d0 0x7f60540787e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6060034000 tx=0x7f606002e000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:45.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.707+0000 7f6065ffb640 1 -- 172.21.15.44:0/2759666907 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f606c060370 con 0x7f60700bd6d0 2024-05-16T22:35:45.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.936+0000 7f60775b2640 1 -- 172.21.15.44:0/2759666907 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f607006eb40 con 0x7f60700bd6d0 2024-05-16T22:35:45.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.937+0000 7f6065ffb640 1 -- 172.21.15.44:0/2759666907 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+4352 (secure 0 0 0) 0x7f606c064670 con 0x7f60700bd6d0 2024-05-16T22:35:45.895 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:35:45.928 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":33,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4954,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2432336323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2432336323},{"type":"v1","addr":"172.21.15.70:6835","nonce":2432336323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4972,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/454770375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":454770375},{"type":"v1","addr":"172.21.15.44:6835","nonce":454770375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T22:33:10.855194+0000","modified":"2024-05-16T22:35:16.110684+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":51,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":16,"addr":"172.21.15.44:6834/153528185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":153528185},{"type":"v1","addr":"172.21.15.44:6834","nonce":153528185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5211,"qdb_cluster":[5211]},"id":3}]} 2024-05-16T22:35:45.963 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 33 2024-05-16T22:35:46.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.939+0000 7f60775b2640 1 -- 172.21.15.44:0/2759666907 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f60540762d0 msgr2=0x7f60540787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:46.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.939+0000 7f60775b2640 1 --2- 172.21.15.44:0/2759666907 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f60540762d0 0x7f60540787e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6060034000 tx=0x7f606002e000 comp rx=0 tx=0).stop 2024-05-16T22:35:46.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.939+0000 7f60775b2640 1 -- 172.21.15.44:0/2759666907 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60700bd6d0 msgr2=0x7f60701e7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:46.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.939+0000 7f60775b2640 1 --2- 172.21.15.44:0/2759666907 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60700bd6d0 0x7f60701e7c30 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f606c00c460 tx=0x7f606c00c920 comp rx=0 tx=0).stop 2024-05-16T22:35:46.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.939+0000 7f60775b2640 1 -- 172.21.15.44:0/2759666907 shutdown_connections 2024-05-16T22:35:46.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.939+0000 7f60775b2640 1 --2- 172.21.15.44:0/2759666907 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f60540762d0 0x7f60540787e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:46.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.939+0000 7f60775b2640 1 --2- 172.21.15.44:0/2759666907 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6070151fc0 0x7f60701e4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:46.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.939+0000 7f60775b2640 1 --2- 172.21.15.44:0/2759666907 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60700bee80 0x7f60701d8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:46.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.939+0000 7f60775b2640 1 --2- 172.21.15.44:0/2759666907 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60700bd6d0 0x7f60701e7c30 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:46.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.939+0000 7f60775b2640 1 -- 172.21.15.44:0/2759666907 >> 172.21.15.44:0/2759666907 conn(0x7f60700c3d20 msgr2=0x7f60700a4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:35:46.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.939+0000 7f60775b2640 1 -- 172.21.15.44:0/2759666907 shutdown_connections 2024-05-16T22:35:46.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:43.939+0000 7f60775b2640 1 -- 172.21.15.44:0/2759666907 wait complete. 2024-05-16T22:35:46.454 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T22:35:46.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.613+0000 7fdb574f2640 1 Processor -- start 2024-05-16T22:35:46.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.614+0000 7fdb574f2640 1 -- start start 2024-05-16T22:35:46.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.615+0000 7fdb574f2640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdb500bd440 0x7fdb500bd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:46.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.615+0000 7fdb574f2640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb500bdd90 con 0x7fdb500b8d70 2024-05-16T22:35:46.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.615+0000 7fdb574f2640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb5014ece0 con 0x7fdb5014e530 2024-05-16T22:35:46.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.615+0000 7fdb574f2640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fdb500b88e0 con 0x7fdb500bd440 2024-05-16T22:35:46.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.615+0000 7fdb55a8f640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fdb500b8d70 0x7fdb500b9180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:45434/0 (socket says 172.21.15.44:45434) 2024-05-16T22:35:46.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.615+0000 7fdb55a8f640 1 -- 172.21.15.44:0/130515637 learned_addr learned my addr 172.21.15.44:0/130515637 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:35:46.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.615+0000 7fdb54a8d640 1 --2- 172.21.15.44:0/130515637 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdb500bd440 0x7fdb500bd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:46.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.615+0000 7fdb4ffff640 1 -- 172.21.15.44:0/130515637 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2838789821 0 0) 0x7fdb500bdd90 con 0x7fdb500b8d70 2024-05-16T22:35:47.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.615+0000 7fdb4ffff640 1 -- 172.21.15.44:0/130515637 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb38003520 con 0x7fdb500b8d70 2024-05-16T22:35:47.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.616+0000 7fdb4ffff640 1 -- 172.21.15.44:0/130515637 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2958229356 0 0) 0x7fdb5014ece0 con 0x7fdb5014e530 2024-05-16T22:35:47.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.616+0000 7fdb4ffff640 1 -- 172.21.15.44:0/130515637 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb500bdd90 con 0x7fdb5014e530 2024-05-16T22:35:47.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.616+0000 7fdb4ffff640 1 -- 172.21.15.44:0/130515637 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3529878889 0 0) 0x7fdb38003520 con 0x7fdb500b8d70 2024-05-16T22:35:47.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.616+0000 7fdb4ffff640 1 -- 172.21.15.44:0/130515637 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdb500bd440 msgr2=0x7fdb500bd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:35:47.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.616+0000 7fdb4ffff640 1 --2- 172.21.15.44:0/130515637 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdb500bd440 0x7fdb500bd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:47.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.616+0000 7fdb4ffff640 1 -- 172.21.15.44:0/130515637 >> v1:172.21.15.70:6789/0 conn(0x7fdb5014e530 legacy=0x7fdb500ba320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:47.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.616+0000 7fdb4ffff640 1 -- 172.21.15.44:0/130515637 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb5014efc0 con 0x7fdb500b8d70 2024-05-16T22:35:47.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.616+0000 7fdb4ffff640 1 -- 172.21.15.44:0/130515637 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 568431863 0 0) 0x7fdb40001a70 con 0x7fdb500b8d70 2024-05-16T22:35:47.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.616+0000 7fdb4ffff640 1 -- 172.21.15.44:0/130515637 >> v1:172.21.15.44:6789/0 conn(0x7fdb500b8d70 legacy=0x7fdb500b9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:47.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.616+0000 7fdb4ffff640 1 --2- 172.21.15.44:0/130515637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb38003c10 0x7fdb38004060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:47.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.616+0000 7fdb4ffff640 1 --2- 172.21.15.44:0/130515637 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb38004800 0x7fdb38004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:47.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.616+0000 7fdb4ffff640 1 --2- 172.21.15.44:0/130515637 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdb38005260 0x7fdb3800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:47.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.616+0000 7fdb4ffff640 1 -- 172.21.15.44:0/130515637 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdb500b88e0 con 0x7fdb38003c10 2024-05-16T22:35:47.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.616+0000 7fdb4ffff640 1 -- 172.21.15.44:0/130515637 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdb3800c170 con 0x7fdb38004800 2024-05-16T22:35:47.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.616+0000 7fdb4ffff640 1 -- 172.21.15.44:0/130515637 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fdb3800c370 con 0x7fdb38005260 2024-05-16T22:35:47.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.616+0000 7fdb54a8d640 1 --2- 172.21.15.44:0/130515637 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdb500bd440 0x7fdb500bd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:35:47.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.616+0000 7fdb5528e640 1 --2- 172.21.15.44:0/130515637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb38003c10 0x7fdb38004060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:47.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.616+0000 7fdb55a8f640 1 --2- 172.21.15.44:0/130515637 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdb38005260 0x7fdb3800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:47.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.616+0000 7fdb54a8d640 1 --2- 172.21.15.44:0/130515637 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb38004800 0x7fdb38004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:47.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.616+0000 7fdb5528e640 1 -- 172.21.15.44:0/130515637 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdb38005260 msgr2=0x7fdb3800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:35:47.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.616+0000 7fdb5528e640 1 --2- 172.21.15.44:0/130515637 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdb38005260 0x7fdb3800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:47.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.616+0000 7fdb5528e640 1 -- 172.21.15.44:0/130515637 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb38004800 msgr2=0x7fdb38004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:35:47.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.616+0000 7fdb5528e640 1 --2- 172.21.15.44:0/130515637 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb38004800 0x7fdb38004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:47.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.616+0000 7fdb5528e640 1 -- 172.21.15.44:0/130515637 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb38003520 con 0x7fdb38003c10 2024-05-16T22:35:47.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.617+0000 7fdb5528e640 1 --2- 172.21.15.44:0/130515637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb38003c10 0x7fdb38004060 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fdb48001920 tx=0x7fdb38005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea5beb5548024819 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:47.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.617+0000 7fdb4ffff640 1 -- 172.21.15.44:0/130515637 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb48001570 con 0x7fdb38003c10 2024-05-16T22:35:47.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.617+0000 7fdb4ffff640 1 -- 172.21.15.44:0/130515637 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb480052d0 con 0x7fdb38003c10 2024-05-16T22:35:48.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.617+0000 7fdb4ffff640 1 -- 172.21.15.44:0/130515637 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb4802abf0 con 0x7fdb38003c10 2024-05-16T22:35:48.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.618+0000 7fdb574f2640 1 -- 172.21.15.44:0/130515637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb38003c10 msgr2=0x7fdb38004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:48.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.618+0000 7fdb574f2640 1 --2- 172.21.15.44:0/130515637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb38003c10 0x7fdb38004060 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fdb48001920 tx=0x7fdb38005830 comp rx=0 tx=0).stop 2024-05-16T22:35:48.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.618+0000 7fdb55a8f640 1 -- 172.21.15.44:0/130515637 reap_dead start 2024-05-16T22:35:48.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.618+0000 7fdb574f2640 1 -- 172.21.15.44:0/130515637 shutdown_connections 2024-05-16T22:35:48.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.618+0000 7fdb574f2640 1 -- 172.21.15.44:0/130515637 >> 172.21.15.44:0/130515637 conn(0x7fdb500c0570 msgr2=0x7fdb500c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:35:48.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.618+0000 7fdb574f2640 1 -- 172.21.15.44:0/130515637 shutdown_connections 2024-05-16T22:35:48.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.618+0000 7fdb574f2640 1 -- 172.21.15.44:0/130515637 wait complete. 2024-05-16T22:35:48.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.620+0000 7fdb574f2640 1 Processor -- start 2024-05-16T22:35:48.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.620+0000 7fdb574f2640 1 -- start start 2024-05-16T22:35:48.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.621+0000 7fdb574f2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb38003c10 0x7fdb501e4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:48.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.621+0000 7fdb574f2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb501dac50 0x7fdb501436d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:48.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.621+0000 7fdb574f2640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdb50143c10 0x7fdb5014a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:48.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.621+0000 7fdb574f2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5014e940 con 0x7fdb38003c10 2024-05-16T22:35:48.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.621+0000 7fdb574f2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdb500bbb70 con 0x7fdb501dac50 2024-05-16T22:35:48.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.621+0000 7fdb574f2640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fdb5014eac0 con 0x7fdb50143c10 2024-05-16T22:35:48.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.621+0000 7fdb5528e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb38003c10 0x7fdb501e4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:48.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.621+0000 7fdb5528e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb38003c10 0x7fdb501e4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33136/0 (socket says 172.21.15.44:33136) 2024-05-16T22:35:48.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.621+0000 7fdb5528e640 1 -- 172.21.15.44:0/3092976792 learned_addr learned my addr 172.21.15.44:0/3092976792 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:35:48.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.621+0000 7fdb54a8d640 1 --2- 172.21.15.44:0/3092976792 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb501dac50 0x7fdb501436d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:48.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.621+0000 7fdb55a8f640 1 --2- 172.21.15.44:0/3092976792 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdb50143c10 0x7fdb5014a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:48.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.621+0000 7fdb5528e640 1 -- 172.21.15.44:0/3092976792 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdb50143c10 msgr2=0x7fdb5014a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:48.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.621+0000 7fdb5528e640 1 --2- 172.21.15.44:0/3092976792 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdb50143c10 0x7fdb5014a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:48.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.621+0000 7fdb5528e640 1 -- 172.21.15.44:0/3092976792 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb501dac50 msgr2=0x7fdb501436d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:48.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.621+0000 7fdb5528e640 1 --2- 172.21.15.44:0/3092976792 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb501dac50 0x7fdb501436d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:48.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.621+0000 7fdb5528e640 1 -- 172.21.15.44:0/3092976792 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb501db300 con 0x7fdb38003c10 2024-05-16T22:35:48.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.621+0000 7fdb5528e640 1 --2- 172.21.15.44:0/3092976792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb38003c10 0x7fdb501e4e40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fdb48005040 tx=0x7fdb48001340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:49.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.621+0000 7fdb4dffb640 1 -- 172.21.15.44:0/3092976792 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb48043070 con 0x7fdb38003c10 2024-05-16T22:35:49.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.622+0000 7fdb4dffb640 1 -- 172.21.15.44:0/3092976792 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb48001550 con 0x7fdb38003c10 2024-05-16T22:35:49.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.622+0000 7fdb4dffb640 1 -- 172.21.15.44:0/3092976792 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb48006e60 con 0x7fdb38003c10 2024-05-16T22:35:49.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.622+0000 7fdb574f2640 1 -- 172.21.15.44:0/3092976792 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb501db5e0 con 0x7fdb38003c10 2024-05-16T22:35:49.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.622+0000 7fdb574f2640 1 -- 172.21.15.44:0/3092976792 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb501e4920 con 0x7fdb38003c10 2024-05-16T22:35:49.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.623+0000 7fdb574f2640 1 -- 172.21.15.44:0/3092976792 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb50050940 con 0x7fdb38003c10 2024-05-16T22:35:49.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.624+0000 7fdb4dffb640 1 -- 172.21.15.44:0/3092976792 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdb48007240 con 0x7fdb38003c10 2024-05-16T22:35:49.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.624+0000 7fdb4dffb640 1 --2- 172.21.15.44:0/3092976792 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fdb3c076300 0x7fdb3c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:49.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.624+0000 7fdb4dffb640 1 -- 172.21.15.44:0/3092976792 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5853+0+0 (secure 0 0 0) 0x7fdb480b6ff0 con 0x7fdb38003c10 2024-05-16T22:35:49.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.624+0000 7fdb54a8d640 1 --2- 172.21.15.44:0/3092976792 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fdb3c076300 0x7fdb3c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:49.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.625+0000 7fdb54a8d640 1 --2- 172.21.15.44:0/3092976792 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fdb3c076300 0x7fdb3c078810 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdb500a9390 tx=0x7fdb44008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:49.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.629+0000 7fdb4dffb640 1 -- 172.21.15.44:0/3092976792 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fdb480807b0 con 0x7fdb38003c10 2024-05-16T22:35:49.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.860+0000 7fdb574f2640 1 -- 172.21.15.44:0/3092976792 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb5014cd70 con 0x7fdb38003c10 2024-05-16T22:35:49.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.861+0000 7fdb4dffb640 1 -- 172.21.15.44:0/3092976792 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+4352 (secure 0 0 0) 0x7fdb480800b0 con 0x7fdb38003c10 2024-05-16T22:35:49.566 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:35:49.601 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":33,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4954,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2432336323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2432336323},{"type":"v1","addr":"172.21.15.70:6835","nonce":2432336323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4972,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/454770375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":454770375},{"type":"v1","addr":"172.21.15.44:6835","nonce":454770375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-16T22:33:10.855194+0000","modified":"2024-05-16T22:35:16.110684+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":51,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":16,"addr":"172.21.15.44:6834/153528185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":153528185},{"type":"v1","addr":"172.21.15.44:6834","nonce":153528185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5211,"qdb_cluster":[5211]},"id":3}]} 2024-05-16T22:35:49.633 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 33 2024-05-16T22:35:49.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.863+0000 7fdb574f2640 1 -- 172.21.15.44:0/3092976792 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fdb3c076300 msgr2=0x7fdb3c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:49.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.863+0000 7fdb574f2640 1 --2- 172.21.15.44:0/3092976792 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fdb3c076300 0x7fdb3c078810 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdb500a9390 tx=0x7fdb44008040 comp rx=0 tx=0).stop 2024-05-16T22:35:49.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.863+0000 7fdb574f2640 1 -- 172.21.15.44:0/3092976792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb38003c10 msgr2=0x7fdb501e4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:49.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.863+0000 7fdb574f2640 1 --2- 172.21.15.44:0/3092976792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb38003c10 0x7fdb501e4e40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fdb48005040 tx=0x7fdb48001340 comp rx=0 tx=0).stop 2024-05-16T22:35:49.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.863+0000 7fdb574f2640 1 -- 172.21.15.44:0/3092976792 shutdown_connections 2024-05-16T22:35:49.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.863+0000 7fdb574f2640 1 --2- 172.21.15.44:0/3092976792 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fdb3c076300 0x7fdb3c078810 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:49.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.863+0000 7fdb574f2640 1 --2- 172.21.15.44:0/3092976792 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdb50143c10 0x7fdb5014a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:49.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.863+0000 7fdb574f2640 1 --2- 172.21.15.44:0/3092976792 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb501dac50 0x7fdb501436d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:49.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.863+0000 7fdb574f2640 1 --2- 172.21.15.44:0/3092976792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb38003c10 0x7fdb501e4e40 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:50.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.863+0000 7fdb574f2640 1 -- 172.21.15.44:0/3092976792 >> 172.21.15.44:0/3092976792 conn(0x7fdb500c0570 msgr2=0x7fdb500b9180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:35:50.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.863+0000 7fdb574f2640 1 -- 172.21.15.44:0/3092976792 shutdown_connections 2024-05-16T22:35:50.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:46.863+0000 7fdb574f2640 1 -- 172.21.15.44:0/3092976792 wait complete. 2024-05-16T22:35:50.116 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-16T22:35:50.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.278+0000 7ffab0661640 1 Processor -- start 2024-05-16T22:35:50.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.278+0000 7ffab0661640 1 -- start start 2024-05-16T22:35:50.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.280+0000 7ffab0661640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ffaa80bfe00 0x7ffaa8074340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:50.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.280+0000 7ffab0661640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ffaa814bb70 0x7ffaa8070200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:50.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.280+0000 7ffab0661640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffaa814bf80 0x7ffaa8070740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:50.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.280+0000 7ffab0661640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7ffaa806f900 con 0x7ffaa814bb70 2024-05-16T22:35:50.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.280+0000 7ffab0661640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7ffaa80bba30 con 0x7ffaa80bfe00 2024-05-16T22:35:50.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.280+0000 7ffab0661640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7ffaa80bbd10 con 0x7ffaa814bf80 2024-05-16T22:35:50.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.280+0000 7ffaadbfc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ffaa814bb70 0x7ffaa8070200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:50.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.280+0000 7ffaadbfc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ffaa814bb70 0x7ffaa8070200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54186/0 (socket says 172.21.15.44:54186) 2024-05-16T22:35:50.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.280+0000 7ffaadbfc640 1 -- 172.21.15.44:0/1315206825 learned_addr learned my addr 172.21.15.44:0/1315206825 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:35:50.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.280+0000 7ffaae3fd640 1 --2- 172.21.15.44:0/1315206825 >> v2:172.21.15.70:3300/0 conn(0x7ffaa80bfe00 0x7ffaa8074340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:50.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.280+0000 7ffaaebfe640 1 --2- 172.21.15.44:0/1315206825 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffaa814bf80 0x7ffaa8070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:50.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.280+0000 7ffaadbfc640 1 -- 172.21.15.44:0/1315206825 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffaa814bf80 msgr2=0x7ffaa8070740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:35:50.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.280+0000 7ffaadbfc640 1 --2- 172.21.15.44:0/1315206825 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffaa814bf80 0x7ffaa8070740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:50.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.280+0000 7ffaadbfc640 1 -- 172.21.15.44:0/1315206825 >> v2:172.21.15.70:3300/0 conn(0x7ffaa80bfe00 msgr2=0x7ffaa8074340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:35:50.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.280+0000 7ffaadbfc640 1 --2- 172.21.15.44:0/1315206825 >> v2:172.21.15.70:3300/0 conn(0x7ffaa80bfe00 0x7ffaa8074340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:50.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.280+0000 7ffaadbfc640 1 -- 172.21.15.44:0/1315206825 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaa80bbff0 con 0x7ffaa814bb70 2024-05-16T22:35:50.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.280+0000 7ffaaebfe640 1 --2- 172.21.15.44:0/1315206825 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffaa814bf80 0x7ffaa8070740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:35:51.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.281+0000 7ffaadbfc640 1 --2- 172.21.15.44:0/1315206825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffaa814bb70 0x7ffaa8070200 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8072580 tx=0x7ffa9c02c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7797076adab3762 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:51.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.281+0000 7ffaad3fb640 1 -- 172.21.15.44:0/1315206825 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c032790 con 0x7ffaa814bb70 2024-05-16T22:35:51.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.281+0000 7ffaad3fb640 1 -- 172.21.15.44:0/1315206825 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa9c038070 con 0x7ffaa814bb70 2024-05-16T22:35:51.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.281+0000 7ffaad3fb640 1 -- 172.21.15.44:0/1315206825 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c032b50 con 0x7ffaa814bb70 2024-05-16T22:35:51.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.282+0000 7ffab0661640 1 -- 172.21.15.44:0/1315206825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffaa814bb70 msgr2=0x7ffaa8070200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:51.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.282+0000 7ffab0661640 1 --2- 172.21.15.44:0/1315206825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffaa814bb70 0x7ffaa8070200 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8072580 tx=0x7ffa9c02c890 comp rx=0 tx=0).stop 2024-05-16T22:35:51.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.282+0000 7ffab0661640 1 -- 172.21.15.44:0/1315206825 shutdown_connections 2024-05-16T22:35:51.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.282+0000 7ffab0661640 1 --2- 172.21.15.44:0/1315206825 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffaa814bf80 0x7ffaa8070740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:51.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.282+0000 7ffab0661640 1 --2- 172.21.15.44:0/1315206825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffaa814bb70 0x7ffaa8070200 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:51.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.282+0000 7ffab0661640 1 --2- 172.21.15.44:0/1315206825 >> v2:172.21.15.70:3300/0 conn(0x7ffaa80bfe00 0x7ffaa8074340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:51.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.282+0000 7ffab0661640 1 -- 172.21.15.44:0/1315206825 >> 172.21.15.44:0/1315206825 conn(0x7ffaa80c05f0 msgr2=0x7ffaa80c0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:35:51.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.282+0000 7ffab0661640 1 -- 172.21.15.44:0/1315206825 shutdown_connections 2024-05-16T22:35:51.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.282+0000 7ffab0661640 1 -- 172.21.15.44:0/1315206825 wait complete. 2024-05-16T22:35:51.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.284+0000 7ffab0661640 1 Processor -- start 2024-05-16T22:35:51.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.284+0000 7ffab0661640 1 -- start start 2024-05-16T22:35:51.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.285+0000 7ffab0661640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffaa80bfe00 0x7ffaa80a5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:51.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.285+0000 7ffab0661640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffaa814bb70 0x7ffaa80a3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:51.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.285+0000 7ffab0661640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffaa814bf80 0x7ffaa80a4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:51.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.285+0000 7ffab0661640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa80bcb10 con 0x7ffaa814bf80 2024-05-16T22:35:51.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.285+0000 7ffab0661640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa80c0210 con 0x7ffaa814bb70 2024-05-16T22:35:51.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.285+0000 7ffab0661640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7ffaa80bcc90 con 0x7ffaa80bfe00 2024-05-16T22:35:51.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.285+0000 7ffaaebfe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffaa814bf80 0x7ffaa80a4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:51.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.285+0000 7ffaaebfe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffaa814bf80 0x7ffaa80a4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54190/0 (socket says 172.21.15.44:54190) 2024-05-16T22:35:51.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.285+0000 7ffaaebfe640 1 -- 172.21.15.44:0/432027457 learned_addr learned my addr 172.21.15.44:0/432027457 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:35:51.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.285+0000 7ffaadbfc640 1 --2- 172.21.15.44:0/432027457 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffaa814bb70 0x7ffaa80a3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:52.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.285+0000 7ffaae3fd640 1 --2- 172.21.15.44:0/432027457 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffaa80bfe00 0x7ffaa80a5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:52.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.285+0000 7ffaaebfe640 1 -- 172.21.15.44:0/432027457 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffaa80bfe00 msgr2=0x7ffaa80a5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:52.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.285+0000 7ffaaebfe640 1 --2- 172.21.15.44:0/432027457 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffaa80bfe00 0x7ffaa80a5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:52.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.285+0000 7ffaaebfe640 1 -- 172.21.15.44:0/432027457 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffaa814bb70 msgr2=0x7ffaa80a3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:52.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.285+0000 7ffaaebfe640 1 --2- 172.21.15.44:0/432027457 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffaa814bb70 0x7ffaa80a3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:52.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.285+0000 7ffaaebfe640 1 -- 172.21.15.44:0/432027457 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaa80a6250 con 0x7ffaa814bf80 2024-05-16T22:35:52.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.285+0000 7ffaadbfc640 1 --2- 172.21.15.44:0/432027457 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffaa814bb70 0x7ffaa80a3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:35:52.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.285+0000 7ffaaebfe640 1 --2- 172.21.15.44:0/432027457 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffaa814bf80 0x7ffaa80a4fd0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ffa9800d530 tx=0x7ffa9800d9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:52.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.286+0000 7ffaa6ffd640 1 -- 172.21.15.44:0/432027457 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa98004030 con 0x7ffaa814bf80 2024-05-16T22:35:52.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.286+0000 7ffaa6ffd640 1 -- 172.21.15.44:0/432027457 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa980041d0 con 0x7ffaa814bf80 2024-05-16T22:35:52.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.286+0000 7ffab0661640 1 -- 172.21.15.44:0/432027457 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaa80a4520 con 0x7ffaa814bf80 2024-05-16T22:35:52.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.286+0000 7ffaa6ffd640 1 -- 172.21.15.44:0/432027457 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa98003610 con 0x7ffaa814bf80 2024-05-16T22:35:52.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.286+0000 7ffab0661640 1 -- 172.21.15.44:0/432027457 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaa81e0c40 con 0x7ffaa814bf80 2024-05-16T22:35:52.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.287+0000 7ffab0661640 1 -- 172.21.15.44:0/432027457 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaa80bc780 con 0x7ffaa814bf80 2024-05-16T22:35:52.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.288+0000 7ffaa6ffd640 1 -- 172.21.15.44:0/432027457 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ffa980037b0 con 0x7ffaa814bf80 2024-05-16T22:35:52.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.288+0000 7ffaa6ffd640 1 --2- 172.21.15.44:0/432027457 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7ffa940762d0 0x7ffa940787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:52.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.288+0000 7ffaa6ffd640 1 -- 172.21.15.44:0/432027457 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5853+0+0 (secure 0 0 0) 0x7ffa98097830 con 0x7ffaa814bf80 2024-05-16T22:35:52.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.288+0000 7ffaae3fd640 1 --2- 172.21.15.44:0/432027457 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7ffa940762d0 0x7ffa940787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:52.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.289+0000 7ffaae3fd640 1 --2- 172.21.15.44:0/432027457 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7ffa940762d0 0x7ffa940787e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ffaa00073f0 tx=0x7ffaa000d040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:52.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.293+0000 7ffaa6ffd640 1 -- 172.21.15.44:0/432027457 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ffa98061070 con 0x7ffaa814bf80 2024-05-16T22:35:52.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.483+0000 7ffab0661640 1 -- 172.21.15.44:0/432027457 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffaa8050940 con 0x7ffaa814bf80 2024-05-16T22:35:52.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.484+0000 7ffaa6ffd640 1 -- 172.21.15.44:0/432027457 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+16853 (secure 0 0 0) 0x7ffa98060970 con 0x7ffaa814bf80 2024-05-16T22:35:52.835 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T22:35:52.868 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":51,"fsid":"572ab7cc-b103-4548-ae8f-c6614d57f0c8","created":"2024-05-16T22:27:02.216874+0000","modified":"2024-05-16T22:34:22.451797+0000","last_up_change":"2024-05-16T22:27:13.693953+0000","last_in_change":"2024-05-16T22:27:04.455119+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-16T22:27:14.562409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-05-16T22:33:02.085011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-05-16T22:33:06.543396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a7003e89-c706-4562-9f25-670bb35ae108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6825","nonce":1074109859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6827","nonce":1074109859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6831","nonce":1074109859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6829","nonce":1074109859}]},"public_addr":"172.21.15.44:6825/1074109859","cluster_addr":"172.21.15.44:6827/1074109859","heartbeat_back_addr":"172.21.15.44:6831/1074109859","heartbeat_front_addr":"172.21.15.44:6829/1074109859","state":["exists","up"]},{"osd":1,"uuid":"a4d5169d-8327-4494-9c7c-58db21b00636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6817","nonce":2909429972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6819","nonce":2909429972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6823","nonce":2909429972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6821","nonce":2909429972}]},"public_addr":"172.21.15.44:6817/2909429972","cluster_addr":"172.21.15.44:6819/2909429972","heartbeat_back_addr":"172.21.15.44:6823/2909429972","heartbeat_front_addr":"172.21.15.44:6821/2909429972","state":["exists","up"]},{"osd":2,"uuid":"d4a834f8-83a5-400f-9814-eb0a25124df4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6801","nonce":2908194156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6803","nonce":2908194156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6807","nonce":2908194156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6805","nonce":2908194156}]},"public_addr":"172.21.15.44:6801/2908194156","cluster_addr":"172.21.15.44:6803/2908194156","heartbeat_back_addr":"172.21.15.44:6807/2908194156","heartbeat_front_addr":"172.21.15.44:6805/2908194156","state":["exists","up"]},{"osd":3,"uuid":"b9d24a56-ad43-4674-a395-5ec24d135ae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6809","nonce":2168695793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6811","nonce":2168695793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6815","nonce":2168695793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6813","nonce":2168695793}]},"public_addr":"172.21.15.44:6809/2168695793","cluster_addr":"172.21.15.44:6811/2168695793","heartbeat_back_addr":"172.21.15.44:6815/2168695793","heartbeat_front_addr":"172.21.15.44:6813/2168695793","state":["exists","up"]},{"osd":4,"uuid":"9bd94af5-3e17-4cbe-995a-8f837a66c653","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6823","nonce":1540297751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6825","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6827","nonce":1540297751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6831","nonce":1540297751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6829","nonce":1540297751}]},"public_addr":"172.21.15.70:6823/1540297751","cluster_addr":"172.21.15.70:6827/1540297751","heartbeat_back_addr":"172.21.15.70:6831/1540297751","heartbeat_front_addr":"172.21.15.70:6829/1540297751","state":["exists","up"]},{"osd":5,"uuid":"a5b0cfa5-b259-48bd-98b6-96b44f5ebabd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6804","nonce":4218901987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6808","nonce":4218901987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6815","nonce":4218901987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6812","nonce":4218901987}]},"public_addr":"172.21.15.70:6804/4218901987","cluster_addr":"172.21.15.70:6808/4218901987","heartbeat_back_addr":"172.21.15.70:6815/4218901987","heartbeat_front_addr":"172.21.15.70:6812/4218901987","state":["exists","up"]},{"osd":6,"uuid":"0b6af6df-1358-4fc6-a62c-ba57e02914ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6801","nonce":2389556489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6805","nonce":2389556489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6813","nonce":2389556489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6807","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6809","nonce":2389556489}]},"public_addr":"172.21.15.70:6801/2389556489","cluster_addr":"172.21.15.70:6805/2389556489","heartbeat_back_addr":"172.21.15.70:6813/2389556489","heartbeat_front_addr":"172.21.15.70:6809/2389556489","state":["exists","up"]},{"osd":7,"uuid":"eb1a2c5d-42cf-47d0-9e03-b9d26944a589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6817","nonce":3619691281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6819","nonce":3619691281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6826","nonce":3619691281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6822","nonce":3619691281}]},"public_addr":"172.21.15.70:6817/3619691281","cluster_addr":"172.21.15.70:6819/3619691281","heartbeat_back_addr":"172.21.15.70:6826/3619691281","heartbeat_front_addr":"172.21.15.70:6822/3619691281","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.652256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.613348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.528454+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.625204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.678845+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.680829+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.556200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.647030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.4","mappings":[{"from":0,"to":5}]},{"pgid":"7.2e","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6834/97015923":"2024-05-17T22:34:22.451767+0000","172.21.15.44:6832/97015923":"2024-05-17T22:34:22.451767+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T22:35:52.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.486+0000 7ffab0661640 1 -- 172.21.15.44:0/432027457 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7ffa940762d0 msgr2=0x7ffa940787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:52.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.486+0000 7ffab0661640 1 --2- 172.21.15.44:0/432027457 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7ffa940762d0 0x7ffa940787e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ffaa00073f0 tx=0x7ffaa000d040 comp rx=0 tx=0).stop 2024-05-16T22:35:53.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.486+0000 7ffab0661640 1 -- 172.21.15.44:0/432027457 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffaa814bf80 msgr2=0x7ffaa80a4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:53.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.486+0000 7ffab0661640 1 --2- 172.21.15.44:0/432027457 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffaa814bf80 0x7ffaa80a4fd0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ffa9800d530 tx=0x7ffa9800d9f0 comp rx=0 tx=0).stop 2024-05-16T22:35:53.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.486+0000 7ffab0661640 1 -- 172.21.15.44:0/432027457 shutdown_connections 2024-05-16T22:35:53.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.486+0000 7ffab0661640 1 --2- 172.21.15.44:0/432027457 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7ffa940762d0 0x7ffa940787e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:53.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.486+0000 7ffab0661640 1 --2- 172.21.15.44:0/432027457 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffaa814bf80 0x7ffaa80a4fd0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:53.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.486+0000 7ffab0661640 1 --2- 172.21.15.44:0/432027457 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffaa814bb70 0x7ffaa80a3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:53.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.486+0000 7ffab0661640 1 --2- 172.21.15.44:0/432027457 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffaa80bfe00 0x7ffaa80a5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:53.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.486+0000 7ffab0661640 1 -- 172.21.15.44:0/432027457 >> 172.21.15.44:0/432027457 conn(0x7ffaa80c05f0 msgr2=0x7ffaa8148c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:35:53.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.486+0000 7ffab0661640 1 -- 172.21.15.44:0/432027457 shutdown_connections 2024-05-16T22:35:53.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:50.486+0000 7ffab0661640 1 -- 172.21.15.44:0/432027457 wait complete. 2024-05-16T22:35:53.352 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-16T22:35:53.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.512+0000 7f6f9b3dc640 1 Processor -- start 2024-05-16T22:35:53.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.512+0000 7f6f9b3dc640 1 -- start start 2024-05-16T22:35:53.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.513+0000 7f6f9b3dc640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6f94152180 0x7f6f94152590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:53.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.513+0000 7f6f9b3dc640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f940bbc80 con 0x7f6f94074320 2024-05-16T22:35:53.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.513+0000 7f6f9b3dc640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f940bbf60 con 0x7f6f9406c8c0 2024-05-16T22:35:53.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.513+0000 7f6f9b3dc640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f6f94151a10 con 0x7f6f94152180 2024-05-16T22:35:53.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.514+0000 7f6f98977640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6f94152180 0x7f6f94152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:53.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.514+0000 7f6f99979640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f6f94074320 0x7f6f94074730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59616/0 (socket says 172.21.15.44:59616) 2024-05-16T22:35:53.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.514+0000 7f6f98977640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6f94152180 0x7f6f94152590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54202/0 (socket says 172.21.15.44:54202) 2024-05-16T22:35:53.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.514+0000 7f6f99979640 1 -- 172.21.15.44:0/3958859531 learned_addr learned my addr 172.21.15.44:0/3958859531 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:35:53.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.514+0000 7f6f98977640 1 -- 172.21.15.44:0/3958859531 >> v1:172.21.15.70:6789/0 conn(0x7f6f9406c8c0 legacy=0x7f6f940bb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:53.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.514+0000 7f6f98977640 1 -- 172.21.15.44:0/3958859531 >> v1:172.21.15.44:6789/0 conn(0x7f6f94074320 legacy=0x7f6f94074730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:53.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.514+0000 7f6f98977640 1 -- 172.21.15.44:0/3958859531 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f94151c60 con 0x7f6f94152180 2024-05-16T22:35:54.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.515+0000 7f6f98977640 1 --2- 172.21.15.44:0/3958859531 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f94152180 0x7f6f94152590 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6f840097a0 tx=0x7f6f8402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=301d93d88b353abc server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:54.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.515+0000 7f6f8bfff640 1 -- 172.21.15.44:0/3958859531 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f84037070 con 0x7f6f94152180 2024-05-16T22:35:54.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.515+0000 7f6f8bfff640 1 -- 172.21.15.44:0/3958859531 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f84032440 con 0x7f6f94152180 2024-05-16T22:35:54.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.515+0000 7f6f8bfff640 1 -- 172.21.15.44:0/3958859531 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f84032810 con 0x7f6f94152180 2024-05-16T22:35:54.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.515+0000 7f6f9b3dc640 1 -- 172.21.15.44:0/3958859531 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f94152180 msgr2=0x7f6f94152590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:54.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.515+0000 7f6f9b3dc640 1 --2- 172.21.15.44:0/3958859531 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f94152180 0x7f6f94152590 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6f840097a0 tx=0x7f6f8402a230 comp rx=0 tx=0).stop 2024-05-16T22:35:54.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.516+0000 7f6f9b3dc640 1 -- 172.21.15.44:0/3958859531 shutdown_connections 2024-05-16T22:35:54.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.516+0000 7f6f9b3dc640 1 --2- 172.21.15.44:0/3958859531 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f94152180 0x7f6f94152590 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:54.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.516+0000 7f6f9b3dc640 1 -- 172.21.15.44:0/3958859531 >> 172.21.15.44:0/3958859531 conn(0x7f6f940bd0f0 msgr2=0x7f6f940bd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:35:54.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.516+0000 7f6f9b3dc640 1 -- 172.21.15.44:0/3958859531 shutdown_connections 2024-05-16T22:35:54.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.516+0000 7f6f9b3dc640 1 -- 172.21.15.44:0/3958859531 wait complete. 2024-05-16T22:35:54.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.517+0000 7f6f9b3dc640 1 Processor -- start 2024-05-16T22:35:54.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.517+0000 7f6f9b3dc640 1 -- start start 2024-05-16T22:35:54.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.518+0000 7f6f9b3dc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f9406c8c0 0x7f6f941e7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:54.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.518+0000 7f6f9b3dc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f94074320 0x7f6f9414cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:54.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.518+0000 7f6f9b3dc640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6f94152180 0x7f6f941478a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:54.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.518+0000 7f6f9b3dc640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6f9406ccd0 con 0x7f6f94074320 2024-05-16T22:35:54.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.518+0000 7f6f9b3dc640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6f940bb090 con 0x7f6f9406c8c0 2024-05-16T22:35:54.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.518+0000 7f6f9b3dc640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f6f9406ce50 con 0x7f6f94152180 2024-05-16T22:35:54.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.518+0000 7f6f98977640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f94074320 0x7f6f9414cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:54.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.518+0000 7f6f98977640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f94074320 0x7f6f9414cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54204/0 (socket says 172.21.15.44:54204) 2024-05-16T22:35:54.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.518+0000 7f6f98977640 1 -- 172.21.15.44:0/2484414987 learned_addr learned my addr 172.21.15.44:0/2484414987 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:35:54.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.519+0000 7f6f99979640 1 --2- 172.21.15.44:0/2484414987 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6f94152180 0x7f6f941478a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:54.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.519+0000 7f6f98977640 1 -- 172.21.15.44:0/2484414987 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6f94152180 msgr2=0x7f6f941478a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:54.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.519+0000 7f6f99178640 1 --2- 172.21.15.44:0/2484414987 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f9406c8c0 0x7f6f941e7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:54.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.519+0000 7f6f98977640 1 --2- 172.21.15.44:0/2484414987 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6f94152180 0x7f6f941478a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:54.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.519+0000 7f6f98977640 1 -- 172.21.15.44:0/2484414987 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f9406c8c0 msgr2=0x7f6f941e7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:54.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.519+0000 7f6f98977640 1 --2- 172.21.15.44:0/2484414987 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f9406c8c0 0x7f6f941e7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:54.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.519+0000 7f6f98977640 1 -- 172.21.15.44:0/2484414987 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f9414d420 con 0x7f6f94074320 2024-05-16T22:35:55.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.519+0000 7f6f98977640 1 --2- 172.21.15.44:0/2484414987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f94074320 0x7f6f9414cee0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6f84035040 tx=0x7f6f840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:55.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.519+0000 7f6f89ffb640 1 -- 172.21.15.44:0/2484414987 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f84037040 con 0x7f6f94074320 2024-05-16T22:35:55.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.519+0000 7f6f89ffb640 1 -- 172.21.15.44:0/2484414987 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f84030770 con 0x7f6f94074320 2024-05-16T22:35:55.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.519+0000 7f6f9b3dc640 1 -- 172.21.15.44:0/2484414987 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f94151370 con 0x7f6f94074320 2024-05-16T22:35:55.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.519+0000 7f6f89ffb640 1 -- 172.21.15.44:0/2484414987 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f84030b80 con 0x7f6f94074320 2024-05-16T22:35:55.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.519+0000 7f6f9b3dc640 1 -- 172.21.15.44:0/2484414987 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f94151090 con 0x7f6f94074320 2024-05-16T22:35:55.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.520+0000 7f6f9b3dc640 1 -- 172.21.15.44:0/2484414987 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f940be3f0 con 0x7f6f94074320 2024-05-16T22:35:55.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.521+0000 7f6f89ffb640 1 -- 172.21.15.44:0/2484414987 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6f84044020 con 0x7f6f94074320 2024-05-16T22:35:55.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.522+0000 7f6f89ffb640 1 --2- 172.21.15.44:0/2484414987 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f6f780762d0 0x7f6f780787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:55.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.522+0000 7f6f89ffb640 1 -- 172.21.15.44:0/2484414987 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5853+0+0 (secure 0 0 0) 0x7f6f840b7ca0 con 0x7f6f94074320 2024-05-16T22:35:55.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.522+0000 7f6f99178640 1 --2- 172.21.15.44:0/2484414987 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f6f780762d0 0x7f6f780787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:55.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.522+0000 7f6f99178640 1 --2- 172.21.15.44:0/2484414987 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f6f780762d0 0x7f6f780787e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6f90000f60 tx=0x7f6f90009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:55.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.526+0000 7f6f89ffb640 1 -- 172.21.15.44:0/2484414987 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6f94151370 con 0x7f6f94074320 2024-05-16T22:35:55.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.760+0000 7f6f9b3dc640 1 -- 172.21.15.44:0/2484414987 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f6f94050940 con 0x7f6f94074320 2024-05-16T22:35:55.520 INFO:tasks.ceph.mon.a.smithi044.stderr:2024-05-16T22:35:53.760+0000 7facbfd75640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-16T22:35:55.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.762+0000 7f6f89ffb640 1 -- 172.21.15.44:0/2484414987 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v34) ==== 161+0+0 (secure 0 0 0) 0x7f6f84032e20 con 0x7f6f94074320 2024-05-16T22:35:55.595 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-16T22:35:55.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.764+0000 7f6f9b3dc640 1 -- 172.21.15.44:0/2484414987 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f6f780762d0 msgr2=0x7f6f780787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:55.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.764+0000 7f6f9b3dc640 1 --2- 172.21.15.44:0/2484414987 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f6f780762d0 0x7f6f780787e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6f90000f60 tx=0x7f6f90009040 comp rx=0 tx=0).stop 2024-05-16T22:35:55.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.764+0000 7f6f9b3dc640 1 -- 172.21.15.44:0/2484414987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f94074320 msgr2=0x7f6f9414cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:55.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.764+0000 7f6f9b3dc640 1 --2- 172.21.15.44:0/2484414987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f94074320 0x7f6f9414cee0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6f84035040 tx=0x7f6f840046c0 comp rx=0 tx=0).stop 2024-05-16T22:35:55.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.764+0000 7f6f9b3dc640 1 -- 172.21.15.44:0/2484414987 shutdown_connections 2024-05-16T22:35:55.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.764+0000 7f6f9b3dc640 1 --2- 172.21.15.44:0/2484414987 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f6f780762d0 0x7f6f780787e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:55.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.764+0000 7f6f9b3dc640 1 --2- 172.21.15.44:0/2484414987 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6f94152180 0x7f6f941478a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:55.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.764+0000 7f6f9b3dc640 1 --2- 172.21.15.44:0/2484414987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f94074320 0x7f6f9414cee0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:55.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.764+0000 7f6f9b3dc640 1 --2- 172.21.15.44:0/2484414987 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f9406c8c0 0x7f6f941e7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:56.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.764+0000 7f6f9b3dc640 1 -- 172.21.15.44:0/2484414987 >> 172.21.15.44:0/2484414987 conn(0x7f6f940bd0f0 msgr2=0x7f6f940a37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:35:56.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.764+0000 7f6f9b3dc640 1 -- 172.21.15.44:0/2484414987 shutdown_connections 2024-05-16T22:35:56.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:53.764+0000 7f6f9b3dc640 1 -- 172.21.15.44:0/2484414987 wait complete. 2024-05-16T22:35:56.113 INFO:tasks.ceph.mds.a.smithi044.stderr: -3739> 2024-05-16T22:35:15.110+0000 7f43468ab640 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x10000000001 2024-05-16T22:35:56.145 INFO:tasks.ceph.mds.a.smithi044.stderr: -3668> 2024-05-16T22:35:15.110+0000 7f43468ab640 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x10000000004 2024-05-16T22:35:56.179 INFO:tasks.ceph.mds.a.smithi044.stderr: -3646> 2024-05-16T22:35:15.111+0000 7f43468ab640 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x10000000003 2024-05-16T22:35:56.215 INFO:tasks.ceph.mds.a.smithi044.stderr: -3607> 2024-05-16T22:35:15.111+0000 7f43468ab640 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x10000000002 2024-05-16T22:35:56.247 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-16T22:35:56.280 INFO:tasks.ceph.mds.a.smithi044.stdout:starting mds.a at 2024-05-16T22:35:56.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.441+0000 7fe938e49640 1 Processor -- start 2024-05-16T22:35:56.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.441+0000 7fe938e49640 1 -- start start 2024-05-16T22:35:56.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.442+0000 7fe938e49640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe934152180 0x7fe934152590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:56.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.442+0000 7fe938e49640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe934074320 0x7fe934074730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:56.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.442+0000 7fe938e49640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9340bbc80 con 0x7fe93406c8c0 2024-05-16T22:35:56.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.442+0000 7fe938e49640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fe934151a10 con 0x7fe934152180 2024-05-16T22:35:56.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.442+0000 7fe938e49640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fe9340bb090 con 0x7fe934074320 2024-05-16T22:35:56.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.442+0000 7fe92bfff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe934152180 0x7fe934152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:56.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.442+0000 7fe92bfff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe934152180 0x7fe934152590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54242/0 (socket says 172.21.15.44:54242) 2024-05-16T22:35:56.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.442+0000 7fe92bfff640 1 -- 172.21.15.44:0/3663082247 learned_addr learned my addr 172.21.15.44:0/3663082247 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:35:56.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.442+0000 7fe932d9d640 1 --2- 172.21.15.44:0/3663082247 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe934074320 0x7fe934074730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:56.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.443+0000 7fe92bfff640 1 -- 172.21.15.44:0/3663082247 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe934074320 msgr2=0x7fe934074730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:35:56.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.443+0000 7fe92bfff640 1 --2- 172.21.15.44:0/3663082247 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe934074320 0x7fe934074730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:56.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.443+0000 7fe92bfff640 1 -- 172.21.15.44:0/3663082247 >> v1:172.21.15.70:6789/0 conn(0x7fe93406c8c0 legacy=0x7fe9340bb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:57.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.443+0000 7fe92bfff640 1 -- 172.21.15.44:0/3663082247 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9340bbf60 con 0x7fe934152180 2024-05-16T22:35:57.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.443+0000 7fe92bfff640 1 --2- 172.21.15.44:0/3663082247 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe934152180 0x7fe934152590 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe91c009870 tx=0x7fe91c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=896ec5ca693e248d server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:57.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.444+0000 7fe931d9b640 1 -- 172.21.15.44:0/3663082247 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91c037070 con 0x7fe934152180 2024-05-16T22:35:57.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.444+0000 7fe931d9b640 1 -- 172.21.15.44:0/3663082247 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe91c032440 con 0x7fe934152180 2024-05-16T22:35:57.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.444+0000 7fe931d9b640 1 -- 172.21.15.44:0/3663082247 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91c032810 con 0x7fe934152180 2024-05-16T22:35:57.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.444+0000 7fe938e49640 1 -- 172.21.15.44:0/3663082247 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe934152180 msgr2=0x7fe934152590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:57.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.444+0000 7fe938e49640 1 --2- 172.21.15.44:0/3663082247 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe934152180 0x7fe934152590 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe91c009870 tx=0x7fe91c02a270 comp rx=0 tx=0).stop 2024-05-16T22:35:57.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.444+0000 7fe938e49640 1 -- 172.21.15.44:0/3663082247 shutdown_connections 2024-05-16T22:35:57.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.444+0000 7fe938e49640 1 --2- 172.21.15.44:0/3663082247 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe934074320 0x7fe934074730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:57.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.444+0000 7fe938e49640 1 --2- 172.21.15.44:0/3663082247 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe934152180 0x7fe934152590 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:57.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.444+0000 7fe938e49640 1 -- 172.21.15.44:0/3663082247 >> 172.21.15.44:0/3663082247 conn(0x7fe9340bd0f0 msgr2=0x7fe9340bd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:35:57.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.444+0000 7fe938e49640 1 -- 172.21.15.44:0/3663082247 shutdown_connections 2024-05-16T22:35:57.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.444+0000 7fe938e49640 1 -- 172.21.15.44:0/3663082247 wait complete. 2024-05-16T22:35:57.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.446+0000 7fe938e49640 1 Processor -- start 2024-05-16T22:35:57.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.446+0000 7fe938e49640 1 -- start start 2024-05-16T22:35:57.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.447+0000 7fe938e49640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe93406c8c0 0x7fe9341d9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:57.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.447+0000 7fe938e49640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe934074320 0x7fe9341d7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:57.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.447+0000 7fe938e49640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe934152180 0x7fe934149ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:57.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.447+0000 7fe938e49640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe93406ccd0 con 0x7fe934152180 2024-05-16T22:35:57.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.447+0000 7fe938e49640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe93414e4c0 con 0x7fe934074320 2024-05-16T22:35:57.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.447+0000 7fe938e49640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fe93406ce50 con 0x7fe93406c8c0 2024-05-16T22:35:57.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.447+0000 7fe932d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe934152180 0x7fe934149ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:57.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.447+0000 7fe932d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe934152180 0x7fe934149ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54254/0 (socket says 172.21.15.44:54254) 2024-05-16T22:35:57.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.447+0000 7fe932d9d640 1 -- 172.21.15.44:0/2538549081 learned_addr learned my addr 172.21.15.44:0/2538549081 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:35:57.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.448+0000 7fe92bfff640 1 --2- 172.21.15.44:0/2538549081 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe934074320 0x7fe9341d7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:57.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.448+0000 7fe93259c640 1 --2- 172.21.15.44:0/2538549081 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe93406c8c0 0x7fe9341d9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:57.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.448+0000 7fe932d9d640 1 -- 172.21.15.44:0/2538549081 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe93406c8c0 msgr2=0x7fe9341d9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:57.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.448+0000 7fe932d9d640 1 --2- 172.21.15.44:0/2538549081 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe93406c8c0 0x7fe9341d9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:57.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.448+0000 7fe932d9d640 1 -- 172.21.15.44:0/2538549081 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe934074320 msgr2=0x7fe9341d7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:58.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.448+0000 7fe932d9d640 1 --2- 172.21.15.44:0/2538549081 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe934074320 0x7fe9341d7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:58.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.448+0000 7fe932d9d640 1 -- 172.21.15.44:0/2538549081 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9341da140 con 0x7fe934152180 2024-05-16T22:35:58.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.448+0000 7fe92bfff640 1 --2- 172.21.15.44:0/2538549081 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe934074320 0x7fe9341d7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:35:58.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.448+0000 7fe932d9d640 1 --2- 172.21.15.44:0/2538549081 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe934152180 0x7fe934149ad0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe92c007d40 tx=0x7fe92c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:58.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.448+0000 7fe92affd640 1 -- 172.21.15.44:0/2538549081 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe92c014420 con 0x7fe934152180 2024-05-16T22:35:58.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.448+0000 7fe92affd640 1 -- 172.21.15.44:0/2538549081 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe92c019070 con 0x7fe934152180 2024-05-16T22:35:58.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.448+0000 7fe938e49640 1 -- 172.21.15.44:0/2538549081 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9341e4cc0 con 0x7fe934152180 2024-05-16T22:35:58.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.448+0000 7fe92affd640 1 -- 172.21.15.44:0/2538549081 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe92c014820 con 0x7fe934152180 2024-05-16T22:35:58.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.448+0000 7fe938e49640 1 -- 172.21.15.44:0/2538549081 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9341e5280 con 0x7fe934152180 2024-05-16T22:35:58.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.449+0000 7fe938e49640 1 -- 172.21.15.44:0/2538549081 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9340be3f0 con 0x7fe934152180 2024-05-16T22:35:58.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.450+0000 7fe92affd640 1 -- 172.21.15.44:0/2538549081 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe92c0149c0 con 0x7fe934152180 2024-05-16T22:35:58.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.450+0000 7fe92affd640 1 --2- 172.21.15.44:0/2538549081 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fe914076300 0x7fe914078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:58.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.450+0000 7fe92affd640 1 -- 172.21.15.44:0/2538549081 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5939+0+0 (secure 0 0 0) 0x7fe92c097ef0 con 0x7fe934152180 2024-05-16T22:35:58.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.451+0000 7fe93259c640 1 --2- 172.21.15.44:0/2538549081 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fe914076300 0x7fe914078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:58.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.451+0000 7fe93259c640 1 --2- 172.21.15.44:0/2538549081 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fe914076300 0x7fe914078810 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe9240015e0 tx=0x7fe924009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:35:58.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.455+0000 7fe92affd640 1 -- 172.21.15.44:0/2538549081 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe92c061760 con 0x7fe934152180 2024-05-16T22:35:58.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.685+0000 7fe938e49640 1 -- 172.21.15.44:0/2538549081 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fe934050940 con 0x7fe934152180 2024-05-16T22:35:58.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.771+0000 7fe92affd640 1 -- 172.21.15.44:0/2538549081 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v36) ==== 104+0+0 (secure 0 0 0) 0x7fe92c061060 con 0x7fe934152180 2024-05-16T22:35:58.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.773+0000 7fe938e49640 1 -- 172.21.15.44:0/2538549081 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fe914076300 msgr2=0x7fe914078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:58.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.773+0000 7fe938e49640 1 --2- 172.21.15.44:0/2538549081 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fe914076300 0x7fe914078810 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe9240015e0 tx=0x7fe924009040 comp rx=0 tx=0).stop 2024-05-16T22:35:58.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.773+0000 7fe938e49640 1 -- 172.21.15.44:0/2538549081 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe934152180 msgr2=0x7fe934149ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:35:58.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.773+0000 7fe938e49640 1 --2- 172.21.15.44:0/2538549081 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe934152180 0x7fe934149ad0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe92c007d40 tx=0x7fe92c00e4b0 comp rx=0 tx=0).stop 2024-05-16T22:35:58.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.773+0000 7fe938e49640 1 -- 172.21.15.44:0/2538549081 shutdown_connections 2024-05-16T22:35:58.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.773+0000 7fe938e49640 1 --2- 172.21.15.44:0/2538549081 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fe914076300 0x7fe914078810 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:58.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.773+0000 7fe938e49640 1 --2- 172.21.15.44:0/2538549081 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe934152180 0x7fe934149ad0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:59.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.773+0000 7fe938e49640 1 --2- 172.21.15.44:0/2538549081 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe934074320 0x7fe9341d7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:59.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.773+0000 7fe938e49640 1 --2- 172.21.15.44:0/2538549081 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe93406c8c0 0x7fe9341d9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:59.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.773+0000 7fe938e49640 1 -- 172.21.15.44:0/2538549081 >> 172.21.15.44:0/2538549081 conn(0x7fe9340bd0f0 msgr2=0x7fe93414cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:35:59.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.773+0000 7fe938e49640 1 -- 172.21.15.44:0/2538549081 shutdown_connections 2024-05-16T22:35:59.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:56.773+0000 7fe938e49640 1 -- 172.21.15.44:0/2538549081 wait complete. 2024-05-16T22:35:59.218 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-16T22:35:59.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.379+0000 7f78dce15640 1 Processor -- start 2024-05-16T22:35:59.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.379+0000 7f78dce15640 1 -- start start 2024-05-16T22:35:59.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.380+0000 7f78dce15640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f78d8074b00 0x7f78d806c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:59.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.380+0000 7f78dce15640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f78d80be3f0 0x7f78d814cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:59.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.380+0000 7f78dce15640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f78d814fad0 0x7f78d814fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:35:59.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.380+0000 7f78dce15640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f78d80bb470 con 0x7f78d8074b00 2024-05-16T22:35:59.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.380+0000 7f78dce15640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f78d806ce00 con 0x7f78d814fad0 2024-05-16T22:35:59.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.380+0000 7f78dce15640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f78d80bb890 con 0x7f78d80be3f0 2024-05-16T22:35:59.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.380+0000 7f78d659c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f78d8074b00 0x7f78d806c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:59.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.380+0000 7f78d659c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f78d8074b00 0x7f78d806c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54270/0 (socket says 172.21.15.44:54270) 2024-05-16T22:35:59.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.380+0000 7f78d659c640 1 -- 172.21.15.44:0/4118179988 learned_addr learned my addr 172.21.15.44:0/4118179988 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:35:59.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.381+0000 7f78d6d9d640 1 --2- 172.21.15.44:0/4118179988 >> v2:172.21.15.70:3300/0 conn(0x7f78d814fad0 0x7f78d814fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:59.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.381+0000 7f78d5d9b640 1 --2- 172.21.15.44:0/4118179988 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f78d80be3f0 0x7f78d814cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:35:59.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.381+0000 7f78d659c640 1 -- 172.21.15.44:0/4118179988 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f78d80be3f0 msgr2=0x7f78d814cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:35:59.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.381+0000 7f78d659c640 1 --2- 172.21.15.44:0/4118179988 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f78d80be3f0 0x7f78d814cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:59.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.381+0000 7f78d659c640 1 -- 172.21.15.44:0/4118179988 >> v2:172.21.15.70:3300/0 conn(0x7f78d814fad0 msgr2=0x7f78d814fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:35:59.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.381+0000 7f78d659c640 1 --2- 172.21.15.44:0/4118179988 >> v2:172.21.15.70:3300/0 conn(0x7f78d814fad0 0x7f78d814fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:35:59.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.381+0000 7f78d659c640 1 -- 172.21.15.44:0/4118179988 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78d80bbb30 con 0x7f78d8074b00 2024-05-16T22:36:00.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.381+0000 7f78d6d9d640 1 --2- 172.21.15.44:0/4118179988 >> v2:172.21.15.70:3300/0 conn(0x7f78d814fad0 0x7f78d814fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-16T22:36:00.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.381+0000 7f78d659c640 1 --2- 172.21.15.44:0/4118179988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78d8074b00 0x7f78d806c8c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f78d8073000 tx=0x7f78c002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd9e02aeab11b3d server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:36:00.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.381+0000 7f78d559a640 1 -- 172.21.15.44:0/4118179988 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c0037070 con 0x7f78d8074b00 2024-05-16T22:36:00.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.381+0000 7f78d559a640 1 -- 172.21.15.44:0/4118179988 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78c0032440 con 0x7f78d8074b00 2024-05-16T22:36:00.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.381+0000 7f78d559a640 1 -- 172.21.15.44:0/4118179988 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c0032810 con 0x7f78d8074b00 2024-05-16T22:36:00.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.382+0000 7f78dce15640 1 -- 172.21.15.44:0/4118179988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78d8074b00 msgr2=0x7f78d806c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:36:00.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.382+0000 7f78dce15640 1 --2- 172.21.15.44:0/4118179988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78d8074b00 0x7f78d806c8c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f78d8073000 tx=0x7f78c002a180 comp rx=0 tx=0).stop 2024-05-16T22:36:00.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.382+0000 7f78dce15640 1 -- 172.21.15.44:0/4118179988 shutdown_connections 2024-05-16T22:36:00.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.382+0000 7f78dce15640 1 --2- 172.21.15.44:0/4118179988 >> v2:172.21.15.70:3300/0 conn(0x7f78d814fad0 0x7f78d814fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:36:00.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.382+0000 7f78dce15640 1 --2- 172.21.15.44:0/4118179988 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f78d80be3f0 0x7f78d814cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:36:00.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.382+0000 7f78dce15640 1 --2- 172.21.15.44:0/4118179988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78d8074b00 0x7f78d806c8c0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:36:00.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.382+0000 7f78dce15640 1 -- 172.21.15.44:0/4118179988 >> 172.21.15.44:0/4118179988 conn(0x7f78d80bd0f0 msgr2=0x7f78d80bd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:36:00.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.382+0000 7f78dce15640 1 -- 172.21.15.44:0/4118179988 shutdown_connections 2024-05-16T22:36:00.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.382+0000 7f78dce15640 1 -- 172.21.15.44:0/4118179988 wait complete. 2024-05-16T22:36:00.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.384+0000 7f78dce15640 1 Processor -- start 2024-05-16T22:36:00.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.384+0000 7f78dce15640 1 -- start start 2024-05-16T22:36:00.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.385+0000 7f78dce15640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78d8074b00 0x7f78d81e4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:36:00.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.385+0000 7f78dce15640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f78d80be3f0 0x7f78d806fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:36:00.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.385+0000 7f78dce15640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78d814fad0 0x7f78d8070a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:36:00.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.385+0000 7f78dce15640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f78d8150420 con 0x7f78d814fad0 2024-05-16T22:36:00.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.385+0000 7f78dce15640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f78d80bc0f0 con 0x7f78d8074b00 2024-05-16T22:36:00.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.385+0000 7f78dce15640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f78d80bc3d0 con 0x7f78d80be3f0 2024-05-16T22:36:00.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.385+0000 7f78d6d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78d814fad0 0x7f78d8070a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:36:00.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.385+0000 7f78d6d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78d814fad0 0x7f78d8070a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54282/0 (socket says 172.21.15.44:54282) 2024-05-16T22:36:00.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.385+0000 7f78d6d9d640 1 -- 172.21.15.44:0/2911554543 learned_addr learned my addr 172.21.15.44:0/2911554543 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:36:00.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.385+0000 7f78d659c640 1 --2- 172.21.15.44:0/2911554543 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78d8074b00 0x7f78d81e4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:36:00.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.386+0000 7f78d5d9b640 1 --2- 172.21.15.44:0/2911554543 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f78d80be3f0 0x7f78d806fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:36:01.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.386+0000 7f78d6d9d640 1 -- 172.21.15.44:0/2911554543 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f78d80be3f0 msgr2=0x7f78d806fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:36:01.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.386+0000 7f78d6d9d640 1 --2- 172.21.15.44:0/2911554543 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f78d80be3f0 0x7f78d806fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:36:01.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.386+0000 7f78d6d9d640 1 -- 172.21.15.44:0/2911554543 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78d8074b00 msgr2=0x7f78d81e4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:36:01.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.386+0000 7f78d6d9d640 1 --2- 172.21.15.44:0/2911554543 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78d8074b00 0x7f78d81e4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:36:01.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.386+0000 7f78d6d9d640 1 -- 172.21.15.44:0/2911554543 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78d81e4870 con 0x7f78d814fad0 2024-05-16T22:36:01.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.386+0000 7f78d6d9d640 1 --2- 172.21.15.44:0/2911554543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78d814fad0 0x7f78d8070a00 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f78d000cde0 tx=0x7f78d000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:36:01.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.386+0000 7f78ceffd640 1 -- 172.21.15.44:0/2911554543 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d000f680 con 0x7f78d814fad0 2024-05-16T22:36:01.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.386+0000 7f78ceffd640 1 -- 172.21.15.44:0/2911554543 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78d000f840 con 0x7f78d814fad0 2024-05-16T22:36:01.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.386+0000 7f78ceffd640 1 -- 172.21.15.44:0/2911554543 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d000fc30 con 0x7f78d814fad0 2024-05-16T22:36:01.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.386+0000 7f78dce15640 1 -- 172.21.15.44:0/2911554543 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78d80a1b10 con 0x7f78d814fad0 2024-05-16T22:36:01.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.386+0000 7f78dce15640 1 -- 172.21.15.44:0/2911554543 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78d80a0650 con 0x7f78d814fad0 2024-05-16T22:36:01.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.387+0000 7f78dce15640 1 -- 172.21.15.44:0/2911554543 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78d8050940 con 0x7f78d814fad0 2024-05-16T22:36:01.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.388+0000 7f78ceffd640 1 -- 172.21.15.44:0/2911554543 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f78d00213f0 con 0x7f78d814fad0 2024-05-16T22:36:01.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.388+0000 7f78ceffd640 1 --2- 172.21.15.44:0/2911554543 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f78b8076300 0x7f78b8078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:36:01.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.388+0000 7f78ceffd640 1 -- 172.21.15.44:0/2911554543 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5939+0+0 (secure 0 0 0) 0x7f78d0098330 con 0x7f78d814fad0 2024-05-16T22:36:01.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.389+0000 7f78d659c640 1 --2- 172.21.15.44:0/2911554543 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f78b8076300 0x7f78b8078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:36:01.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.389+0000 7f78d659c640 1 --2- 172.21.15.44:0/2911554543 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f78b8076300 0x7f78b8078810 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f78c0034000 tx=0x7f78c002e000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:36:01.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.393+0000 7f78ceffd640 1 -- 172.21.15.44:0/2911554543 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f78d0014030 con 0x7f78d814fad0 2024-05-16T22:36:01.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.586+0000 7f78dce15640 1 -- 172.21.15.44:0/2911554543 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f78d80742e0 con 0x7f78d814fad0 2024-05-16T22:36:01.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.777+0000 7f78ceffd640 1 -- 172.21.15.44:0/2911554543 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v53) ==== 181+0+0 (secure 0 0 0) 0x7f78d00614c0 con 0x7f78d814fad0 2024-05-16T22:36:01.697 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' removed 2024-05-16T22:36:01.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.780+0000 7f78dce15640 1 -- 172.21.15.44:0/2911554543 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f78b8076300 msgr2=0x7f78b8078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:36:01.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.780+0000 7f78dce15640 1 --2- 172.21.15.44:0/2911554543 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f78b8076300 0x7f78b8078810 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f78c0034000 tx=0x7f78c002e000 comp rx=0 tx=0).stop 2024-05-16T22:36:01.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.780+0000 7f78dce15640 1 -- 172.21.15.44:0/2911554543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78d814fad0 msgr2=0x7f78d8070a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:36:01.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.780+0000 7f78dce15640 1 --2- 172.21.15.44:0/2911554543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78d814fad0 0x7f78d8070a00 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f78d000cde0 tx=0x7f78d000a650 comp rx=0 tx=0).stop 2024-05-16T22:36:01.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.780+0000 7f78dce15640 1 -- 172.21.15.44:0/2911554543 shutdown_connections 2024-05-16T22:36:01.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.780+0000 7f78dce15640 1 --2- 172.21.15.44:0/2911554543 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f78b8076300 0x7f78b8078810 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:36:01.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.780+0000 7f78dce15640 1 --2- 172.21.15.44:0/2911554543 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f78d80be3f0 0x7f78d806fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:36:02.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.780+0000 7f78dce15640 1 --2- 172.21.15.44:0/2911554543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78d814fad0 0x7f78d8070a00 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:36:02.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.780+0000 7f78dce15640 1 --2- 172.21.15.44:0/2911554543 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78d8074b00 0x7f78d81e4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:36:02.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.780+0000 7f78dce15640 1 -- 172.21.15.44:0/2911554543 >> 172.21.15.44:0/2911554543 conn(0x7f78d80bd0f0 msgr2=0x7f78d80be890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:36:02.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.780+0000 7f78dce15640 1 -- 172.21.15.44:0/2911554543 shutdown_connections 2024-05-16T22:36:02.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:35:59.780+0000 7f78dce15640 1 -- 172.21.15.44:0/2911554543 wait complete. 2024-05-16T22:36:02.232 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-16T22:36:02.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.395+0000 7f82da6d1640 1 Processor -- start 2024-05-16T22:36:02.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.395+0000 7f82da6d1640 1 -- start start 2024-05-16T22:36:02.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.396+0000 7f82da6d1640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f82d4151fc0 0x7f82d40bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:36:02.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.396+0000 7f82da6d1640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f82d40bf050 0x7f82d4158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:36:02.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.396+0000 7f82da6d1640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82d40c36f0 con 0x7f82d406da30 2024-05-16T22:36:02.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.396+0000 7f82da6d1640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f82d40bdc10 con 0x7f82d4151fc0 2024-05-16T22:36:02.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.396+0000 7f82da6d1640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f82d4152530 con 0x7f82d40bf050 2024-05-16T22:36:02.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.396+0000 7f82d37fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f82d406da30 0x7f82d40be940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44750/0 (socket says 172.21.15.44:44750) 2024-05-16T22:36:02.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.396+0000 7f82d37fe640 1 -- 172.21.15.44:0/437208368 learned_addr learned my addr 172.21.15.44:0/437208368 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:36:02.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.396+0000 7f82d8c6e640 1 --2- 172.21.15.44:0/437208368 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f82d40bf050 0x7f82d4158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:36:02.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.396+0000 7f82d3fff640 1 --2- 172.21.15.44:0/437208368 >> v2:172.21.15.70:3300/0 conn(0x7f82d4151fc0 0x7f82d40bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:36:02.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.396+0000 7f82d2ffd640 1 -- 172.21.15.44:0/437208368 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1807368422 0 0) 0x7f82d40c36f0 con 0x7f82d406da30 2024-05-16T22:36:02.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.396+0000 7f82d2ffd640 1 -- 172.21.15.44:0/437208368 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82bc003520 con 0x7f82d406da30 2024-05-16T22:36:02.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.397+0000 7f82d2ffd640 1 -- 172.21.15.44:0/437208368 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1534989690 0 0) 0x7f82bc003520 con 0x7f82d406da30 2024-05-16T22:36:02.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.397+0000 7f82d2ffd640 1 -- 172.21.15.44:0/437208368 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f82d40bf050 msgr2=0x7f82d4158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:36:02.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.397+0000 7f82d2ffd640 1 --2- 172.21.15.44:0/437208368 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f82d40bf050 0x7f82d4158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:36:03.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.397+0000 7f82d2ffd640 1 -- 172.21.15.44:0/437208368 >> v2:172.21.15.70:3300/0 conn(0x7f82d4151fc0 msgr2=0x7f82d40bd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:36:03.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.397+0000 7f82d2ffd640 1 --2- 172.21.15.44:0/437208368 >> v2:172.21.15.70:3300/0 conn(0x7f82d4151fc0 0x7f82d40bd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:36:03.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.397+0000 7f82d2ffd640 1 -- 172.21.15.44:0/437208368 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82d4152810 con 0x7f82d406da30 2024-05-16T22:36:03.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.397+0000 7f82d2ffd640 1 -- 172.21.15.44:0/437208368 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 568431863 0 0) 0x7f82c80016f0 con 0x7f82d406da30 2024-05-16T22:36:03.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.397+0000 7f82d3fff640 1 --2- 172.21.15.44:0/437208368 >> v2:172.21.15.70:3300/0 conn(0x7f82d4151fc0 0x7f82d40bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T22:36:03.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.397+0000 7f82d2ffd640 1 -- 172.21.15.44:0/437208368 >> v1:172.21.15.44:6789/0 conn(0x7f82d406da30 legacy=0x7f82d40be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:36:03.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.397+0000 7f82d2ffd640 1 --2- 172.21.15.44:0/437208368 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f82d40bf050 0x7f82bc003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:36:03.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.397+0000 7f82d2ffd640 1 --2- 172.21.15.44:0/437208368 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82bc003fd0 0x7f82bc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:36:03.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.397+0000 7f82d2ffd640 1 --2- 172.21.15.44:0/437208368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82bc004d40 0x7f82bc005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:36:03.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.397+0000 7f82d2ffd640 1 -- 172.21.15.44:0/437208368 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f82d40bdc10 con 0x7f82bc003fd0 2024-05-16T22:36:03.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.397+0000 7f82d2ffd640 1 -- 172.21.15.44:0/437208368 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f82d4152530 con 0x7f82bc004d40 2024-05-16T22:36:03.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.397+0000 7f82d2ffd640 1 -- 172.21.15.44:0/437208368 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f82bc00bb50 con 0x7f82d40bf050 2024-05-16T22:36:03.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.397+0000 7f82d37fe640 1 --2- 172.21.15.44:0/437208368 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82bc003fd0 0x7f82bc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:36:03.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.397+0000 7f82d3fff640 1 --2- 172.21.15.44:0/437208368 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f82d40bf050 0x7f82bc003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:36:03.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.397+0000 7f82d8c6e640 1 --2- 172.21.15.44:0/437208368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82bc004d40 0x7f82bc005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:36:03.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.397+0000 7f82d37fe640 1 -- 172.21.15.44:0/437208368 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f82d40bf050 msgr2=0x7f82bc003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:36:03.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.397+0000 7f82d37fe640 1 --2- 172.21.15.44:0/437208368 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f82d40bf050 0x7f82bc003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:36:03.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.397+0000 7f82d37fe640 1 -- 172.21.15.44:0/437208368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82bc004d40 msgr2=0x7f82bc005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T22:36:03.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.397+0000 7f82d37fe640 1 --2- 172.21.15.44:0/437208368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82bc004d40 0x7f82bc005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:36:03.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.397+0000 7f82d37fe640 1 -- 172.21.15.44:0/437208368 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82bc003520 con 0x7f82bc003fd0 2024-05-16T22:36:03.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.397+0000 7f82d8c6e640 1 --2- 172.21.15.44:0/437208368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82bc004d40 0x7f82bc005150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:36:03.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.398+0000 7f82d37fe640 1 --2- 172.21.15.44:0/437208368 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82bc003fd0 0x7f82bc004800 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f82d406d590 tx=0x7f82bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b06df7b8c59008a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:36:03.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.398+0000 7f82d2ffd640 1 -- 172.21.15.44:0/437208368 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c8007d50 con 0x7f82bc003fd0 2024-05-16T22:36:03.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.398+0000 7f82d2ffd640 1 -- 172.21.15.44:0/437208368 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82c8005af0 con 0x7f82bc003fd0 2024-05-16T22:36:03.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.398+0000 7f82d2ffd640 1 -- 172.21.15.44:0/437208368 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c8007070 con 0x7f82bc003fd0 2024-05-16T22:36:03.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.399+0000 7f82da6d1640 1 -- 172.21.15.44:0/437208368 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82bc003fd0 msgr2=0x7f82bc004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:36:03.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.399+0000 7f82da6d1640 1 --2- 172.21.15.44:0/437208368 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82bc003fd0 0x7f82bc004800 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f82d406d590 tx=0x7f82bc005830 comp rx=0 tx=0).stop 2024-05-16T22:36:04.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.399+0000 7f82d8c6e640 1 -- 172.21.15.44:0/437208368 reap_dead start 2024-05-16T22:36:04.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.399+0000 7f82da6d1640 1 -- 172.21.15.44:0/437208368 shutdown_connections 2024-05-16T22:36:04.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.399+0000 7f82da6d1640 1 -- 172.21.15.44:0/437208368 >> 172.21.15.44:0/437208368 conn(0x7f82d40c3d20 msgr2=0x7f82d40c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:36:04.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.399+0000 7f82da6d1640 1 -- 172.21.15.44:0/437208368 shutdown_connections 2024-05-16T22:36:04.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.399+0000 7f82da6d1640 1 -- 172.21.15.44:0/437208368 wait complete. 2024-05-16T22:36:04.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.400+0000 7f82da6d1640 1 Processor -- start 2024-05-16T22:36:04.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.401+0000 7f82da6d1640 1 -- start start 2024-05-16T22:36:04.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.402+0000 7f82da6d1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82bc003fd0 0x7f82d40ba1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:36:04.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.402+0000 7f82da6d1640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f82d414e940 0x7f82d414b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:36:04.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.402+0000 7f82da6d1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82d414b680 0x7f82d41e7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:36:04.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.402+0000 7f82da6d1640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f82d40a3050 con 0x7f82d414b680 2024-05-16T22:36:04.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.402+0000 7f82da6d1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f82d40a2ed0 con 0x7f82bc003fd0 2024-05-16T22:36:04.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.402+0000 7f82da6d1640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f82d406de40 con 0x7f82d414e940 2024-05-16T22:36:04.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.402+0000 7f82d8c6e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82d414b680 0x7f82d41e7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:36:04.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.402+0000 7f82d8c6e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82d414b680 0x7f82d41e7790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37574/0 (socket says 172.21.15.44:37574) 2024-05-16T22:36:04.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.402+0000 7f82d8c6e640 1 -- 172.21.15.44:0/4227443456 learned_addr learned my addr 172.21.15.44:0/4227443456 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:36:04.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.402+0000 7f82d3fff640 1 --2- 172.21.15.44:0/4227443456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82bc003fd0 0x7f82d40ba1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:36:04.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.402+0000 7f82d37fe640 1 --2- 172.21.15.44:0/4227443456 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f82d414e940 0x7f82d414b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:36:04.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.402+0000 7f82d8c6e640 1 -- 172.21.15.44:0/4227443456 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f82d414e940 msgr2=0x7f82d414b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:36:04.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.402+0000 7f82d8c6e640 1 --2- 172.21.15.44:0/4227443456 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f82d414e940 0x7f82d414b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:36:04.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.402+0000 7f82d8c6e640 1 -- 172.21.15.44:0/4227443456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82bc003fd0 msgr2=0x7f82d40ba1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:36:04.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.402+0000 7f82d8c6e640 1 --2- 172.21.15.44:0/4227443456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82bc003fd0 0x7f82d40ba1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:36:04.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.402+0000 7f82d8c6e640 1 -- 172.21.15.44:0/4227443456 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82d40ba6e0 con 0x7f82d414b680 2024-05-16T22:36:04.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.402+0000 7f82d8c6e640 1 --2- 172.21.15.44:0/4227443456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82d414b680 0x7f82d41e7790 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f82d408daf0 tx=0x7f82cc010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:36:04.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.402+0000 7f82d0ff9640 1 -- 172.21.15.44:0/4227443456 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82cc010d80 con 0x7f82d414b680 2024-05-16T22:36:04.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.403+0000 7f82d0ff9640 1 -- 172.21.15.44:0/4227443456 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82cc003990 con 0x7f82d414b680 2024-05-16T22:36:05.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.403+0000 7f82da6d1640 1 -- 172.21.15.44:0/4227443456 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82d40b7b50 con 0x7f82d414b680 2024-05-16T22:36:05.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.403+0000 7f82d0ff9640 1 -- 172.21.15.44:0/4227443456 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82cc003dc0 con 0x7f82d414b680 2024-05-16T22:36:05.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.403+0000 7f82da6d1640 1 -- 172.21.15.44:0/4227443456 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82d40b8670 con 0x7f82d414b680 2024-05-16T22:36:05.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.404+0000 7f82da6d1640 1 -- 172.21.15.44:0/4227443456 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82d40c26b0 con 0x7f82d414b680 2024-05-16T22:36:05.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.404+0000 7f82d0ff9640 1 -- 172.21.15.44:0/4227443456 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f82cc01e030 con 0x7f82d414b680 2024-05-16T22:36:05.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.405+0000 7f82d0ff9640 1 --2- 172.21.15.44:0/4227443456 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f82c0076300 0x7f82c0078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:36:05.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.405+0000 7f82d0ff9640 1 -- 172.21.15.44:0/4227443456 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5501+0+0 (secure 0 0 0) 0x7f82cc097a20 con 0x7f82d414b680 2024-05-16T22:36:05.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.405+0000 7f82d3fff640 1 --2- 172.21.15.44:0/4227443456 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f82c0076300 0x7f82c0078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:36:05.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.405+0000 7f82d3fff640 1 --2- 172.21.15.44:0/4227443456 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f82c0076300 0x7f82c0078810 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f82c4009dc0 tx=0x7f82c4009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:36:05.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.410+0000 7f82d0ff9640 1 -- 172.21.15.44:0/4227443456 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f82cc025020 con 0x7f82d414b680 2024-05-16T22:36:05.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.600+0000 7f82da6d1640 1 -- 172.21.15.44:0/4227443456 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f82d4050940 con 0x7f82d414b680 2024-05-16T22:36:05.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.800+0000 7f82d0ff9640 1 -- 172.21.15.44:0/4227443456 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v54) ==== 169+0+0 (secure 0 0 0) 0x7f82d40ba6e0 con 0x7f82d414b680 2024-05-16T22:36:05.492 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' removed 2024-05-16T22:36:05.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.803+0000 7f82da6d1640 1 -- 172.21.15.44:0/4227443456 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f82c0076300 msgr2=0x7f82c0078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:36:05.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.803+0000 7f82da6d1640 1 --2- 172.21.15.44:0/4227443456 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f82c0076300 0x7f82c0078810 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f82c4009dc0 tx=0x7f82c4009190 comp rx=0 tx=0).stop 2024-05-16T22:36:05.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.803+0000 7f82da6d1640 1 -- 172.21.15.44:0/4227443456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82d414b680 msgr2=0x7f82d41e7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:36:05.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.803+0000 7f82da6d1640 1 --2- 172.21.15.44:0/4227443456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82d414b680 0x7f82d41e7790 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f82d408daf0 tx=0x7f82cc010590 comp rx=0 tx=0).stop 2024-05-16T22:36:05.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.803+0000 7f82da6d1640 1 -- 172.21.15.44:0/4227443456 shutdown_connections 2024-05-16T22:36:05.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.803+0000 7f82da6d1640 1 --2- 172.21.15.44:0/4227443456 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f82c0076300 0x7f82c0078810 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:36:05.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.803+0000 7f82da6d1640 1 --2- 172.21.15.44:0/4227443456 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f82d414e940 0x7f82d414b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:36:05.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.803+0000 7f82da6d1640 1 --2- 172.21.15.44:0/4227443456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82d414b680 0x7f82d41e7790 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:36:05.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.803+0000 7f82da6d1640 1 --2- 172.21.15.44:0/4227443456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82bc003fd0 0x7f82d40ba1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:36:05.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.803+0000 7f82da6d1640 1 -- 172.21.15.44:0/4227443456 >> 172.21.15.44:0/4227443456 conn(0x7f82d40c3d20 msgr2=0x7f82d40a4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:36:05.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.804+0000 7f82da6d1640 1 -- 172.21.15.44:0/4227443456 shutdown_connections 2024-05-16T22:36:05.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:02.804+0000 7f82da6d1640 1 -- 172.21.15.44:0/4227443456 wait complete. 2024-05-16T22:36:05.968 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-16T22:36:06.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.130+0000 7f78b592d640 1 Processor -- start 2024-05-16T22:36:06.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.130+0000 7f78b592d640 1 -- start start 2024-05-16T22:36:06.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.131+0000 7f78b592d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f78b0148770 0x7f78b00c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:36:06.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.131+0000 7f78b592d640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78b00c0620 con 0x7f78b00bf9b0 2024-05-16T22:36:06.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.131+0000 7f78b592d640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78b0151ad0 con 0x7f78b014e360 2024-05-16T22:36:06.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.131+0000 7f78b592d640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f78b0151e40 con 0x7f78b0148770 2024-05-16T22:36:06.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.131+0000 7f78af7fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f78b00bf9b0 0x7f78b00bfdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44760/0 (socket says 172.21.15.44:44760) 2024-05-16T22:36:06.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.131+0000 7f78af7fe640 1 -- 172.21.15.44:0/2505021571 learned_addr learned my addr 172.21.15.44:0/2505021571 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:36:06.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.131+0000 7f78a7fff640 1 --2- 172.21.15.44:0/2505021571 >> v2:172.21.15.70:3300/0 conn(0x7f78b0148770 0x7f78b00c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:36:06.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.132+0000 7f78ae7fc640 1 -- 172.21.15.44:0/2505021571 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3855490236 0 0) 0x7f78b00c0620 con 0x7f78b00bf9b0 2024-05-16T22:36:06.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.132+0000 7f78ae7fc640 1 -- 172.21.15.44:0/2505021571 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f789c003520 con 0x7f78b00bf9b0 2024-05-16T22:36:06.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.132+0000 7f78ae7fc640 1 -- 172.21.15.44:0/2505021571 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2103557867 0 0) 0x7f78b0151ad0 con 0x7f78b014e360 2024-05-16T22:36:06.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.132+0000 7f78ae7fc640 1 -- 172.21.15.44:0/2505021571 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78b00c0620 con 0x7f78b014e360 2024-05-16T22:36:06.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.132+0000 7f78a7fff640 1 -- 172.21.15.44:0/2505021571 >> v1:172.21.15.70:6789/0 conn(0x7f78b014e360 legacy=0x7f78b01522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:36:06.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.132+0000 7f78a7fff640 1 -- 172.21.15.44:0/2505021571 >> v1:172.21.15.44:6789/0 conn(0x7f78b00bf9b0 legacy=0x7f78b00bfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:36:06.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.132+0000 7f78ae7fc640 1 -- 172.21.15.44:0/2505021571 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3347622861 0 0) 0x7f789c003520 con 0x7f78b00bf9b0 2024-05-16T22:36:06.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.132+0000 7f78a7fff640 1 -- 172.21.15.44:0/2505021571 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b00c11c0 con 0x7f78b0148770 2024-05-16T22:36:06.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.133+0000 7f78a7fff640 1 --2- 172.21.15.44:0/2505021571 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78b0148770 0x7f78b00c0c80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f78980097d0 tx=0x7f789802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8977e54c17382a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:36:06.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.133+0000 7f78ae7fc640 1 -- 172.21.15.44:0/2505021571 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7898037070 con 0x7f78b0148770 2024-05-16T22:36:06.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.133+0000 7f78ae7fc640 1 -- 172.21.15.44:0/2505021571 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f789802ad00 con 0x7f78b0148770 2024-05-16T22:36:06.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.133+0000 7f78ae7fc640 1 -- 172.21.15.44:0/2505021571 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a8001a70 con 0x7f78b0148770 2024-05-16T22:36:06.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.134+0000 7f78b592d640 1 -- 172.21.15.44:0/2505021571 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78b0148770 msgr2=0x7f78b00c0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:36:06.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.134+0000 7f78b592d640 1 --2- 172.21.15.44:0/2505021571 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78b0148770 0x7f78b00c0c80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f78980097d0 tx=0x7f789802a270 comp rx=0 tx=0).stop 2024-05-16T22:36:06.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.134+0000 7f78b592d640 1 -- 172.21.15.44:0/2505021571 shutdown_connections 2024-05-16T22:36:07.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.134+0000 7f78b592d640 1 --2- 172.21.15.44:0/2505021571 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78b0148770 0x7f78b00c0c80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:36:07.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.134+0000 7f78b592d640 1 -- 172.21.15.44:0/2505021571 >> 172.21.15.44:0/2505021571 conn(0x7f78b00c17c0 msgr2=0x7f78b00c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:36:07.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.134+0000 7f78b592d640 1 -- 172.21.15.44:0/2505021571 shutdown_connections 2024-05-16T22:36:07.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.134+0000 7f78b592d640 1 -- 172.21.15.44:0/2505021571 wait complete. 2024-05-16T22:36:07.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.135+0000 7f78b592d640 1 Processor -- start 2024-05-16T22:36:07.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.136+0000 7f78b592d640 1 -- start start 2024-05-16T22:36:07.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.137+0000 7f78b592d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78b00bf9b0 0x7f78b0150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:36:07.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.137+0000 7f78b592d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78b0148770 0x7f78b01402d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:36:07.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.137+0000 7f78b592d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f78b014e360 0x7f78b013aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:36:07.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.137+0000 7f78b592d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f78b015a060 con 0x7f78b0148770 2024-05-16T22:36:07.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.137+0000 7f78b592d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f78b0159ee0 con 0x7f78b00bf9b0 2024-05-16T22:36:07.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.137+0000 7f78b592d640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f78b015a1e0 con 0x7f78b014e360 2024-05-16T22:36:07.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.137+0000 7f78a7fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78b0148770 0x7f78b01402d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:36:07.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.137+0000 7f78a7fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78b0148770 0x7f78b01402d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37584/0 (socket says 172.21.15.44:37584) 2024-05-16T22:36:07.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.137+0000 7f78a7fff640 1 -- 172.21.15.44:0/2086765799 learned_addr learned my addr 172.21.15.44:0/2086765799 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:36:07.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.137+0000 7f78aeffd640 1 --2- 172.21.15.44:0/2086765799 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78b00bf9b0 0x7f78b0150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:36:07.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.137+0000 7f78af7fe640 1 --2- 172.21.15.44:0/2086765799 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f78b014e360 0x7f78b013aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:36:07.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.137+0000 7f78a7fff640 1 -- 172.21.15.44:0/2086765799 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f78b014e360 msgr2=0x7f78b013aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:36:07.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.137+0000 7f78a7fff640 1 --2- 172.21.15.44:0/2086765799 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f78b014e360 0x7f78b013aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:36:07.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.137+0000 7f78a7fff640 1 -- 172.21.15.44:0/2086765799 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78b00bf9b0 msgr2=0x7f78b0150710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:36:07.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.137+0000 7f78a7fff640 1 --2- 172.21.15.44:0/2086765799 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78b00bf9b0 0x7f78b0150710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:36:07.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.137+0000 7f78a7fff640 1 -- 172.21.15.44:0/2086765799 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b0150c50 con 0x7f78b0148770 2024-05-16T22:36:07.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.137+0000 7f78af7fe640 1 --2- 172.21.15.44:0/2086765799 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f78b014e360 0x7f78b013aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:36:07.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.137+0000 7f78a7fff640 1 --2- 172.21.15.44:0/2086765799 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78b0148770 0x7f78b01402d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f7898000c00 tx=0x7f78980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:36:07.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.137+0000 7f78acff9640 1 -- 172.21.15.44:0/2086765799 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7898041020 con 0x7f78b0148770 2024-05-16T22:36:07.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.137+0000 7f78acff9640 1 -- 172.21.15.44:0/2086765799 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f789803d620 con 0x7f78b0148770 2024-05-16T22:36:08.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.137+0000 7f78acff9640 1 -- 172.21.15.44:0/2086765799 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7898037040 con 0x7f78b0148770 2024-05-16T22:36:08.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.137+0000 7f78b592d640 1 -- 172.21.15.44:0/2086765799 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78b0140810 con 0x7f78b0148770 2024-05-16T22:36:08.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.138+0000 7f78b592d640 1 -- 172.21.15.44:0/2086765799 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78b014fbb0 con 0x7f78b0148770 2024-05-16T22:36:08.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.138+0000 7f78b592d640 1 -- 172.21.15.44:0/2086765799 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78b014d580 con 0x7f78b0148770 2024-05-16T22:36:08.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.139+0000 7f78acff9640 1 -- 172.21.15.44:0/2086765799 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7898044020 con 0x7f78b0148770 2024-05-16T22:36:08.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.140+0000 7f78acff9640 1 --2- 172.21.15.44:0/2086765799 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f7890076300 0x7f7890078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:36:08.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.140+0000 7f78acff9640 1 -- 172.21.15.44:0/2086765799 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5029+0+0 (secure 0 0 0) 0x7f78980b7530 con 0x7f78b0148770 2024-05-16T22:36:08.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.140+0000 7f78aeffd640 1 --2- 172.21.15.44:0/2086765799 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f7890076300 0x7f7890078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:36:08.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.140+0000 7f78aeffd640 1 --2- 172.21.15.44:0/2086765799 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f7890076300 0x7f7890078810 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f78a0001120 tx=0x7f78a0009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:36:08.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.145+0000 7f78acff9640 1 -- 172.21.15.44:0/2086765799 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f78b014d580 con 0x7f78b0148770 2024-05-16T22:36:08.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.335+0000 7f78b592d640 1 -- 172.21.15.44:0/2086765799 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f78b0050940 con 0x7f78b0148770 2024-05-16T22:36:08.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.338+0000 7f78acff9640 1 -- 172.21.15.44:0/2086765799 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) ==== 104+0+0 (secure 0 0 0) 0x7f789804b070 con 0x7f78b0148770 2024-05-16T22:36:08.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.340+0000 7f78b592d640 1 -- 172.21.15.44:0/2086765799 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f7890076300 msgr2=0x7f7890078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:36:08.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.340+0000 7f78b592d640 1 --2- 172.21.15.44:0/2086765799 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f7890076300 0x7f7890078810 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f78a0001120 tx=0x7f78a0009040 comp rx=0 tx=0).stop 2024-05-16T22:36:08.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.340+0000 7f78b592d640 1 -- 172.21.15.44:0/2086765799 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78b0148770 msgr2=0x7f78b01402d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:36:08.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.340+0000 7f78b592d640 1 --2- 172.21.15.44:0/2086765799 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78b0148770 0x7f78b01402d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f7898000c00 tx=0x7f78980046c0 comp rx=0 tx=0).stop 2024-05-16T22:36:08.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.340+0000 7f78b592d640 1 -- 172.21.15.44:0/2086765799 shutdown_connections 2024-05-16T22:36:08.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.340+0000 7f78b592d640 1 --2- 172.21.15.44:0/2086765799 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f7890076300 0x7f7890078810 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:36:08.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.340+0000 7f78b592d640 1 --2- 172.21.15.44:0/2086765799 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f78b014e360 0x7f78b013aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:36:08.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.340+0000 7f78b592d640 1 --2- 172.21.15.44:0/2086765799 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78b0148770 0x7f78b01402d0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:36:08.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.340+0000 7f78b592d640 1 --2- 172.21.15.44:0/2086765799 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78b00bf9b0 0x7f78b0150710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:36:08.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.340+0000 7f78b592d640 1 -- 172.21.15.44:0/2086765799 >> 172.21.15.44:0/2086765799 conn(0x7f78b00c17c0 msgr2=0x7f78b00bfdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:36:08.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.340+0000 7f78b592d640 1 -- 172.21.15.44:0/2086765799 shutdown_connections 2024-05-16T22:36:08.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:06.340+0000 7f78b592d640 1 -- 172.21.15.44:0/2086765799 wait complete. 2024-05-16T22:36:08.946 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_fscrypt.TestFSCryptRecovery.test_fscrypt_journal_recovery' 2024-05-16T22:36:09.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.107+0000 7ff0a360c640 1 Processor -- start 2024-05-16T22:36:09.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.107+0000 7ff0a360c640 1 -- start start 2024-05-16T22:36:09.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.108+0000 7ff0a360c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff09c14cce0 0x7ff09c0716a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:36:09.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.108+0000 7ff0a360c640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff09c0720d0 con 0x7ff09c0be4f0 2024-05-16T22:36:09.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.108+0000 7ff0a360c640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff09c0bf6f0 con 0x7ff09c071be0 2024-05-16T22:36:09.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.108+0000 7ff0a360c640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7ff09c0bfa60 con 0x7ff09c14cce0 2024-05-16T22:36:09.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.108+0000 7ff0a13a8640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ff09c0be4f0 0x7ff09c0bfef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44772/0 (socket says 172.21.15.44:44772) 2024-05-16T22:36:09.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.108+0000 7ff0a13a8640 1 -- 172.21.15.44:0/3074969009 learned_addr learned my addr 172.21.15.44:0/3074969009 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T22:36:09.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.108+0000 7ff0a0ba7640 1 --2- 172.21.15.44:0/3074969009 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff09c14cce0 0x7ff09c0716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:36:09.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.108+0000 7ff093fff640 1 -- 172.21.15.44:0/3074969009 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2101228177 0 0) 0x7ff09c0720d0 con 0x7ff09c0be4f0 2024-05-16T22:36:09.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.108+0000 7ff093fff640 1 -- 172.21.15.44:0/3074969009 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff088003520 con 0x7ff09c0be4f0 2024-05-16T22:36:09.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.109+0000 7ff093fff640 1 -- 172.21.15.44:0/3074969009 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3509165712 0 0) 0x7ff09c0bf6f0 con 0x7ff09c071be0 2024-05-16T22:36:09.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.109+0000 7ff093fff640 1 -- 172.21.15.44:0/3074969009 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff09c0720d0 con 0x7ff09c071be0 2024-05-16T22:36:09.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.109+0000 7ff093fff640 1 -- 172.21.15.44:0/3074969009 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3927369079 0 0) 0x7ff088003520 con 0x7ff09c0be4f0 2024-05-16T22:36:09.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.109+0000 7ff0a0ba7640 1 -- 172.21.15.44:0/3074969009 >> v1:172.21.15.70:6789/0 conn(0x7ff09c071be0 legacy=0x7ff09c156cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:36:09.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.109+0000 7ff0a0ba7640 1 -- 172.21.15.44:0/3074969009 >> v1:172.21.15.44:6789/0 conn(0x7ff09c0be4f0 legacy=0x7ff09c0bfef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:36:09.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.109+0000 7ff0a0ba7640 1 -- 172.21.15.44:0/3074969009 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff09c0be900 con 0x7ff09c14cce0 2024-05-16T22:36:09.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.109+0000 7ff0a0ba7640 1 --2- 172.21.15.44:0/3074969009 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff09c14cce0 0x7ff09c0716a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff08c0097d0 tx=0x7ff08c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f854f4d741dcdda8 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:36:09.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.110+0000 7ff093fff640 1 -- 172.21.15.44:0/3074969009 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff08c037070 con 0x7ff09c14cce0 2024-05-16T22:36:09.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.110+0000 7ff093fff640 1 -- 172.21.15.44:0/3074969009 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff08c02ab90 con 0x7ff09c14cce0 2024-05-16T22:36:09.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.110+0000 7ff093fff640 1 -- 172.21.15.44:0/3074969009 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0980016f0 con 0x7ff09c14cce0 2024-05-16T22:36:09.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.110+0000 7ff0a360c640 1 -- 172.21.15.44:0/3074969009 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff09c14cce0 msgr2=0x7ff09c0716a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:36:09.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.110+0000 7ff0a360c640 1 --2- 172.21.15.44:0/3074969009 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff09c14cce0 0x7ff09c0716a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff08c0097d0 tx=0x7ff08c02a100 comp rx=0 tx=0).stop 2024-05-16T22:36:09.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.110+0000 7ff0a360c640 1 -- 172.21.15.44:0/3074969009 shutdown_connections 2024-05-16T22:36:09.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.110+0000 7ff0a360c640 1 --2- 172.21.15.44:0/3074969009 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff09c14cce0 0x7ff09c0716a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:36:09.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.110+0000 7ff0a360c640 1 -- 172.21.15.44:0/3074969009 >> 172.21.15.44:0/3074969009 conn(0x7ff09c0c17c0 msgr2=0x7ff09c0c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:36:10.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.110+0000 7ff0a360c640 1 -- 172.21.15.44:0/3074969009 shutdown_connections 2024-05-16T22:36:10.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.110+0000 7ff0a360c640 1 -- 172.21.15.44:0/3074969009 wait complete. 2024-05-16T22:36:10.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.112+0000 7ff0a360c640 1 Processor -- start 2024-05-16T22:36:10.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.112+0000 7ff0a360c640 1 -- start start 2024-05-16T22:36:10.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.113+0000 7ff0a360c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff09c071be0 0x7ff09c1e22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:36:10.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.113+0000 7ff0a360c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff09c0be4f0 0x7ff09c09d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:36:10.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.113+0000 7ff0a360c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff09c14cce0 0x7ff09c09c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:36:10.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.113+0000 7ff0a360c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff09c0723b0 con 0x7ff09c0be4f0 2024-05-16T22:36:10.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.113+0000 7ff0a360c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff09c071310 con 0x7ff09c071be0 2024-05-16T22:36:10.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.113+0000 7ff0a360c640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7ff09c0bc1c0 con 0x7ff09c14cce0 2024-05-16T22:36:10.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.113+0000 7ff0a0ba7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff09c0be4f0 0x7ff09c09d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:36:10.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.113+0000 7ff0a0ba7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff09c0be4f0 0x7ff09c09d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37598/0 (socket says 172.21.15.44:37598) 2024-05-16T22:36:10.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.113+0000 7ff0a0ba7640 1 -- 172.21.15.44:0/1016894676 learned_addr learned my addr 172.21.15.44:0/1016894676 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T22:36:10.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.114+0000 7ff0a13a8640 1 --2- 172.21.15.44:0/1016894676 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff09c071be0 0x7ff09c1e22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:36:10.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.114+0000 7ff0a1ba9640 1 --2- 172.21.15.44:0/1016894676 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff09c14cce0 0x7ff09c09c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:36:10.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.114+0000 7ff0a0ba7640 1 -- 172.21.15.44:0/1016894676 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff09c14cce0 msgr2=0x7ff09c09c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:36:10.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.114+0000 7ff0a0ba7640 1 --2- 172.21.15.44:0/1016894676 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff09c14cce0 0x7ff09c09c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:36:10.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.114+0000 7ff0a0ba7640 1 -- 172.21.15.44:0/1016894676 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff09c071be0 msgr2=0x7ff09c1e22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:36:10.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.114+0000 7ff0a0ba7640 1 --2- 172.21.15.44:0/1016894676 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff09c071be0 0x7ff09c1e22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:36:10.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.114+0000 7ff0a0ba7640 1 -- 172.21.15.44:0/1016894676 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff09c1e27e0 con 0x7ff09c0be4f0 2024-05-16T22:36:10.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.114+0000 7ff0a13a8640 1 --2- 172.21.15.44:0/1016894676 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff09c071be0 0x7ff09c1e22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:36:10.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.114+0000 7ff0a1ba9640 1 --2- 172.21.15.44:0/1016894676 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff09c14cce0 0x7ff09c09c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T22:36:10.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.114+0000 7ff0a0ba7640 1 --2- 172.21.15.44:0/1016894676 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff09c0be4f0 0x7ff09c09d890 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff08c0097d0 tx=0x7ff08c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:36:10.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.114+0000 7ff091ffb640 1 -- 172.21.15.44:0/1016894676 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff08c037050 con 0x7ff09c0be4f0 2024-05-16T22:36:10.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.114+0000 7ff091ffb640 1 -- 172.21.15.44:0/1016894676 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff08c043070 con 0x7ff09c0be4f0 2024-05-16T22:36:10.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.114+0000 7ff0a360c640 1 -- 172.21.15.44:0/1016894676 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff09c1d3fa0 con 0x7ff09c0be4f0 2024-05-16T22:36:10.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.114+0000 7ff091ffb640 1 -- 172.21.15.44:0/1016894676 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff08c006e10 con 0x7ff09c0be4f0 2024-05-16T22:36:10.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.114+0000 7ff0a360c640 1 -- 172.21.15.44:0/1016894676 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff09c09d200 con 0x7ff09c0be4f0 2024-05-16T22:36:11.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.116+0000 7ff0a360c640 1 -- 172.21.15.44:0/1016894676 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff09c09d440 con 0x7ff09c0be4f0 2024-05-16T22:36:11.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.116+0000 7ff091ffb640 1 -- 172.21.15.44:0/1016894676 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff08c03ca30 con 0x7ff09c0be4f0 2024-05-16T22:36:11.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.117+0000 7ff091ffb640 1 --2- 172.21.15.44:0/1016894676 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7ff0800762d0 0x7ff0800787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T22:36:11.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.117+0000 7ff091ffb640 1 -- 172.21.15.44:0/1016894676 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5029+0+0 (secure 0 0 0) 0x7ff08c0b7d90 con 0x7ff09c0be4f0 2024-05-16T22:36:11.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.117+0000 7ff0a13a8640 1 --2- 172.21.15.44:0/1016894676 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7ff0800762d0 0x7ff0800787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T22:36:11.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.118+0000 7ff0a13a8640 1 --2- 172.21.15.44:0/1016894676 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7ff0800762d0 0x7ff0800787e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff0980013c0 tx=0x7ff098009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T22:36:11.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.121+0000 7ff091ffb640 1 -- 172.21.15.44:0/1016894676 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff08c081a20 con 0x7ff09c0be4f0 2024-05-16T22:36:11.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.388+0000 7ff0a360c640 1 -- 172.21.15.44:0/1016894676 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_fscrypt.TestFSCryptRecovery.test_fscrypt_journal_recovery"]} v 0) -- 0x7ff09c050940 con 0x7ff09c0be4f0 2024-05-16T22:36:11.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.810+0000 7ff091ffb640 1 -- 172.21.15.44:0/1016894676 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_fscrypt.TestFSCryptRecovery.test_fscrypt_journal_recovery"]}]=0 v358) ==== 154+0+0 (secure 0 0 0) 0x7ff08c081320 con 0x7ff09c0be4f0 2024-05-16T22:36:11.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.813+0000 7ff0a360c640 1 -- 172.21.15.44:0/1016894676 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7ff0800762d0 msgr2=0x7ff0800787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:36:11.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.813+0000 7ff0a360c640 1 --2- 172.21.15.44:0/1016894676 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7ff0800762d0 0x7ff0800787e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff0980013c0 tx=0x7ff098009040 comp rx=0 tx=0).stop 2024-05-16T22:36:11.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.813+0000 7ff0a360c640 1 -- 172.21.15.44:0/1016894676 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff09c0be4f0 msgr2=0x7ff09c09d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T22:36:11.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.813+0000 7ff0a360c640 1 --2- 172.21.15.44:0/1016894676 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff09c0be4f0 0x7ff09c09d890 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff08c0097d0 tx=0x7ff08c0046c0 comp rx=0 tx=0).stop 2024-05-16T22:36:11.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.813+0000 7ff0a360c640 1 -- 172.21.15.44:0/1016894676 shutdown_connections 2024-05-16T22:36:11.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.813+0000 7ff0a360c640 1 --2- 172.21.15.44:0/1016894676 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7ff0800762d0 0x7ff0800787e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:36:11.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.813+0000 7ff0a360c640 1 --2- 172.21.15.44:0/1016894676 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff09c14cce0 0x7ff09c09c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:36:11.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.813+0000 7ff0a360c640 1 --2- 172.21.15.44:0/1016894676 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff09c0be4f0 0x7ff09c09d890 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:36:11.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.813+0000 7ff0a360c640 1 --2- 172.21.15.44:0/1016894676 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff09c071be0 0x7ff09c1e22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T22:36:11.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.813+0000 7ff0a360c640 1 -- 172.21.15.44:0/1016894676 >> 172.21.15.44:0/1016894676 conn(0x7ff09c0c17c0 msgr2=0x7ff09c1d8aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T22:36:11.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.813+0000 7ff0a360c640 1 -- 172.21.15.44:0/1016894676 shutdown_connections 2024-05-16T22:36:11.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T22:36:09.813+0000 7ff0a360c640 1 -- 172.21.15.44:0/1016894676 wait complete. 2024-05-16T22:36:11.757 INFO:tasks.cephfs_test_runner:That alternate_name can be recovered from the journal. ... FAIL 2024-05-16T22:36:11.790 INFO:tasks.cephfs_test_runner: 2024-05-16T22:36:11.824 INFO:tasks.cephfs_test_runner:====================================================================== 2024-05-16T22:36:11.856 INFO:tasks.cephfs_test_runner:FAIL: test_fscrypt_journal_recovery (tasks.cephfs.test_fscrypt.TestFSCryptRecovery) 2024-05-16T22:36:11.890 INFO:tasks.cephfs_test_runner:That alternate_name can be recovered from the journal. 2024-05-16T22:36:11.923 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-16T22:36:11.957 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-05-16T22:36:11.994 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_4d9eb97fa160d2c19d1436d63c7ffea8b5461de0/qa/tasks/cephfs/test_fscrypt.py", line 87, in test_fscrypt_journal_recovery 2024-05-16T22:36:12.057 INFO:tasks.cephfs_test_runner: verify_alternate_name() 2024-05-16T22:36:12.090 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_4d9eb97fa160d2c19d1436d63c7ffea8b5461de0/qa/tasks/cephfs/test_fscrypt.py", line 75, in verify_alternate_name 2024-05-16T22:36:12.123 INFO:tasks.cephfs_test_runner: self.assertGreater(len(alternate_name), 240) 2024-05-16T22:36:12.232 INFO:tasks.cephfs_test_runner:AssertionError: 0 not greater than 240 2024-05-16T22:36:12.265 INFO:tasks.cephfs_test_runner: 2024-05-16T22:36:12.299 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-16T22:36:12.332 INFO:tasks.cephfs_test_runner:Ran 2 tests in 509.477s 2024-05-16T22:36:12.365 INFO:tasks.cephfs_test_runner: 2024-05-16T22:36:12.399 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 2024-05-16T22:36:12.468 INFO:tasks.cephfs_test_runner: 2024-05-16T22:36:12.507 INFO:tasks.cephfs_test_runner:====================================================================== 2024-05-16T22:36:12.540 INFO:tasks.cephfs_test_runner:FAIL: test_fscrypt_journal_recovery (tasks.cephfs.test_fscrypt.TestFSCryptRecovery) 2024-05-16T22:36:12.574 INFO:tasks.cephfs_test_runner:That alternate_name can be recovered from the journal. 2024-05-16T22:36:12.607 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-16T22:36:12.640 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-05-16T22:36:12.674 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_4d9eb97fa160d2c19d1436d63c7ffea8b5461de0/qa/tasks/cephfs/test_fscrypt.py", line 87, in test_fscrypt_journal_recovery 2024-05-16T22:36:12.727 INFO:tasks.cephfs_test_runner: verify_alternate_name() 2024-05-16T22:36:12.766 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_4d9eb97fa160d2c19d1436d63c7ffea8b5461de0/qa/tasks/cephfs/test_fscrypt.py", line 75, in verify_alternate_name 2024-05-16T22:36:12.799 INFO:tasks.cephfs_test_runner: self.assertGreater(len(alternate_name), 240) 2024-05-16T22:36:12.832 INFO:tasks.cephfs_test_runner:AssertionError: 0 not greater than 240 2024-05-16T22:36:12.866 INFO:tasks.cephfs_test_runner: 2024-05-16T22:36:12.899 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_08ca1187b5d019c0ae6c90488c6c9faaace42185/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_4d9eb97fa160d2c19d1436d63c7ffea8b5461de0/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_fscrypt_journal_recovery (tasks.cephfs.test_fscrypt.TestFSCryptRecovery) 2024-05-16T22:36:13.160 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=218c144c0aa5444ab63abfed2bccb8a7 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_08ca1187b5d019c0ae6c90488c6c9faaace42185/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_4d9eb97fa160d2c19d1436d63c7ffea8b5461de0/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_fscrypt_journal_recovery (tasks.cephfs.test_fscrypt.TestFSCryptRecovery) 2024-05-16T22:36:13.226 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-05-16T22:36:13.266 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-05-16T22:36:13.299 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task sleep... 2024-05-16T22:36:13.325 INFO:teuthology.task.sleep:Sleeping for 3600 seconds 2024-05-16T22:36:13.788 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:36:13.827 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:36:13.860 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:36:44.006 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:36:44.076 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:36:44.147 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:37:14.302 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:37:14.352 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:37:14.385 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:37:44.547 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:37:44.598 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:37:44.630 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:38:14.793 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:38:14.834 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:38:14.867 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:38:45.046 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:38:45.105 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:38:45.137 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:39:15.292 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:39:15.334 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:39:15.366 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:39:45.519 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:39:45.593 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:39:45.628 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:40:15.790 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:40:15.824 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:40:15.856 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:40:46.010 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:40:46.053 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:40:46.085 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:41:16.246 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:41:16.290 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:41:16.322 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:41:46.457 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:41:46.511 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:41:46.543 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:42:16.697 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:42:16.747 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:42:16.780 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:42:46.942 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:42:46.984 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:42:47.017 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:43:17.171 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:43:17.221 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:43:17.253 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:43:47.424 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:43:47.474 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:43:47.508 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:44:17.669 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:44:17.712 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:44:17.745 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:44:47.906 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:44:47.949 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:44:47.981 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:45:18.134 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:45:18.169 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:45:18.202 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:45:48.356 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:45:48.390 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:45:48.422 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:46:18.602 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:46:18.660 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:46:18.692 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:46:48.838 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:46:48.871 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:46:48.904 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:47:19.050 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:47:19.092 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:47:19.124 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:47:49.279 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:47:49.338 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:47:49.370 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:48:19.517 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:48:19.550 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:48:19.582 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:48:49.739 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:48:49.775 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:48:49.808 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:49:19.967 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:49:20.021 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:49:20.054 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:49:50.221 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:49:50.258 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:49:50.291 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:50:20.450 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:50:20.470 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:50:20.502 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:50:50.652 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:50:50.682 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:50:50.714 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:51:20.856 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:51:20.927 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:51:20.960 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:51:51.111 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:51:51.149 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:51:51.197 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:52:21.347 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:52:21.445 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:52:21.477 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:52:51.634 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:52:51.688 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:52:51.709 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:53:21.888 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:53:21.937 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:53:21.970 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:53:52.117 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:53:52.167 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:53:52.200 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:54:22.353 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:54:22.388 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:54:22.438 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:54:52.580 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:54:52.634 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:54:52.667 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:55:22.818 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:55:22.848 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:55:22.878 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:55:53.029 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:55:53.066 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:55:53.099 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:56:23.284 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:56:23.312 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:56:23.344 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:56:53.496 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:56:53.549 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:56:53.581 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:57:23.732 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:57:23.778 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:57:23.826 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:57:53.985 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:57:54.032 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:57:54.082 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:58:24.238 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:58:24.286 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:58:24.319 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:58:54.468 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:58:54.515 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:58:54.548 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:59:24.704 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:59:24.761 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:59:24.793 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:59:54.941 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:59:55.013 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T22:59:55.046 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:00:25.202 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:00:25.245 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:00:25.275 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:00:55.423 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:00:55.480 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:00:55.512 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:01:25.659 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:01:25.717 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:01:25.750 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:01:55.906 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:01:55.945 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:01:55.977 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:02:26.368 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:02:26.407 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:02:26.439 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:02:56.588 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:02:56.619 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:02:56.651 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:03:26.781 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:03:26.822 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:03:26.859 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:03:57.002 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:03:57.042 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:03:57.075 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:04:27.223 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:04:27.263 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:04:27.304 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:04:57.470 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:04:57.518 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:04:57.549 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:05:27.856 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:05:27.888 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:05:27.921 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:05:58.170 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:05:58.317 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:05:58.383 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:06:28.539 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:06:28.587 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:06:28.620 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:06:58.776 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:06:58.817 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:06:58.849 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:07:29.004 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:07:29.052 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:07:29.085 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:07:59.233 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:07:59.273 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:07:59.306 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:08:29.462 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:08:29.534 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:08:29.567 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:08:59.724 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:08:59.773 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:08:59.804 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:09:29.960 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:09:29.992 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:09:30.024 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:10:00.172 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:10:00.220 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:10:00.253 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:10:30.409 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:10:30.474 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:10:30.506 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:11:00.722 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:11:00.769 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:11:00.802 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:11:30.967 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:11:30.998 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:11:31.031 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:12:01.179 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:12:01.218 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:12:01.251 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:12:31.399 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:12:31.479 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:12:31.512 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:13:01.653 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:13:01.700 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:13:01.733 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:13:31.891 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:13:31.929 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:13:31.961 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:14:02.112 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:14:02.150 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:14:02.182 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:14:32.340 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:14:32.378 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:14:32.411 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:15:02.560 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:15:02.606 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:15:02.639 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:15:32.788 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:15:32.827 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:15:32.860 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:16:03.008 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:16:03.048 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:16:03.089 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:16:33.246 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:16:33.285 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:16:33.318 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:17:03.465 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:17:03.515 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:17:03.547 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:17:33.754 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:17:33.810 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:17:33.843 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:18:03.998 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:18:04.055 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:18:04.088 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:18:34.234 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:18:34.293 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:18:34.325 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:19:04.488 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:19:04.537 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:19:04.570 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:19:34.724 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:19:34.758 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:19:34.790 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:20:04.944 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:20:05.003 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:20:05.036 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:20:35.214 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:20:35.266 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:20:35.298 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:21:05.459 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:21:05.495 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:21:05.527 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:21:35.679 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:21:35.715 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:21:35.748 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:22:05.909 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:22:05.944 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:22:05.977 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:22:36.128 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:22:36.174 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:22:36.206 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:23:06.373 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:23:06.419 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:23:06.452 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:23:36.610 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:23:36.632 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:23:36.665 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:24:06.831 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:24:06.878 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:24:06.910 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:24:37.067 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:24:37.107 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:24:37.139 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:25:07.288 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:25:07.320 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:25:07.353 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:25:37.515 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:25:37.557 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:25:37.590 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:26:07.744 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:26:07.777 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:26:07.810 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:26:37.965 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:26:38.006 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:26:38.039 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:27:08.183 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:27:08.218 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:27:08.251 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:27:38.412 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:27:38.470 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:27:38.507 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:28:08.676 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:28:08.763 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:28:08.795 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:28:38.961 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:28:39.008 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:28:39.040 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:29:09.199 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:29:09.254 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:29:09.294 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:29:39.468 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:29:39.549 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:29:39.590 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:30:09.756 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:30:09.802 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:30:09.834 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:30:40.001 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:30:40.056 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:30:40.088 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:31:10.227 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:31:10.285 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:31:10.334 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:31:40.491 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:31:40.539 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:31:40.571 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:32:10.728 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:32:10.767 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:32:10.799 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:32:40.955 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:32:40.995 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:32:41.027 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:33:11.184 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:33:11.240 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:33:11.273 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:33:41.467 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:33:41.519 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:33:41.552 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:34:11.708 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:34:11.764 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:34:11.796 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:34:41.953 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:34:41.985 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:34:42.018 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:35:12.164 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:35:12.213 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:35:12.246 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:35:42.426 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:35:42.476 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:35:42.508 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:36:12.654 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:36:12.695 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:36:12.728 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:36:13.358 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-05-16T23:36:13.404 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-16T23:36:13.426 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-16T23:36:13.459 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-16T23:36:13.548 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-05-16T23:36:13.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T23:36:13.617 DEBUG:teuthology.orchestra.run.smithi196:> ip netns list 2024-05-16T23:36:13.713 INFO:teuthology.orchestra.run.smithi196.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-16T23:36:13.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T23:36:13.767 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-16T23:36:13.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-16T23:36:13.937 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link delete ceph-brx 2024-05-16T23:36:14.070 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-16T23:36:14.101 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-16T23:36:14.151 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-16T23:36:14.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.311+0000 7fd03a9f3640 1 Processor -- start 2024-05-16T23:36:14.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.311+0000 7fd03a9f3640 1 -- start start 2024-05-16T23:36:14.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.312+0000 7fd03a9f3640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd03414e360 0x7fd0341522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:14.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.312+0000 7fd03a9f3640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd0340bf9b0 0x7fd0340bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:14.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.312+0000 7fd03a9f3640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0340c1390 con 0x7fd034148770 2024-05-16T23:36:14.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.312+0000 7fd03a9f3640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fd034151e40 con 0x7fd0340bf9b0 2024-05-16T23:36:14.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.312+0000 7fd03a9f3640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fd0340c0620 con 0x7fd03414e360 2024-05-16T23:36:14.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.312+0000 7fd0337fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fd034148770 0x7fd0340c0c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:50124/0 (socket says 172.21.15.44:50124) 2024-05-16T23:36:14.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.312+0000 7fd0337fe640 1 -- 172.21.15.44:0/1966113209 learned_addr learned my addr 172.21.15.44:0/1966113209 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T23:36:14.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.312+0000 7fd033fff640 1 --2- 172.21.15.44:0/1966113209 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd03414e360 0x7fd0341522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:14.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.312+0000 7fd038f90640 1 --2- 172.21.15.44:0/1966113209 >> v2:172.21.15.70:3300/0 conn(0x7fd0340bf9b0 0x7fd0340bfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:14.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.312+0000 7fd032ffd640 1 -- 172.21.15.44:0/1966113209 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 56485734 0 0) 0x7fd028001110 con 0x7fd034148770 2024-05-16T23:36:14.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.312+0000 7fd032ffd640 1 -- 172.21.15.44:0/1966113209 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd01c003520 con 0x7fd034148770 2024-05-16T23:36:14.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.312+0000 7fd032ffd640 1 -- 172.21.15.44:0/1966113209 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3804082804 0 0) 0x7fd01c003520 con 0x7fd034148770 2024-05-16T23:36:14.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.312+0000 7fd032ffd640 1 -- 172.21.15.44:0/1966113209 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd03414e360 msgr2=0x7fd0341522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T23:36:14.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.312+0000 7fd032ffd640 1 --2- 172.21.15.44:0/1966113209 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd03414e360 0x7fd0341522d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:14.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.313+0000 7fd032ffd640 1 -- 172.21.15.44:0/1966113209 >> v2:172.21.15.70:3300/0 conn(0x7fd0340bf9b0 msgr2=0x7fd0340bfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T23:36:14.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.313+0000 7fd032ffd640 1 --2- 172.21.15.44:0/1966113209 >> v2:172.21.15.70:3300/0 conn(0x7fd0340bf9b0 0x7fd0340bfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:15.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.313+0000 7fd032ffd640 1 -- 172.21.15.44:0/1966113209 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd034151ad0 con 0x7fd034148770 2024-05-16T23:36:15.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.313+0000 7fd032ffd640 1 -- 172.21.15.44:0/1966113209 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 568431863 0 0) 0x7fd0280018c0 con 0x7fd034148770 2024-05-16T23:36:15.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.313+0000 7fd038f90640 1 --2- 172.21.15.44:0/1966113209 >> v2:172.21.15.70:3300/0 conn(0x7fd0340bf9b0 0x7fd0340bfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T23:36:15.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.313+0000 7fd033fff640 1 --2- 172.21.15.44:0/1966113209 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd03414e360 0x7fd0341522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T23:36:15.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.313+0000 7fd032ffd640 1 -- 172.21.15.44:0/1966113209 >> v1:172.21.15.44:6789/0 conn(0x7fd034148770 legacy=0x7fd0340c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:15.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.313+0000 7fd032ffd640 1 --2- 172.21.15.44:0/1966113209 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd03414e360 0x7fd01c003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:15.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.313+0000 7fd032ffd640 1 --2- 172.21.15.44:0/1966113209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd01c003fb0 0x7fd01c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:15.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.313+0000 7fd032ffd640 1 --2- 172.21.15.44:0/1966113209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd01c004d40 0x7fd01c005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:15.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.313+0000 7fd032ffd640 1 -- 172.21.15.44:0/1966113209 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd034151e40 con 0x7fd01c004d40 2024-05-16T23:36:15.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.313+0000 7fd032ffd640 1 -- 172.21.15.44:0/1966113209 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd0340c0620 con 0x7fd01c003fb0 2024-05-16T23:36:15.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.313+0000 7fd032ffd640 1 -- 172.21.15.44:0/1966113209 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fd01c00bb20 con 0x7fd03414e360 2024-05-16T23:36:15.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.313+0000 7fd038f90640 1 --2- 172.21.15.44:0/1966113209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd01c004d40 0x7fd01c005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:15.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.313+0000 7fd033fff640 1 --2- 172.21.15.44:0/1966113209 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd03414e360 0x7fd01c003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:15.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.313+0000 7fd0337fe640 1 --2- 172.21.15.44:0/1966113209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd01c003fb0 0x7fd01c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:15.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.313+0000 7fd038f90640 1 -- 172.21.15.44:0/1966113209 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd03414e360 msgr2=0x7fd01c003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T23:36:15.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.313+0000 7fd038f90640 1 --2- 172.21.15.44:0/1966113209 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd03414e360 0x7fd01c003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:15.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.313+0000 7fd038f90640 1 -- 172.21.15.44:0/1966113209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd01c003fb0 msgr2=0x7fd01c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T23:36:15.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.313+0000 7fd038f90640 1 --2- 172.21.15.44:0/1966113209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd01c003fb0 0x7fd01c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:15.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.313+0000 7fd038f90640 1 -- 172.21.15.44:0/1966113209 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd01c003520 con 0x7fd01c004d40 2024-05-16T23:36:15.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.314+0000 7fd038f90640 1 --2- 172.21.15.44:0/1966113209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd01c004d40 0x7fd01c005150 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd02c00e320 tx=0x7fd01c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48633c99b4b361b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:15.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.314+0000 7fd032ffd640 1 -- 172.21.15.44:0/1966113209 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd02c009de0 con 0x7fd01c004d40 2024-05-16T23:36:15.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.314+0000 7fd032ffd640 1 -- 172.21.15.44:0/1966113209 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd02c02c650 con 0x7fd01c004d40 2024-05-16T23:36:15.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.314+0000 7fd032ffd640 1 -- 172.21.15.44:0/1966113209 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd02c02ca00 con 0x7fd01c004d40 2024-05-16T23:36:15.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.315+0000 7fd03a9f3640 1 -- 172.21.15.44:0/1966113209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd01c004d40 msgr2=0x7fd01c005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:15.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.315+0000 7fd03a9f3640 1 --2- 172.21.15.44:0/1966113209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd01c004d40 0x7fd01c005150 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd02c00e320 tx=0x7fd01c005830 comp rx=0 tx=0).stop 2024-05-16T23:36:15.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.315+0000 7fd038f90640 1 -- 172.21.15.44:0/1966113209 reap_dead start 2024-05-16T23:36:15.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.315+0000 7fd03a9f3640 1 -- 172.21.15.44:0/1966113209 shutdown_connections 2024-05-16T23:36:15.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.315+0000 7fd03a9f3640 1 -- 172.21.15.44:0/1966113209 >> 172.21.15.44:0/1966113209 conn(0x7fd0340c17c0 msgr2=0x7fd0340c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T23:36:16.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.315+0000 7fd03a9f3640 1 -- 172.21.15.44:0/1966113209 shutdown_connections 2024-05-16T23:36:16.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.315+0000 7fd03a9f3640 1 -- 172.21.15.44:0/1966113209 wait complete. 2024-05-16T23:36:16.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.316+0000 7fd03a9f3640 1 Processor -- start 2024-05-16T23:36:16.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.317+0000 7fd03a9f3640 1 -- start start 2024-05-16T23:36:16.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.318+0000 7fd03a9f3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd01c004d40 0x7fd0341d8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:16.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.318+0000 7fd03a9f3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0341d9ce0 0x7fd0341da0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:16.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.318+0000 7fd03a9f3640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd0340a3900 0x7fd0340a3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:16.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.318+0000 7fd03a9f3640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd034152450 con 0x7fd01c004d40 2024-05-16T23:36:16.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.318+0000 7fd03a9f3640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd0341522d0 con 0x7fd0341d9ce0 2024-05-16T23:36:16.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.318+0000 7fd03a9f3640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fd0341525d0 con 0x7fd0340a3900 2024-05-16T23:36:16.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.318+0000 7fd033fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd01c004d40 0x7fd0341d8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:16.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.318+0000 7fd033fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd01c004d40 0x7fd0341d8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55432/0 (socket says 172.21.15.44:55432) 2024-05-16T23:36:16.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.318+0000 7fd033fff640 1 -- 172.21.15.44:0/2581924923 learned_addr learned my addr 172.21.15.44:0/2581924923 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T23:36:16.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.318+0000 7fd038f90640 1 --2- 172.21.15.44:0/2581924923 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd0340a3900 0x7fd0340a3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:16.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.318+0000 7fd0337fe640 1 --2- 172.21.15.44:0/2581924923 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0341d9ce0 0x7fd0341da0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:16.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.318+0000 7fd033fff640 1 -- 172.21.15.44:0/2581924923 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd0340a3900 msgr2=0x7fd0340a3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:16.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.318+0000 7fd033fff640 1 --2- 172.21.15.44:0/2581924923 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd0340a3900 0x7fd0340a3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:16.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.318+0000 7fd033fff640 1 -- 172.21.15.44:0/2581924923 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0341d9ce0 msgr2=0x7fd0341da0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:16.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.318+0000 7fd033fff640 1 --2- 172.21.15.44:0/2581924923 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0341d9ce0 0x7fd0341da0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:16.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.318+0000 7fd033fff640 1 -- 172.21.15.44:0/2581924923 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0341d8ab0 con 0x7fd01c004d40 2024-05-16T23:36:16.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.318+0000 7fd038f90640 1 --2- 172.21.15.44:0/2581924923 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd0340a3900 0x7fd0340a3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T23:36:16.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.318+0000 7fd033fff640 1 --2- 172.21.15.44:0/2581924923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd01c004d40 0x7fd0341d8570 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd0240119d0 tx=0x7fd024011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:16.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.319+0000 7fd030ff9640 1 -- 172.21.15.44:0/2581924923 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd02400fa90 con 0x7fd01c004d40 2024-05-16T23:36:16.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.319+0000 7fd030ff9640 1 -- 172.21.15.44:0/2581924923 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd02400fc30 con 0x7fd01c004d40 2024-05-16T23:36:16.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.319+0000 7fd03a9f3640 1 -- 172.21.15.44:0/2581924923 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0341e4d10 con 0x7fd01c004d40 2024-05-16T23:36:16.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.319+0000 7fd030ff9640 1 -- 172.21.15.44:0/2581924923 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd024004030 con 0x7fd01c004d40 2024-05-16T23:36:16.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.319+0000 7fd03a9f3640 1 -- 172.21.15.44:0/2581924923 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0341e52d0 con 0x7fd01c004d40 2024-05-16T23:36:16.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.320+0000 7fd03a9f3640 1 -- 172.21.15.44:0/2581924923 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0340c1570 con 0x7fd01c004d40 2024-05-16T23:36:17.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.320+0000 7fd030ff9640 1 -- 172.21.15.44:0/2581924923 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd024012040 con 0x7fd01c004d40 2024-05-16T23:36:17.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.321+0000 7fd030ff9640 1 --2- 172.21.15.44:0/2581924923 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd0200762d0 0x7fd0200787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:17.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.321+0000 7fd030ff9640 1 -- 172.21.15.44:0/2581924923 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5029+0+0 (secure 0 0 0) 0x7fd0240976d0 con 0x7fd01c004d40 2024-05-16T23:36:17.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.321+0000 7fd0337fe640 1 --2- 172.21.15.44:0/2581924923 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd0200762d0 0x7fd0200787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:17.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.322+0000 7fd0337fe640 1 --2- 172.21.15.44:0/2581924923 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd0200762d0 0x7fd0200787e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd028001eb0 tx=0x7fd028007b20 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:17.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.326+0000 7fd030ff9640 1 -- 172.21.15.44:0/2581924923 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd024019070 con 0x7fd01c004d40 2024-05-16T23:36:17.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.513+0000 7fd03a9f3640 1 -- 172.21.15.44:0/2581924923 --> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd0340bca40 con 0x7fd0200762d0 2024-05-16T23:36:17.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.514+0000 7fd030ff9640 1 -- 172.21.15.44:0/2581924923 <== mgr.4114 v2:172.21.15.70:6832/4049588098 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13341 (secure 0 0 0) 0x7fd0340bca40 con 0x7fd0200762d0 2024-05-16T23:36:17.345 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T23:36:17.380 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-05-16T23:36:17.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.517+0000 7fd03a9f3640 1 -- 172.21.15.44:0/2581924923 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd0200762d0 msgr2=0x7fd0200787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:17.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.517+0000 7fd03a9f3640 1 --2- 172.21.15.44:0/2581924923 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd0200762d0 0x7fd0200787e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd028001eb0 tx=0x7fd028007b20 comp rx=0 tx=0).stop 2024-05-16T23:36:17.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.517+0000 7fd03a9f3640 1 -- 172.21.15.44:0/2581924923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd01c004d40 msgr2=0x7fd0341d8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:17.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.517+0000 7fd03a9f3640 1 --2- 172.21.15.44:0/2581924923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd01c004d40 0x7fd0341d8570 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd0240119d0 tx=0x7fd024011dd0 comp rx=0 tx=0).stop 2024-05-16T23:36:17.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.517+0000 7fd03a9f3640 1 -- 172.21.15.44:0/2581924923 shutdown_connections 2024-05-16T23:36:17.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.517+0000 7fd03a9f3640 1 --2- 172.21.15.44:0/2581924923 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fd0200762d0 0x7fd0200787e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:17.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.517+0000 7fd03a9f3640 1 --2- 172.21.15.44:0/2581924923 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd0340a3900 0x7fd0340a3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:17.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.517+0000 7fd03a9f3640 1 --2- 172.21.15.44:0/2581924923 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0341d9ce0 0x7fd0341da0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:17.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.517+0000 7fd03a9f3640 1 --2- 172.21.15.44:0/2581924923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd01c004d40 0x7fd0341d8570 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:17.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.517+0000 7fd03a9f3640 1 -- 172.21.15.44:0/2581924923 >> 172.21.15.44:0/2581924923 conn(0x7fd0340c17c0 msgr2=0x7fd0340a0510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T23:36:17.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.517+0000 7fd03a9f3640 1 -- 172.21.15.44:0/2581924923 shutdown_connections 2024-05-16T23:36:17.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:14.517+0000 7fd03a9f3640 1 -- 172.21.15.44:0/2581924923 wait complete. 2024-05-16T23:36:17.854 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":2117,"stamp":"2024-05-16T23:36:13.515447+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":263976,"kb_used_data":6216,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754710744,"statfs":{"total":773094113280,"available":772823801856,"internally_reserved":0,"allocated":6365184,"data_stored":3314944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":263835185},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003042"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":206,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-16T23:33:29.708492+0000","last_change":"2024-05-16T22:27:15.950850+0000","last_active":"2024-05-16T23:33:29.708492+0000","last_peered":"2024-05-16T23:33:29.708492+0000","last_clean":"2024-05-16T23:33:29.708492+0000","last_became_active":"2024-05-16T22:27:15.949553+0000","last_became_peered":"2024-05-16T22:27:15.949553+0000","last_unstale":"2024-05-16T23:33:29.708492+0000","last_undegraded":"2024-05-16T23:33:29.708492+0000","last_fullsized":"2024-05-16T23:33:29.708492+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:14.702385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:14.702385+0000","last_clean_scrub_stamp":"2024-05-16T22:27:14.702385+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:46:07.495562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542975,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36552,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335288,"statfs":{"total":96636764160,"available":96599334912,"internally_reserved":0,"allocated":1241088,"data_stored":857144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575678,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31812,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":647168,"data_stored":266776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575678,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35972,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335868,"statfs":{"total":96636764160,"available":96599928832,"internally_reserved":0,"allocated":647168,"data_stored":266776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575678,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31812,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":647168,"data_stored":266776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575678,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31812,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":647168,"data_stored":266776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575678,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31812,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":647168,"data_stored":266776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575677,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31812,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":647168,"data_stored":266776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575678,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32392,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339448,"statfs":{"total":96636764160,"available":96603594752,"internally_reserved":0,"allocated":1241088,"data_stored":857144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-16T23:36:17.888 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-16T23:36:18.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.049+0000 7f003dff3640 1 Processor -- start 2024-05-16T23:36:18.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.049+0000 7f003dff3640 1 -- start start 2024-05-16T23:36:18.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.050+0000 7f003dff3640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f00380b4eb0 0x7f003806f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:18.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.050+0000 7f003dff3640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00380b52c0 con 0x7f003814ee30 2024-05-16T23:36:18.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.050+0000 7f003dff3640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00380bb0e0 con 0x7f00380b4aa0 2024-05-16T23:36:18.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.050+0000 7f003dff3640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f0038071f40 con 0x7f00380b4eb0 2024-05-16T23:36:18.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.050+0000 7f0037fff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f003814ee30 0x7f00381559e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:50134/0 (socket says 172.21.15.44:50134) 2024-05-16T23:36:18.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.050+0000 7f0037fff640 1 -- 172.21.15.44:0/3583552234 learned_addr learned my addr 172.21.15.44:0/3583552234 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T23:36:18.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.050+0000 7f0036ffd640 1 --2- 172.21.15.44:0/3583552234 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f00380b4eb0 0x7f003806f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:18.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.050+0000 7f00367fc640 1 -- 172.21.15.44:0/3583552234 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 371634637 0 0) 0x7f00380b52c0 con 0x7f003814ee30 2024-05-16T23:36:18.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.050+0000 7f00367fc640 1 -- 172.21.15.44:0/3583552234 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0020003520 con 0x7f003814ee30 2024-05-16T23:36:18.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.051+0000 7f0036ffd640 1 -- 172.21.15.44:0/3583552234 >> v1:172.21.15.70:6789/0 conn(0x7f00380b4aa0 legacy=0x7f003814e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:18.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.051+0000 7f00367fc640 1 -- 172.21.15.44:0/3583552234 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3495267361 0 0) 0x7f00380bb0e0 con 0x7f00380b4aa0 2024-05-16T23:36:18.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.051+0000 7f0036ffd640 1 -- 172.21.15.44:0/3583552234 >> v1:172.21.15.44:6789/0 conn(0x7f003814ee30 legacy=0x7f00381559e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:18.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.051+0000 7f0036ffd640 1 -- 172.21.15.44:0/3583552234 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00380bab60 con 0x7f00380b4eb0 2024-05-16T23:36:18.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.051+0000 7f0036ffd640 1 --2- 172.21.15.44:0/3583552234 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f00380b4eb0 0x7f003806f7c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f002800a970 tx=0x7f002802b550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68bb9be34701ec4a server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:18.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.051+0000 7f00367fc640 1 -- 172.21.15.44:0/3583552234 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002800b040 con 0x7f00380b4eb0 2024-05-16T23:36:18.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.052+0000 7f00367fc640 1 -- 172.21.15.44:0/3583552234 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0028030710 con 0x7f00380b4eb0 2024-05-16T23:36:18.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.052+0000 7f00367fc640 1 -- 172.21.15.44:0/3583552234 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0028030ac0 con 0x7f00380b4eb0 2024-05-16T23:36:18.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.052+0000 7f003dff3640 1 -- 172.21.15.44:0/3583552234 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f00380b4eb0 msgr2=0x7f003806f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:18.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.052+0000 7f003dff3640 1 --2- 172.21.15.44:0/3583552234 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f00380b4eb0 0x7f003806f7c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f002800a970 tx=0x7f002802b550 comp rx=0 tx=0).stop 2024-05-16T23:36:18.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.052+0000 7f003dff3640 1 -- 172.21.15.44:0/3583552234 shutdown_connections 2024-05-16T23:36:18.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.052+0000 7f003dff3640 1 --2- 172.21.15.44:0/3583552234 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f00380b4eb0 0x7f003806f7c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:18.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.052+0000 7f003dff3640 1 -- 172.21.15.44:0/3583552234 >> 172.21.15.44:0/3583552234 conn(0x7f00380a1ac0 msgr2=0x7f00380bbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T23:36:18.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.052+0000 7f003dff3640 1 -- 172.21.15.44:0/3583552234 shutdown_connections 2024-05-16T23:36:18.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.052+0000 7f003dff3640 1 -- 172.21.15.44:0/3583552234 wait complete. 2024-05-16T23:36:18.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.054+0000 7f003dff3640 1 Processor -- start 2024-05-16T23:36:19.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.054+0000 7f003dff3640 1 -- start start 2024-05-16T23:36:19.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.055+0000 7f003dff3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00380b4aa0 0x7f003814ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:19.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.055+0000 7f003dff3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00380b4eb0 0x7f0038145f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:19.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.055+0000 7f003dff3640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f003814ee30 0x7f0038146440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:19.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.055+0000 7f003dff3640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f00380b9ee0 con 0x7f00380b4aa0 2024-05-16T23:36:19.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.055+0000 7f003dff3640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f00380ba060 con 0x7f00380b4eb0 2024-05-16T23:36:19.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.055+0000 7f003dff3640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f003806fd00 con 0x7f003814ee30 2024-05-16T23:36:19.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.055+0000 7f00377fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00380b4aa0 0x7f003814ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:19.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.055+0000 7f00377fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00380b4aa0 0x7f003814ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55448/0 (socket says 172.21.15.44:55448) 2024-05-16T23:36:19.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.055+0000 7f00377fe640 1 -- 172.21.15.44:0/2903139800 learned_addr learned my addr 172.21.15.44:0/2903139800 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T23:36:19.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.055+0000 7f0036ffd640 1 --2- 172.21.15.44:0/2903139800 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00380b4eb0 0x7f0038145f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:19.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.055+0000 7f0037fff640 1 --2- 172.21.15.44:0/2903139800 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f003814ee30 0x7f0038146440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:19.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.056+0000 7f00377fe640 1 -- 172.21.15.44:0/2903139800 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f003814ee30 msgr2=0x7f0038146440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:19.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.056+0000 7f00377fe640 1 --2- 172.21.15.44:0/2903139800 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f003814ee30 0x7f0038146440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:19.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.056+0000 7f00377fe640 1 -- 172.21.15.44:0/2903139800 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00380b4eb0 msgr2=0x7f0038145f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:19.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.056+0000 7f00377fe640 1 --2- 172.21.15.44:0/2903139800 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00380b4eb0 0x7f0038145f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:19.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.056+0000 7f00377fe640 1 -- 172.21.15.44:0/2903139800 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f003814b190 con 0x7f00380b4aa0 2024-05-16T23:36:19.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.056+0000 7f00377fe640 1 --2- 172.21.15.44:0/2903139800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00380b4aa0 0x7f003814ac50 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f002c00c340 tx=0x7f002c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:19.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.056+0000 7f001ffff640 1 -- 172.21.15.44:0/2903139800 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002c017070 con 0x7f00380b4aa0 2024-05-16T23:36:19.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.056+0000 7f001ffff640 1 -- 172.21.15.44:0/2903139800 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f002c0035f0 con 0x7f00380b4aa0 2024-05-16T23:36:19.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.056+0000 7f003dff3640 1 -- 172.21.15.44:0/2903139800 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00380b6680 con 0x7f00380b4aa0 2024-05-16T23:36:19.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.056+0000 7f001ffff640 1 -- 172.21.15.44:0/2903139800 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002c0039e0 con 0x7f00380b4aa0 2024-05-16T23:36:19.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.056+0000 7f003dff3640 1 -- 172.21.15.44:0/2903139800 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00381d6de0 con 0x7f00380b4aa0 2024-05-16T23:36:19.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.057+0000 7f003dff3640 1 -- 172.21.15.44:0/2903139800 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00380a0e70 con 0x7f00380b4aa0 2024-05-16T23:36:19.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.058+0000 7f001ffff640 1 -- 172.21.15.44:0/2903139800 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f002c01a070 con 0x7f00380b4aa0 2024-05-16T23:36:19.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.058+0000 7f001ffff640 1 --2- 172.21.15.44:0/2903139800 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f00240762d0 0x7f00240787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:20.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.058+0000 7f001ffff640 1 -- 172.21.15.44:0/2903139800 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5029+0+0 (secure 0 0 0) 0x7f002c096740 con 0x7f00380b4aa0 2024-05-16T23:36:20.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.058+0000 7f0036ffd640 1 --2- 172.21.15.44:0/2903139800 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f00240762d0 0x7f00240787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:20.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.059+0000 7f0036ffd640 1 --2- 172.21.15.44:0/2903139800 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f00240762d0 0x7f00240787e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0028035000 tx=0x7f0028030000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:20.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.063+0000 7f001ffff640 1 -- 172.21.15.44:0/2903139800 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f00380a0e70 con 0x7f00380b4aa0 2024-05-16T23:36:20.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.255+0000 7f003dff3640 1 -- 172.21.15.44:0/2903139800 --> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f003814e420 con 0x7f00240762d0 2024-05-16T23:36:20.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.256+0000 7f001ffff640 1 -- 172.21.15.44:0/2903139800 <== mgr.4114 v2:172.21.15.70:6832/4049588098 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13341 (secure 0 0 0) 0x7f003814e420 con 0x7f00240762d0 2024-05-16T23:36:20.223 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T23:36:20.257 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-05-16T23:36:20.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.258+0000 7f003dff3640 1 -- 172.21.15.44:0/2903139800 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f00240762d0 msgr2=0x7f00240787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:20.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.258+0000 7f003dff3640 1 --2- 172.21.15.44:0/2903139800 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f00240762d0 0x7f00240787e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0028035000 tx=0x7f0028030000 comp rx=0 tx=0).stop 2024-05-16T23:36:20.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.258+0000 7f003dff3640 1 -- 172.21.15.44:0/2903139800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00380b4aa0 msgr2=0x7f003814ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:20.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.258+0000 7f003dff3640 1 --2- 172.21.15.44:0/2903139800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00380b4aa0 0x7f003814ac50 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f002c00c340 tx=0x7f002c00c800 comp rx=0 tx=0).stop 2024-05-16T23:36:20.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.259+0000 7f003dff3640 1 -- 172.21.15.44:0/2903139800 shutdown_connections 2024-05-16T23:36:20.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.259+0000 7f003dff3640 1 --2- 172.21.15.44:0/2903139800 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f00240762d0 0x7f00240787e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:20.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.259+0000 7f003dff3640 1 --2- 172.21.15.44:0/2903139800 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f003814ee30 0x7f0038146440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:20.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.259+0000 7f003dff3640 1 --2- 172.21.15.44:0/2903139800 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00380b4eb0 0x7f0038145f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:20.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.259+0000 7f003dff3640 1 --2- 172.21.15.44:0/2903139800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00380b4aa0 0x7f003814ac50 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:20.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.259+0000 7f003dff3640 1 -- 172.21.15.44:0/2903139800 >> 172.21.15.44:0/2903139800 conn(0x7f00380a1ac0 msgr2=0x7f00380746b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T23:36:20.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.259+0000 7f003dff3640 1 -- 172.21.15.44:0/2903139800 shutdown_connections 2024-05-16T23:36:20.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:18.259+0000 7f003dff3640 1 -- 172.21.15.44:0/2903139800 wait complete. 2024-05-16T23:36:20.731 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":2119,"stamp":"2024-05-16T23:36:17.516249+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":263976,"kb_used_data":6216,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754710744,"statfs":{"total":773094113280,"available":772823801856,"internally_reserved":0,"allocated":6365184,"data_stored":3314944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":263835185},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002920"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":206,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-16T23:33:29.708492+0000","last_change":"2024-05-16T22:27:15.950850+0000","last_active":"2024-05-16T23:33:29.708492+0000","last_peered":"2024-05-16T23:33:29.708492+0000","last_clean":"2024-05-16T23:33:29.708492+0000","last_became_active":"2024-05-16T22:27:15.949553+0000","last_became_peered":"2024-05-16T22:27:15.949553+0000","last_unstale":"2024-05-16T23:33:29.708492+0000","last_undegraded":"2024-05-16T23:33:29.708492+0000","last_fullsized":"2024-05-16T23:33:29.708492+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:14.702385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:14.702385+0000","last_clean_scrub_stamp":"2024-05-16T22:27:14.702385+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:46:07.495562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542976,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36552,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335288,"statfs":{"total":96636764160,"available":96599334912,"internally_reserved":0,"allocated":1241088,"data_stored":857144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575679,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31812,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":647168,"data_stored":266776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575679,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35972,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335868,"statfs":{"total":96636764160,"available":96599928832,"internally_reserved":0,"allocated":647168,"data_stored":266776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575679,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31812,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":647168,"data_stored":266776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575679,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31812,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":647168,"data_stored":266776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575679,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31812,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":647168,"data_stored":266776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575678,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31812,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":647168,"data_stored":266776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575679,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32392,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339448,"statfs":{"total":96636764160,"available":96603594752,"internally_reserved":0,"allocated":1241088,"data_stored":857144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-16T23:36:20.765 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-16T23:36:20.798 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-16T23:36:20.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.983+0000 7f48d870d640 1 Processor -- start 2024-05-16T23:36:21.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.983+0000 7f48d870d640 1 -- start start 2024-05-16T23:36:21.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.984+0000 7f48d870d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f48d014e530 0x7f48d00ba320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:21.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.984+0000 7f48d870d640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48d00ba860 con 0x7f48d00b8d70 2024-05-16T23:36:21.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.984+0000 7f48d870d640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48d014ece0 con 0x7f48d00bd440 2024-05-16T23:36:21.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.984+0000 7f48d870d640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f48d00b88e0 con 0x7f48d014e530 2024-05-16T23:36:21.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.984+0000 7f48d6caa640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f48d00b8d70 0x7f48d00b9180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:42068/0 (socket says 172.21.15.44:42068) 2024-05-16T23:36:21.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.984+0000 7f48d6caa640 1 -- 172.21.15.44:0/747800660 learned_addr learned my addr 172.21.15.44:0/747800660 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T23:36:21.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.984+0000 7f48d64a9640 1 --2- 172.21.15.44:0/747800660 >> v2:172.21.15.70:3300/0 conn(0x7f48d014e530 0x7f48d00ba320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:21.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.984+0000 7f48d54a7640 1 -- 172.21.15.44:0/747800660 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 823732189 0 0) 0x7f48d00ba860 con 0x7f48d00b8d70 2024-05-16T23:36:21.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.984+0000 7f48d54a7640 1 -- 172.21.15.44:0/747800660 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48bc003520 con 0x7f48d00b8d70 2024-05-16T23:36:21.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.985+0000 7f48d64a9640 1 -- 172.21.15.44:0/747800660 >> v1:172.21.15.70:6789/0 conn(0x7f48d00bd440 legacy=0x7f48d00bd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:21.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.985+0000 7f48d54a7640 1 -- 172.21.15.44:0/747800660 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4287533504 0 0) 0x7f48d014ece0 con 0x7f48d00bd440 2024-05-16T23:36:21.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.985+0000 7f48d64a9640 1 -- 172.21.15.44:0/747800660 >> v1:172.21.15.44:6789/0 conn(0x7f48d00b8d70 legacy=0x7f48d00b9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:21.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.985+0000 7f48d64a9640 1 -- 172.21.15.44:0/747800660 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d014efc0 con 0x7f48d014e530 2024-05-16T23:36:21.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.985+0000 7f48d64a9640 1 --2- 172.21.15.44:0/747800660 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48d014e530 0x7f48d00ba320 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f48cc009790 tx=0x7f48cc02a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f953c178ee3aa9dc server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:21.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.985+0000 7f48d54a7640 1 -- 172.21.15.44:0/747800660 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48cc037070 con 0x7f48d014e530 2024-05-16T23:36:21.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.986+0000 7f48d54a7640 1 -- 172.21.15.44:0/747800660 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48cc032440 con 0x7f48d014e530 2024-05-16T23:36:21.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.986+0000 7f48d54a7640 1 -- 172.21.15.44:0/747800660 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48cc032810 con 0x7f48d014e530 2024-05-16T23:36:21.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.986+0000 7f48d870d640 1 -- 172.21.15.44:0/747800660 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48d014e530 msgr2=0x7f48d00ba320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:21.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.986+0000 7f48d870d640 1 --2- 172.21.15.44:0/747800660 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48d014e530 0x7f48d00ba320 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f48cc009790 tx=0x7f48cc02a210 comp rx=0 tx=0).stop 2024-05-16T23:36:21.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.986+0000 7f48d870d640 1 -- 172.21.15.44:0/747800660 shutdown_connections 2024-05-16T23:36:21.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.986+0000 7f48d870d640 1 --2- 172.21.15.44:0/747800660 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48d014e530 0x7f48d00ba320 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:21.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.986+0000 7f48d870d640 1 -- 172.21.15.44:0/747800660 >> 172.21.15.44:0/747800660 conn(0x7f48d00c0570 msgr2=0x7f48d00c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T23:36:21.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.986+0000 7f48d870d640 1 -- 172.21.15.44:0/747800660 shutdown_connections 2024-05-16T23:36:21.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.986+0000 7f48d870d640 1 -- 172.21.15.44:0/747800660 wait complete. 2024-05-16T23:36:21.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.988+0000 7f48d870d640 1 Processor -- start 2024-05-16T23:36:21.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.988+0000 7f48d870d640 1 -- start start 2024-05-16T23:36:21.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.989+0000 7f48d870d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f48d00b8d70 0x7f48d0140c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:21.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.989+0000 7f48d870d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48d00bd440 0x7f48d013f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:21.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.989+0000 7f48d870d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48d014e530 0x7f48d013d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:21.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.989+0000 7f48d870d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f48d014e940 con 0x7f48d014e530 2024-05-16T23:36:22.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.989+0000 7f48d870d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f48d00bbb70 con 0x7f48d00bd440 2024-05-16T23:36:22.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.989+0000 7f48d870d640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f48d014eac0 con 0x7f48d00b8d70 2024-05-16T23:36:22.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.989+0000 7f48d6caa640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48d014e530 0x7f48d013d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:22.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.989+0000 7f48d6caa640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48d014e530 0x7f48d013d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44360/0 (socket says 172.21.15.44:44360) 2024-05-16T23:36:22.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.989+0000 7f48d6caa640 1 -- 172.21.15.44:0/3895727130 learned_addr learned my addr 172.21.15.44:0/3895727130 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T23:36:22.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.989+0000 7f48d64a9640 1 --2- 172.21.15.44:0/3895727130 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f48d00b8d70 0x7f48d0140c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:22.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.989+0000 7f48d5ca8640 1 --2- 172.21.15.44:0/3895727130 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48d00bd440 0x7f48d013f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:22.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.989+0000 7f48d6caa640 1 -- 172.21.15.44:0/3895727130 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f48d00b8d70 msgr2=0x7f48d0140c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:22.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.989+0000 7f48d6caa640 1 --2- 172.21.15.44:0/3895727130 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f48d00b8d70 0x7f48d0140c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:22.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.989+0000 7f48d6caa640 1 -- 172.21.15.44:0/3895727130 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48d00bd440 msgr2=0x7f48d013f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:22.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.989+0000 7f48d6caa640 1 --2- 172.21.15.44:0/3895727130 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48d00bd440 0x7f48d013f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:22.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.990+0000 7f48d6caa640 1 -- 172.21.15.44:0/3895727130 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d01411d0 con 0x7f48d014e530 2024-05-16T23:36:22.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.990+0000 7f48d6caa640 1 --2- 172.21.15.44:0/3895727130 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48d014e530 0x7f48d013d670 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f48c800cad0 tx=0x7f48c800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:22.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.990+0000 7f48c6ffd640 1 -- 172.21.15.44:0/3895727130 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c800ac30 con 0x7f48d014e530 2024-05-16T23:36:22.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.990+0000 7f48c6ffd640 1 -- 172.21.15.44:0/3895727130 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48c800add0 con 0x7f48d014e530 2024-05-16T23:36:22.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.990+0000 7f48c6ffd640 1 -- 172.21.15.44:0/3895727130 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c8012600 con 0x7f48d014e530 2024-05-16T23:36:22.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.990+0000 7f48d870d640 1 -- 172.21.15.44:0/3895727130 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48d013f8a0 con 0x7f48d014e530 2024-05-16T23:36:22.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.990+0000 7f48d870d640 1 -- 172.21.15.44:0/3895727130 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48d01e4a30 con 0x7f48d014e530 2024-05-16T23:36:22.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.991+0000 7f48d870d640 1 -- 172.21.15.44:0/3895727130 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48d013efc0 con 0x7f48d014e530 2024-05-16T23:36:22.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.992+0000 7f48c6ffd640 1 -- 172.21.15.44:0/3895727130 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f48c80127a0 con 0x7f48d014e530 2024-05-16T23:36:22.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.992+0000 7f48c6ffd640 1 --2- 172.21.15.44:0/3895727130 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f48b40762d0 0x7f48b40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:22.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.993+0000 7f48c6ffd640 1 -- 172.21.15.44:0/3895727130 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5029+0+0 (secure 0 0 0) 0x7f48c8097830 con 0x7f48d014e530 2024-05-16T23:36:22.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.993+0000 7f48d64a9640 1 --2- 172.21.15.44:0/3895727130 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f48b40762d0 0x7f48b40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:22.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.993+0000 7f48d64a9640 1 --2- 172.21.15.44:0/3895727130 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f48b40762d0 0x7f48b40787e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f48cc034000 tx=0x7f48cc02e000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:22.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:20.997+0000 7f48c6ffd640 1 -- 172.21.15.44:0/3895727130 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f48c8060d50 con 0x7f48d014e530 2024-05-16T23:36:22.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:21.189+0000 7f48d870d640 1 -- 172.21.15.44:0/3895727130 --> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f48d0149180 con 0x7f48b40762d0 2024-05-16T23:36:22.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:21.190+0000 7f48c6ffd640 1 -- 172.21.15.44:0/3895727130 <== mgr.4114 v2:172.21.15.70:6832/4049588098 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13341 (secure 0 0 0) 0x7f48d0149180 con 0x7f48b40762d0 2024-05-16T23:36:22.299 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T23:36:22.310 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-05-16T23:36:22.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:21.192+0000 7f48d870d640 1 -- 172.21.15.44:0/3895727130 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f48b40762d0 msgr2=0x7f48b40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:22.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:21.192+0000 7f48d870d640 1 --2- 172.21.15.44:0/3895727130 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f48b40762d0 0x7f48b40787e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f48cc034000 tx=0x7f48cc02e000 comp rx=0 tx=0).stop 2024-05-16T23:36:22.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:21.192+0000 7f48d870d640 1 -- 172.21.15.44:0/3895727130 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48d014e530 msgr2=0x7f48d013d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:22.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:21.192+0000 7f48d870d640 1 --2- 172.21.15.44:0/3895727130 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48d014e530 0x7f48d013d670 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f48c800cad0 tx=0x7f48c800cf90 comp rx=0 tx=0).stop 2024-05-16T23:36:22.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:21.192+0000 7f48d870d640 1 -- 172.21.15.44:0/3895727130 shutdown_connections 2024-05-16T23:36:22.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:21.192+0000 7f48d870d640 1 --2- 172.21.15.44:0/3895727130 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f48b40762d0 0x7f48b40787e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:22.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:21.192+0000 7f48d870d640 1 --2- 172.21.15.44:0/3895727130 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48d014e530 0x7f48d013d670 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:22.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:21.192+0000 7f48d870d640 1 --2- 172.21.15.44:0/3895727130 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48d00bd440 0x7f48d013f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:22.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:21.192+0000 7f48d870d640 1 --2- 172.21.15.44:0/3895727130 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f48d00b8d70 0x7f48d0140c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:22.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:21.192+0000 7f48d870d640 1 -- 172.21.15.44:0/3895727130 >> 172.21.15.44:0/3895727130 conn(0x7f48d00c0570 msgr2=0x7f48d00c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T23:36:22.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:21.192+0000 7f48d870d640 1 -- 172.21.15.44:0/3895727130 shutdown_connections 2024-05-16T23:36:22.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:21.192+0000 7f48d870d640 1 -- 172.21.15.44:0/3895727130 wait complete. 2024-05-16T23:36:22.432 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":2120,"stamp":"2024-05-16T23:36:19.516733+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":263976,"kb_used_data":6216,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754710744,"statfs":{"total":773094113280,"available":772823801856,"internally_reserved":0,"allocated":6365184,"data_stored":3314944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":263835185},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002774"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":206,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-16T23:33:29.708492+0000","last_change":"2024-05-16T22:27:15.950850+0000","last_active":"2024-05-16T23:33:29.708492+0000","last_peered":"2024-05-16T23:33:29.708492+0000","last_clean":"2024-05-16T23:33:29.708492+0000","last_became_active":"2024-05-16T22:27:15.949553+0000","last_became_peered":"2024-05-16T22:27:15.949553+0000","last_unstale":"2024-05-16T23:33:29.708492+0000","last_undegraded":"2024-05-16T23:33:29.708492+0000","last_fullsized":"2024-05-16T23:33:29.708492+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:14.702385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:14.702385+0000","last_clean_scrub_stamp":"2024-05-16T22:27:14.702385+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:46:07.495562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542976,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36552,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335288,"statfs":{"total":96636764160,"available":96599334912,"internally_reserved":0,"allocated":1241088,"data_stored":857144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575680,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31812,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":647168,"data_stored":266776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575680,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35972,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335868,"statfs":{"total":96636764160,"available":96599928832,"internally_reserved":0,"allocated":647168,"data_stored":266776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575680,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31812,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":647168,"data_stored":266776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575680,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31812,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":647168,"data_stored":266776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575680,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31812,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":647168,"data_stored":266776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575679,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31812,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":647168,"data_stored":266776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575680,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32392,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339448,"statfs":{"total":96636764160,"available":96603594752,"internally_reserved":0,"allocated":1241088,"data_stored":857144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-16T23:36:22.442 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-16T23:36:22.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.577+0000 7fe41f6f2640 1 Processor -- start 2024-05-16T23:36:22.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.578+0000 7fe41f6f2640 1 -- start start 2024-05-16T23:36:22.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.579+0000 7fe41f6f2640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe4180be230 0x7fe41806dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:22.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.579+0000 7fe41f6f2640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe4180bd510 0x7fe4180bd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:22.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.579+0000 7fe41f6f2640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe41814ebd0 0x7fe41814efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:22.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.579+0000 7fe41f6f2640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fe41814c230 con 0x7fe4180bd510 2024-05-16T23:36:22.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.579+0000 7fe41f6f2640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fe4180bea40 con 0x7fe41814ebd0 2024-05-16T23:36:22.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.579+0000 7fe41f6f2640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fe41806e0f0 con 0x7fe4180be230 2024-05-16T23:36:22.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.579+0000 7fe41cc8d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe4180bd510 0x7fe4180bd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:22.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.579+0000 7fe41cc8d640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe4180bd510 0x7fe4180bd920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44374/0 (socket says 172.21.15.44:44374) 2024-05-16T23:36:22.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.579+0000 7fe41cc8d640 1 -- 172.21.15.44:0/2313743485 learned_addr learned my addr 172.21.15.44:0/2313743485 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T23:36:22.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.579+0000 7fe41dc8f640 1 --2- 172.21.15.44:0/2313743485 >> v2:172.21.15.70:3300/0 conn(0x7fe41814ebd0 0x7fe41814efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:22.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.579+0000 7fe41d48e640 1 --2- 172.21.15.44:0/2313743485 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe4180be230 0x7fe41806dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:22.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.579+0000 7fe41cc8d640 1 -- 172.21.15.44:0/2313743485 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe4180be230 msgr2=0x7fe41806dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T23:36:22.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.579+0000 7fe41cc8d640 1 --2- 172.21.15.44:0/2313743485 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe4180be230 0x7fe41806dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:22.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.579+0000 7fe41cc8d640 1 -- 172.21.15.44:0/2313743485 >> v2:172.21.15.70:3300/0 conn(0x7fe41814ebd0 msgr2=0x7fe41814efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T23:36:22.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.579+0000 7fe41cc8d640 1 --2- 172.21.15.44:0/2313743485 >> v2:172.21.15.70:3300/0 conn(0x7fe41814ebd0 0x7fe41814efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:22.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.579+0000 7fe41cc8d640 1 -- 172.21.15.44:0/2313743485 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4180becb0 con 0x7fe4180bd510 2024-05-16T23:36:22.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.579+0000 7fe41dc8f640 1 --2- 172.21.15.44:0/2313743485 >> v2:172.21.15.70:3300/0 conn(0x7fe41814ebd0 0x7fe41814efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T23:36:22.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.580+0000 7fe41cc8d640 1 --2- 172.21.15.44:0/2313743485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4180bd510 0x7fe4180bd920 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe4180c34a0 tx=0x7fe40c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bac0b69219248a9a server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:22.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.580+0000 7fe417fff640 1 -- 172.21.15.44:0/2313743485 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe40c037070 con 0x7fe4180bd510 2024-05-16T23:36:22.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.580+0000 7fe417fff640 1 -- 172.21.15.44:0/2313743485 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe40c032440 con 0x7fe4180bd510 2024-05-16T23:36:22.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.580+0000 7fe417fff640 1 -- 172.21.15.44:0/2313743485 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe40c032810 con 0x7fe4180bd510 2024-05-16T23:36:22.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.581+0000 7fe41f6f2640 1 -- 172.21.15.44:0/2313743485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4180bd510 msgr2=0x7fe4180bd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:22.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.581+0000 7fe41f6f2640 1 --2- 172.21.15.44:0/2313743485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4180bd510 0x7fe4180bd920 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe4180c34a0 tx=0x7fe40c02a210 comp rx=0 tx=0).stop 2024-05-16T23:36:22.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.581+0000 7fe41f6f2640 1 -- 172.21.15.44:0/2313743485 shutdown_connections 2024-05-16T23:36:22.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.581+0000 7fe41f6f2640 1 --2- 172.21.15.44:0/2313743485 >> v2:172.21.15.70:3300/0 conn(0x7fe41814ebd0 0x7fe41814efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:22.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.581+0000 7fe41f6f2640 1 --2- 172.21.15.44:0/2313743485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4180bd510 0x7fe4180bd920 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:22.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.581+0000 7fe41f6f2640 1 --2- 172.21.15.44:0/2313743485 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe4180be230 0x7fe41806dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:22.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.581+0000 7fe41f6f2640 1 -- 172.21.15.44:0/2313743485 >> 172.21.15.44:0/2313743485 conn(0x7fe4180c3cd0 msgr2=0x7fe4180c40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T23:36:22.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.581+0000 7fe41f6f2640 1 -- 172.21.15.44:0/2313743485 shutdown_connections 2024-05-16T23:36:22.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.581+0000 7fe41f6f2640 1 -- 172.21.15.44:0/2313743485 wait complete. 2024-05-16T23:36:22.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.583+0000 7fe41f6f2640 1 Processor -- start 2024-05-16T23:36:22.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.583+0000 7fe41f6f2640 1 -- start start 2024-05-16T23:36:22.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.584+0000 7fe41f6f2640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe4180bd510 0x7fe41814b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:22.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.584+0000 7fe41f6f2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4180be230 0x7fe4180a6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:22.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.584+0000 7fe41f6f2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe41814ebd0 0x7fe4180a88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:22.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.584+0000 7fe41f6f2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe41806ea70 con 0x7fe4180be230 2024-05-16T23:36:23.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.584+0000 7fe41f6f2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe41814f520 con 0x7fe41814ebd0 2024-05-16T23:36:23.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.584+0000 7fe41f6f2640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fe4180be640 con 0x7fe4180bd510 2024-05-16T23:36:23.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.584+0000 7fe41cc8d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4180be230 0x7fe4180a6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:23.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.584+0000 7fe41cc8d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4180be230 0x7fe4180a6f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44376/0 (socket says 172.21.15.44:44376) 2024-05-16T23:36:23.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.584+0000 7fe41cc8d640 1 -- 172.21.15.44:0/3982474363 learned_addr learned my addr 172.21.15.44:0/3982474363 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T23:36:23.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.584+0000 7fe41d48e640 1 --2- 172.21.15.44:0/3982474363 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe4180bd510 0x7fe41814b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:23.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.584+0000 7fe41dc8f640 1 --2- 172.21.15.44:0/3982474363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe41814ebd0 0x7fe4180a88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:23.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.584+0000 7fe41cc8d640 1 -- 172.21.15.44:0/3982474363 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe4180bd510 msgr2=0x7fe41814b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:23.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.584+0000 7fe41cc8d640 1 --2- 172.21.15.44:0/3982474363 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe4180bd510 0x7fe41814b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:23.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.584+0000 7fe41cc8d640 1 -- 172.21.15.44:0/3982474363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe41814ebd0 msgr2=0x7fe4180a88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:23.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.584+0000 7fe41cc8d640 1 --2- 172.21.15.44:0/3982474363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe41814ebd0 0x7fe4180a88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:23.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.584+0000 7fe41cc8d640 1 -- 172.21.15.44:0/3982474363 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe41814b8d0 con 0x7fe4180be230 2024-05-16T23:36:23.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.584+0000 7fe41cc8d640 1 --2- 172.21.15.44:0/3982474363 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4180be230 0x7fe4180a6f70 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe40c000c00 tx=0x7fe40c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:23.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.584+0000 7fe415ffb640 1 -- 172.21.15.44:0/3982474363 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe40c041020 con 0x7fe4180be230 2024-05-16T23:36:23.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.585+0000 7fe415ffb640 1 -- 172.21.15.44:0/3982474363 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe40c0306c0 con 0x7fe4180be230 2024-05-16T23:36:23.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.585+0000 7fe41f6f2640 1 -- 172.21.15.44:0/3982474363 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4180a7ee0 con 0x7fe4180be230 2024-05-16T23:36:23.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.585+0000 7fe415ffb640 1 -- 172.21.15.44:0/3982474363 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe40c037040 con 0x7fe4180be230 2024-05-16T23:36:23.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.585+0000 7fe41f6f2640 1 -- 172.21.15.44:0/3982474363 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4180a6ce0 con 0x7fe4180be230 2024-05-16T23:36:23.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.586+0000 7fe41f6f2640 1 -- 172.21.15.44:0/3982474363 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4180bc160 con 0x7fe4180be230 2024-05-16T23:36:23.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.587+0000 7fe415ffb640 1 -- 172.21.15.44:0/3982474363 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe40c044020 con 0x7fe4180be230 2024-05-16T23:36:23.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.587+0000 7fe415ffb640 1 --2- 172.21.15.44:0/3982474363 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fe404076300 0x7fe404078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:23.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.587+0000 7fe415ffb640 1 -- 172.21.15.44:0/3982474363 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5029+0+0 (secure 0 0 0) 0x7fe40c0b79d0 con 0x7fe4180be230 2024-05-16T23:36:23.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.588+0000 7fe41d48e640 1 --2- 172.21.15.44:0/3982474363 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fe404076300 0x7fe404078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:23.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.588+0000 7fe41d48e640 1 --2- 172.21.15.44:0/3982474363 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fe404076300 0x7fe404078810 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe410003610 tx=0x7fe410008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:23.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.592+0000 7fe415ffb640 1 -- 172.21.15.44:0/3982474363 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe4180bc160 con 0x7fe4180be230 2024-05-16T23:36:23.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.782+0000 7fe41f6f2640 1 -- 172.21.15.44:0/3982474363 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe4180a9430 con 0x7fe4180be230 2024-05-16T23:36:23.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.783+0000 7fe415ffb640 1 -- 172.21.15.44:0/3982474363 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) ==== 74+0+13108 (secure 0 0 0) 0x7fe40c04b030 con 0x7fe4180be230 2024-05-16T23:36:23.228 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T23:36:23.235 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":54,"fsid":"572ab7cc-b103-4548-ae8f-c6614d57f0c8","created":"2024-05-16T22:27:02.216874+0000","modified":"2024-05-16T22:36:02.794891+0000","last_up_change":"2024-05-16T22:27:13.693953+0000","last_in_change":"2024-05-16T22:27:04.455119+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-16T22:27:14.562409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a7003e89-c706-4562-9f25-670bb35ae108","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6825","nonce":1074109859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6827","nonce":1074109859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6831","nonce":1074109859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":1074109859},{"type":"v1","addr":"172.21.15.44:6829","nonce":1074109859}]},"public_addr":"172.21.15.44:6825/1074109859","cluster_addr":"172.21.15.44:6827/1074109859","heartbeat_back_addr":"172.21.15.44:6831/1074109859","heartbeat_front_addr":"172.21.15.44:6829/1074109859","state":["exists","up"]},{"osd":1,"uuid":"a4d5169d-8327-4494-9c7c-58db21b00636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6817","nonce":2909429972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6819","nonce":2909429972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6823","nonce":2909429972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2909429972},{"type":"v1","addr":"172.21.15.44:6821","nonce":2909429972}]},"public_addr":"172.21.15.44:6817/2909429972","cluster_addr":"172.21.15.44:6819/2909429972","heartbeat_back_addr":"172.21.15.44:6823/2909429972","heartbeat_front_addr":"172.21.15.44:6821/2909429972","state":["exists","up"]},{"osd":2,"uuid":"d4a834f8-83a5-400f-9814-eb0a25124df4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6801","nonce":2908194156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6803","nonce":2908194156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6807","nonce":2908194156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2908194156},{"type":"v1","addr":"172.21.15.44:6805","nonce":2908194156}]},"public_addr":"172.21.15.44:6801/2908194156","cluster_addr":"172.21.15.44:6803/2908194156","heartbeat_back_addr":"172.21.15.44:6807/2908194156","heartbeat_front_addr":"172.21.15.44:6805/2908194156","state":["exists","up"]},{"osd":3,"uuid":"b9d24a56-ad43-4674-a395-5ec24d135ae8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6809","nonce":2168695793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6811","nonce":2168695793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6815","nonce":2168695793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":2168695793},{"type":"v1","addr":"172.21.15.44:6813","nonce":2168695793}]},"public_addr":"172.21.15.44:6809/2168695793","cluster_addr":"172.21.15.44:6811/2168695793","heartbeat_back_addr":"172.21.15.44:6815/2168695793","heartbeat_front_addr":"172.21.15.44:6813/2168695793","state":["exists","up"]},{"osd":4,"uuid":"9bd94af5-3e17-4cbe-995a-8f837a66c653","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6823","nonce":1540297751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6825","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6827","nonce":1540297751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6831","nonce":1540297751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1540297751},{"type":"v1","addr":"172.21.15.70:6829","nonce":1540297751}]},"public_addr":"172.21.15.70:6823/1540297751","cluster_addr":"172.21.15.70:6827/1540297751","heartbeat_back_addr":"172.21.15.70:6831/1540297751","heartbeat_front_addr":"172.21.15.70:6829/1540297751","state":["exists","up"]},{"osd":5,"uuid":"a5b0cfa5-b259-48bd-98b6-96b44f5ebabd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6804","nonce":4218901987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6808","nonce":4218901987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6815","nonce":4218901987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4218901987},{"type":"v1","addr":"172.21.15.70:6812","nonce":4218901987}]},"public_addr":"172.21.15.70:6804/4218901987","cluster_addr":"172.21.15.70:6808/4218901987","heartbeat_back_addr":"172.21.15.70:6815/4218901987","heartbeat_front_addr":"172.21.15.70:6812/4218901987","state":["exists","up"]},{"osd":6,"uuid":"0b6af6df-1358-4fc6-a62c-ba57e02914ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6801","nonce":2389556489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6805","nonce":2389556489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6813","nonce":2389556489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6807","nonce":2389556489},{"type":"v1","addr":"172.21.15.70:6809","nonce":2389556489}]},"public_addr":"172.21.15.70:6801/2389556489","cluster_addr":"172.21.15.70:6805/2389556489","heartbeat_back_addr":"172.21.15.70:6813/2389556489","heartbeat_front_addr":"172.21.15.70:6809/2389556489","state":["exists","up"]},{"osd":7,"uuid":"eb1a2c5d-42cf-47d0-9e03-b9d26944a589","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6817","nonce":3619691281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6819","nonce":3619691281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6826","nonce":3619691281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3619691281},{"type":"v1","addr":"172.21.15.70:6822","nonce":3619691281}]},"public_addr":"172.21.15.70:6817/3619691281","cluster_addr":"172.21.15.70:6819/3619691281","heartbeat_back_addr":"172.21.15.70:6826/3619691281","heartbeat_front_addr":"172.21.15.70:6822/3619691281","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.652256+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.613348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.528454+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.625204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.678845+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.680829+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.556200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-16T22:27:09.647030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6834/153528185":"2024-05-17T22:35:53.761517+0000","172.21.15.44:6832/153528185":"2024-05-17T22:35:53.761517+0000","172.21.15.44:6834/97015923":"2024-05-17T22:34:22.451767+0000","172.21.15.44:6832/97015923":"2024-05-17T22:34:22.451767+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-16T23:36:23.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.785+0000 7fe41f6f2640 1 -- 172.21.15.44:0/3982474363 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fe404076300 msgr2=0x7fe404078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:23.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.785+0000 7fe41f6f2640 1 --2- 172.21.15.44:0/3982474363 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fe404076300 0x7fe404078810 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe410003610 tx=0x7fe410008040 comp rx=0 tx=0).stop 2024-05-16T23:36:23.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.785+0000 7fe41f6f2640 1 -- 172.21.15.44:0/3982474363 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4180be230 msgr2=0x7fe4180a6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:23.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.785+0000 7fe41f6f2640 1 --2- 172.21.15.44:0/3982474363 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4180be230 0x7fe4180a6f70 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe40c000c00 tx=0x7fe40c0046c0 comp rx=0 tx=0).stop 2024-05-16T23:36:23.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.785+0000 7fe41f6f2640 1 -- 172.21.15.44:0/3982474363 shutdown_connections 2024-05-16T23:36:23.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.785+0000 7fe41f6f2640 1 --2- 172.21.15.44:0/3982474363 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fe404076300 0x7fe404078810 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:23.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.785+0000 7fe41f6f2640 1 --2- 172.21.15.44:0/3982474363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe41814ebd0 0x7fe4180a88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:23.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.785+0000 7fe41f6f2640 1 --2- 172.21.15.44:0/3982474363 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4180be230 0x7fe4180a6f70 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:23.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.785+0000 7fe41f6f2640 1 --2- 172.21.15.44:0/3982474363 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe4180bd510 0x7fe41814b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:23.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.785+0000 7fe41f6f2640 1 -- 172.21.15.44:0/3982474363 >> 172.21.15.44:0/3982474363 conn(0x7fe4180c3cd0 msgr2=0x7fe4180bd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T23:36:23.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.786+0000 7fe41f6f2640 1 -- 172.21.15.44:0/3982474363 shutdown_connections 2024-05-16T23:36:23.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:22.786+0000 7fe41f6f2640 1 -- 172.21.15.44:0/3982474363 wait complete. 2024-05-16T23:36:24.360 INFO:tasks.ceph:Scrubbing osd.0 2024-05-16T23:36:24.366 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-16T23:36:24.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.504+0000 7fcc55b00640 1 Processor -- start 2024-05-16T23:36:24.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.504+0000 7fcc55b00640 1 -- start start 2024-05-16T23:36:24.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.505+0000 7fcc55b00640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcc500bf050 0x7fcc50159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:24.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.505+0000 7fcc55b00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc5006e140 con 0x7fcc500bd6d0 2024-05-16T23:36:24.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.505+0000 7fcc55b00640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc500c36f0 con 0x7fcc50151fc0 2024-05-16T23:36:24.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.505+0000 7fcc55b00640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fcc50152530 con 0x7fcc500bf050 2024-05-16T23:36:24.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.505+0000 7fcc4effd640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fcc500bd6d0 0x7fcc500be940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:42078/0 (socket says 172.21.15.44:42078) 2024-05-16T23:36:24.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.505+0000 7fcc4effd640 1 -- 172.21.15.44:0/3760857983 learned_addr learned my addr 172.21.15.44:0/3760857983 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T23:36:24.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.505+0000 7fcc4ffff640 1 --2- 172.21.15.44:0/3760857983 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcc500bf050 0x7fcc50159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:24.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.505+0000 7fcc4e7fc640 1 -- 172.21.15.44:0/3760857983 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 913250927 0 0) 0x7fcc38001110 con 0x7fcc500bd6d0 2024-05-16T23:36:24.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.505+0000 7fcc4e7fc640 1 -- 172.21.15.44:0/3760857983 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc3c003520 con 0x7fcc500bd6d0 2024-05-16T23:36:24.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.505+0000 7fcc4e7fc640 1 -- 172.21.15.44:0/3760857983 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 388014276 0 0) 0x7fcc500c36f0 con 0x7fcc50151fc0 2024-05-16T23:36:24.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.505+0000 7fcc4e7fc640 1 -- 172.21.15.44:0/3760857983 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc38001110 con 0x7fcc50151fc0 2024-05-16T23:36:24.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.506+0000 7fcc4e7fc640 1 -- 172.21.15.44:0/3760857983 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3362343418 0 0) 0x7fcc3c003520 con 0x7fcc500bd6d0 2024-05-16T23:36:24.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.506+0000 7fcc4ffff640 1 -- 172.21.15.44:0/3760857983 >> v1:172.21.15.70:6789/0 conn(0x7fcc50151fc0 legacy=0x7fcc5006da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:24.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.506+0000 7fcc4ffff640 1 -- 172.21.15.44:0/3760857983 >> v1:172.21.15.44:6789/0 conn(0x7fcc500bd6d0 legacy=0x7fcc500be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:24.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.506+0000 7fcc4ffff640 1 -- 172.21.15.44:0/3760857983 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc50152810 con 0x7fcc500bf050 2024-05-16T23:36:24.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.506+0000 7fcc4ffff640 1 --2- 172.21.15.44:0/3760857983 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcc500bf050 0x7fcc50159ea0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcc48009dc0 tx=0x7fcc4802a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d5c37bacd2e857a server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:24.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.507+0000 7fcc4e7fc640 1 -- 172.21.15.44:0/3760857983 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc380018c0 con 0x7fcc500bf050 2024-05-16T23:36:24.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.507+0000 7fcc4e7fc640 1 -- 172.21.15.44:0/3760857983 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc48007540 con 0x7fcc500bf050 2024-05-16T23:36:24.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.507+0000 7fcc4e7fc640 1 -- 172.21.15.44:0/3760857983 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc48007910 con 0x7fcc500bf050 2024-05-16T23:36:24.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.507+0000 7fcc55b00640 1 -- 172.21.15.44:0/3760857983 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcc500bf050 msgr2=0x7fcc50159ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:24.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.507+0000 7fcc55b00640 1 --2- 172.21.15.44:0/3760857983 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcc500bf050 0x7fcc50159ea0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcc48009dc0 tx=0x7fcc4802a5d0 comp rx=0 tx=0).stop 2024-05-16T23:36:24.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.507+0000 7fcc55b00640 1 -- 172.21.15.44:0/3760857983 shutdown_connections 2024-05-16T23:36:24.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.507+0000 7fcc55b00640 1 --2- 172.21.15.44:0/3760857983 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcc500bf050 0x7fcc50159ea0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:24.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.507+0000 7fcc55b00640 1 -- 172.21.15.44:0/3760857983 >> 172.21.15.44:0/3760857983 conn(0x7fcc500c3d20 msgr2=0x7fcc500c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T23:36:24.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.507+0000 7fcc55b00640 1 -- 172.21.15.44:0/3760857983 shutdown_connections 2024-05-16T23:36:24.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.507+0000 7fcc55b00640 1 -- 172.21.15.44:0/3760857983 wait complete. 2024-05-16T23:36:24.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.509+0000 7fcc55b00640 1 Processor -- start 2024-05-16T23:36:24.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.509+0000 7fcc55b00640 1 -- start start 2024-05-16T23:36:24.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.510+0000 7fcc55b00640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcc500bd6d0 0x7fcc501db360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:24.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.510+0000 7fcc55b00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcc500bf050 0x7fcc501e4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:24.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.510+0000 7fcc55b00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc50151fc0 0x7fcc5014e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:24.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.510+0000 7fcc55b00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcc500a2ed0 con 0x7fcc50151fc0 2024-05-16T23:36:24.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.510+0000 7fcc55b00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcc500bdae0 con 0x7fcc500bf050 2024-05-16T23:36:24.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.510+0000 7fcc55b00640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fcc500a3050 con 0x7fcc500bd6d0 2024-05-16T23:36:24.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.510+0000 7fcc4ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc50151fc0 0x7fcc5014e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:24.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.510+0000 7fcc4ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc50151fc0 0x7fcc5014e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44378/0 (socket says 172.21.15.44:44378) 2024-05-16T23:36:24.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.510+0000 7fcc4ffff640 1 -- 172.21.15.44:0/4192009442 learned_addr learned my addr 172.21.15.44:0/4192009442 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T23:36:25.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.510+0000 7fcc4f7fe640 1 --2- 172.21.15.44:0/4192009442 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcc500bd6d0 0x7fcc501db360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:25.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.510+0000 7fcc4effd640 1 --2- 172.21.15.44:0/4192009442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcc500bf050 0x7fcc501e4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:25.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.511+0000 7fcc4ffff640 1 -- 172.21.15.44:0/4192009442 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcc500bd6d0 msgr2=0x7fcc501db360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:25.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.511+0000 7fcc4ffff640 1 --2- 172.21.15.44:0/4192009442 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcc500bd6d0 0x7fcc501db360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:25.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.511+0000 7fcc4ffff640 1 -- 172.21.15.44:0/4192009442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcc500bf050 msgr2=0x7fcc501e4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:25.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.511+0000 7fcc4ffff640 1 --2- 172.21.15.44:0/4192009442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcc500bf050 0x7fcc501e4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:25.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.511+0000 7fcc4ffff640 1 -- 172.21.15.44:0/4192009442 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc501db8a0 con 0x7fcc50151fc0 2024-05-16T23:36:25.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.511+0000 7fcc4ffff640 1 --2- 172.21.15.44:0/4192009442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc50151fc0 0x7fcc5014e1d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fcc48009ee0 tx=0x7fcc48004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:25.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.511+0000 7fcc47fff640 1 -- 172.21.15.44:0/4192009442 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc4803f070 con 0x7fcc50151fc0 2024-05-16T23:36:25.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.511+0000 7fcc47fff640 1 -- 172.21.15.44:0/4192009442 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc48031bc0 con 0x7fcc50151fc0 2024-05-16T23:36:25.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.511+0000 7fcc55b00640 1 -- 172.21.15.44:0/4192009442 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc501e5380 con 0x7fcc50151fc0 2024-05-16T23:36:25.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.511+0000 7fcc47fff640 1 -- 172.21.15.44:0/4192009442 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc48009450 con 0x7fcc50151fc0 2024-05-16T23:36:25.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.511+0000 7fcc55b00640 1 -- 172.21.15.44:0/4192009442 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc501e86b0 con 0x7fcc50151fc0 2024-05-16T23:36:25.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.512+0000 7fcc55b00640 1 -- 172.21.15.44:0/4192009442 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcc501e4a20 con 0x7fcc50151fc0 2024-05-16T23:36:25.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.513+0000 7fcc47fff640 1 -- 172.21.15.44:0/4192009442 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcc48044460 con 0x7fcc50151fc0 2024-05-16T23:36:25.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.513+0000 7fcc47fff640 1 --2- 172.21.15.44:0/4192009442 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fcc300762d0 0x7fcc300787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:25.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.514+0000 7fcc47fff640 1 -- 172.21.15.44:0/4192009442 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5029+0+0 (secure 0 0 0) 0x7fcc480b8f30 con 0x7fcc50151fc0 2024-05-16T23:36:25.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.514+0000 7fcc47fff640 1 --2- 172.21.15.44:0/4192009442 >> [v2:172.21.15.44:6824/1074109859,v1:172.21.15.44:6825/1074109859] conn(0x7fcc3007c280 0x7fcc3007e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:25.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.514+0000 7fcc47fff640 1 -- 172.21.15.44:0/4192009442 --> [v2:172.21.15.44:6824/1074109859,v1:172.21.15.44:6825/1074109859] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcc48007540 con 0x7fcc3007c280 2024-05-16T23:36:25.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.514+0000 7fcc47fff640 1 -- 172.21.15.44:0/4192009442 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fcc480b93c0 con 0x7fcc50151fc0 2024-05-16T23:36:25.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.514+0000 7fcc4f7fe640 1 --2- 172.21.15.44:0/4192009442 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fcc300762d0 0x7fcc300787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:25.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.514+0000 7fcc4effd640 1 --2- 172.21.15.44:0/4192009442 >> [v2:172.21.15.44:6824/1074109859,v1:172.21.15.44:6825/1074109859] conn(0x7fcc3007c280 0x7fcc3007e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:25.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.514+0000 7fcc4effd640 1 --2- 172.21.15.44:0/4192009442 >> [v2:172.21.15.44:6824/1074109859,v1:172.21.15.44:6825/1074109859] conn(0x7fcc3007c280 0x7fcc3007e6d0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:25.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.514+0000 7fcc4f7fe640 1 --2- 172.21.15.44:0/4192009442 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fcc300762d0 0x7fcc300787e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fcc40001120 tx=0x7fcc40009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:25.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.515+0000 7fcc47fff640 1 -- 172.21.15.44:0/4192009442 <== osd.0 v2:172.21.15.44:6824/1074109859 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcc48007540 con 0x7fcc3007c280 2024-05-16T23:36:25.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.528+0000 7fcc55b00640 1 -- 172.21.15.44:0/4192009442 --> [v2:172.21.15.44:6824/1074109859,v1:172.21.15.44:6825/1074109859] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fcc500bb1f0 con 0x7fcc3007c280 2024-05-16T23:36:25.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.529+0000 7fcc47fff640 1 -- 172.21.15.44:0/4192009442 <== osd.0 v2:172.21.15.44:6824/1074109859 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fcc500bb1f0 con 0x7fcc3007c280 2024-05-16T23:36:25.291 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-05-16T23:36:25.300 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-16T23:36:25.308 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-05-16T23:36:25.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.529+0000 7fcc55b00640 1 -- 172.21.15.44:0/4192009442 >> [v2:172.21.15.44:6824/1074109859,v1:172.21.15.44:6825/1074109859] conn(0x7fcc3007c280 msgr2=0x7fcc3007e6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:25.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.529+0000 7fcc55b00640 1 --2- 172.21.15.44:0/4192009442 >> [v2:172.21.15.44:6824/1074109859,v1:172.21.15.44:6825/1074109859] conn(0x7fcc3007c280 0x7fcc3007e6d0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:25.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.529+0000 7fcc55b00640 1 -- 172.21.15.44:0/4192009442 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fcc300762d0 msgr2=0x7fcc300787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:25.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.529+0000 7fcc55b00640 1 --2- 172.21.15.44:0/4192009442 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fcc300762d0 0x7fcc300787e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fcc40001120 tx=0x7fcc40009040 comp rx=0 tx=0).stop 2024-05-16T23:36:25.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.529+0000 7fcc55b00640 1 -- 172.21.15.44:0/4192009442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc50151fc0 msgr2=0x7fcc5014e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:25.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.529+0000 7fcc55b00640 1 --2- 172.21.15.44:0/4192009442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc50151fc0 0x7fcc5014e1d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fcc48009ee0 tx=0x7fcc48004a40 comp rx=0 tx=0).stop 2024-05-16T23:36:25.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.529+0000 7fcc4ffff640 1 -- 172.21.15.44:0/4192009442 reap_dead start 2024-05-16T23:36:25.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.529+0000 7fcc55b00640 1 -- 172.21.15.44:0/4192009442 shutdown_connections 2024-05-16T23:36:25.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.529+0000 7fcc55b00640 1 -- 172.21.15.44:0/4192009442 >> 172.21.15.44:0/4192009442 conn(0x7fcc500c3d20 msgr2=0x7fcc500c0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T23:36:25.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.529+0000 7fcc55b00640 1 -- 172.21.15.44:0/4192009442 shutdown_connections 2024-05-16T23:36:25.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:24.529+0000 7fcc55b00640 1 -- 172.21.15.44:0/4192009442 wait complete. 2024-05-16T23:36:25.485 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-16T23:36:25.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.621+0000 7f2d6fb1f640 1 Processor -- start 2024-05-16T23:36:25.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.621+0000 7f2d6fb1f640 1 -- start start 2024-05-16T23:36:25.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.621+0000 7f2d6fb1f640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d68148770 0x7f2d680c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:25.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.621+0000 7f2d6fb1f640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d680c0620 con 0x7f2d680bf9b0 2024-05-16T23:36:25.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.621+0000 7f2d6fb1f640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d68151ad0 con 0x7f2d6814e360 2024-05-16T23:36:25.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.621+0000 7f2d6fb1f640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f2d68151e40 con 0x7f2d68148770 2024-05-16T23:36:25.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.621+0000 7f2d6e0bc640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f2d680bf9b0 0x7f2d680bfdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:42082/0 (socket says 172.21.15.44:42082) 2024-05-16T23:36:25.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.622+0000 7f2d6e0bc640 1 -- 172.21.15.44:0/2734546924 learned_addr learned my addr 172.21.15.44:0/2734546924 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T23:36:25.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.622+0000 7f2d6d0ba640 1 --2- 172.21.15.44:0/2734546924 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d68148770 0x7f2d680c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:25.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.622+0000 7f2d6c8b9640 1 -- 172.21.15.44:0/2734546924 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 490372971 0 0) 0x7f2d680c0620 con 0x7f2d680bf9b0 2024-05-16T23:36:25.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.622+0000 7f2d6c8b9640 1 -- 172.21.15.44:0/2734546924 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d54003520 con 0x7f2d680bf9b0 2024-05-16T23:36:25.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.622+0000 7f2d6c8b9640 1 -- 172.21.15.44:0/2734546924 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2357208853 0 0) 0x7f2d54003520 con 0x7f2d680bf9b0 2024-05-16T23:36:25.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.622+0000 7f2d6c8b9640 1 -- 172.21.15.44:0/2734546924 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d68148770 msgr2=0x7f2d680c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T23:36:25.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.622+0000 7f2d6c8b9640 1 --2- 172.21.15.44:0/2734546924 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d68148770 0x7f2d680c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:25.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.622+0000 7f2d6c8b9640 1 -- 172.21.15.44:0/2734546924 >> v1:172.21.15.70:6789/0 conn(0x7f2d6814e360 legacy=0x7f2d681522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:25.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.622+0000 7f2d6c8b9640 1 -- 172.21.15.44:0/2734546924 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d680c11c0 con 0x7f2d680bf9b0 2024-05-16T23:36:25.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.622+0000 7f2d6c8b9640 1 -- 172.21.15.44:0/2734546924 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 568431863 0 0) 0x7f2d64001a90 con 0x7f2d680bf9b0 2024-05-16T23:36:25.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.622+0000 7f2d6c8b9640 1 -- 172.21.15.44:0/2734546924 >> v1:172.21.15.44:6789/0 conn(0x7f2d680bf9b0 legacy=0x7f2d680bfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:25.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.622+0000 7f2d6c8b9640 1 --2- 172.21.15.44:0/2734546924 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d540039e0 0x7f2d54003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:25.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.622+0000 7f2d6c8b9640 1 --2- 172.21.15.44:0/2734546924 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d54004800 0x7f2d54004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:25.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.622+0000 7f2d6c8b9640 1 --2- 172.21.15.44:0/2734546924 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d68148770 0x7f2d54005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:25.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.622+0000 7f2d6c8b9640 1 -- 172.21.15.44:0/2734546924 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2d68151e40 con 0x7f2d540039e0 2024-05-16T23:36:25.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.622+0000 7f2d6c8b9640 1 -- 172.21.15.44:0/2734546924 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2d5400bb50 con 0x7f2d54004800 2024-05-16T23:36:25.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.622+0000 7f2d6c8b9640 1 -- 172.21.15.44:0/2734546924 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f2d5400bd00 con 0x7f2d68148770 2024-05-16T23:36:25.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.622+0000 7f2d6d8bb640 1 --2- 172.21.15.44:0/2734546924 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d540039e0 0x7f2d54003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:25.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.622+0000 7f2d6d0ba640 1 --2- 172.21.15.44:0/2734546924 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d54004800 0x7f2d54004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:25.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.622+0000 7f2d6e0bc640 1 --2- 172.21.15.44:0/2734546924 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d68148770 0x7f2d54005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:25.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.623+0000 7f2d6d8bb640 1 -- 172.21.15.44:0/2734546924 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d68148770 msgr2=0x7f2d54005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T23:36:25.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.623+0000 7f2d6d8bb640 1 --2- 172.21.15.44:0/2734546924 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d68148770 0x7f2d54005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:25.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.623+0000 7f2d6d8bb640 1 -- 172.21.15.44:0/2734546924 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d54004800 msgr2=0x7f2d54004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T23:36:25.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.623+0000 7f2d6d8bb640 1 --2- 172.21.15.44:0/2734546924 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d54004800 0x7f2d54004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:25.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.623+0000 7f2d6d8bb640 1 -- 172.21.15.44:0/2734546924 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d54003520 con 0x7f2d540039e0 2024-05-16T23:36:25.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.623+0000 7f2d6d8bb640 1 --2- 172.21.15.44:0/2734546924 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d540039e0 0x7f2d54003e10 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f2d60001810 tx=0x7f2d54005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7847eda3939f8a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:25.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.624+0000 7f2d6c8b9640 1 -- 172.21.15.44:0/2734546924 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d60037070 con 0x7f2d540039e0 2024-05-16T23:36:25.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.624+0000 7f2d6c8b9640 1 -- 172.21.15.44:0/2734546924 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d6002ac80 con 0x7f2d540039e0 2024-05-16T23:36:25.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.624+0000 7f2d6c8b9640 1 -- 172.21.15.44:0/2734546924 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d60001430 con 0x7f2d540039e0 2024-05-16T23:36:25.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.624+0000 7f2d6fb1f640 1 -- 172.21.15.44:0/2734546924 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d540039e0 msgr2=0x7f2d54003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:25.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.624+0000 7f2d6fb1f640 1 --2- 172.21.15.44:0/2734546924 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d540039e0 0x7f2d54003e10 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f2d60001810 tx=0x7f2d54005830 comp rx=0 tx=0).stop 2024-05-16T23:36:25.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.624+0000 7f2d6e0bc640 1 -- 172.21.15.44:0/2734546924 reap_dead start 2024-05-16T23:36:26.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.624+0000 7f2d6fb1f640 1 -- 172.21.15.44:0/2734546924 shutdown_connections 2024-05-16T23:36:26.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.624+0000 7f2d6fb1f640 1 -- 172.21.15.44:0/2734546924 >> 172.21.15.44:0/2734546924 conn(0x7f2d680c17c0 msgr2=0x7f2d680c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T23:36:26.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.624+0000 7f2d6fb1f640 1 -- 172.21.15.44:0/2734546924 shutdown_connections 2024-05-16T23:36:26.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.624+0000 7f2d6fb1f640 1 -- 172.21.15.44:0/2734546924 wait complete. 2024-05-16T23:36:26.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.626+0000 7f2d6fb1f640 1 Processor -- start 2024-05-16T23:36:26.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.626+0000 7f2d6fb1f640 1 -- start start 2024-05-16T23:36:26.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.627+0000 7f2d6fb1f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d540039e0 0x7f2d68070d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:26.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.627+0000 7f2d6fb1f640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d68071fd0 0x7f2d6814f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:26.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.627+0000 7f2d6fb1f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d6813f8e0 0x7f2d6813fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:26.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.627+0000 7f2d6fb1f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2d68154ca0 con 0x7f2d540039e0 2024-05-16T23:36:26.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.627+0000 7f2d6fb1f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2d680c0ed0 con 0x7f2d6813f8e0 2024-05-16T23:36:26.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.627+0000 7f2d6fb1f640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f2d68154e20 con 0x7f2d68071fd0 2024-05-16T23:36:26.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.627+0000 7f2d6d8bb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d540039e0 0x7f2d68070d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:26.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.627+0000 7f2d6d8bb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d540039e0 0x7f2d68070d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44392/0 (socket says 172.21.15.44:44392) 2024-05-16T23:36:26.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.627+0000 7f2d6d8bb640 1 -- 172.21.15.44:0/24239011 learned_addr learned my addr 172.21.15.44:0/24239011 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T23:36:26.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.627+0000 7f2d6d0ba640 1 --2- 172.21.15.44:0/24239011 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d68071fd0 0x7f2d6814f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:26.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.627+0000 7f2d6e0bc640 1 --2- 172.21.15.44:0/24239011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d6813f8e0 0x7f2d6813fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:26.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.627+0000 7f2d6d8bb640 1 -- 172.21.15.44:0/24239011 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d68071fd0 msgr2=0x7f2d6814f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:26.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.627+0000 7f2d6d8bb640 1 --2- 172.21.15.44:0/24239011 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d68071fd0 0x7f2d6814f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:26.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.627+0000 7f2d6d8bb640 1 -- 172.21.15.44:0/24239011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d6813f8e0 msgr2=0x7f2d6813fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:26.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.627+0000 7f2d6d8bb640 1 --2- 172.21.15.44:0/24239011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d6813f8e0 0x7f2d6813fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:26.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.627+0000 7f2d6d8bb640 1 -- 172.21.15.44:0/24239011 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d68150b10 con 0x7f2d540039e0 2024-05-16T23:36:26.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.627+0000 7f2d6d0ba640 1 --2- 172.21.15.44:0/24239011 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d68071fd0 0x7f2d6814f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T23:36:26.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.628+0000 7f2d6d8bb640 1 --2- 172.21.15.44:0/24239011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d540039e0 0x7f2d68070d10 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f2d6002a670 tx=0x7f2d60001110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:26.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.628+0000 7f2d5e7fc640 1 -- 172.21.15.44:0/24239011 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d60037040 con 0x7f2d540039e0 2024-05-16T23:36:26.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.628+0000 7f2d5e7fc640 1 -- 172.21.15.44:0/24239011 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d60003c70 con 0x7f2d540039e0 2024-05-16T23:36:26.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.628+0000 7f2d6fb1f640 1 -- 172.21.15.44:0/24239011 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d68071580 con 0x7f2d540039e0 2024-05-16T23:36:26.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.628+0000 7f2d5e7fc640 1 -- 172.21.15.44:0/24239011 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d60007a10 con 0x7f2d540039e0 2024-05-16T23:36:26.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.628+0000 7f2d6fb1f640 1 -- 172.21.15.44:0/24239011 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d68150dc0 con 0x7f2d540039e0 2024-05-16T23:36:26.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.629+0000 7f2d6fb1f640 1 -- 172.21.15.44:0/24239011 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d680c0620 con 0x7f2d540039e0 2024-05-16T23:36:26.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.631+0000 7f2d5e7fc640 1 -- 172.21.15.44:0/24239011 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2d60007260 con 0x7f2d540039e0 2024-05-16T23:36:26.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.631+0000 7f2d5e7fc640 1 --2- 172.21.15.44:0/24239011 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f2d4c076300 0x7f2d4c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:26.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.631+0000 7f2d5e7fc640 1 -- 172.21.15.44:0/24239011 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5029+0+0 (secure 0 0 0) 0x7f2d600b7350 con 0x7f2d540039e0 2024-05-16T23:36:26.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.631+0000 7f2d6d0ba640 1 --2- 172.21.15.44:0/24239011 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f2d4c076300 0x7f2d4c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:26.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.631+0000 7f2d6d0ba640 1 --2- 172.21.15.44:0/24239011 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f2d4c076300 0x7f2d4c078810 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2d6814beb0 tx=0x7f2d58008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:26.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.635+0000 7f2d5e7fc640 1 -- 172.21.15.44:0/24239011 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2d680c0620 con 0x7f2d540039e0 2024-05-16T23:36:26.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.826+0000 7f2d6fb1f640 1 -- 172.21.15.44:0/24239011 --> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f2d68071c30 con 0x7f2d4c076300 2024-05-16T23:36:26.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.826+0000 7f2d5e7fc640 1 -- 172.21.15.44:0/24239011 <== mgr.4114 v2:172.21.15.70:6832/4049588098 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2d68071c30 con 0x7f2d4c076300 2024-05-16T23:36:26.435 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 0 to deep-scrub 2024-05-16T23:36:26.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.829+0000 7f2d6fb1f640 1 -- 172.21.15.44:0/24239011 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f2d4c076300 msgr2=0x7f2d4c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:26.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.829+0000 7f2d6fb1f640 1 --2- 172.21.15.44:0/24239011 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f2d4c076300 0x7f2d4c078810 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2d6814beb0 tx=0x7f2d58008040 comp rx=0 tx=0).stop 2024-05-16T23:36:26.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.829+0000 7f2d6fb1f640 1 -- 172.21.15.44:0/24239011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d540039e0 msgr2=0x7f2d68070d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:26.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.829+0000 7f2d6fb1f640 1 --2- 172.21.15.44:0/24239011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d540039e0 0x7f2d68070d10 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f2d6002a670 tx=0x7f2d60001110 comp rx=0 tx=0).stop 2024-05-16T23:36:26.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.829+0000 7f2d6fb1f640 1 -- 172.21.15.44:0/24239011 shutdown_connections 2024-05-16T23:36:26.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.829+0000 7f2d6fb1f640 1 --2- 172.21.15.44:0/24239011 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f2d4c076300 0x7f2d4c078810 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:26.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.829+0000 7f2d6fb1f640 1 --2- 172.21.15.44:0/24239011 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d68071fd0 0x7f2d6814f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:26.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.829+0000 7f2d6fb1f640 1 --2- 172.21.15.44:0/24239011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d6813f8e0 0x7f2d6813fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:26.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.829+0000 7f2d6fb1f640 1 --2- 172.21.15.44:0/24239011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2d540039e0 0x7f2d68070d10 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:26.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.829+0000 7f2d6fb1f640 1 -- 172.21.15.44:0/24239011 >> 172.21.15.44:0/24239011 conn(0x7f2d680c17c0 msgr2=0x7f2d680a4970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T23:36:26.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.829+0000 7f2d6fb1f640 1 -- 172.21.15.44:0/24239011 shutdown_connections 2024-05-16T23:36:26.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:25.829+0000 7f2d6fb1f640 1 -- 172.21.15.44:0/24239011 wait complete. 2024-05-16T23:36:26.575 INFO:tasks.ceph:Scrubbing osd.1 2024-05-16T23:36:26.583 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-16T23:36:26.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.723+0000 7f9164bb7640 1 Processor -- start 2024-05-16T23:36:26.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.723+0000 7f9164bb7640 1 -- start start 2024-05-16T23:36:26.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.725+0000 7f9164bb7640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f91600a9060 0x7f9160148910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:26.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.725+0000 7f9164bb7640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f91600ba0f0 0x7f916014e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:26.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.725+0000 7f9164bb7640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91600b8a30 con 0x7f91600ba500 2024-05-16T23:36:26.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.725+0000 7f9164bb7640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f91600b8d10 con 0x7f91600a9060 2024-05-16T23:36:26.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.725+0000 7f9164bb7640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f91600b8ff0 con 0x7f91600ba0f0 2024-05-16T23:36:26.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.725+0000 7f915e59c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f91600a9060 0x7f9160148910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:26.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.725+0000 7f915e59c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f91600a9060 0x7f9160148910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44408/0 (socket says 172.21.15.44:44408) 2024-05-16T23:36:26.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.725+0000 7f915ed9d640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f91600ba500 0x7f9160151a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:42098/0 (socket says 172.21.15.44:42098) 2024-05-16T23:36:26.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.725+0000 7f915e59c640 1 -- 172.21.15.44:0/485710578 learned_addr learned my addr 172.21.15.44:0/485710578 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T23:36:26.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.725+0000 7f915dd9b640 1 --2- 172.21.15.44:0/485710578 >> v2:172.21.15.70:3300/0 conn(0x7f91600ba0f0 0x7f916014e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:26.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.725+0000 7f915e59c640 1 -- 172.21.15.44:0/485710578 >> v2:172.21.15.70:3300/0 conn(0x7f91600ba0f0 msgr2=0x7f916014e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T23:36:26.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.725+0000 7f915e59c640 1 --2- 172.21.15.44:0/485710578 >> v2:172.21.15.70:3300/0 conn(0x7f91600ba0f0 0x7f916014e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:26.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.725+0000 7f915e59c640 1 -- 172.21.15.44:0/485710578 >> v1:172.21.15.44:6789/0 conn(0x7f91600ba500 legacy=0x7f9160151a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:26.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.725+0000 7f915e59c640 1 -- 172.21.15.44:0/485710578 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91600b92d0 con 0x7f91600a9060 2024-05-16T23:36:26.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.725+0000 7f915d59a640 1 -- 172.21.15.44:0/485710578 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3874933748 0 0) 0x7f91600b8a30 con 0x7f91600ba500 2024-05-16T23:36:26.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.726+0000 7f915e59c640 1 --2- 172.21.15.44:0/485710578 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91600a9060 0x7f9160148910 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f91600c0370 tx=0x7f915002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad9629db84d62b32 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:26.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.726+0000 7f915d59a640 1 -- 172.21.15.44:0/485710578 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9150037070 con 0x7f91600a9060 2024-05-16T23:36:26.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.726+0000 7f915d59a640 1 -- 172.21.15.44:0/485710578 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f915002ae50 con 0x7f91600a9060 2024-05-16T23:36:26.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.726+0000 7f915d59a640 1 -- 172.21.15.44:0/485710578 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9150032860 con 0x7f91600a9060 2024-05-16T23:36:26.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.727+0000 7f9164bb7640 1 -- 172.21.15.44:0/485710578 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91600a9060 msgr2=0x7f9160148910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:27.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.727+0000 7f9164bb7640 1 --2- 172.21.15.44:0/485710578 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91600a9060 0x7f9160148910 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f91600c0370 tx=0x7f915002a300 comp rx=0 tx=0).stop 2024-05-16T23:36:27.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.727+0000 7f9164bb7640 1 -- 172.21.15.44:0/485710578 shutdown_connections 2024-05-16T23:36:27.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.727+0000 7f9164bb7640 1 --2- 172.21.15.44:0/485710578 >> v2:172.21.15.70:3300/0 conn(0x7f91600ba0f0 0x7f916014e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:27.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.727+0000 7f9164bb7640 1 --2- 172.21.15.44:0/485710578 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91600a9060 0x7f9160148910 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:27.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.727+0000 7f9164bb7640 1 -- 172.21.15.44:0/485710578 >> 172.21.15.44:0/485710578 conn(0x7f91600c07c0 msgr2=0x7f91600c0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T23:36:27.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.727+0000 7f9164bb7640 1 -- 172.21.15.44:0/485710578 shutdown_connections 2024-05-16T23:36:27.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.727+0000 7f9164bb7640 1 -- 172.21.15.44:0/485710578 wait complete. 2024-05-16T23:36:27.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.729+0000 7f9164bb7640 1 Processor -- start 2024-05-16T23:36:27.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.729+0000 7f9164bb7640 1 -- start start 2024-05-16T23:36:27.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.730+0000 7f9164bb7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91600a9060 0x7f9160146c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:27.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.730+0000 7f9164bb7640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f91600ba0f0 0x7f9160150440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:27.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.730+0000 7f9164bb7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91600ba500 0x7f9160143ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:27.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.730+0000 7f9164bb7640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f916008dbb0 con 0x7f91600ba500 2024-05-16T23:36:27.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.730+0000 7f9164bb7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f916008da30 con 0x7f91600a9060 2024-05-16T23:36:27.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.730+0000 7f9164bb7640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f916014eba0 con 0x7f91600ba0f0 2024-05-16T23:36:27.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.730+0000 7f915ed9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91600ba500 0x7f9160143ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:27.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.730+0000 7f915ed9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91600ba500 0x7f9160143ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44414/0 (socket says 172.21.15.44:44414) 2024-05-16T23:36:27.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.730+0000 7f915ed9d640 1 -- 172.21.15.44:0/3160166666 learned_addr learned my addr 172.21.15.44:0/3160166666 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T23:36:27.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.730+0000 7f915e59c640 1 --2- 172.21.15.44:0/3160166666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91600a9060 0x7f9160146c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:27.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.730+0000 7f915dd9b640 1 --2- 172.21.15.44:0/3160166666 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f91600ba0f0 0x7f9160150440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:27.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.730+0000 7f915ed9d640 1 -- 172.21.15.44:0/3160166666 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f91600ba0f0 msgr2=0x7f9160150440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:27.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.730+0000 7f915ed9d640 1 --2- 172.21.15.44:0/3160166666 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f91600ba0f0 0x7f9160150440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:27.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.730+0000 7f915ed9d640 1 -- 172.21.15.44:0/3160166666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91600a9060 msgr2=0x7f9160146c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:27.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.730+0000 7f915ed9d640 1 --2- 172.21.15.44:0/3160166666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91600a9060 0x7f9160146c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:27.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.730+0000 7f915ed9d640 1 -- 172.21.15.44:0/3160166666 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9160147160 con 0x7f91600ba500 2024-05-16T23:36:27.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.730+0000 7f915dd9b640 1 --2- 172.21.15.44:0/3160166666 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f91600ba0f0 0x7f9160150440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T23:36:27.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.730+0000 7f915ed9d640 1 --2- 172.21.15.44:0/3160166666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91600ba500 0x7f9160143ac0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f915800c680 tx=0x7f915800cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:27.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.731+0000 7f914effd640 1 -- 172.21.15.44:0/3160166666 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9158018070 con 0x7f91600ba500 2024-05-16T23:36:27.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.731+0000 7f914effd640 1 -- 172.21.15.44:0/3160166666 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9158004d60 con 0x7f91600ba500 2024-05-16T23:36:27.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.731+0000 7f914effd640 1 -- 172.21.15.44:0/3160166666 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915800a880 con 0x7f91600ba500 2024-05-16T23:36:27.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.731+0000 7f9164bb7640 1 -- 172.21.15.44:0/3160166666 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9160150980 con 0x7f91600ba500 2024-05-16T23:36:27.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.731+0000 7f9164bb7640 1 -- 172.21.15.44:0/3160166666 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9160151f00 con 0x7f91600ba500 2024-05-16T23:36:27.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.731+0000 7f9164bb7640 1 -- 172.21.15.44:0/3160166666 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9160152700 con 0x7f91600ba500 2024-05-16T23:36:27.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.732+0000 7f914effd640 1 -- 172.21.15.44:0/3160166666 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f915800aa20 con 0x7f91600ba500 2024-05-16T23:36:27.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.733+0000 7f914effd640 1 --2- 172.21.15.44:0/3160166666 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f91400762d0 0x7f91400787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:27.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.733+0000 7f914effd640 1 -- 172.21.15.44:0/3160166666 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5029+0+0 (secure 0 0 0) 0x7f91580967f0 con 0x7f91600ba500 2024-05-16T23:36:27.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.733+0000 7f915e59c640 1 --2- 172.21.15.44:0/3160166666 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f91400762d0 0x7f91400787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:27.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.733+0000 7f914effd640 1 --2- 172.21.15.44:0/3160166666 >> [v2:172.21.15.44:6816/2909429972,v1:172.21.15.44:6817/2909429972] conn(0x7f914007c280 0x7f914007e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:27.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.733+0000 7f914effd640 1 -- 172.21.15.44:0/3160166666 --> [v2:172.21.15.44:6816/2909429972,v1:172.21.15.44:6817/2909429972] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f914007eda0 con 0x7f914007c280 2024-05-16T23:36:27.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.733+0000 7f914effd640 1 -- 172.21.15.44:0/3160166666 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f915809b2c0 con 0x7f91600ba500 2024-05-16T23:36:27.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.733+0000 7f915dd9b640 1 --2- 172.21.15.44:0/3160166666 >> [v2:172.21.15.44:6816/2909429972,v1:172.21.15.44:6817/2909429972] conn(0x7f914007c280 0x7f914007e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:27.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.733+0000 7f915dd9b640 1 --2- 172.21.15.44:0/3160166666 >> [v2:172.21.15.44:6816/2909429972,v1:172.21.15.44:6817/2909429972] conn(0x7f914007c280 0x7f914007e6d0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:27.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.734+0000 7f915e59c640 1 --2- 172.21.15.44:0/3160166666 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f91400762d0 0x7f91400787e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9150034000 tx=0x7f915002e000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:27.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.734+0000 7f914effd640 1 -- 172.21.15.44:0/3160166666 <== osd.1 v2:172.21.15.44:6816/2909429972 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f914007eda0 con 0x7f914007c280 2024-05-16T23:36:27.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.747+0000 7f9164bb7640 1 -- 172.21.15.44:0/3160166666 --> [v2:172.21.15.44:6816/2909429972,v1:172.21.15.44:6817/2909429972] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f91600bd9e0 con 0x7f914007c280 2024-05-16T23:36:27.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.748+0000 7f914effd640 1 -- 172.21.15.44:0/3160166666 <== osd.1 v2:172.21.15.44:6816/2909429972 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f91600bd9e0 con 0x7f914007c280 2024-05-16T23:36:27.421 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-05-16T23:36:27.428 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-16T23:36:27.481 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-05-16T23:36:27.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.748+0000 7f9164bb7640 1 -- 172.21.15.44:0/3160166666 >> [v2:172.21.15.44:6816/2909429972,v1:172.21.15.44:6817/2909429972] conn(0x7f914007c280 msgr2=0x7f914007e6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:27.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.748+0000 7f9164bb7640 1 --2- 172.21.15.44:0/3160166666 >> [v2:172.21.15.44:6816/2909429972,v1:172.21.15.44:6817/2909429972] conn(0x7f914007c280 0x7f914007e6d0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:27.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.748+0000 7f9164bb7640 1 -- 172.21.15.44:0/3160166666 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f91400762d0 msgr2=0x7f91400787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:27.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.748+0000 7f9164bb7640 1 --2- 172.21.15.44:0/3160166666 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f91400762d0 0x7f91400787e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9150034000 tx=0x7f915002e000 comp rx=0 tx=0).stop 2024-05-16T23:36:27.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.748+0000 7f9164bb7640 1 -- 172.21.15.44:0/3160166666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91600ba500 msgr2=0x7f9160143ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:27.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.748+0000 7f9164bb7640 1 --2- 172.21.15.44:0/3160166666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91600ba500 0x7f9160143ac0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f915800c680 tx=0x7f915800cb40 comp rx=0 tx=0).stop 2024-05-16T23:36:27.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.748+0000 7f915ed9d640 1 -- 172.21.15.44:0/3160166666 reap_dead start 2024-05-16T23:36:27.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.748+0000 7f9164bb7640 1 -- 172.21.15.44:0/3160166666 shutdown_connections 2024-05-16T23:36:27.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.748+0000 7f9164bb7640 1 -- 172.21.15.44:0/3160166666 >> 172.21.15.44:0/3160166666 conn(0x7f91600c07c0 msgr2=0x7f916014eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T23:36:27.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.748+0000 7f9164bb7640 1 -- 172.21.15.44:0/3160166666 shutdown_connections 2024-05-16T23:36:27.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:26.748+0000 7f9164bb7640 1 -- 172.21.15.44:0/3160166666 wait complete. 2024-05-16T23:36:27.599 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-16T23:36:27.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.747+0000 7f6d4ed34640 1 Processor -- start 2024-05-16T23:36:27.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.747+0000 7f6d4ed34640 1 -- start start 2024-05-16T23:36:27.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.748+0000 7f6d4ed34640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6d480be4f0 0x7f6d480bfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:27.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.748+0000 7f6d4ed34640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6d4814cce0 0x7f6d480716a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:27.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.748+0000 7f6d4ed34640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d480720d0 con 0x7f6d48071be0 2024-05-16T23:36:27.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.748+0000 7f6d4ed34640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f6d480bfa60 con 0x7f6d4814cce0 2024-05-16T23:36:27.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.748+0000 7f6d4ed34640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f6d48071310 con 0x7f6d480be4f0 2024-05-16T23:36:27.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.748+0000 7f6d47fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6d4814cce0 0x7f6d480716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:27.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.748+0000 7f6d47fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6d4814cce0 0x7f6d480716a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44422/0 (socket says 172.21.15.44:44422) 2024-05-16T23:36:27.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.748+0000 7f6d47fff640 1 -- 172.21.15.44:0/3635319668 learned_addr learned my addr 172.21.15.44:0/3635319668 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T23:36:27.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.749+0000 7f6d4cad0640 1 --2- 172.21.15.44:0/3635319668 >> v2:172.21.15.70:3300/0 conn(0x7f6d480be4f0 0x7f6d480bfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:27.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.749+0000 7f6d47fff640 1 -- 172.21.15.44:0/3635319668 >> v2:172.21.15.70:3300/0 conn(0x7f6d480be4f0 msgr2=0x7f6d480bfef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T23:36:27.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.749+0000 7f6d47fff640 1 --2- 172.21.15.44:0/3635319668 >> v2:172.21.15.70:3300/0 conn(0x7f6d480be4f0 0x7f6d480bfef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:27.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.749+0000 7f6d47fff640 1 -- 172.21.15.44:0/3635319668 >> v1:172.21.15.70:6789/0 conn(0x7f6d48071be0 legacy=0x7f6d4814f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T23:36:27.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.749+0000 7f6d47fff640 1 -- 172.21.15.44:0/3635319668 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d480bf6f0 con 0x7f6d4814cce0 2024-05-16T23:36:27.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.750+0000 7f6d47fff640 1 --2- 172.21.15.44:0/3635319668 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d4814cce0 0x7f6d480716a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f6d48073370 tx=0x7f6d3c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba38f18ef814cc8b server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:27.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.750+0000 7f6d477fe640 1 -- 172.21.15.44:0/3635319668 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c037070 con 0x7f6d4814cce0 2024-05-16T23:36:27.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.750+0000 7f6d477fe640 1 -- 172.21.15.44:0/3635319668 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d3c032440 con 0x7f6d4814cce0 2024-05-16T23:36:27.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.750+0000 7f6d477fe640 1 -- 172.21.15.44:0/3635319668 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c032810 con 0x7f6d4814cce0 2024-05-16T23:36:27.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.750+0000 7f6d4ed34640 1 -- 172.21.15.44:0/3635319668 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d4814cce0 msgr2=0x7f6d480716a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:27.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.750+0000 7f6d4ed34640 1 --2- 172.21.15.44:0/3635319668 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d4814cce0 0x7f6d480716a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f6d48073370 tx=0x7f6d3c02a1e0 comp rx=0 tx=0).stop 2024-05-16T23:36:28.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.750+0000 7f6d4ed34640 1 -- 172.21.15.44:0/3635319668 shutdown_connections 2024-05-16T23:36:28.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.750+0000 7f6d4ed34640 1 --2- 172.21.15.44:0/3635319668 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d4814cce0 0x7f6d480716a0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:28.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.750+0000 7f6d4ed34640 1 --2- 172.21.15.44:0/3635319668 >> v2:172.21.15.70:3300/0 conn(0x7f6d480be4f0 0x7f6d480bfef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:28.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.750+0000 7f6d4ed34640 1 -- 172.21.15.44:0/3635319668 >> 172.21.15.44:0/3635319668 conn(0x7f6d480c17c0 msgr2=0x7f6d480c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T23:36:28.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.751+0000 7f6d4ed34640 1 -- 172.21.15.44:0/3635319668 shutdown_connections 2024-05-16T23:36:28.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.751+0000 7f6d4ed34640 1 -- 172.21.15.44:0/3635319668 wait complete. 2024-05-16T23:36:28.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.752+0000 7f6d4ed34640 1 Processor -- start 2024-05-16T23:36:28.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.752+0000 7f6d4ed34640 1 -- start start 2024-05-16T23:36:28.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.753+0000 7f6d4ed34640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d48071be0 0x7f6d481e2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:28.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.753+0000 7f6d4ed34640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d480be4f0 0x7f6d480a2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:28.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.753+0000 7f6d4ed34640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6d4814cce0 0x7f6d480a04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:28.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.753+0000 7f6d4ed34640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6d480c0430 con 0x7f6d480be4f0 2024-05-16T23:36:28.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.753+0000 7f6d4ed34640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6d480723b0 con 0x7f6d48071be0 2024-05-16T23:36:28.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.753+0000 7f6d4ed34640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f6d480a6c90 con 0x7f6d4814cce0 2024-05-16T23:36:28.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.753+0000 7f6d47fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d480be4f0 0x7f6d480a2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:28.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.753+0000 7f6d47fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d480be4f0 0x7f6d480a2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44428/0 (socket says 172.21.15.44:44428) 2024-05-16T23:36:28.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.753+0000 7f6d47fff640 1 -- 172.21.15.44:0/2516298651 learned_addr learned my addr 172.21.15.44:0/2516298651 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T23:36:28.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.754+0000 7f6d4cad0640 1 --2- 172.21.15.44:0/2516298651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d48071be0 0x7f6d481e2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:28.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.754+0000 7f6d4d2d1640 1 --2- 172.21.15.44:0/2516298651 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6d4814cce0 0x7f6d480a04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:28.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.754+0000 7f6d47fff640 1 -- 172.21.15.44:0/2516298651 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6d4814cce0 msgr2=0x7f6d480a04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:28.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.754+0000 7f6d47fff640 1 --2- 172.21.15.44:0/2516298651 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6d4814cce0 0x7f6d480a04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:28.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.754+0000 7f6d47fff640 1 -- 172.21.15.44:0/2516298651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d48071be0 msgr2=0x7f6d481e2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:28.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.754+0000 7f6d47fff640 1 --2- 172.21.15.44:0/2516298651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d48071be0 0x7f6d481e2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:28.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.754+0000 7f6d47fff640 1 -- 172.21.15.44:0/2516298651 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d4809cb50 con 0x7f6d480be4f0 2024-05-16T23:36:28.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.754+0000 7f6d47fff640 1 --2- 172.21.15.44:0/2516298651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d480be4f0 0x7f6d480a2660 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c000c00 tx=0x7f6d3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:28.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.754+0000 7f6d457fa640 1 -- 172.21.15.44:0/2516298651 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c041020 con 0x7f6d480be4f0 2024-05-16T23:36:28.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.754+0000 7f6d457fa640 1 -- 172.21.15.44:0/2516298651 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d3c0306c0 con 0x7f6d480be4f0 2024-05-16T23:36:28.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.754+0000 7f6d4ed34640 1 -- 172.21.15.44:0/2516298651 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d4809be00 con 0x7f6d480be4f0 2024-05-16T23:36:28.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.754+0000 7f6d457fa640 1 -- 172.21.15.44:0/2516298651 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c037040 con 0x7f6d480be4f0 2024-05-16T23:36:28.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.754+0000 7f6d4ed34640 1 -- 172.21.15.44:0/2516298651 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d481e5b30 con 0x7f6d480be4f0 2024-05-16T23:36:28.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.755+0000 7f6d4ed34640 1 -- 172.21.15.44:0/2516298651 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d480a5ce0 con 0x7f6d480be4f0 2024-05-16T23:36:28.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.756+0000 7f6d457fa640 1 -- 172.21.15.44:0/2516298651 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6d3c044020 con 0x7f6d480be4f0 2024-05-16T23:36:28.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.757+0000 7f6d457fa640 1 --2- 172.21.15.44:0/2516298651 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f6d340762d0 0x7f6d340787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:28.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.757+0000 7f6d457fa640 1 -- 172.21.15.44:0/2516298651 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5029+0+0 (secure 0 0 0) 0x7f6d3c0b7a60 con 0x7f6d480be4f0 2024-05-16T23:36:28.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.757+0000 7f6d4cad0640 1 --2- 172.21.15.44:0/2516298651 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f6d340762d0 0x7f6d340787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:28.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.757+0000 7f6d4cad0640 1 --2- 172.21.15.44:0/2516298651 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f6d340762d0 0x7f6d340787e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6d380079a0 tx=0x7f6d38008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:28.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.761+0000 7f6d457fa640 1 -- 172.21.15.44:0/2516298651 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6d3c04b030 con 0x7f6d480be4f0 2024-05-16T23:36:28.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.954+0000 7f6d4ed34640 1 -- 172.21.15.44:0/2516298651 --> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f6d480bf020 con 0x7f6d340762d0 2024-05-16T23:36:28.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.955+0000 7f6d457fa640 1 -- 172.21.15.44:0/2516298651 <== mgr.4114 v2:172.21.15.70:6832/4049588098 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6d480bf020 con 0x7f6d340762d0 2024-05-16T23:36:28.455 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 1 to deep-scrub 2024-05-16T23:36:28.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.957+0000 7f6d4ed34640 1 -- 172.21.15.44:0/2516298651 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f6d340762d0 msgr2=0x7f6d340787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:28.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.957+0000 7f6d4ed34640 1 --2- 172.21.15.44:0/2516298651 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f6d340762d0 0x7f6d340787e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6d380079a0 tx=0x7f6d38008040 comp rx=0 tx=0).stop 2024-05-16T23:36:28.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.957+0000 7f6d4ed34640 1 -- 172.21.15.44:0/2516298651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d480be4f0 msgr2=0x7f6d480a2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:28.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.957+0000 7f6d4ed34640 1 --2- 172.21.15.44:0/2516298651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d480be4f0 0x7f6d480a2660 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c000c00 tx=0x7f6d3c0046c0 comp rx=0 tx=0).stop 2024-05-16T23:36:28.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.957+0000 7f6d4ed34640 1 -- 172.21.15.44:0/2516298651 shutdown_connections 2024-05-16T23:36:28.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.957+0000 7f6d4ed34640 1 --2- 172.21.15.44:0/2516298651 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f6d340762d0 0x7f6d340787e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:28.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.957+0000 7f6d4ed34640 1 --2- 172.21.15.44:0/2516298651 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6d4814cce0 0x7f6d480a04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:28.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.957+0000 7f6d4ed34640 1 --2- 172.21.15.44:0/2516298651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d480be4f0 0x7f6d480a2660 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:28.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.957+0000 7f6d4ed34640 1 --2- 172.21.15.44:0/2516298651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d48071be0 0x7f6d481e2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:28.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.957+0000 7f6d4ed34640 1 -- 172.21.15.44:0/2516298651 >> 172.21.15.44:0/2516298651 conn(0x7f6d480c17c0 msgr2=0x7f6d48149e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T23:36:28.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.957+0000 7f6d4ed34640 1 -- 172.21.15.44:0/2516298651 shutdown_connections 2024-05-16T23:36:28.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:27.957+0000 7f6d4ed34640 1 -- 172.21.15.44:0/2516298651 wait complete. 2024-05-16T23:36:28.577 INFO:tasks.ceph:Scrubbing osd.2 2024-05-16T23:36:28.585 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-16T23:36:28.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.715+0000 7fe03af5e640 1 Processor -- start 2024-05-16T23:36:28.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.716+0000 7fe03af5e640 1 -- start start 2024-05-16T23:36:28.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.717+0000 7fe03af5e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe0340bf050 0x7fe034159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:28.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.717+0000 7fe03af5e640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe03406e140 con 0x7fe0340bd6d0 2024-05-16T23:36:28.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.717+0000 7fe03af5e640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0340c36f0 con 0x7fe034151fc0 2024-05-16T23:36:28.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.717+0000 7fe03af5e640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fe034152530 con 0x7fe0340bf050 2024-05-16T23:36:28.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.717+0000 7fe0394fb640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe0340bf050 0x7fe034159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:28.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.717+0000 7fe0394fb640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe0340bf050 0x7fe034159ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44438/0 (socket says 172.21.15.44:44438) 2024-05-16T23:36:28.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.717+0000 7fe0394fb640 1 -- 172.21.15.44:0/613102265 learned_addr learned my addr 172.21.15.44:0/613102265 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T23:36:28.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.717+0000 7fe033fff640 1 --1- 172.21.15.44:0/613102265 >> v1:172.21.15.44:6789/0 conn(0x7fe0340bd6d0 0x7fe0340be940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:42112/0 (socket says 172.21.15.44:42112) 2024-05-16T23:36:28.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.717+0000 7fe0394fb640 1 -- 172.21.15.44:0/613102265 >> v1:172.21.15.70:6789/0 conn(0x7fe034151fc0 legacy=0x7fe03406da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T23:36:28.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.717+0000 7fe0394fb640 1 -- 172.21.15.44:0/613102265 >> v1:172.21.15.44:6789/0 conn(0x7fe0340bd6d0 legacy=0x7fe0340be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:28.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.717+0000 7fe0394fb640 1 -- 172.21.15.44:0/613102265 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe034152810 con 0x7fe0340bf050 2024-05-16T23:36:28.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.718+0000 7fe0394fb640 1 --2- 172.21.15.44:0/613102265 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0340bf050 0x7fe034159ea0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fe02c009e50 tx=0x7fe02c02a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce40071be228c625 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:28.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.718+0000 7fe0337fe640 1 -- 172.21.15.44:0/613102265 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe02c036070 con 0x7fe0340bf050 2024-05-16T23:36:28.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.718+0000 7fe0337fe640 1 -- 172.21.15.44:0/613102265 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe02c031600 con 0x7fe0340bf050 2024-05-16T23:36:28.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.718+0000 7fe0337fe640 1 -- 172.21.15.44:0/613102265 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe02c0319f0 con 0x7fe0340bf050 2024-05-16T23:36:28.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.719+0000 7fe03af5e640 1 -- 172.21.15.44:0/613102265 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0340bf050 msgr2=0x7fe034159ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:28.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.719+0000 7fe03af5e640 1 --2- 172.21.15.44:0/613102265 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0340bf050 0x7fe034159ea0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fe02c009e50 tx=0x7fe02c02a7c0 comp rx=0 tx=0).stop 2024-05-16T23:36:28.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.719+0000 7fe03af5e640 1 -- 172.21.15.44:0/613102265 shutdown_connections 2024-05-16T23:36:28.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.719+0000 7fe03af5e640 1 --2- 172.21.15.44:0/613102265 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0340bf050 0x7fe034159ea0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:28.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.719+0000 7fe03af5e640 1 -- 172.21.15.44:0/613102265 >> 172.21.15.44:0/613102265 conn(0x7fe0340c3d20 msgr2=0x7fe0340c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T23:36:28.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.719+0000 7fe03af5e640 1 -- 172.21.15.44:0/613102265 shutdown_connections 2024-05-16T23:36:28.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.719+0000 7fe03af5e640 1 -- 172.21.15.44:0/613102265 wait complete. 2024-05-16T23:36:28.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.720+0000 7fe03af5e640 1 Processor -- start 2024-05-16T23:36:28.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.720+0000 7fe03af5e640 1 -- start start 2024-05-16T23:36:28.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.722+0000 7fe03af5e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0340bd6d0 0x7fe0340b7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:28.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.722+0000 7fe03af5e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0340bf050 0x7fe0341e47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:28.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.722+0000 7fe03af5e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe034151fc0 0x7fe03414b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:28.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.722+0000 7fe03af5e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe0340a2ed0 con 0x7fe0340bf050 2024-05-16T23:36:28.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.722+0000 7fe03af5e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe0340bdae0 con 0x7fe0340bd6d0 2024-05-16T23:36:29.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.722+0000 7fe03af5e640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fe0340a3050 con 0x7fe034151fc0 2024-05-16T23:36:29.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.722+0000 7fe033fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0340bf050 0x7fe0341e47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:29.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.722+0000 7fe033fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0340bf050 0x7fe0341e47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44442/0 (socket says 172.21.15.44:44442) 2024-05-16T23:36:29.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.722+0000 7fe033fff640 1 -- 172.21.15.44:0/4139868352 learned_addr learned my addr 172.21.15.44:0/4139868352 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T23:36:29.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.722+0000 7fe038cfa640 1 --2- 172.21.15.44:0/4139868352 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0340bd6d0 0x7fe0340b7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:29.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.722+0000 7fe0394fb640 1 --2- 172.21.15.44:0/4139868352 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe034151fc0 0x7fe03414b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:29.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.722+0000 7fe033fff640 1 -- 172.21.15.44:0/4139868352 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe034151fc0 msgr2=0x7fe03414b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:29.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.722+0000 7fe033fff640 1 --2- 172.21.15.44:0/4139868352 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe034151fc0 0x7fe03414b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:29.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.722+0000 7fe033fff640 1 -- 172.21.15.44:0/4139868352 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0340bd6d0 msgr2=0x7fe0340b7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:29.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.722+0000 7fe033fff640 1 --2- 172.21.15.44:0/4139868352 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0340bd6d0 0x7fe0340b7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:29.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.722+0000 7fe033fff640 1 -- 172.21.15.44:0/4139868352 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0341e4d00 con 0x7fe0340bf050 2024-05-16T23:36:29.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.722+0000 7fe033fff640 1 --2- 172.21.15.44:0/4139868352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0340bf050 0x7fe0341e47c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fe02800c390 tx=0x7fe02800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:29.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.722+0000 7fe0317fa640 1 -- 172.21.15.44:0/4139868352 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0280074e0 con 0x7fe0340bf050 2024-05-16T23:36:29.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.722+0000 7fe0317fa640 1 -- 172.21.15.44:0/4139868352 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0280076a0 con 0x7fe0340bf050 2024-05-16T23:36:29.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.722+0000 7fe03af5e640 1 -- 172.21.15.44:0/4139868352 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe03414f390 con 0x7fe0340bf050 2024-05-16T23:36:29.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.723+0000 7fe0317fa640 1 -- 172.21.15.44:0/4139868352 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe028004a20 con 0x7fe0340bf050 2024-05-16T23:36:29.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.723+0000 7fe03af5e640 1 -- 172.21.15.44:0/4139868352 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0341e4f70 con 0x7fe0340bf050 2024-05-16T23:36:29.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.723+0000 7fe03af5e640 1 -- 172.21.15.44:0/4139868352 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe0340c1190 con 0x7fe0340bf050 2024-05-16T23:36:29.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.724+0000 7fe0317fa640 1 -- 172.21.15.44:0/4139868352 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe02801a020 con 0x7fe0340bf050 2024-05-16T23:36:29.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.725+0000 7fe0317fa640 1 --2- 172.21.15.44:0/4139868352 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fe0200762d0 0x7fe0200787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:29.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.725+0000 7fe0317fa640 1 -- 172.21.15.44:0/4139868352 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5029+0+0 (secure 0 0 0) 0x7fe028097370 con 0x7fe0340bf050 2024-05-16T23:36:29.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.725+0000 7fe0317fa640 1 --2- 172.21.15.44:0/4139868352 >> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] conn(0x7fe02007c280 0x7fe02007e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:29.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.725+0000 7fe0317fa640 1 -- 172.21.15.44:0/4139868352 --> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe028010ec0 con 0x7fe02007c280 2024-05-16T23:36:29.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.725+0000 7fe0317fa640 1 -- 172.21.15.44:0/4139868352 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fe028097800 con 0x7fe0340bf050 2024-05-16T23:36:29.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.725+0000 7fe0394fb640 1 --2- 172.21.15.44:0/4139868352 >> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] conn(0x7fe02007c280 0x7fe02007e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:29.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.725+0000 7fe038cfa640 1 --2- 172.21.15.44:0/4139868352 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fe0200762d0 0x7fe0200787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:29.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.726+0000 7fe0394fb640 1 --2- 172.21.15.44:0/4139868352 >> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] conn(0x7fe02007c280 0x7fe02007e6d0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:29.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.726+0000 7fe038cfa640 1 --2- 172.21.15.44:0/4139868352 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fe0200762d0 0x7fe0200787e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe024000f60 tx=0x7fe024009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:29.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.726+0000 7fe0317fa640 1 -- 172.21.15.44:0/4139868352 <== osd.2 v2:172.21.15.44:6800/2908194156 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe028010ec0 con 0x7fe02007c280 2024-05-16T23:36:29.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.740+0000 7fe03af5e640 1 -- 172.21.15.44:0/4139868352 --> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe03414ec50 con 0x7fe02007c280 2024-05-16T23:36:29.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.740+0000 7fe0317fa640 1 -- 172.21.15.44:0/4139868352 <== osd.2 v2:172.21.15.44:6800/2908194156 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe03414ec50 con 0x7fe02007c280 2024-05-16T23:36:29.330 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-05-16T23:36:29.338 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-16T23:36:29.347 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-05-16T23:36:29.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.740+0000 7fe03af5e640 1 -- 172.21.15.44:0/4139868352 >> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] conn(0x7fe02007c280 msgr2=0x7fe02007e6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:29.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.740+0000 7fe03af5e640 1 --2- 172.21.15.44:0/4139868352 >> [v2:172.21.15.44:6800/2908194156,v1:172.21.15.44:6801/2908194156] conn(0x7fe02007c280 0x7fe02007e6d0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:29.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.740+0000 7fe03af5e640 1 -- 172.21.15.44:0/4139868352 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fe0200762d0 msgr2=0x7fe0200787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:29.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.740+0000 7fe03af5e640 1 --2- 172.21.15.44:0/4139868352 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fe0200762d0 0x7fe0200787e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe024000f60 tx=0x7fe024009040 comp rx=0 tx=0).stop 2024-05-16T23:36:29.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.740+0000 7fe03af5e640 1 -- 172.21.15.44:0/4139868352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0340bf050 msgr2=0x7fe0341e47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:29.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.740+0000 7fe03af5e640 1 --2- 172.21.15.44:0/4139868352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0340bf050 0x7fe0341e47c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fe02800c390 tx=0x7fe02800c850 comp rx=0 tx=0).stop 2024-05-16T23:36:29.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.740+0000 7fe0394fb640 1 -- 172.21.15.44:0/4139868352 reap_dead start 2024-05-16T23:36:29.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.740+0000 7fe03af5e640 1 -- 172.21.15.44:0/4139868352 shutdown_connections 2024-05-16T23:36:29.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.740+0000 7fe03af5e640 1 -- 172.21.15.44:0/4139868352 >> 172.21.15.44:0/4139868352 conn(0x7fe0340c3d20 msgr2=0x7fe0340c0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T23:36:29.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.741+0000 7fe03af5e640 1 -- 172.21.15.44:0/4139868352 shutdown_connections 2024-05-16T23:36:29.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:28.741+0000 7fe03af5e640 1 -- 172.21.15.44:0/4139868352 wait complete. 2024-05-16T23:36:29.512 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-16T23:36:29.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.648+0000 7f5bc31ce640 1 Processor -- start 2024-05-16T23:36:29.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.648+0000 7f5bc31ce640 1 -- start start 2024-05-16T23:36:29.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.649+0000 7f5bc31ce640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5bbc074b00 0x7f5bbc06c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:29.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.649+0000 7f5bc31ce640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5bbc0be3f0 0x7f5bbc14cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:29.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.649+0000 7f5bc31ce640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bbc06ce00 con 0x7f5bbc14fad0 2024-05-16T23:36:29.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.649+0000 7f5bc31ce640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f5bbc0bb470 con 0x7f5bbc074b00 2024-05-16T23:36:29.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.649+0000 7f5bc31ce640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f5bbc0bb890 con 0x7f5bbc0be3f0 2024-05-16T23:36:29.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.650+0000 7f5bc0f6a640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5bbc074b00 0x7f5bbc06c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:29.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.650+0000 7f5bc0f6a640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5bbc074b00 0x7f5bbc06c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44450/0 (socket says 172.21.15.44:44450) 2024-05-16T23:36:29.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.650+0000 7f5bc0f6a640 1 -- 172.21.15.44:0/354426876 learned_addr learned my addr 172.21.15.44:0/354426876 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T23:36:29.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.650+0000 7f5bbbfff640 1 --2- 172.21.15.44:0/354426876 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5bbc0be3f0 0x7f5bbc14cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:29.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.650+0000 7f5bc0f6a640 1 -- 172.21.15.44:0/354426876 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5bbc0be3f0 msgr2=0x7f5bbc14cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T23:36:29.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.650+0000 7f5bc0f6a640 1 --2- 172.21.15.44:0/354426876 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5bbc0be3f0 0x7f5bbc14cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:29.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.650+0000 7f5bc0f6a640 1 -- 172.21.15.44:0/354426876 >> v1:172.21.15.70:6789/0 conn(0x7f5bbc14fad0 legacy=0x7f5bbc14fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:29.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.650+0000 7f5bc0f6a640 1 -- 172.21.15.44:0/354426876 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bbc0bbb30 con 0x7f5bbc074b00 2024-05-16T23:36:29.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.650+0000 7f5bbbfff640 1 --2- 172.21.15.44:0/354426876 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5bbc0be3f0 0x7f5bbc14cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T23:36:29.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.651+0000 7f5bc0f6a640 1 --2- 172.21.15.44:0/354426876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bbc074b00 0x7f5bbc06c8c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc0bba60 tx=0x7f5bac02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=712d862602cff552 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:29.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.651+0000 7f5bbb7fe640 1 -- 172.21.15.44:0/354426876 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bac037070 con 0x7f5bbc074b00 2024-05-16T23:36:29.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.651+0000 7f5bbb7fe640 1 -- 172.21.15.44:0/354426876 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bac032440 con 0x7f5bbc074b00 2024-05-16T23:36:29.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.651+0000 7f5bbb7fe640 1 -- 172.21.15.44:0/354426876 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bac032810 con 0x7f5bbc074b00 2024-05-16T23:36:29.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.651+0000 7f5bc31ce640 1 -- 172.21.15.44:0/354426876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bbc074b00 msgr2=0x7f5bbc06c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:29.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.651+0000 7f5bc31ce640 1 --2- 172.21.15.44:0/354426876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bbc074b00 0x7f5bbc06c8c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc0bba60 tx=0x7f5bac02a1c0 comp rx=0 tx=0).stop 2024-05-16T23:36:30.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.652+0000 7f5bc31ce640 1 -- 172.21.15.44:0/354426876 shutdown_connections 2024-05-16T23:36:30.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.652+0000 7f5bc31ce640 1 --2- 172.21.15.44:0/354426876 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5bbc0be3f0 0x7f5bbc14cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:30.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.652+0000 7f5bc31ce640 1 --2- 172.21.15.44:0/354426876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bbc074b00 0x7f5bbc06c8c0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:30.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.652+0000 7f5bc31ce640 1 -- 172.21.15.44:0/354426876 >> 172.21.15.44:0/354426876 conn(0x7f5bbc0bd0f0 msgr2=0x7f5bbc0bd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T23:36:30.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.652+0000 7f5bc31ce640 1 -- 172.21.15.44:0/354426876 shutdown_connections 2024-05-16T23:36:30.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.652+0000 7f5bc31ce640 1 -- 172.21.15.44:0/354426876 wait complete. 2024-05-16T23:36:30.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.653+0000 7f5bc31ce640 1 Processor -- start 2024-05-16T23:36:30.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.653+0000 7f5bc31ce640 1 -- start start 2024-05-16T23:36:30.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.654+0000 7f5bc31ce640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bbc074b00 0x7f5bbc1d5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:30.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.654+0000 7f5bc31ce640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5bbc0be3f0 0x7f5bbc1d6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:30.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.654+0000 7f5bc31ce640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5bbc14fad0 0x7f5bbc1d7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:30.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.654+0000 7f5bc31ce640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5bbc0bc3d0 con 0x7f5bbc074b00 2024-05-16T23:36:30.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.654+0000 7f5bc31ce640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5bbc0bc0f0 con 0x7f5bbc14fad0 2024-05-16T23:36:30.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.654+0000 7f5bc31ce640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f5bbc14d060 con 0x7f5bbc0be3f0 2024-05-16T23:36:30.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.655+0000 7f5bc0f6a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bbc074b00 0x7f5bbc1d5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:30.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.655+0000 7f5bc0f6a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bbc074b00 0x7f5bbc1d5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44464/0 (socket says 172.21.15.44:44464) 2024-05-16T23:36:30.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.655+0000 7f5bc0f6a640 1 -- 172.21.15.44:0/169551933 learned_addr learned my addr 172.21.15.44:0/169551933 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T23:36:30.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.655+0000 7f5bbbfff640 1 --2- 172.21.15.44:0/169551933 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5bbc0be3f0 0x7f5bbc1d6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:30.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.655+0000 7f5bc176b640 1 --2- 172.21.15.44:0/169551933 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5bbc14fad0 0x7f5bbc1d7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:30.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.655+0000 7f5bc0f6a640 1 -- 172.21.15.44:0/169551933 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5bbc0be3f0 msgr2=0x7f5bbc1d6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:30.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.655+0000 7f5bc0f6a640 1 --2- 172.21.15.44:0/169551933 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5bbc0be3f0 0x7f5bbc1d6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:30.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.655+0000 7f5bc0f6a640 1 -- 172.21.15.44:0/169551933 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5bbc14fad0 msgr2=0x7f5bbc1d7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:30.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.655+0000 7f5bc0f6a640 1 --2- 172.21.15.44:0/169551933 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5bbc14fad0 0x7f5bbc1d7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:30.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.655+0000 7f5bc0f6a640 1 -- 172.21.15.44:0/169551933 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bbc0a0570 con 0x7f5bbc074b00 2024-05-16T23:36:30.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.655+0000 7f5bc0f6a640 1 --2- 172.21.15.44:0/169551933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bbc074b00 0x7f5bbc1d5dd0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f5bac000c00 tx=0x7f5bac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:30.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.655+0000 7f5bb97fa640 1 -- 172.21.15.44:0/169551933 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bac041020 con 0x7f5bbc074b00 2024-05-16T23:36:30.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.655+0000 7f5bb97fa640 1 -- 172.21.15.44:0/169551933 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bac0306c0 con 0x7f5bbc074b00 2024-05-16T23:36:30.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.655+0000 7f5bc31ce640 1 -- 172.21.15.44:0/169551933 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bbc14d550 con 0x7f5bbc074b00 2024-05-16T23:36:30.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.655+0000 7f5bb97fa640 1 -- 172.21.15.44:0/169551933 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bac037040 con 0x7f5bbc074b00 2024-05-16T23:36:30.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.655+0000 7f5bc31ce640 1 -- 172.21.15.44:0/169551933 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bbc1d55d0 con 0x7f5bbc074b00 2024-05-16T23:36:30.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.656+0000 7f5bc31ce640 1 -- 172.21.15.44:0/169551933 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bbc14c530 con 0x7f5bbc074b00 2024-05-16T23:36:30.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.657+0000 7f5bb97fa640 1 -- 172.21.15.44:0/169551933 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5bac044020 con 0x7f5bbc074b00 2024-05-16T23:36:30.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.658+0000 7f5bb97fa640 1 --2- 172.21.15.44:0/169551933 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f5ba8076300 0x7f5ba8078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:30.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.658+0000 7f5bb97fa640 1 -- 172.21.15.44:0/169551933 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5029+0+0 (secure 0 0 0) 0x7f5bac0b7b80 con 0x7f5bbc074b00 2024-05-16T23:36:30.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.658+0000 7f5bbbfff640 1 --2- 172.21.15.44:0/169551933 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f5ba8076300 0x7f5ba8078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:30.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.658+0000 7f5bbbfff640 1 --2- 172.21.15.44:0/169551933 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f5ba8076300 0x7f5ba8078810 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc1e6e30 tx=0x7f5bb0008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:30.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.663+0000 7f5bb97fa640 1 -- 172.21.15.44:0/169551933 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5bbc14c530 con 0x7f5bbc074b00 2024-05-16T23:36:30.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.852+0000 7f5bc31ce640 1 -- 172.21.15.44:0/169551933 --> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f5bbc06e840 con 0x7f5ba8076300 2024-05-16T23:36:30.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.852+0000 7f5bb97fa640 1 -- 172.21.15.44:0/169551933 <== mgr.4114 v2:172.21.15.70:6832/4049588098 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5bb000b540 con 0x7f5ba8076300 2024-05-16T23:36:30.600 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 2 to deep-scrub 2024-05-16T23:36:30.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.854+0000 7f5bc31ce640 1 -- 172.21.15.44:0/169551933 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f5ba8076300 msgr2=0x7f5ba8078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:30.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.854+0000 7f5bc31ce640 1 --2- 172.21.15.44:0/169551933 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f5ba8076300 0x7f5ba8078810 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc1e6e30 tx=0x7f5bb0008040 comp rx=0 tx=0).stop 2024-05-16T23:36:30.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.854+0000 7f5bc31ce640 1 -- 172.21.15.44:0/169551933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bbc074b00 msgr2=0x7f5bbc1d5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:30.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.854+0000 7f5bc31ce640 1 --2- 172.21.15.44:0/169551933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bbc074b00 0x7f5bbc1d5dd0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f5bac000c00 tx=0x7f5bac0046c0 comp rx=0 tx=0).stop 2024-05-16T23:36:30.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.854+0000 7f5bc31ce640 1 -- 172.21.15.44:0/169551933 shutdown_connections 2024-05-16T23:36:30.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.854+0000 7f5bc31ce640 1 --2- 172.21.15.44:0/169551933 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f5ba8076300 0x7f5ba8078810 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:30.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.854+0000 7f5bc31ce640 1 --2- 172.21.15.44:0/169551933 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5bbc0be3f0 0x7f5bbc1d6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:30.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.854+0000 7f5bc31ce640 1 --2- 172.21.15.44:0/169551933 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5bbc14fad0 0x7f5bbc1d7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:30.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.854+0000 7f5bc31ce640 1 --2- 172.21.15.44:0/169551933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bbc074b00 0x7f5bbc1d5dd0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:30.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.854+0000 7f5bc31ce640 1 -- 172.21.15.44:0/169551933 >> 172.21.15.44:0/169551933 conn(0x7f5bbc0bd0f0 msgr2=0x7f5bbc148ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T23:36:30.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.854+0000 7f5bc31ce640 1 -- 172.21.15.44:0/169551933 shutdown_connections 2024-05-16T23:36:30.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:29.854+0000 7f5bc31ce640 1 -- 172.21.15.44:0/169551933 wait complete. 2024-05-16T23:36:30.755 INFO:tasks.ceph:Scrubbing osd.3 2024-05-16T23:36:30.764 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-16T23:36:30.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.904+0000 7f4f63e42640 1 Processor -- start 2024-05-16T23:36:30.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.904+0000 7f4f63e42640 1 -- start start 2024-05-16T23:36:30.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.906+0000 7f4f63e42640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4f5c071680 0x7f4f5c0be330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:30.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.906+0000 7f4f63e42640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4f5c1487e0 0x7f4f5c1519e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:30.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.906+0000 7f4f63e42640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f5c148bf0 con 0x7f4f5c0bf630 2024-05-16T23:36:30.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.906+0000 7f4f63e42640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f4f5c0be930 con 0x7f4f5c071680 2024-05-16T23:36:30.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.906+0000 7f4f63e42640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f4f5c070ba0 con 0x7f4f5c1487e0 2024-05-16T23:36:30.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.906+0000 7f4f61bde640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4f5c071680 0x7f4f5c0be330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:30.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.906+0000 7f4f61bde640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4f5c071680 0x7f4f5c0be330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51452/0 (socket says 172.21.15.44:51452) 2024-05-16T23:36:30.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.906+0000 7f4f61bde640 1 -- 172.21.15.44:0/302201204 learned_addr learned my addr 172.21.15.44:0/302201204 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T23:36:30.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.906+0000 7f4f613dd640 1 --2- 172.21.15.44:0/302201204 >> v2:172.21.15.70:3300/0 conn(0x7f4f5c1487e0 0x7f4f5c1519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:31.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.906+0000 7f4f61bde640 1 -- 172.21.15.44:0/302201204 >> v2:172.21.15.70:3300/0 conn(0x7f4f5c1487e0 msgr2=0x7f4f5c1519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T23:36:31.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.906+0000 7f4f61bde640 1 --2- 172.21.15.44:0/302201204 >> v2:172.21.15.70:3300/0 conn(0x7f4f5c1487e0 0x7f4f5c1519e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:31.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.906+0000 7f4f61bde640 1 -- 172.21.15.44:0/302201204 >> v1:172.21.15.70:6789/0 conn(0x7f4f5c0bf630 legacy=0x7f4f5c0bfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:31.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.906+0000 7f4f61bde640 1 -- 172.21.15.44:0/302201204 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f5c151f20 con 0x7f4f5c071680 2024-05-16T23:36:31.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.907+0000 7f4f61bde640 1 --2- 172.21.15.44:0/302201204 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f5c071680 0x7f4f5c0be330 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c0a0e20 tx=0x7f4f4c02a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adca3a623857c5c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:31.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.907+0000 7f4f60bdc640 1 -- 172.21.15.44:0/302201204 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c036070 con 0x7f4f5c071680 2024-05-16T23:36:31.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.907+0000 7f4f60bdc640 1 -- 172.21.15.44:0/302201204 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f4c031600 con 0x7f4f5c071680 2024-05-16T23:36:31.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.907+0000 7f4f60bdc640 1 -- 172.21.15.44:0/302201204 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c0319f0 con 0x7f4f5c071680 2024-05-16T23:36:31.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.908+0000 7f4f63e42640 1 -- 172.21.15.44:0/302201204 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f5c071680 msgr2=0x7f4f5c0be330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:31.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.908+0000 7f4f63e42640 1 --2- 172.21.15.44:0/302201204 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f5c071680 0x7f4f5c0be330 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c0a0e20 tx=0x7f4f4c02a7c0 comp rx=0 tx=0).stop 2024-05-16T23:36:31.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.908+0000 7f4f63e42640 1 -- 172.21.15.44:0/302201204 shutdown_connections 2024-05-16T23:36:31.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.908+0000 7f4f63e42640 1 --2- 172.21.15.44:0/302201204 >> v2:172.21.15.70:3300/0 conn(0x7f4f5c1487e0 0x7f4f5c1519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:31.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.908+0000 7f4f63e42640 1 --2- 172.21.15.44:0/302201204 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f5c071680 0x7f4f5c0be330 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:31.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.908+0000 7f4f63e42640 1 -- 172.21.15.44:0/302201204 >> 172.21.15.44:0/302201204 conn(0x7f4f5c0c1830 msgr2=0x7f4f5c0c1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T23:36:31.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.908+0000 7f4f63e42640 1 -- 172.21.15.44:0/302201204 shutdown_connections 2024-05-16T23:36:31.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.908+0000 7f4f63e42640 1 -- 172.21.15.44:0/302201204 wait complete. 2024-05-16T23:36:31.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.909+0000 7f4f63e42640 1 Processor -- start 2024-05-16T23:36:31.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.910+0000 7f4f63e42640 1 -- start start 2024-05-16T23:36:31.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.911+0000 7f4f63e42640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f5c071680 0x7f4f5c1e7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:31.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.911+0000 7f4f63e42640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f5c0bf630 0x7f4f5c0a2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:31.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.911+0000 7f4f63e42640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4f5c1487e0 0x7f4f5c1473b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:31.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.911+0000 7f4f63e42640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4f5c071e00 con 0x7f4f5c071680 2024-05-16T23:36:31.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.911+0000 7f4f63e42640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4f5c0c0150 con 0x7f4f5c0bf630 2024-05-16T23:36:31.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.911+0000 7f4f63e42640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f4f5c071f80 con 0x7f4f5c1487e0 2024-05-16T23:36:31.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.911+0000 7f4f61bde640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f5c071680 0x7f4f5c1e7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:31.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.911+0000 7f4f61bde640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f5c071680 0x7f4f5c1e7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51456/0 (socket says 172.21.15.44:51456) 2024-05-16T23:36:31.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.911+0000 7f4f61bde640 1 -- 172.21.15.44:0/1299090860 learned_addr learned my addr 172.21.15.44:0/1299090860 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T23:36:31.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.911+0000 7f4f623df640 1 --2- 172.21.15.44:0/1299090860 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4f5c1487e0 0x7f4f5c1473b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:31.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.911+0000 7f4f613dd640 1 --2- 172.21.15.44:0/1299090860 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f5c0bf630 0x7f4f5c0a2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:31.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.911+0000 7f4f61bde640 1 -- 172.21.15.44:0/1299090860 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4f5c1487e0 msgr2=0x7f4f5c1473b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:31.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.911+0000 7f4f61bde640 1 --2- 172.21.15.44:0/1299090860 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4f5c1487e0 0x7f4f5c1473b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:31.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.911+0000 7f4f61bde640 1 -- 172.21.15.44:0/1299090860 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f5c0bf630 msgr2=0x7f4f5c0a2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:31.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.911+0000 7f4f61bde640 1 --2- 172.21.15.44:0/1299090860 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f5c0bf630 0x7f4f5c0a2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:31.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.911+0000 7f4f61bde640 1 -- 172.21.15.44:0/1299090860 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f5c1e8170 con 0x7f4f5c071680 2024-05-16T23:36:31.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.911+0000 7f4f613dd640 1 --2- 172.21.15.44:0/1299090860 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f5c0bf630 0x7f4f5c0a2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T23:36:31.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.911+0000 7f4f61bde640 1 --2- 172.21.15.44:0/1299090860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f5c071680 0x7f4f5c1e7c30 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c009f40 tx=0x7f4f4c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:31.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.911+0000 7f4f5a7fc640 1 -- 172.21.15.44:0/1299090860 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c036050 con 0x7f4f5c071680 2024-05-16T23:36:31.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.911+0000 7f4f5a7fc640 1 -- 172.21.15.44:0/1299090860 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f4c042070 con 0x7f4f5c071680 2024-05-16T23:36:31.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.911+0000 7f4f63e42640 1 -- 172.21.15.44:0/1299090860 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f5c1e7750 con 0x7f4f5c071680 2024-05-16T23:36:31.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.911+0000 7f4f5a7fc640 1 -- 172.21.15.44:0/1299090860 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c009510 con 0x7f4f5c071680 2024-05-16T23:36:31.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.912+0000 7f4f63e42640 1 -- 172.21.15.44:0/1299090860 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f5c0a3170 con 0x7f4f5c071680 2024-05-16T23:36:31.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.912+0000 7f4f63e42640 1 -- 172.21.15.44:0/1299090860 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4f5c0a3990 con 0x7f4f5c071680 2024-05-16T23:36:31.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.913+0000 7f4f5a7fc640 1 -- 172.21.15.44:0/1299090860 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4f4c004470 con 0x7f4f5c071680 2024-05-16T23:36:31.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.914+0000 7f4f5a7fc640 1 --2- 172.21.15.44:0/1299090860 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4f480762d0 0x7f4f480787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:31.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.914+0000 7f4f5a7fc640 1 -- 172.21.15.44:0/1299090860 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5029+0+0 (secure 0 0 0) 0x7f4f4c0b8220 con 0x7f4f5c071680 2024-05-16T23:36:31.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.914+0000 7f4f613dd640 1 --2- 172.21.15.44:0/1299090860 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4f480762d0 0x7f4f480787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:31.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.914+0000 7f4f5a7fc640 1 --2- 172.21.15.44:0/1299090860 >> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] conn(0x7f4f4807c280 0x7f4f4807e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:31.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.914+0000 7f4f5a7fc640 1 -- 172.21.15.44:0/1299090860 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4f4c02ee50 con 0x7f4f4807c280 2024-05-16T23:36:31.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.914+0000 7f4f5a7fc640 1 -- 172.21.15.44:0/1299090860 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f4f4c0bf050 con 0x7f4f5c071680 2024-05-16T23:36:31.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.914+0000 7f4f623df640 1 --2- 172.21.15.44:0/1299090860 >> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] conn(0x7f4f4807c280 0x7f4f4807e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:31.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.914+0000 7f4f613dd640 1 --2- 172.21.15.44:0/1299090860 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4f480762d0 0x7f4f480787e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c151330 tx=0x7f4f50008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:31.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.914+0000 7f4f623df640 1 --2- 172.21.15.44:0/1299090860 >> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] conn(0x7f4f4807c280 0x7f4f4807e6d0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:31.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.915+0000 7f4f5a7fc640 1 -- 172.21.15.44:0/1299090860 <== osd.3 v2:172.21.15.44:6808/2168695793 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4f4c02ee50 con 0x7f4f4807c280 2024-05-16T23:36:31.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.928+0000 7f4f63e42640 1 -- 172.21.15.44:0/1299090860 --> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4f5c050940 con 0x7f4f4807c280 2024-05-16T23:36:31.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.929+0000 7f4f5a7fc640 1 -- 172.21.15.44:0/1299090860 <== osd.3 v2:172.21.15.44:6808/2168695793 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f4f5c050940 con 0x7f4f4807c280 2024-05-16T23:36:31.573 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-05-16T23:36:31.590 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-16T23:36:31.598 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-05-16T23:36:31.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.929+0000 7f4f63e42640 1 -- 172.21.15.44:0/1299090860 >> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] conn(0x7f4f4807c280 msgr2=0x7f4f4807e6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:31.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.929+0000 7f4f63e42640 1 --2- 172.21.15.44:0/1299090860 >> [v2:172.21.15.44:6808/2168695793,v1:172.21.15.44:6809/2168695793] conn(0x7f4f4807c280 0x7f4f4807e6d0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:31.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.929+0000 7f4f63e42640 1 -- 172.21.15.44:0/1299090860 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4f480762d0 msgr2=0x7f4f480787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:31.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.929+0000 7f4f63e42640 1 --2- 172.21.15.44:0/1299090860 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f4f480762d0 0x7f4f480787e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c151330 tx=0x7f4f50008040 comp rx=0 tx=0).stop 2024-05-16T23:36:31.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.929+0000 7f4f63e42640 1 -- 172.21.15.44:0/1299090860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f5c071680 msgr2=0x7f4f5c1e7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:31.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.929+0000 7f4f63e42640 1 --2- 172.21.15.44:0/1299090860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f5c071680 0x7f4f5c1e7c30 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c009f40 tx=0x7f4f4c004a40 comp rx=0 tx=0).stop 2024-05-16T23:36:31.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.929+0000 7f4f623df640 1 -- 172.21.15.44:0/1299090860 reap_dead start 2024-05-16T23:36:31.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.929+0000 7f4f63e42640 1 -- 172.21.15.44:0/1299090860 shutdown_connections 2024-05-16T23:36:31.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.929+0000 7f4f63e42640 1 -- 172.21.15.44:0/1299090860 >> 172.21.15.44:0/1299090860 conn(0x7f4f5c0c1830 msgr2=0x7f4f5c1d7820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T23:36:31.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.929+0000 7f4f63e42640 1 -- 172.21.15.44:0/1299090860 shutdown_connections 2024-05-16T23:36:31.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:30.929+0000 7f4f63e42640 1 -- 172.21.15.44:0/1299090860 wait complete. 2024-05-16T23:36:31.692 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-16T23:36:31.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.828+0000 7fdc5e229640 1 Processor -- start 2024-05-16T23:36:31.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.828+0000 7fdc5e229640 1 -- start start 2024-05-16T23:36:31.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.829+0000 7fdc5e229640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdc5814cce0 0x7fdc580716a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:31.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.829+0000 7fdc5e229640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fdc58071be0 0x7fdc58156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:31.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.829+0000 7fdc5e229640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc580720d0 con 0x7fdc580be4f0 2024-05-16T23:36:31.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.829+0000 7fdc5e229640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fdc580bfa60 con 0x7fdc58071be0 2024-05-16T23:36:31.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.829+0000 7fdc5e229640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fdc58071310 con 0x7fdc5814cce0 2024-05-16T23:36:31.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.829+0000 7fdc577fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fdc580be4f0 0x7fdc580bfef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:51384/0 (socket says 172.21.15.44:51384) 2024-05-16T23:36:31.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.829+0000 7fdc577fe640 1 -- 172.21.15.44:0/3267244506 learned_addr learned my addr 172.21.15.44:0/3267244506 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T23:36:31.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.830+0000 7fdc56ffd640 1 --2- 172.21.15.44:0/3267244506 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdc5814cce0 0x7fdc580716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:31.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.830+0000 7fdc57fff640 1 --2- 172.21.15.44:0/3267244506 >> v2:172.21.15.70:3300/0 conn(0x7fdc58071be0 0x7fdc58156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:31.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.830+0000 7fdc567fc640 1 -- 172.21.15.44:0/3267244506 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3019573677 0 0) 0x7fdc580720d0 con 0x7fdc580be4f0 2024-05-16T23:36:31.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.830+0000 7fdc567fc640 1 -- 172.21.15.44:0/3267244506 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc40003520 con 0x7fdc580be4f0 2024-05-16T23:36:31.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.830+0000 7fdc56ffd640 1 -- 172.21.15.44:0/3267244506 >> v2:172.21.15.70:3300/0 conn(0x7fdc58071be0 msgr2=0x7fdc58156cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T23:36:31.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.830+0000 7fdc56ffd640 1 --2- 172.21.15.44:0/3267244506 >> v2:172.21.15.70:3300/0 conn(0x7fdc58071be0 0x7fdc58156cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:31.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.830+0000 7fdc56ffd640 1 -- 172.21.15.44:0/3267244506 >> v1:172.21.15.44:6789/0 conn(0x7fdc580be4f0 legacy=0x7fdc580bfef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:31.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.830+0000 7fdc56ffd640 1 -- 172.21.15.44:0/3267244506 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc580bf6f0 con 0x7fdc5814cce0 2024-05-16T23:36:32.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.830+0000 7fdc57fff640 1 --2- 172.21.15.44:0/3267244506 >> v2:172.21.15.70:3300/0 conn(0x7fdc58071be0 0x7fdc58156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T23:36:32.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.831+0000 7fdc56ffd640 1 --2- 172.21.15.44:0/3267244506 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdc5814cce0 0x7fdc580716a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c0097a0 tx=0x7fdc4c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=914901a35af38455 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:32.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.831+0000 7fdc567fc640 1 -- 172.21.15.44:0/3267244506 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c037070 con 0x7fdc5814cce0 2024-05-16T23:36:32.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.831+0000 7fdc567fc640 1 -- 172.21.15.44:0/3267244506 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc4c02ae50 con 0x7fdc5814cce0 2024-05-16T23:36:32.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.831+0000 7fdc567fc640 1 -- 172.21.15.44:0/3267244506 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c032660 con 0x7fdc5814cce0 2024-05-16T23:36:32.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.832+0000 7fdc5e229640 1 -- 172.21.15.44:0/3267244506 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdc5814cce0 msgr2=0x7fdc580716a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:32.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.832+0000 7fdc5e229640 1 --2- 172.21.15.44:0/3267244506 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdc5814cce0 0x7fdc580716a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c0097a0 tx=0x7fdc4c02a100 comp rx=0 tx=0).stop 2024-05-16T23:36:32.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.832+0000 7fdc5e229640 1 -- 172.21.15.44:0/3267244506 shutdown_connections 2024-05-16T23:36:32.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.832+0000 7fdc5e229640 1 --2- 172.21.15.44:0/3267244506 >> v2:172.21.15.70:3300/0 conn(0x7fdc58071be0 0x7fdc58156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:32.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.832+0000 7fdc5e229640 1 --2- 172.21.15.44:0/3267244506 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdc5814cce0 0x7fdc580716a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:32.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.832+0000 7fdc5e229640 1 -- 172.21.15.44:0/3267244506 >> 172.21.15.44:0/3267244506 conn(0x7fdc580c17c0 msgr2=0x7fdc580c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T23:36:32.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.832+0000 7fdc5e229640 1 -- 172.21.15.44:0/3267244506 shutdown_connections 2024-05-16T23:36:32.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.832+0000 7fdc5e229640 1 -- 172.21.15.44:0/3267244506 wait complete. 2024-05-16T23:36:32.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.833+0000 7fdc5e229640 1 Processor -- start 2024-05-16T23:36:32.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.833+0000 7fdc5e229640 1 -- start start 2024-05-16T23:36:32.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.834+0000 7fdc5e229640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdc58071be0 0x7fdc581e5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:32.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.834+0000 7fdc5e229640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdc580be4f0 0x7fdc581d57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:32.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.835+0000 7fdc5e229640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc5814cce0 0x7fdc580a02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:32.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.835+0000 7fdc5e229640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdc580a6c90 con 0x7fdc580be4f0 2024-05-16T23:36:32.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.835+0000 7fdc5e229640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdc580723b0 con 0x7fdc5814cce0 2024-05-16T23:36:32.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.835+0000 7fdc5e229640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fdc580bc1c0 con 0x7fdc58071be0 2024-05-16T23:36:32.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.835+0000 7fdc56ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdc580be4f0 0x7fdc581d57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:32.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.835+0000 7fdc56ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdc580be4f0 0x7fdc581d57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51462/0 (socket says 172.21.15.44:51462) 2024-05-16T23:36:32.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.835+0000 7fdc56ffd640 1 -- 172.21.15.44:0/766318636 learned_addr learned my addr 172.21.15.44:0/766318636 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T23:36:32.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.835+0000 7fdc577fe640 1 --2- 172.21.15.44:0/766318636 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdc58071be0 0x7fdc581e5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:32.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.835+0000 7fdc57fff640 1 --2- 172.21.15.44:0/766318636 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc5814cce0 0x7fdc580a02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:32.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.835+0000 7fdc56ffd640 1 -- 172.21.15.44:0/766318636 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdc58071be0 msgr2=0x7fdc581e5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:32.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.835+0000 7fdc56ffd640 1 --2- 172.21.15.44:0/766318636 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdc58071be0 0x7fdc581e5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:32.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.835+0000 7fdc56ffd640 1 -- 172.21.15.44:0/766318636 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc5814cce0 msgr2=0x7fdc580a02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:32.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.835+0000 7fdc56ffd640 1 --2- 172.21.15.44:0/766318636 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc5814cce0 0x7fdc580a02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:32.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.835+0000 7fdc56ffd640 1 -- 172.21.15.44:0/766318636 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc581e61b0 con 0x7fdc580be4f0 2024-05-16T23:36:32.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.835+0000 7fdc56ffd640 1 --2- 172.21.15.44:0/766318636 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdc580be4f0 0x7fdc581d57f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c0097a0 tx=0x7fdc4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:32.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.835+0000 7fdc3ffff640 1 -- 172.21.15.44:0/766318636 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c037040 con 0x7fdc580be4f0 2024-05-16T23:36:32.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.835+0000 7fdc3ffff640 1 -- 172.21.15.44:0/766318636 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc4c004030 con 0x7fdc580be4f0 2024-05-16T23:36:32.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.835+0000 7fdc5e229640 1 -- 172.21.15.44:0/766318636 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc581d6310 con 0x7fdc580be4f0 2024-05-16T23:36:32.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.835+0000 7fdc3ffff640 1 -- 172.21.15.44:0/766318636 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c006e10 con 0x7fdc580be4f0 2024-05-16T23:36:32.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.835+0000 7fdc5e229640 1 -- 172.21.15.44:0/766318636 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc581e1e60 con 0x7fdc580be4f0 2024-05-16T23:36:32.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.836+0000 7fdc5e229640 1 -- 172.21.15.44:0/766318636 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc580bf020 con 0x7fdc580be4f0 2024-05-16T23:36:32.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.837+0000 7fdc3ffff640 1 -- 172.21.15.44:0/766318636 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdc4c003610 con 0x7fdc580be4f0 2024-05-16T23:36:32.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.838+0000 7fdc3ffff640 1 --2- 172.21.15.44:0/766318636 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fdc440762d0 0x7fdc440787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:32.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.838+0000 7fdc3ffff640 1 -- 172.21.15.44:0/766318636 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5029+0+0 (secure 0 0 0) 0x7fdc4c0b7ee0 con 0x7fdc580be4f0 2024-05-16T23:36:32.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.838+0000 7fdc577fe640 1 --2- 172.21.15.44:0/766318636 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fdc440762d0 0x7fdc440787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:32.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.838+0000 7fdc577fe640 1 --2- 172.21.15.44:0/766318636 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fdc440762d0 0x7fdc440787e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fdc48005880 tx=0x7fdc48006aa0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:32.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:31.842+0000 7fdc3ffff640 1 -- 172.21.15.44:0/766318636 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fdc4c081a50 con 0x7fdc580be4f0 2024-05-16T23:36:32.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.036+0000 7fdc5e229640 1 -- 172.21.15.44:0/766318636 --> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fdc58050940 con 0x7fdc440762d0 2024-05-16T23:36:32.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.036+0000 7fdc3ffff640 1 -- 172.21.15.44:0/766318636 <== mgr.4114 v2:172.21.15.70:6832/4049588098 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fdc58050940 con 0x7fdc440762d0 2024-05-16T23:36:32.642 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 3 to deep-scrub 2024-05-16T23:36:32.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.039+0000 7fdc5e229640 1 -- 172.21.15.44:0/766318636 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fdc440762d0 msgr2=0x7fdc440787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:32.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.039+0000 7fdc5e229640 1 --2- 172.21.15.44:0/766318636 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fdc440762d0 0x7fdc440787e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fdc48005880 tx=0x7fdc48006aa0 comp rx=0 tx=0).stop 2024-05-16T23:36:32.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.039+0000 7fdc5e229640 1 -- 172.21.15.44:0/766318636 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdc580be4f0 msgr2=0x7fdc581d57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:32.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.039+0000 7fdc5e229640 1 --2- 172.21.15.44:0/766318636 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdc580be4f0 0x7fdc581d57f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c0097a0 tx=0x7fdc4c0046c0 comp rx=0 tx=0).stop 2024-05-16T23:36:32.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.039+0000 7fdc5e229640 1 -- 172.21.15.44:0/766318636 shutdown_connections 2024-05-16T23:36:32.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.039+0000 7fdc5e229640 1 --2- 172.21.15.44:0/766318636 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fdc440762d0 0x7fdc440787e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:32.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.039+0000 7fdc5e229640 1 --2- 172.21.15.44:0/766318636 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc5814cce0 0x7fdc580a02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:32.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.039+0000 7fdc5e229640 1 --2- 172.21.15.44:0/766318636 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdc580be4f0 0x7fdc581d57f0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:32.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.039+0000 7fdc5e229640 1 --2- 172.21.15.44:0/766318636 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdc58071be0 0x7fdc581e5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:32.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.039+0000 7fdc5e229640 1 -- 172.21.15.44:0/766318636 >> 172.21.15.44:0/766318636 conn(0x7fdc580c17c0 msgr2=0x7fdc5814c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T23:36:32.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.039+0000 7fdc5e229640 1 -- 172.21.15.44:0/766318636 shutdown_connections 2024-05-16T23:36:32.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.039+0000 7fdc5e229640 1 -- 172.21.15.44:0/766318636 wait complete. 2024-05-16T23:36:32.775 INFO:tasks.ceph:Scrubbing osd.4 2024-05-16T23:36:32.783 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-16T23:36:32.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.922+0000 7f6885c49640 1 Processor -- start 2024-05-16T23:36:32.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.922+0000 7f6885c49640 1 -- start start 2024-05-16T23:36:32.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.923+0000 7f6885c49640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f68800b95f0 0x7f68800b7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:32.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.923+0000 7f6885c49640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f688014bff0 con 0x7f6880153a00 2024-05-16T23:36:32.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.923+0000 7f6885c49640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68800bab00 con 0x7f688014b0b0 2024-05-16T23:36:32.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.923+0000 7f6885c49640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f68800bb7f0 con 0x7f68800b95f0 2024-05-16T23:36:32.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.923+0000 7f687ffff640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f6880153a00 0x7f6880155e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:51398/0 (socket says 172.21.15.44:51398) 2024-05-16T23:36:32.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.923+0000 7f687ffff640 1 -- 172.21.15.44:0/3851230813 learned_addr learned my addr 172.21.15.44:0/3851230813 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T23:36:33.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.923+0000 7f687effd640 1 --2- 172.21.15.44:0/3851230813 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f68800b95f0 0x7f68800b7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:33.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.923+0000 7f687e7fc640 1 -- 172.21.15.44:0/3851230813 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 37815050 0 0) 0x7f688014bff0 con 0x7f6880153a00 2024-05-16T23:36:33.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.923+0000 7f687e7fc640 1 -- 172.21.15.44:0/3851230813 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6868003520 con 0x7f6880153a00 2024-05-16T23:36:33.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.923+0000 7f687e7fc640 1 -- 172.21.15.44:0/3851230813 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2193068038 0 0) 0x7f68800bab00 con 0x7f688014b0b0 2024-05-16T23:36:33.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.924+0000 7f687e7fc640 1 -- 172.21.15.44:0/3851230813 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f688014bff0 con 0x7f688014b0b0 2024-05-16T23:36:33.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.924+0000 7f687e7fc640 1 -- 172.21.15.44:0/3851230813 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2775005463 0 0) 0x7f6868003520 con 0x7f6880153a00 2024-05-16T23:36:33.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.924+0000 7f687e7fc640 1 -- 172.21.15.44:0/3851230813 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f68800b95f0 msgr2=0x7f68800b7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T23:36:33.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.924+0000 7f687e7fc640 1 --2- 172.21.15.44:0/3851230813 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f68800b95f0 0x7f68800b7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:33.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.924+0000 7f687e7fc640 1 -- 172.21.15.44:0/3851230813 >> v1:172.21.15.70:6789/0 conn(0x7f688014b0b0 legacy=0x7f68800bbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:33.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.924+0000 7f687e7fc640 1 -- 172.21.15.44:0/3851230813 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68800b9bf0 con 0x7f6880153a00 2024-05-16T23:36:33.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.924+0000 7f687e7fc640 1 -- 172.21.15.44:0/3851230813 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 568431863 0 0) 0x7f6878001670 con 0x7f6880153a00 2024-05-16T23:36:33.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.924+0000 7f687e7fc640 1 -- 172.21.15.44:0/3851230813 >> v1:172.21.15.44:6789/0 conn(0x7f6880153a00 legacy=0x7f6880155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:33.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.924+0000 7f687e7fc640 1 --2- 172.21.15.44:0/3851230813 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f68800b95f0 0x7f6868003c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:33.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.924+0000 7f687e7fc640 1 --2- 172.21.15.44:0/3851230813 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6868004210 0x7f6868004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:33.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.924+0000 7f687e7fc640 1 --2- 172.21.15.44:0/3851230813 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6868004db0 0x7f6868005280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:33.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.924+0000 7f687e7fc640 1 -- 172.21.15.44:0/3851230813 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f68800bb7f0 con 0x7f6868004db0 2024-05-16T23:36:33.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.924+0000 7f687e7fc640 1 -- 172.21.15.44:0/3851230813 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f686800bc70 con 0x7f6868004210 2024-05-16T23:36:33.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.924+0000 7f687e7fc640 1 -- 172.21.15.44:0/3851230813 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f686800be70 con 0x7f68800b95f0 2024-05-16T23:36:33.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.924+0000 7f687effd640 1 --2- 172.21.15.44:0/3851230813 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6868004210 0x7f6868004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:33.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.924+0000 7f687f7fe640 1 --2- 172.21.15.44:0/3851230813 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f68800b95f0 0x7f6868003c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:33.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.924+0000 7f687ffff640 1 --2- 172.21.15.44:0/3851230813 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6868004db0 0x7f6868005280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:33.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.924+0000 7f687ffff640 1 -- 172.21.15.44:0/3851230813 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f68800b95f0 msgr2=0x7f6868003c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T23:36:33.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.924+0000 7f687ffff640 1 --2- 172.21.15.44:0/3851230813 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f68800b95f0 0x7f6868003c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:33.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.924+0000 7f687ffff640 1 -- 172.21.15.44:0/3851230813 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6868004210 msgr2=0x7f6868004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T23:36:33.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.924+0000 7f687ffff640 1 --2- 172.21.15.44:0/3851230813 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6868004210 0x7f6868004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:33.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.924+0000 7f687ffff640 1 -- 172.21.15.44:0/3851230813 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6868003520 con 0x7f6868004db0 2024-05-16T23:36:33.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.925+0000 7f687ffff640 1 --2- 172.21.15.44:0/3851230813 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6868004db0 0x7f6868005280 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6880148cc0 tx=0x7f6868005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49eef7e4a7eee7fc server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:33.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.925+0000 7f687e7fc640 1 -- 172.21.15.44:0/3851230813 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6878001cb0 con 0x7f6868004db0 2024-05-16T23:36:33.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.925+0000 7f687e7fc640 1 -- 172.21.15.44:0/3851230813 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6878007d00 con 0x7f6868004db0 2024-05-16T23:36:33.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.925+0000 7f687e7fc640 1 -- 172.21.15.44:0/3851230813 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68780092b0 con 0x7f6868004db0 2024-05-16T23:36:33.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.926+0000 7f6885c49640 1 -- 172.21.15.44:0/3851230813 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6868004db0 msgr2=0x7f6868005280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:33.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.926+0000 7f6885c49640 1 --2- 172.21.15.44:0/3851230813 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6868004db0 0x7f6868005280 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6880148cc0 tx=0x7f6868005830 comp rx=0 tx=0).stop 2024-05-16T23:36:33.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.926+0000 7f687ffff640 1 -- 172.21.15.44:0/3851230813 reap_dead start 2024-05-16T23:36:33.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.926+0000 7f6885c49640 1 -- 172.21.15.44:0/3851230813 shutdown_connections 2024-05-16T23:36:33.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.926+0000 7f6885c49640 1 -- 172.21.15.44:0/3851230813 >> 172.21.15.44:0/3851230813 conn(0x7f688006e220 msgr2=0x7f68800c05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T23:36:33.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.926+0000 7f6885c49640 1 -- 172.21.15.44:0/3851230813 shutdown_connections 2024-05-16T23:36:33.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.926+0000 7f6885c49640 1 -- 172.21.15.44:0/3851230813 wait complete. 2024-05-16T23:36:33.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.927+0000 7f6885c49640 1 Processor -- start 2024-05-16T23:36:33.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.928+0000 7f6885c49640 1 -- start start 2024-05-16T23:36:33.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.929+0000 7f6885c49640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6868004db0 0x7f6880140c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:33.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.929+0000 7f6885c49640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f688014ceb0 0x7f688013c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:33.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.929+0000 7f6885c49640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f688014e8e0 0x7f68801e3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:33.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.929+0000 7f6885c49640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f68800bafe0 con 0x7f6868004db0 2024-05-16T23:36:33.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.929+0000 7f6885c49640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f68801457a0 con 0x7f688014e8e0 2024-05-16T23:36:33.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.929+0000 7f6885c49640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f68800bb160 con 0x7f688014ceb0 2024-05-16T23:36:33.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.929+0000 7f687f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6868004db0 0x7f6880140c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:33.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.929+0000 7f687f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6868004db0 0x7f6880140c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51470/0 (socket says 172.21.15.44:51470) 2024-05-16T23:36:33.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.929+0000 7f687f7fe640 1 -- 172.21.15.44:0/1703156647 learned_addr learned my addr 172.21.15.44:0/1703156647 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T23:36:33.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.929+0000 7f687effd640 1 --2- 172.21.15.44:0/1703156647 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f688014ceb0 0x7f688013c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:33.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.929+0000 7f687ffff640 1 --2- 172.21.15.44:0/1703156647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f688014e8e0 0x7f68801e3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:33.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.929+0000 7f687f7fe640 1 -- 172.21.15.44:0/1703156647 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f688014ceb0 msgr2=0x7f688013c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:33.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.929+0000 7f687f7fe640 1 --2- 172.21.15.44:0/1703156647 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f688014ceb0 0x7f688013c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:33.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.929+0000 7f687f7fe640 1 -- 172.21.15.44:0/1703156647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f688014e8e0 msgr2=0x7f68801e3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:33.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.929+0000 7f687f7fe640 1 --2- 172.21.15.44:0/1703156647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f688014e8e0 0x7f68801e3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:33.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.929+0000 7f687f7fe640 1 -- 172.21.15.44:0/1703156647 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6880141150 con 0x7f6868004db0 2024-05-16T23:36:33.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.929+0000 7f687f7fe640 1 --2- 172.21.15.44:0/1703156647 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6868004db0 0x7f6880140c10 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f687000fc10 tx=0x7f687000d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:33.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.930+0000 7f6867fff640 1 -- 172.21.15.44:0/1703156647 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687000dc30 con 0x7f6868004db0 2024-05-16T23:36:33.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.930+0000 7f6867fff640 1 -- 172.21.15.44:0/1703156647 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6870018070 con 0x7f6868004db0 2024-05-16T23:36:33.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.930+0000 7f6885c49640 1 -- 172.21.15.44:0/1703156647 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f688014ee30 con 0x7f6868004db0 2024-05-16T23:36:33.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.930+0000 7f6867fff640 1 -- 172.21.15.44:0/1703156647 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6870003970 con 0x7f6868004db0 2024-05-16T23:36:33.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.930+0000 7f6885c49640 1 -- 172.21.15.44:0/1703156647 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68801e06d0 con 0x7f6868004db0 2024-05-16T23:36:33.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.930+0000 7f6885c49640 1 -- 172.21.15.44:0/1703156647 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f68800bfe80 con 0x7f6868004db0 2024-05-16T23:36:33.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.931+0000 7f6867fff640 1 -- 172.21.15.44:0/1703156647 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6870003b30 con 0x7f6868004db0 2024-05-16T23:36:33.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.932+0000 7f6867fff640 1 --2- 172.21.15.44:0/1703156647 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f686c076300 0x7f686c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:33.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.932+0000 7f6867fff640 1 -- 172.21.15.44:0/1703156647 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5029+0+0 (secure 0 0 0) 0x7f6870097680 con 0x7f6868004db0 2024-05-16T23:36:33.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.932+0000 7f6867fff640 1 --2- 172.21.15.44:0/1703156647 >> [v2:172.21.15.70:6821/1540297751,v1:172.21.15.70:6823/1540297751] conn(0x7f686c07c2b0 0x7f686c07e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:33.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.932+0000 7f6867fff640 1 -- 172.21.15.44:0/1703156647 --> [v2:172.21.15.70:6821/1540297751,v1:172.21.15.70:6823/1540297751] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6870009e50 con 0x7f686c07c2b0 2024-05-16T23:36:33.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.932+0000 7f6867fff640 1 -- 172.21.15.44:0/1703156647 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f687009e050 con 0x7f6868004db0 2024-05-16T23:36:33.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.932+0000 7f687effd640 1 --2- 172.21.15.44:0/1703156647 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f686c076300 0x7f686c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:33.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.932+0000 7f687ffff640 1 --2- 172.21.15.44:0/1703156647 >> [v2:172.21.15.70:6821/1540297751,v1:172.21.15.70:6823/1540297751] conn(0x7f686c07c2b0 0x7f686c07e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:33.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.933+0000 7f687effd640 1 --2- 172.21.15.44:0/1703156647 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f686c076300 0x7f686c078810 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f68800b75a0 tx=0x7f6874009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:33.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.933+0000 7f687ffff640 1 --2- 172.21.15.44:0/1703156647 >> [v2:172.21.15.70:6821/1540297751,v1:172.21.15.70:6823/1540297751] conn(0x7f686c07c2b0 0x7f686c07e700 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:33.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.934+0000 7f6867fff640 1 -- 172.21.15.44:0/1703156647 <== osd.4 v2:172.21.15.70:6821/1540297751 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6870009e50 con 0x7f686c07c2b0 2024-05-16T23:36:33.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.947+0000 7f6885c49640 1 -- 172.21.15.44:0/1703156647 --> [v2:172.21.15.70:6821/1540297751,v1:172.21.15.70:6823/1540297751] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6880069b50 con 0x7f686c07c2b0 2024-05-16T23:36:33.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.947+0000 7f6867fff640 1 -- 172.21.15.44:0/1703156647 <== osd.4 v2:172.21.15.70:6821/1540297751 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6880069b50 con 0x7f686c07c2b0 2024-05-16T23:36:33.898 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-05-16T23:36:33.909 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-16T23:36:33.918 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-05-16T23:36:33.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.948+0000 7f6885c49640 1 -- 172.21.15.44:0/1703156647 >> [v2:172.21.15.70:6821/1540297751,v1:172.21.15.70:6823/1540297751] conn(0x7f686c07c2b0 msgr2=0x7f686c07e700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:33.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.948+0000 7f6885c49640 1 --2- 172.21.15.44:0/1703156647 >> [v2:172.21.15.70:6821/1540297751,v1:172.21.15.70:6823/1540297751] conn(0x7f686c07c2b0 0x7f686c07e700 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:33.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.948+0000 7f6885c49640 1 -- 172.21.15.44:0/1703156647 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f686c076300 msgr2=0x7f686c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:33.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.948+0000 7f6885c49640 1 --2- 172.21.15.44:0/1703156647 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f686c076300 0x7f686c078810 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f68800b75a0 tx=0x7f6874009190 comp rx=0 tx=0).stop 2024-05-16T23:36:33.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.948+0000 7f6885c49640 1 -- 172.21.15.44:0/1703156647 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6868004db0 msgr2=0x7f6880140c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:33.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.948+0000 7f6885c49640 1 --2- 172.21.15.44:0/1703156647 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6868004db0 0x7f6880140c10 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f687000fc10 tx=0x7f687000d520 comp rx=0 tx=0).stop 2024-05-16T23:36:33.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.948+0000 7f687ffff640 1 -- 172.21.15.44:0/1703156647 reap_dead start 2024-05-16T23:36:34.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.948+0000 7f6885c49640 1 -- 172.21.15.44:0/1703156647 shutdown_connections 2024-05-16T23:36:34.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.948+0000 7f6885c49640 1 -- 172.21.15.44:0/1703156647 >> 172.21.15.44:0/1703156647 conn(0x7f688006e220 msgr2=0x7f688013ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T23:36:34.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.948+0000 7f6885c49640 1 -- 172.21.15.44:0/1703156647 shutdown_connections 2024-05-16T23:36:34.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:32.948+0000 7f6885c49640 1 -- 172.21.15.44:0/1703156647 wait complete. 2024-05-16T23:36:34.075 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-16T23:36:34.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.212+0000 7ff9cdb1f640 1 Processor -- start 2024-05-16T23:36:34.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.212+0000 7ff9cdb1f640 1 -- start start 2024-05-16T23:36:34.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.213+0000 7ff9cdb1f640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff9c80be3f0 0x7ff9c80bb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:34.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.213+0000 7ff9cdb1f640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff9c814bb10 0x7ff9c8073a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:34.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.214+0000 7ff9cdb1f640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff9c814bf20 0x7ff9c8073fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:34.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.214+0000 7ff9cdb1f640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7ff9c80bc6e0 con 0x7ff9c80be3f0 2024-05-16T23:36:34.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.214+0000 7ff9cdb1f640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7ff9c80bb710 con 0x7ff9c814bb10 2024-05-16T23:36:34.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.214+0000 7ff9cdb1f640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7ff9c80bed70 con 0x7ff9c814bf20 2024-05-16T23:36:34.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.214+0000 7ff9c77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff9c80be3f0 0x7ff9c80bb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:34.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.214+0000 7ff9c77fe640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff9c80be3f0 0x7ff9c80bb1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51484/0 (socket says 172.21.15.44:51484) 2024-05-16T23:36:34.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.214+0000 7ff9c77fe640 1 -- 172.21.15.44:0/98265048 learned_addr learned my addr 172.21.15.44:0/98265048 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T23:36:34.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.214+0000 7ff9c7fff640 1 --2- 172.21.15.44:0/98265048 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff9c814bf20 0x7ff9c8073fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:34.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.214+0000 7ff9c6ffd640 1 --2- 172.21.15.44:0/98265048 >> v2:172.21.15.70:3300/0 conn(0x7ff9c814bb10 0x7ff9c8073a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:34.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.214+0000 7ff9c77fe640 1 -- 172.21.15.44:0/98265048 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff9c814bf20 msgr2=0x7ff9c8073fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T23:36:34.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.214+0000 7ff9c77fe640 1 --2- 172.21.15.44:0/98265048 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff9c814bf20 0x7ff9c8073fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:34.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.214+0000 7ff9c77fe640 1 -- 172.21.15.44:0/98265048 >> v2:172.21.15.70:3300/0 conn(0x7ff9c814bb10 msgr2=0x7ff9c8073a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T23:36:34.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.214+0000 7ff9c77fe640 1 --2- 172.21.15.44:0/98265048 >> v2:172.21.15.70:3300/0 conn(0x7ff9c814bb10 0x7ff9c8073a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:34.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.214+0000 7ff9c77fe640 1 -- 172.21.15.44:0/98265048 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9c8073260 con 0x7ff9c80be3f0 2024-05-16T23:36:34.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.215+0000 7ff9c77fe640 1 --2- 172.21.15.44:0/98265048 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9c80be3f0 0x7ff9c80bb1d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8072b00 tx=0x7ff9b802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=209f787c08c0ec9b server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:34.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.215+0000 7ff9c67fc640 1 -- 172.21.15.44:0/98265048 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b8037070 con 0x7ff9c80be3f0 2024-05-16T23:36:34.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.215+0000 7ff9c67fc640 1 -- 172.21.15.44:0/98265048 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9b8032440 con 0x7ff9c80be3f0 2024-05-16T23:36:34.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.215+0000 7ff9c67fc640 1 -- 172.21.15.44:0/98265048 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b8032810 con 0x7ff9c80be3f0 2024-05-16T23:36:34.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.216+0000 7ff9cdb1f640 1 -- 172.21.15.44:0/98265048 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9c80be3f0 msgr2=0x7ff9c80bb1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:34.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.216+0000 7ff9cdb1f640 1 --2- 172.21.15.44:0/98265048 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9c80be3f0 0x7ff9c80bb1d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8072b00 tx=0x7ff9b802a270 comp rx=0 tx=0).stop 2024-05-16T23:36:34.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.216+0000 7ff9cdb1f640 1 -- 172.21.15.44:0/98265048 shutdown_connections 2024-05-16T23:36:34.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.216+0000 7ff9cdb1f640 1 --2- 172.21.15.44:0/98265048 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff9c814bf20 0x7ff9c8073fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:34.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.216+0000 7ff9cdb1f640 1 --2- 172.21.15.44:0/98265048 >> v2:172.21.15.70:3300/0 conn(0x7ff9c814bb10 0x7ff9c8073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:34.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.216+0000 7ff9cdb1f640 1 --2- 172.21.15.44:0/98265048 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9c80be3f0 0x7ff9c80bb1d0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:34.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.216+0000 7ff9cdb1f640 1 -- 172.21.15.44:0/98265048 >> 172.21.15.44:0/98265048 conn(0x7ff9c80bd0f0 msgr2=0x7ff9c80bd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T23:36:34.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.216+0000 7ff9cdb1f640 1 -- 172.21.15.44:0/98265048 shutdown_connections 2024-05-16T23:36:34.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.216+0000 7ff9cdb1f640 1 -- 172.21.15.44:0/98265048 wait complete. 2024-05-16T23:36:34.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.217+0000 7ff9cdb1f640 1 Processor -- start 2024-05-16T23:36:34.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.218+0000 7ff9cdb1f640 1 -- start start 2024-05-16T23:36:34.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.219+0000 7ff9cdb1f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff9c80be3f0 0x7ff9c813f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:34.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.219+0000 7ff9cdb1f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9c814bb10 0x7ff9c8143e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:34.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.219+0000 7ff9cdb1f640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff9c814bf20 0x7ff9c813d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:34.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.219+0000 7ff9cdb1f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c80c02d0 con 0x7ff9c814bb10 2024-05-16T23:36:34.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.219+0000 7ff9cdb1f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c80c0150 con 0x7ff9c80be3f0 2024-05-16T23:36:34.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.219+0000 7ff9cdb1f640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7ff9c80bfb50 con 0x7ff9c814bf20 2024-05-16T23:36:34.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.219+0000 7ff9c6ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9c814bb10 0x7ff9c8143e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:34.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.219+0000 7ff9c6ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9c814bb10 0x7ff9c8143e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51492/0 (socket says 172.21.15.44:51492) 2024-05-16T23:36:34.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.219+0000 7ff9c6ffd640 1 -- 172.21.15.44:0/3170810706 learned_addr learned my addr 172.21.15.44:0/3170810706 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T23:36:34.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.219+0000 7ff9c7fff640 1 --2- 172.21.15.44:0/3170810706 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff9c814bf20 0x7ff9c813d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:34.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.219+0000 7ff9c77fe640 1 --2- 172.21.15.44:0/3170810706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff9c80be3f0 0x7ff9c813f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:34.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.219+0000 7ff9c6ffd640 1 -- 172.21.15.44:0/3170810706 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff9c814bf20 msgr2=0x7ff9c813d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:34.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.219+0000 7ff9c6ffd640 1 --2- 172.21.15.44:0/3170810706 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff9c814bf20 0x7ff9c813d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:34.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.219+0000 7ff9c6ffd640 1 -- 172.21.15.44:0/3170810706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff9c80be3f0 msgr2=0x7ff9c813f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:34.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.219+0000 7ff9c6ffd640 1 --2- 172.21.15.44:0/3170810706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff9c80be3f0 0x7ff9c813f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:34.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.219+0000 7ff9c6ffd640 1 -- 172.21.15.44:0/3170810706 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9c8142870 con 0x7ff9c814bb10 2024-05-16T23:36:34.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.219+0000 7ff9c7fff640 1 --2- 172.21.15.44:0/3170810706 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff9c814bf20 0x7ff9c813d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T23:36:34.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.219+0000 7ff9c77fe640 1 --2- 172.21.15.44:0/3170810706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff9c80be3f0 0x7ff9c813f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T23:36:34.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.219+0000 7ff9c6ffd640 1 --2- 172.21.15.44:0/3170810706 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9c814bb10 0x7ff9c8143e80 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff9b000e870 tx=0x7ff9b000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:34.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.220+0000 7ff9bffff640 1 -- 172.21.15.44:0/3170810706 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b0017070 con 0x7ff9c814bb10 2024-05-16T23:36:34.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.220+0000 7ff9bffff640 1 -- 172.21.15.44:0/3170810706 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9b000c940 con 0x7ff9c814bb10 2024-05-16T23:36:34.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.220+0000 7ff9cdb1f640 1 -- 172.21.15.44:0/3170810706 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9c8149e80 con 0x7ff9c814bb10 2024-05-16T23:36:34.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.220+0000 7ff9bffff640 1 -- 172.21.15.44:0/3170810706 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b000cd30 con 0x7ff9c814bb10 2024-05-16T23:36:34.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.220+0000 7ff9cdb1f640 1 -- 172.21.15.44:0/3170810706 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9c8143850 con 0x7ff9c814bb10 2024-05-16T23:36:34.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.221+0000 7ff9cdb1f640 1 -- 172.21.15.44:0/3170810706 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9c8050940 con 0x7ff9c814bb10 2024-05-16T23:36:34.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.222+0000 7ff9bffff640 1 -- 172.21.15.44:0/3170810706 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff9b001a070 con 0x7ff9c814bb10 2024-05-16T23:36:34.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.222+0000 7ff9bffff640 1 --2- 172.21.15.44:0/3170810706 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7ff9a80762d0 0x7ff9a80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:34.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.222+0000 7ff9bffff640 1 -- 172.21.15.44:0/3170810706 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5029+0+0 (secure 0 0 0) 0x7ff9b0097230 con 0x7ff9c814bb10 2024-05-16T23:36:34.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.222+0000 7ff9c77fe640 1 --2- 172.21.15.44:0/3170810706 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7ff9a80762d0 0x7ff9a80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:34.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.223+0000 7ff9c77fe640 1 --2- 172.21.15.44:0/3170810706 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7ff9a80762d0 0x7ff9a80787e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8034000 tx=0x7ff9b802e000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:34.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.227+0000 7ff9bffff640 1 -- 172.21.15.44:0/3170810706 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff9c8142870 con 0x7ff9c814bb10 2024-05-16T23:36:34.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.417+0000 7ff9cdb1f640 1 -- 172.21.15.44:0/3170810706 --> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7ff9c813f7d0 con 0x7ff9a80762d0 2024-05-16T23:36:34.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.417+0000 7ff9bffff640 1 -- 172.21.15.44:0/3170810706 <== mgr.4114 v2:172.21.15.70:6832/4049588098 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff9c813f7d0 con 0x7ff9a80762d0 2024-05-16T23:36:34.909 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 4 to deep-scrub 2024-05-16T23:36:34.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.419+0000 7ff9cdb1f640 1 -- 172.21.15.44:0/3170810706 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7ff9a80762d0 msgr2=0x7ff9a80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:34.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.419+0000 7ff9cdb1f640 1 --2- 172.21.15.44:0/3170810706 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7ff9a80762d0 0x7ff9a80787e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8034000 tx=0x7ff9b802e000 comp rx=0 tx=0).stop 2024-05-16T23:36:34.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.419+0000 7ff9cdb1f640 1 -- 172.21.15.44:0/3170810706 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9c814bb10 msgr2=0x7ff9c8143e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:34.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.419+0000 7ff9cdb1f640 1 --2- 172.21.15.44:0/3170810706 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9c814bb10 0x7ff9c8143e80 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff9b000e870 tx=0x7ff9b000ed30 comp rx=0 tx=0).stop 2024-05-16T23:36:34.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.420+0000 7ff9cdb1f640 1 -- 172.21.15.44:0/3170810706 shutdown_connections 2024-05-16T23:36:34.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.420+0000 7ff9cdb1f640 1 --2- 172.21.15.44:0/3170810706 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7ff9a80762d0 0x7ff9a80787e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:34.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.420+0000 7ff9cdb1f640 1 --2- 172.21.15.44:0/3170810706 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff9c814bf20 0x7ff9c813d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:34.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.420+0000 7ff9cdb1f640 1 --2- 172.21.15.44:0/3170810706 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9c814bb10 0x7ff9c8143e80 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:34.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.420+0000 7ff9cdb1f640 1 --2- 172.21.15.44:0/3170810706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff9c80be3f0 0x7ff9c813f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:35.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.420+0000 7ff9cdb1f640 1 -- 172.21.15.44:0/3170810706 >> 172.21.15.44:0/3170810706 conn(0x7ff9c80bd0f0 msgr2=0x7ff9c80a4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T23:36:35.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.420+0000 7ff9cdb1f640 1 -- 172.21.15.44:0/3170810706 shutdown_connections 2024-05-16T23:36:35.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:34.420+0000 7ff9cdb1f640 1 -- 172.21.15.44:0/3170810706 wait complete. 2024-05-16T23:36:35.030 INFO:tasks.ceph:Scrubbing osd.5 2024-05-16T23:36:35.083 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-16T23:36:35.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.224+0000 7f2852e9f640 1 Processor -- start 2024-05-16T23:36:35.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.224+0000 7f2852e9f640 1 -- start start 2024-05-16T23:36:35.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.225+0000 7f2852e9f640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f284c148910 0x7f284c14e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:35.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.225+0000 7f2852e9f640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f284c14eba0 0x7f284c158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:35.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.225+0000 7f2852e9f640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f284c0ba800 con 0x7f284c0a9060 2024-05-16T23:36:35.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.225+0000 7f2852e9f640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f284c0b8a30 con 0x7f284c14eba0 2024-05-16T23:36:35.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.225+0000 7f2852e9f640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f284c0b8d10 con 0x7f284c148910 2024-05-16T23:36:35.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.225+0000 7f285143c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f284c14eba0 0x7f284c158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:35.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.225+0000 7f285143c640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f284c14eba0 0x7f284c158db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51504/0 (socket says 172.21.15.44:51504) 2024-05-16T23:36:35.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.225+0000 7f285143c640 1 -- 172.21.15.44:0/4183620193 learned_addr learned my addr 172.21.15.44:0/4183620193 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T23:36:35.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.225+0000 7f284bfff640 1 --2- 172.21.15.44:0/4183620193 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f284c148910 0x7f284c14e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:35.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.225+0000 7f285143c640 1 -- 172.21.15.44:0/4183620193 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f284c148910 msgr2=0x7f284c14e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T23:36:35.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.225+0000 7f285143c640 1 --2- 172.21.15.44:0/4183620193 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f284c148910 0x7f284c14e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:35.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.225+0000 7f285143c640 1 -- 172.21.15.44:0/4183620193 >> v1:172.21.15.70:6789/0 conn(0x7f284c0a9060 legacy=0x7f284c0ba0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:35.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.225+0000 7f285143c640 1 -- 172.21.15.44:0/4183620193 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f284c0b8ff0 con 0x7f284c14eba0 2024-05-16T23:36:35.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.225+0000 7f284bfff640 1 --2- 172.21.15.44:0/4183620193 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f284c148910 0x7f284c14e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T23:36:35.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.226+0000 7f285143c640 1 --2- 172.21.15.44:0/4183620193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f284c14eba0 0x7f284c158db0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f283c009870 tx=0x7f283c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62c87678a29395e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:35.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.226+0000 7f284b7fe640 1 -- 172.21.15.44:0/4183620193 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f283c037070 con 0x7f284c14eba0 2024-05-16T23:36:35.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.226+0000 7f284b7fe640 1 -- 172.21.15.44:0/4183620193 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f283c02ae50 con 0x7f284c14eba0 2024-05-16T23:36:35.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.226+0000 7f284b7fe640 1 -- 172.21.15.44:0/4183620193 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f283c032860 con 0x7f284c14eba0 2024-05-16T23:36:35.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.227+0000 7f2852e9f640 1 -- 172.21.15.44:0/4183620193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f284c14eba0 msgr2=0x7f284c158db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:35.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.227+0000 7f2852e9f640 1 --2- 172.21.15.44:0/4183620193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f284c14eba0 0x7f284c158db0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f283c009870 tx=0x7f283c02a300 comp rx=0 tx=0).stop 2024-05-16T23:36:35.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.227+0000 7f2852e9f640 1 -- 172.21.15.44:0/4183620193 shutdown_connections 2024-05-16T23:36:35.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.227+0000 7f2852e9f640 1 --2- 172.21.15.44:0/4183620193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f284c14eba0 0x7f284c158db0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:35.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.227+0000 7f2852e9f640 1 --2- 172.21.15.44:0/4183620193 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f284c148910 0x7f284c14e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:35.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.227+0000 7f2852e9f640 1 -- 172.21.15.44:0/4183620193 >> 172.21.15.44:0/4183620193 conn(0x7f284c0c07c0 msgr2=0x7f284c0c0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T23:36:35.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.227+0000 7f2852e9f640 1 -- 172.21.15.44:0/4183620193 shutdown_connections 2024-05-16T23:36:35.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.227+0000 7f2852e9f640 1 -- 172.21.15.44:0/4183620193 wait complete. 2024-05-16T23:36:35.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.228+0000 7f2852e9f640 1 Processor -- start 2024-05-16T23:36:35.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.229+0000 7f2852e9f640 1 -- start start 2024-05-16T23:36:35.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.230+0000 7f2852e9f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f284c0a9060 0x7f284c0c2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:35.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.230+0000 7f2852e9f640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f284c148910 0x7f284c1e4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:35.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.230+0000 7f2852e9f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f284c14eba0 0x7f284c146b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:35.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.230+0000 7f2852e9f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f284c08d400 con 0x7f284c0a9060 2024-05-16T23:36:35.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.230+0000 7f2852e9f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f284c14efb0 con 0x7f284c14eba0 2024-05-16T23:36:35.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.230+0000 7f2852e9f640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f284c08d580 con 0x7f284c148910 2024-05-16T23:36:35.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.230+0000 7f2850c3b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f284c0a9060 0x7f284c0c2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:35.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.230+0000 7f2850c3b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f284c0a9060 0x7f284c0c2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51516/0 (socket says 172.21.15.44:51516) 2024-05-16T23:36:35.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.230+0000 7f2850c3b640 1 -- 172.21.15.44:0/1827488844 learned_addr learned my addr 172.21.15.44:0/1827488844 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T23:36:35.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.230+0000 7f284bfff640 1 --2- 172.21.15.44:0/1827488844 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f284c148910 0x7f284c1e4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:35.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.230+0000 7f285143c640 1 --2- 172.21.15.44:0/1827488844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f284c14eba0 0x7f284c146b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:35.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.230+0000 7f2850c3b640 1 -- 172.21.15.44:0/1827488844 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f284c148910 msgr2=0x7f284c1e4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:35.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.230+0000 7f2850c3b640 1 --2- 172.21.15.44:0/1827488844 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f284c148910 0x7f284c1e4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:35.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.230+0000 7f2850c3b640 1 -- 172.21.15.44:0/1827488844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f284c14eba0 msgr2=0x7f284c146b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:35.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.230+0000 7f2850c3b640 1 --2- 172.21.15.44:0/1827488844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f284c14eba0 0x7f284c146b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:35.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.230+0000 7f2850c3b640 1 -- 172.21.15.44:0/1827488844 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f284c1d7460 con 0x7f284c0a9060 2024-05-16T23:36:35.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.230+0000 7f2850c3b640 1 --2- 172.21.15.44:0/1827488844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f284c0a9060 0x7f284c0c2760 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f284400c760 tx=0x7f284400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:35.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.231+0000 7f28497fa640 1 -- 172.21.15.44:0/1827488844 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2844003b70 con 0x7f284c0a9060 2024-05-16T23:36:35.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.231+0000 7f28497fa640 1 -- 172.21.15.44:0/1827488844 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2844003d30 con 0x7f284c0a9060 2024-05-16T23:36:35.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.231+0000 7f2852e9f640 1 -- 172.21.15.44:0/1827488844 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f284c0c2ca0 con 0x7f284c0a9060 2024-05-16T23:36:35.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.231+0000 7f28497fa640 1 -- 172.21.15.44:0/1827488844 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f284400aa30 con 0x7f284c0a9060 2024-05-16T23:36:35.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.231+0000 7f2852e9f640 1 -- 172.21.15.44:0/1827488844 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f284c1d6e20 con 0x7f284c0a9060 2024-05-16T23:36:35.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.231+0000 7f2852e9f640 1 -- 172.21.15.44:0/1827488844 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f284c0ba9e0 con 0x7f284c0a9060 2024-05-16T23:36:35.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.232+0000 7f28497fa640 1 -- 172.21.15.44:0/1827488844 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f284400abd0 con 0x7f284c0a9060 2024-05-16T23:36:35.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.233+0000 7f28497fa640 1 --2- 172.21.15.44:0/1827488844 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f28380762d0 0x7f28380787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:35.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.233+0000 7f28497fa640 1 -- 172.21.15.44:0/1827488844 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5029+0+0 (secure 0 0 0) 0x7f2844097030 con 0x7f284c0a9060 2024-05-16T23:36:35.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.233+0000 7f28497fa640 1 --2- 172.21.15.44:0/1827488844 >> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] conn(0x7f283807c280 0x7f283807e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:35.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.233+0000 7f28497fa640 1 -- 172.21.15.44:0/1827488844 --> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f283807eda0 con 0x7f283807c280 2024-05-16T23:36:35.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.233+0000 7f28497fa640 1 -- 172.21.15.44:0/1827488844 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f284409e050 con 0x7f284c0a9060 2024-05-16T23:36:35.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.233+0000 7f284bfff640 1 --2- 172.21.15.44:0/1827488844 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f28380762d0 0x7f28380787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:35.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.233+0000 7f285143c640 1 --2- 172.21.15.44:0/1827488844 >> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] conn(0x7f283807c280 0x7f283807e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:35.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.234+0000 7f284bfff640 1 --2- 172.21.15.44:0/1827488844 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f28380762d0 0x7f28380787e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f284c147d00 tx=0x7f2840008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:35.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.234+0000 7f285143c640 1 --2- 172.21.15.44:0/1827488844 >> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] conn(0x7f283807c280 0x7f283807e6d0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:35.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.234+0000 7f28497fa640 1 -- 172.21.15.44:0/1827488844 <== osd.5 v2:172.21.15.70:6802/4218901987 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f283807eda0 con 0x7f283807c280 2024-05-16T23:36:35.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.248+0000 7f2852e9f640 1 -- 172.21.15.44:0/1827488844 --> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f284c050940 con 0x7f283807c280 2024-05-16T23:36:35.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.248+0000 7f28497fa640 1 -- 172.21.15.44:0/1827488844 <== osd.5 v2:172.21.15.70:6802/4218901987 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f284c050940 con 0x7f283807c280 2024-05-16T23:36:35.932 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-05-16T23:36:35.961 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-16T23:36:35.971 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-05-16T23:36:35.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.249+0000 7f2852e9f640 1 -- 172.21.15.44:0/1827488844 >> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] conn(0x7f283807c280 msgr2=0x7f283807e6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:35.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.249+0000 7f2852e9f640 1 --2- 172.21.15.44:0/1827488844 >> [v2:172.21.15.70:6802/4218901987,v1:172.21.15.70:6804/4218901987] conn(0x7f283807c280 0x7f283807e6d0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:35.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.249+0000 7f2852e9f640 1 -- 172.21.15.44:0/1827488844 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f28380762d0 msgr2=0x7f28380787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:36.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.249+0000 7f2852e9f640 1 --2- 172.21.15.44:0/1827488844 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f28380762d0 0x7f28380787e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f284c147d00 tx=0x7f2840008040 comp rx=0 tx=0).stop 2024-05-16T23:36:36.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.249+0000 7f2852e9f640 1 -- 172.21.15.44:0/1827488844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f284c0a9060 msgr2=0x7f284c0c2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:36.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.249+0000 7f2852e9f640 1 --2- 172.21.15.44:0/1827488844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f284c0a9060 0x7f284c0c2760 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f284400c760 tx=0x7f284400cc20 comp rx=0 tx=0).stop 2024-05-16T23:36:36.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.249+0000 7f285143c640 1 -- 172.21.15.44:0/1827488844 reap_dead start 2024-05-16T23:36:36.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.249+0000 7f2852e9f640 1 -- 172.21.15.44:0/1827488844 shutdown_connections 2024-05-16T23:36:36.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.249+0000 7f2852e9f640 1 -- 172.21.15.44:0/1827488844 >> 172.21.15.44:0/1827488844 conn(0x7f284c0c07c0 msgr2=0x7f284c0c0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T23:36:36.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.249+0000 7f2852e9f640 1 -- 172.21.15.44:0/1827488844 shutdown_connections 2024-05-16T23:36:36.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:35.249+0000 7f2852e9f640 1 -- 172.21.15.44:0/1827488844 wait complete. 2024-05-16T23:36:36.082 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-16T23:36:36.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.219+0000 7f9b118a8640 1 Processor -- start 2024-05-16T23:36:36.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.219+0000 7f9b118a8640 1 -- start start 2024-05-16T23:36:36.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.220+0000 7f9b118a8640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f9b0c0a3bd0 0x7f9b0c0bb940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:36.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.220+0000 7f9b118a8640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9b0c0bc8d0 0x7f9b0c1462b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:36.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.220+0000 7f9b118a8640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b0c0a40b0 con 0x7f9b0c14fa20 2024-05-16T23:36:36.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.220+0000 7f9b118a8640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f9b0c0a49e0 con 0x7f9b0c0bc8d0 2024-05-16T23:36:36.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.220+0000 7f9b118a8640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f9b0c0a4390 con 0x7f9b0c0a3bd0 2024-05-16T23:36:36.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.220+0000 7f9b03fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9b0c0bc8d0 0x7f9b0c1462b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:36.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.220+0000 7f9b0b7fe640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f9b0c14fa20 0x7f9b0c14fe30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:51400/0 (socket says 172.21.15.44:51400) 2024-05-16T23:36:36.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.220+0000 7f9b03fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9b0c0bc8d0 0x7f9b0c1462b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51520/0 (socket says 172.21.15.44:51520) 2024-05-16T23:36:36.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.220+0000 7f9b0b7fe640 1 -- 172.21.15.44:0/157588451 learned_addr learned my addr 172.21.15.44:0/157588451 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T23:36:36.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.221+0000 7f9b0affd640 1 --2- 172.21.15.44:0/157588451 >> v2:172.21.15.70:3300/0 conn(0x7f9b0c0a3bd0 0x7f9b0c0bb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:36.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.221+0000 7f9b03fff640 1 -- 172.21.15.44:0/157588451 >> v2:172.21.15.70:3300/0 conn(0x7f9b0c0a3bd0 msgr2=0x7f9b0c0bb940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T23:36:36.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.221+0000 7f9b03fff640 1 --2- 172.21.15.44:0/157588451 >> v2:172.21.15.70:3300/0 conn(0x7f9b0c0a3bd0 0x7f9b0c0bb940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:36.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.221+0000 7f9b03fff640 1 -- 172.21.15.44:0/157588451 >> v1:172.21.15.44:6789/0 conn(0x7f9b0c14fa20 legacy=0x7f9b0c14fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:36.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.221+0000 7f9b0a7fc640 1 -- 172.21.15.44:0/157588451 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4148561112 0 0) 0x7f9b0c0a40b0 con 0x7f9b0c14fa20 2024-05-16T23:36:36.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.221+0000 7f9b03fff640 1 -- 172.21.15.44:0/157588451 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b0c0a4670 con 0x7f9b0c0bc8d0 2024-05-16T23:36:36.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.222+0000 7f9b03fff640 1 --2- 172.21.15.44:0/157588451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b0c0bc8d0 0x7f9b0c1462b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c0a4b60 tx=0x7f9af402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50e296a9d499e4b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:36.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.222+0000 7f9b0a7fc640 1 -- 172.21.15.44:0/157588451 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af4037070 con 0x7f9b0c0bc8d0 2024-05-16T23:36:36.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.222+0000 7f9b0a7fc640 1 -- 172.21.15.44:0/157588451 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9af4032440 con 0x7f9b0c0bc8d0 2024-05-16T23:36:36.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.222+0000 7f9b0a7fc640 1 -- 172.21.15.44:0/157588451 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af4032810 con 0x7f9b0c0bc8d0 2024-05-16T23:36:36.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.222+0000 7f9b118a8640 1 -- 172.21.15.44:0/157588451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b0c0bc8d0 msgr2=0x7f9b0c1462b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:36.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.222+0000 7f9b118a8640 1 --2- 172.21.15.44:0/157588451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b0c0bc8d0 0x7f9b0c1462b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c0a4b60 tx=0x7f9af402a1a0 comp rx=0 tx=0).stop 2024-05-16T23:36:36.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.223+0000 7f9b118a8640 1 -- 172.21.15.44:0/157588451 shutdown_connections 2024-05-16T23:36:36.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.223+0000 7f9b118a8640 1 --2- 172.21.15.44:0/157588451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b0c0bc8d0 0x7f9b0c1462b0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:36.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.223+0000 7f9b118a8640 1 --2- 172.21.15.44:0/157588451 >> v2:172.21.15.70:3300/0 conn(0x7f9b0c0a3bd0 0x7f9b0c0bb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:36.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.223+0000 7f9b118a8640 1 -- 172.21.15.44:0/157588451 >> 172.21.15.44:0/157588451 conn(0x7f9b0c0a1ac0 msgr2=0x7f9b0c0bbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T23:36:36.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.223+0000 7f9b118a8640 1 -- 172.21.15.44:0/157588451 shutdown_connections 2024-05-16T23:36:36.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.223+0000 7f9b118a8640 1 -- 172.21.15.44:0/157588451 wait complete. 2024-05-16T23:36:36.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.224+0000 7f9b118a8640 1 Processor -- start 2024-05-16T23:36:36.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.224+0000 7f9b118a8640 1 -- start start 2024-05-16T23:36:36.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.225+0000 7f9b118a8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b0c0a3bd0 0x7f9b0c1e37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:36.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.225+0000 7f9b118a8640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9b0c0bc8d0 0x7f9b0c14b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:36.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.225+0000 7f9b118a8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b0c14fa20 0x7f9b0c14baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:36.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.225+0000 7f9b118a8640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9b0c0a2a30 con 0x7f9b0c14fa20 2024-05-16T23:36:36.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.225+0000 7f9b118a8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9b0c0a28b0 con 0x7f9b0c0a3bd0 2024-05-16T23:36:36.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.225+0000 7f9b118a8640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f9b0c1467f0 con 0x7f9b0c0bc8d0 2024-05-16T23:36:36.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.225+0000 7f9b0b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b0c14fa20 0x7f9b0c14baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:36.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.225+0000 7f9b0b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b0c14fa20 0x7f9b0c14baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51522/0 (socket says 172.21.15.44:51522) 2024-05-16T23:36:36.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.225+0000 7f9b0b7fe640 1 -- 172.21.15.44:0/1676885297 learned_addr learned my addr 172.21.15.44:0/1676885297 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T23:36:36.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.226+0000 7f9b0affd640 1 --2- 172.21.15.44:0/1676885297 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b0c0a3bd0 0x7f9b0c1e37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:36.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.226+0000 7f9b03fff640 1 --2- 172.21.15.44:0/1676885297 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9b0c0bc8d0 0x7f9b0c14b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:36.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.226+0000 7f9b0b7fe640 1 -- 172.21.15.44:0/1676885297 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9b0c0bc8d0 msgr2=0x7f9b0c14b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:36.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.226+0000 7f9b0b7fe640 1 --2- 172.21.15.44:0/1676885297 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9b0c0bc8d0 0x7f9b0c14b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:36.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.226+0000 7f9b0b7fe640 1 -- 172.21.15.44:0/1676885297 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b0c0a3bd0 msgr2=0x7f9b0c1e37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:36.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.226+0000 7f9b0b7fe640 1 --2- 172.21.15.44:0/1676885297 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b0c0a3bd0 0x7f9b0c1e37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:36.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.226+0000 7f9b0b7fe640 1 -- 172.21.15.44:0/1676885297 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b0c1e2d10 con 0x7f9b0c14fa20 2024-05-16T23:36:36.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.226+0000 7f9b0b7fe640 1 --2- 172.21.15.44:0/1676885297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b0c14fa20 0x7f9b0c14baa0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f9b0400c6e0 tx=0x7f9b0400cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:36.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.226+0000 7f9b08ff9640 1 -- 172.21.15.44:0/1676885297 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b04018070 con 0x7f9b0c14fa20 2024-05-16T23:36:36.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.226+0000 7f9b08ff9640 1 -- 172.21.15.44:0/1676885297 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b04004d60 con 0x7f9b0c14fa20 2024-05-16T23:36:36.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.226+0000 7f9b118a8640 1 -- 172.21.15.44:0/1676885297 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b0c1e2fb0 con 0x7f9b0c14fa20 2024-05-16T23:36:36.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.226+0000 7f9b08ff9640 1 -- 172.21.15.44:0/1676885297 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b0400a820 con 0x7f9b0c14fa20 2024-05-16T23:36:36.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.226+0000 7f9b118a8640 1 -- 172.21.15.44:0/1676885297 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b0c14a170 con 0x7f9b0c14fa20 2024-05-16T23:36:36.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.227+0000 7f9b118a8640 1 -- 172.21.15.44:0/1676885297 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b0c06eec0 con 0x7f9b0c14fa20 2024-05-16T23:36:36.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.228+0000 7f9b08ff9640 1 -- 172.21.15.44:0/1676885297 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9b0401b070 con 0x7f9b0c14fa20 2024-05-16T23:36:36.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.228+0000 7f9b08ff9640 1 --2- 172.21.15.44:0/1676885297 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f9aec076300 0x7f9aec078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:36.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.228+0000 7f9b08ff9640 1 -- 172.21.15.44:0/1676885297 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5029+0+0 (secure 0 0 0) 0x7f9b04096820 con 0x7f9b0c14fa20 2024-05-16T23:36:36.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.229+0000 7f9b0affd640 1 --2- 172.21.15.44:0/1676885297 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f9aec076300 0x7f9aec078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:36.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.229+0000 7f9b0affd640 1 --2- 172.21.15.44:0/1676885297 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f9aec076300 0x7f9aec078810 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9afc006fd0 tx=0x7f9afc008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:36.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.233+0000 7f9b08ff9640 1 -- 172.21.15.44:0/1676885297 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9b0c06eec0 con 0x7f9b0c14fa20 2024-05-16T23:36:36.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.422+0000 7f9b118a8640 1 -- 172.21.15.44:0/1676885297 --> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f9b0c06a280 con 0x7f9aec076300 2024-05-16T23:36:36.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.423+0000 7f9b08ff9640 1 -- 172.21.15.44:0/1676885297 <== mgr.4114 v2:172.21.15.70:6832/4049588098 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f9b0c06a280 con 0x7f9aec076300 2024-05-16T23:36:36.912 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 5 to deep-scrub 2024-05-16T23:36:36.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.425+0000 7f9b118a8640 1 -- 172.21.15.44:0/1676885297 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f9aec076300 msgr2=0x7f9aec078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:36.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.425+0000 7f9b118a8640 1 --2- 172.21.15.44:0/1676885297 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f9aec076300 0x7f9aec078810 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9afc006fd0 tx=0x7f9afc008040 comp rx=0 tx=0).stop 2024-05-16T23:36:36.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.425+0000 7f9b118a8640 1 -- 172.21.15.44:0/1676885297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b0c14fa20 msgr2=0x7f9b0c14baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:36.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.425+0000 7f9b118a8640 1 --2- 172.21.15.44:0/1676885297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b0c14fa20 0x7f9b0c14baa0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f9b0400c6e0 tx=0x7f9b0400cba0 comp rx=0 tx=0).stop 2024-05-16T23:36:36.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.425+0000 7f9b118a8640 1 -- 172.21.15.44:0/1676885297 shutdown_connections 2024-05-16T23:36:36.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.425+0000 7f9b118a8640 1 --2- 172.21.15.44:0/1676885297 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f9aec076300 0x7f9aec078810 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:36.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.425+0000 7f9b118a8640 1 --2- 172.21.15.44:0/1676885297 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9b0c0bc8d0 0x7f9b0c14b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:36.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.425+0000 7f9b118a8640 1 --2- 172.21.15.44:0/1676885297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b0c14fa20 0x7f9b0c14baa0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:37.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.425+0000 7f9b118a8640 1 --2- 172.21.15.44:0/1676885297 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b0c0a3bd0 0x7f9b0c1e37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:37.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.425+0000 7f9b118a8640 1 -- 172.21.15.44:0/1676885297 >> 172.21.15.44:0/1676885297 conn(0x7f9b0c0a1ac0 msgr2=0x7f9b0c06e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T23:36:37.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.425+0000 7f9b118a8640 1 -- 172.21.15.44:0/1676885297 shutdown_connections 2024-05-16T23:36:37.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:36.425+0000 7f9b118a8640 1 -- 172.21.15.44:0/1676885297 wait complete. 2024-05-16T23:36:37.057 INFO:tasks.ceph:Scrubbing osd.6 2024-05-16T23:36:37.067 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-16T23:36:37.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.207+0000 7f2f18db7640 1 Processor -- start 2024-05-16T23:36:37.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.207+0000 7f2f18db7640 1 -- start start 2024-05-16T23:36:37.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.208+0000 7f2f18db7640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2f140bf9b0 0x7f2f140bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:37.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.208+0000 7f2f18db7640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f140c1390 con 0x7f2f14148770 2024-05-16T23:36:37.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.208+0000 7f2f18db7640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f140c0620 con 0x7f2f1414e360 2024-05-16T23:36:37.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.208+0000 7f2f18db7640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f2f14151e40 con 0x7f2f140bf9b0 2024-05-16T23:36:37.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.208+0000 7f2f09d9b640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f2f14148770 0x7f2f140c0c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:51402/0 (socket says 172.21.15.44:51402) 2024-05-16T23:36:37.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.208+0000 7f2f09d9b640 1 -- 172.21.15.44:0/2147868937 learned_addr learned my addr 172.21.15.44:0/2147868937 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T23:36:37.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.208+0000 7f2f12d9d640 1 --2- 172.21.15.44:0/2147868937 >> v2:172.21.15.44:3300/0 conn(0x7f2f140bf9b0 0x7f2f140bfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:37.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.208+0000 7f2f11d9b640 1 -- 172.21.15.44:0/2147868937 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1633701663 0 0) 0x7f2efc001110 con 0x7f2f14148770 2024-05-16T23:36:37.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.208+0000 7f2f11d9b640 1 -- 172.21.15.44:0/2147868937 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f00003520 con 0x7f2f14148770 2024-05-16T23:36:37.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.209+0000 7f2f12d9d640 1 -- 172.21.15.44:0/2147868937 >> v1:172.21.15.70:6789/0 conn(0x7f2f1414e360 legacy=0x7f2f141522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:37.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.209+0000 7f2f12d9d640 1 -- 172.21.15.44:0/2147868937 >> v1:172.21.15.44:6789/0 conn(0x7f2f14148770 legacy=0x7f2f140c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:37.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.209+0000 7f2f12d9d640 1 -- 172.21.15.44:0/2147868937 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f14151ad0 con 0x7f2f140bf9b0 2024-05-16T23:36:37.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.209+0000 7f2f12d9d640 1 --2- 172.21.15.44:0/2147868937 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f140bf9b0 0x7f2f140bfdc0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c009dc0 tx=0x7f2f0c02a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8162fbd88d7ee658 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:37.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.209+0000 7f2f11d9b640 1 -- 172.21.15.44:0/2147868937 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c037070 con 0x7f2f140bf9b0 2024-05-16T23:36:37.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.209+0000 7f2f11d9b640 1 -- 172.21.15.44:0/2147868937 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f0c007740 con 0x7f2f140bf9b0 2024-05-16T23:36:37.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.210+0000 7f2f11d9b640 1 -- 172.21.15.44:0/2147868937 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c007b10 con 0x7f2f140bf9b0 2024-05-16T23:36:37.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.210+0000 7f2f18db7640 1 -- 172.21.15.44:0/2147868937 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f140bf9b0 msgr2=0x7f2f140bfdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:37.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.210+0000 7f2f18db7640 1 --2- 172.21.15.44:0/2147868937 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f140bf9b0 0x7f2f140bfdc0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c009dc0 tx=0x7f2f0c02a7c0 comp rx=0 tx=0).stop 2024-05-16T23:36:37.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.210+0000 7f2f18db7640 1 -- 172.21.15.44:0/2147868937 shutdown_connections 2024-05-16T23:36:37.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.210+0000 7f2f18db7640 1 --2- 172.21.15.44:0/2147868937 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f140bf9b0 0x7f2f140bfdc0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:37.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.210+0000 7f2f18db7640 1 -- 172.21.15.44:0/2147868937 >> 172.21.15.44:0/2147868937 conn(0x7f2f140c17c0 msgr2=0x7f2f140c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T23:36:37.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.210+0000 7f2f18db7640 1 -- 172.21.15.44:0/2147868937 shutdown_connections 2024-05-16T23:36:37.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.210+0000 7f2f18db7640 1 -- 172.21.15.44:0/2147868937 wait complete. 2024-05-16T23:36:37.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.212+0000 7f2f18db7640 1 Processor -- start 2024-05-16T23:36:37.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.212+0000 7f2f18db7640 1 -- start start 2024-05-16T23:36:37.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.213+0000 7f2f18db7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f140bf9b0 0x7f2f1406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:37.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.213+0000 7f2f18db7640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2f14148770 0x7f2f140b6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:37.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.213+0000 7f2f18db7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f1414e360 0x7f2f1413c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:37.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.213+0000 7f2f18db7640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2f14159e50 con 0x7f2f1414e360 2024-05-16T23:36:37.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.213+0000 7f2f18db7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2f14159cd0 con 0x7f2f140bf9b0 2024-05-16T23:36:37.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.213+0000 7f2f18db7640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f2f14159fd0 con 0x7f2f14148770 2024-05-16T23:36:37.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.213+0000 7f2f12d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f1414e360 0x7f2f1413c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:37.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.213+0000 7f2f12d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f1414e360 0x7f2f1413c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51534/0 (socket says 172.21.15.44:51534) 2024-05-16T23:36:37.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.213+0000 7f2f12d9d640 1 -- 172.21.15.44:0/1205232606 learned_addr learned my addr 172.21.15.44:0/1205232606 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T23:36:37.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.214+0000 7f2f09d9b640 1 --2- 172.21.15.44:0/1205232606 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2f14148770 0x7f2f140b6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:37.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.214+0000 7f2f1259c640 1 --2- 172.21.15.44:0/1205232606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f140bf9b0 0x7f2f1406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:37.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.214+0000 7f2f12d9d640 1 -- 172.21.15.44:0/1205232606 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2f14148770 msgr2=0x7f2f140b6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:37.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.214+0000 7f2f12d9d640 1 --2- 172.21.15.44:0/1205232606 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2f14148770 0x7f2f140b6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:37.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.214+0000 7f2f12d9d640 1 -- 172.21.15.44:0/1205232606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f140bf9b0 msgr2=0x7f2f1406ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:37.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.214+0000 7f2f12d9d640 1 --2- 172.21.15.44:0/1205232606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f140bf9b0 0x7f2f1406ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:37.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.214+0000 7f2f12d9d640 1 -- 172.21.15.44:0/1205232606 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f1406ef60 con 0x7f2f1414e360 2024-05-16T23:36:37.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.214+0000 7f2f12d9d640 1 --2- 172.21.15.44:0/1205232606 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f1414e360 0x7f2f1413c890 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c009ee0 tx=0x7f2f0c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:37.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.214+0000 7f2f0b7fe640 1 -- 172.21.15.44:0/1205232606 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c042020 con 0x7f2f1414e360 2024-05-16T23:36:37.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.214+0000 7f2f0b7fe640 1 -- 172.21.15.44:0/1205232606 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f0c0327f0 con 0x7f2f1414e360 2024-05-16T23:36:37.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.214+0000 7f2f18db7640 1 -- 172.21.15.44:0/1205232606 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f140b6ed0 con 0x7f2f1414e360 2024-05-16T23:36:37.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.214+0000 7f2f0b7fe640 1 -- 172.21.15.44:0/1205232606 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c037040 con 0x7f2f1414e360 2024-05-16T23:36:37.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.214+0000 7f2f18db7640 1 -- 172.21.15.44:0/1205232606 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f140a1680 con 0x7f2f1414e360 2024-05-16T23:36:37.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.215+0000 7f2f18db7640 1 -- 172.21.15.44:0/1205232606 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2f140c1160 con 0x7f2f1414e360 2024-05-16T23:36:37.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.216+0000 7f2f0b7fe640 1 -- 172.21.15.44:0/1205232606 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2f0c045020 con 0x7f2f1414e360 2024-05-16T23:36:37.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.216+0000 7f2f0b7fe640 1 --2- 172.21.15.44:0/1205232606 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f2ef40762d0 0x7f2ef40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:37.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.217+0000 7f2f0b7fe640 1 -- 172.21.15.44:0/1205232606 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5029+0+0 (secure 0 0 0) 0x7f2f0c0b8a70 con 0x7f2f1414e360 2024-05-16T23:36:37.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.217+0000 7f2f1259c640 1 --2- 172.21.15.44:0/1205232606 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f2ef40762d0 0x7f2ef40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:37.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.217+0000 7f2f0b7fe640 1 --2- 172.21.15.44:0/1205232606 >> [v2:172.21.15.70:6800/2389556489,v1:172.21.15.70:6801/2389556489] conn(0x7f2ef407c280 0x7f2ef407e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:37.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.217+0000 7f2f0b7fe640 1 -- 172.21.15.44:0/1205232606 --> [v2:172.21.15.70:6800/2389556489,v1:172.21.15.70:6801/2389556489] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2f0c007740 con 0x7f2ef407c280 2024-05-16T23:36:37.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.217+0000 7f2f0b7fe640 1 -- 172.21.15.44:0/1205232606 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f2f0c0b8f00 con 0x7f2f1414e360 2024-05-16T23:36:37.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.217+0000 7f2f09d9b640 1 --2- 172.21.15.44:0/1205232606 >> [v2:172.21.15.70:6800/2389556489,v1:172.21.15.70:6801/2389556489] conn(0x7f2ef407c280 0x7f2ef407e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:37.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.217+0000 7f2f1259c640 1 --2- 172.21.15.44:0/1205232606 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f2ef40762d0 0x7f2ef40787e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2f040015e0 tx=0x7f2f04009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:37.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.217+0000 7f2f09d9b640 1 --2- 172.21.15.44:0/1205232606 >> [v2:172.21.15.70:6800/2389556489,v1:172.21.15.70:6801/2389556489] conn(0x7f2ef407c280 0x7f2ef407e6d0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:37.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.218+0000 7f2f0b7fe640 1 -- 172.21.15.44:0/1205232606 <== osd.6 v2:172.21.15.70:6800/2389556489 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2f0c007740 con 0x7f2ef407c280 2024-05-16T23:36:37.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.231+0000 7f2f18db7640 1 -- 172.21.15.44:0/1205232606 --> [v2:172.21.15.70:6800/2389556489,v1:172.21.15.70:6801/2389556489] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2f14159ab0 con 0x7f2ef407c280 2024-05-16T23:36:37.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.232+0000 7f2f0b7fe640 1 -- 172.21.15.44:0/1205232606 <== osd.6 v2:172.21.15.70:6800/2389556489 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2f14159ab0 con 0x7f2ef407c280 2024-05-16T23:36:37.907 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-05-16T23:36:37.914 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-16T23:36:37.921 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-05-16T23:36:37.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.233+0000 7f2f18db7640 1 -- 172.21.15.44:0/1205232606 >> [v2:172.21.15.70:6800/2389556489,v1:172.21.15.70:6801/2389556489] conn(0x7f2ef407c280 msgr2=0x7f2ef407e6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:37.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.233+0000 7f2f18db7640 1 --2- 172.21.15.44:0/1205232606 >> [v2:172.21.15.70:6800/2389556489,v1:172.21.15.70:6801/2389556489] conn(0x7f2ef407c280 0x7f2ef407e6d0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:37.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.233+0000 7f2f18db7640 1 -- 172.21.15.44:0/1205232606 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f2ef40762d0 msgr2=0x7f2ef40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:37.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.233+0000 7f2f18db7640 1 --2- 172.21.15.44:0/1205232606 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f2ef40762d0 0x7f2ef40787e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2f040015e0 tx=0x7f2f04009040 comp rx=0 tx=0).stop 2024-05-16T23:36:37.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.233+0000 7f2f18db7640 1 -- 172.21.15.44:0/1205232606 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f1414e360 msgr2=0x7f2f1413c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:37.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.233+0000 7f2f18db7640 1 --2- 172.21.15.44:0/1205232606 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f1414e360 0x7f2f1413c890 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c009ee0 tx=0x7f2f0c004a40 comp rx=0 tx=0).stop 2024-05-16T23:36:37.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.233+0000 7f2f12d9d640 1 -- 172.21.15.44:0/1205232606 reap_dead start 2024-05-16T23:36:37.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.233+0000 7f2f18db7640 1 -- 172.21.15.44:0/1205232606 shutdown_connections 2024-05-16T23:36:38.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.233+0000 7f2f18db7640 1 -- 172.21.15.44:0/1205232606 >> 172.21.15.44:0/1205232606 conn(0x7f2f140c17c0 msgr2=0x7f2f140c0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T23:36:38.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.233+0000 7f2f18db7640 1 -- 172.21.15.44:0/1205232606 shutdown_connections 2024-05-16T23:36:38.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:37.233+0000 7f2f18db7640 1 -- 172.21.15.44:0/1205232606 wait complete. 2024-05-16T23:36:38.031 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-16T23:36:38.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.167+0000 7fb42c62b640 1 Processor -- start 2024-05-16T23:36:38.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.168+0000 7fb42c62b640 1 -- start start 2024-05-16T23:36:38.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.169+0000 7fb42c62b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb42414e530 0x7fb4240ba320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:38.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.169+0000 7fb42c62b640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb4240bd440 0x7fb4240bd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:38.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.169+0000 7fb42c62b640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb4240b8d70 0x7fb4240b9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:38.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.169+0000 7fb42c62b640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fb4240b88e0 con 0x7fb4240b8d70 2024-05-16T23:36:38.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.169+0000 7fb42c62b640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fb4240ba860 con 0x7fb42414e530 2024-05-16T23:36:38.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.169+0000 7fb42c62b640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fb4240bdd90 con 0x7fb4240bd440 2024-05-16T23:36:38.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.169+0000 7fb42abc8640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb4240b8d70 0x7fb4240b9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:38.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.169+0000 7fb42abc8640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb4240b8d70 0x7fb4240b9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51542/0 (socket says 172.21.15.44:51542) 2024-05-16T23:36:38.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.169+0000 7fb42abc8640 1 -- 172.21.15.44:0/490531287 learned_addr learned my addr 172.21.15.44:0/490531287 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T23:36:38.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.169+0000 7fb42a3c7640 1 --2- 172.21.15.44:0/490531287 >> v2:172.21.15.70:3300/0 conn(0x7fb42414e530 0x7fb4240ba320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:38.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.169+0000 7fb429bc6640 1 --2- 172.21.15.44:0/490531287 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb4240bd440 0x7fb4240bd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:38.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.169+0000 7fb42abc8640 1 -- 172.21.15.44:0/490531287 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb4240bd440 msgr2=0x7fb4240bd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T23:36:38.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.169+0000 7fb42abc8640 1 --2- 172.21.15.44:0/490531287 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb4240bd440 0x7fb4240bd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:38.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.169+0000 7fb42abc8640 1 -- 172.21.15.44:0/490531287 >> v2:172.21.15.70:3300/0 conn(0x7fb42414e530 msgr2=0x7fb4240ba320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T23:36:38.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.169+0000 7fb42abc8640 1 --2- 172.21.15.44:0/490531287 >> v2:172.21.15.70:3300/0 conn(0x7fb42414e530 0x7fb4240ba320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:38.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.169+0000 7fb42abc8640 1 -- 172.21.15.44:0/490531287 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb42414ece0 con 0x7fb4240b8d70 2024-05-16T23:36:38.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.170+0000 7fb42abc8640 1 --2- 172.21.15.44:0/490531287 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4240b8d70 0x7fb4240b9180 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb42408d0d0 tx=0x7fb41402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30366980c7b8370b server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:38.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.170+0000 7fb4293c5640 1 -- 172.21.15.44:0/490531287 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb414036070 con 0x7fb4240b8d70 2024-05-16T23:36:38.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.170+0000 7fb4293c5640 1 -- 172.21.15.44:0/490531287 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb414031600 con 0x7fb4240b8d70 2024-05-16T23:36:38.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.170+0000 7fb4293c5640 1 -- 172.21.15.44:0/490531287 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4140319d0 con 0x7fb4240b8d70 2024-05-16T23:36:38.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.171+0000 7fb42c62b640 1 -- 172.21.15.44:0/490531287 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4240b8d70 msgr2=0x7fb4240b9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:38.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.171+0000 7fb42c62b640 1 --2- 172.21.15.44:0/490531287 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4240b8d70 0x7fb4240b9180 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb42408d0d0 tx=0x7fb41402a6c0 comp rx=0 tx=0).stop 2024-05-16T23:36:38.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.171+0000 7fb42c62b640 1 -- 172.21.15.44:0/490531287 shutdown_connections 2024-05-16T23:36:38.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.171+0000 7fb42c62b640 1 --2- 172.21.15.44:0/490531287 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4240b8d70 0x7fb4240b9180 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:38.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.171+0000 7fb42c62b640 1 --2- 172.21.15.44:0/490531287 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb4240bd440 0x7fb4240bd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:38.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.171+0000 7fb42c62b640 1 --2- 172.21.15.44:0/490531287 >> v2:172.21.15.70:3300/0 conn(0x7fb42414e530 0x7fb4240ba320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:38.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.171+0000 7fb42c62b640 1 -- 172.21.15.44:0/490531287 >> 172.21.15.44:0/490531287 conn(0x7fb4240c0570 msgr2=0x7fb4240c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T23:36:38.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.171+0000 7fb42c62b640 1 -- 172.21.15.44:0/490531287 shutdown_connections 2024-05-16T23:36:38.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.171+0000 7fb42c62b640 1 -- 172.21.15.44:0/490531287 wait complete. 2024-05-16T23:36:38.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.173+0000 7fb42c62b640 1 Processor -- start 2024-05-16T23:36:38.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.173+0000 7fb42c62b640 1 -- start start 2024-05-16T23:36:38.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.174+0000 7fb42c62b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb4240b8d70 0x7fb4241e4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:38.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.174+0000 7fb42c62b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4240bd440 0x7fb4241411a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:38.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.174+0000 7fb42c62b640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb42414e530 0x7fb42413de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:38.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.174+0000 7fb42c62b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb4240bbb70 con 0x7fb4240bd440 2024-05-16T23:36:38.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.174+0000 7fb42c62b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb42414f2a0 con 0x7fb4240b8d70 2024-05-16T23:36:38.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.174+0000 7fb42c62b640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fb4240b96c0 con 0x7fb42414e530 2024-05-16T23:36:38.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.174+0000 7fb429bc6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4240bd440 0x7fb4241411a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:38.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.174+0000 7fb429bc6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4240bd440 0x7fb4241411a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51544/0 (socket says 172.21.15.44:51544) 2024-05-16T23:36:38.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.174+0000 7fb429bc6640 1 -- 172.21.15.44:0/3445264055 learned_addr learned my addr 172.21.15.44:0/3445264055 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T23:36:38.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.174+0000 7fb42a3c7640 1 --2- 172.21.15.44:0/3445264055 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb4240b8d70 0x7fb4241e4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:38.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.174+0000 7fb42abc8640 1 --2- 172.21.15.44:0/3445264055 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb42414e530 0x7fb42413de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:38.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.174+0000 7fb429bc6640 1 -- 172.21.15.44:0/3445264055 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb42414e530 msgr2=0x7fb42413de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:38.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.174+0000 7fb429bc6640 1 --2- 172.21.15.44:0/3445264055 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb42414e530 0x7fb42413de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:38.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.174+0000 7fb429bc6640 1 -- 172.21.15.44:0/3445264055 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb4240b8d70 msgr2=0x7fb4241e4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:38.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.174+0000 7fb429bc6640 1 --2- 172.21.15.44:0/3445264055 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb4240b8d70 0x7fb4241e4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:38.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.174+0000 7fb429bc6640 1 -- 172.21.15.44:0/3445264055 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4241416e0 con 0x7fb4240bd440 2024-05-16T23:36:38.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.174+0000 7fb42a3c7640 1 --2- 172.21.15.44:0/3445264055 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb4240b8d70 0x7fb4241e4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T23:36:38.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.174+0000 7fb429bc6640 1 --2- 172.21.15.44:0/3445264055 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4240bd440 0x7fb4241411a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb41800e8a0 tx=0x7fb41800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:38.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.175+0000 7fb422ffd640 1 -- 172.21.15.44:0/3445264055 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb418017070 con 0x7fb4240bd440 2024-05-16T23:36:38.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.175+0000 7fb422ffd640 1 -- 172.21.15.44:0/3445264055 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb41800ee90 con 0x7fb4240bd440 2024-05-16T23:36:38.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.175+0000 7fb42c62b640 1 -- 172.21.15.44:0/3445264055 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb42413ff10 con 0x7fb4240bd440 2024-05-16T23:36:38.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.175+0000 7fb422ffd640 1 -- 172.21.15.44:0/3445264055 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41800cb60 con 0x7fb4240bd440 2024-05-16T23:36:38.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.175+0000 7fb42c62b640 1 -- 172.21.15.44:0/3445264055 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4241e46d0 con 0x7fb4240bd440 2024-05-16T23:36:38.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.176+0000 7fb42c62b640 1 -- 172.21.15.44:0/3445264055 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb424140500 con 0x7fb4240bd440 2024-05-16T23:36:38.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.177+0000 7fb422ffd640 1 -- 172.21.15.44:0/3445264055 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb41801a070 con 0x7fb4240bd440 2024-05-16T23:36:38.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.177+0000 7fb422ffd640 1 --2- 172.21.15.44:0/3445264055 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fb410076300 0x7fb410078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:38.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.177+0000 7fb422ffd640 1 -- 172.21.15.44:0/3445264055 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5029+0+0 (secure 0 0 0) 0x7fb418097420 con 0x7fb4240bd440 2024-05-16T23:36:38.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.178+0000 7fb42a3c7640 1 --2- 172.21.15.44:0/3445264055 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fb410076300 0x7fb410078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:38.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.178+0000 7fb42a3c7640 1 --2- 172.21.15.44:0/3445264055 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fb410076300 0x7fb410078810 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb41c009ae0 tx=0x7fb41c008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:38.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.182+0000 7fb422ffd640 1 -- 172.21.15.44:0/3445264055 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb4180609d0 con 0x7fb4240bd440 2024-05-16T23:36:38.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.373+0000 7fb42c62b640 1 -- 172.21.15.44:0/3445264055 --> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fb424050940 con 0x7fb410076300 2024-05-16T23:36:38.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.374+0000 7fb422ffd640 1 -- 172.21.15.44:0/3445264055 <== mgr.4114 v2:172.21.15.70:6832/4049588098 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb424050940 con 0x7fb410076300 2024-05-16T23:36:38.909 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 6 to deep-scrub 2024-05-16T23:36:38.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.376+0000 7fb42c62b640 1 -- 172.21.15.44:0/3445264055 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fb410076300 msgr2=0x7fb410078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:38.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.376+0000 7fb42c62b640 1 --2- 172.21.15.44:0/3445264055 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fb410076300 0x7fb410078810 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb41c009ae0 tx=0x7fb41c008040 comp rx=0 tx=0).stop 2024-05-16T23:36:38.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.376+0000 7fb42c62b640 1 -- 172.21.15.44:0/3445264055 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4240bd440 msgr2=0x7fb4241411a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:38.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.376+0000 7fb42c62b640 1 --2- 172.21.15.44:0/3445264055 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4240bd440 0x7fb4241411a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb41800e8a0 tx=0x7fb41800ed60 comp rx=0 tx=0).stop 2024-05-16T23:36:39.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.376+0000 7fb42c62b640 1 -- 172.21.15.44:0/3445264055 shutdown_connections 2024-05-16T23:36:39.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.376+0000 7fb42c62b640 1 --2- 172.21.15.44:0/3445264055 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fb410076300 0x7fb410078810 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:39.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.376+0000 7fb42c62b640 1 --2- 172.21.15.44:0/3445264055 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb42414e530 0x7fb42413de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:39.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.376+0000 7fb42c62b640 1 --2- 172.21.15.44:0/3445264055 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4240bd440 0x7fb4241411a0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:39.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.376+0000 7fb42c62b640 1 --2- 172.21.15.44:0/3445264055 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb4240b8d70 0x7fb4241e4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:39.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.376+0000 7fb42c62b640 1 -- 172.21.15.44:0/3445264055 >> 172.21.15.44:0/3445264055 conn(0x7fb4240c0570 msgr2=0x7fb4240c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T23:36:39.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.376+0000 7fb42c62b640 1 -- 172.21.15.44:0/3445264055 shutdown_connections 2024-05-16T23:36:39.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:38.376+0000 7fb42c62b640 1 -- 172.21.15.44:0/3445264055 wait complete. 2024-05-16T23:36:39.058 INFO:tasks.ceph:Scrubbing osd.7 2024-05-16T23:36:39.066 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-16T23:36:39.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.204+0000 7f016a384640 1 Processor -- start 2024-05-16T23:36:39.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.204+0000 7f016a384640 1 -- start start 2024-05-16T23:36:39.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.205+0000 7f016a384640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0164151fc0 0x7f01640bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:39.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.205+0000 7f016a384640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f016406da30 0x7f01640be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:39.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.205+0000 7f016a384640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f016406de40 0x7f01640bee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:39.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.205+0000 7f016a384640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f01640bdc10 con 0x7f0164151fc0 2024-05-16T23:36:39.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.205+0000 7f016a384640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f01640c36f0 con 0x7f016406de40 2024-05-16T23:36:39.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.205+0000 7f016a384640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f0164152530 con 0x7f016406da30 2024-05-16T23:36:39.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.205+0000 7f0163fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0164151fc0 0x7f01640bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:39.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.205+0000 7f0163fff640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0164151fc0 0x7f01640bd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51558/0 (socket says 172.21.15.44:51558) 2024-05-16T23:36:39.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.205+0000 7f0163fff640 1 -- 172.21.15.44:0/929809961 learned_addr learned my addr 172.21.15.44:0/929809961 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T23:36:39.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.205+0000 7f0168921640 1 --2- 172.21.15.44:0/929809961 >> v2:172.21.15.70:3300/0 conn(0x7f016406de40 0x7f01640bee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:39.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.205+0000 7f01637fe640 1 --2- 172.21.15.44:0/929809961 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f016406da30 0x7f01640be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:39.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.206+0000 7f0163fff640 1 -- 172.21.15.44:0/929809961 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f016406da30 msgr2=0x7f01640be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T23:36:39.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.206+0000 7f0163fff640 1 --2- 172.21.15.44:0/929809961 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f016406da30 0x7f01640be940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:39.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.206+0000 7f0163fff640 1 -- 172.21.15.44:0/929809961 >> v2:172.21.15.70:3300/0 conn(0x7f016406de40 msgr2=0x7f01640bee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T23:36:39.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.206+0000 7f0163fff640 1 --2- 172.21.15.44:0/929809961 >> v2:172.21.15.70:3300/0 conn(0x7f016406de40 0x7f01640bee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:39.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.206+0000 7f0163fff640 1 -- 172.21.15.44:0/929809961 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0164152810 con 0x7f0164151fc0 2024-05-16T23:36:39.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.206+0000 7f0168921640 1 --2- 172.21.15.44:0/929809961 >> v2:172.21.15.70:3300/0 conn(0x7f016406de40 0x7f01640bee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T23:36:39.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.206+0000 7f0163fff640 1 --2- 172.21.15.44:0/929809961 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0164151fc0 0x7f01640bd6d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f01640bdee0 tx=0x7f015402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b288195740542d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:39.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.207+0000 7f0162ffd640 1 -- 172.21.15.44:0/929809961 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0154037070 con 0x7f0164151fc0 2024-05-16T23:36:39.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.207+0000 7f0162ffd640 1 -- 172.21.15.44:0/929809961 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0154032440 con 0x7f0164151fc0 2024-05-16T23:36:39.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.207+0000 7f0162ffd640 1 -- 172.21.15.44:0/929809961 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0154032810 con 0x7f0164151fc0 2024-05-16T23:36:39.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.207+0000 7f016a384640 1 -- 172.21.15.44:0/929809961 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0164151fc0 msgr2=0x7f01640bd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:39.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.207+0000 7f016a384640 1 --2- 172.21.15.44:0/929809961 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0164151fc0 0x7f01640bd6d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f01640bdee0 tx=0x7f015402a1e0 comp rx=0 tx=0).stop 2024-05-16T23:36:39.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.207+0000 7f016a384640 1 -- 172.21.15.44:0/929809961 shutdown_connections 2024-05-16T23:36:39.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.207+0000 7f016a384640 1 --2- 172.21.15.44:0/929809961 >> v2:172.21.15.70:3300/0 conn(0x7f016406de40 0x7f01640bee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:39.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.207+0000 7f016a384640 1 --2- 172.21.15.44:0/929809961 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f016406da30 0x7f01640be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:39.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.207+0000 7f016a384640 1 --2- 172.21.15.44:0/929809961 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0164151fc0 0x7f01640bd6d0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:39.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.207+0000 7f016a384640 1 -- 172.21.15.44:0/929809961 >> 172.21.15.44:0/929809961 conn(0x7f01640c3d20 msgr2=0x7f01640c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T23:36:39.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.207+0000 7f016a384640 1 -- 172.21.15.44:0/929809961 shutdown_connections 2024-05-16T23:36:39.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.207+0000 7f016a384640 1 -- 172.21.15.44:0/929809961 wait complete. 2024-05-16T23:36:39.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.209+0000 7f016a384640 1 Processor -- start 2024-05-16T23:36:39.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.209+0000 7f016a384640 1 -- start start 2024-05-16T23:36:39.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.210+0000 7f016a384640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f016406da30 0x7f016414b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:39.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.210+0000 7f016a384640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f016406de40 0x7f0164148a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:39.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.210+0000 7f016a384640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0164151fc0 0x7f0164148f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:39.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.210+0000 7f016a384640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f01640a3050 con 0x7f016406de40 2024-05-16T23:36:39.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.210+0000 7f016a384640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f01640a2ed0 con 0x7f016406da30 2024-05-16T23:36:39.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.210+0000 7f016a384640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f016414e570 con 0x7f0164151fc0 2024-05-16T23:36:39.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.210+0000 7f01637fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f016406de40 0x7f0164148a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:39.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.210+0000 7f01637fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f016406de40 0x7f0164148a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51560/0 (socket says 172.21.15.44:51560) 2024-05-16T23:36:39.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.210+0000 7f01637fe640 1 -- 172.21.15.44:0/823623692 learned_addr learned my addr 172.21.15.44:0/823623692 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T23:36:39.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.211+0000 7f0163fff640 1 --2- 172.21.15.44:0/823623692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f016406da30 0x7f016414b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:39.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.211+0000 7f0168921640 1 --2- 172.21.15.44:0/823623692 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0164151fc0 0x7f0164148f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:39.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.211+0000 7f01637fe640 1 -- 172.21.15.44:0/823623692 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0164151fc0 msgr2=0x7f0164148f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:39.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.211+0000 7f01637fe640 1 --2- 172.21.15.44:0/823623692 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0164151fc0 0x7f0164148f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:39.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.211+0000 7f01637fe640 1 -- 172.21.15.44:0/823623692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f016406da30 msgr2=0x7f016414b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:39.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.211+0000 7f01637fe640 1 --2- 172.21.15.44:0/823623692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f016406da30 0x7f016414b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:39.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.211+0000 7f01637fe640 1 -- 172.21.15.44:0/823623692 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01641d7e10 con 0x7f016406de40 2024-05-16T23:36:39.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.211+0000 7f01637fe640 1 --2- 172.21.15.44:0/823623692 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f016406de40 0x7f0164148a50 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f015800d800 tx=0x7f015800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:39.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.211+0000 7f0160ff9640 1 -- 172.21.15.44:0/823623692 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0158018030 con 0x7f016406de40 2024-05-16T23:36:39.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.211+0000 7f0160ff9640 1 -- 172.21.15.44:0/823623692 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01580096a0 con 0x7f016406de40 2024-05-16T23:36:39.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.211+0000 7f016a384640 1 -- 172.21.15.44:0/823623692 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01641e7cb0 con 0x7f016406de40 2024-05-16T23:36:39.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.211+0000 7f0160ff9640 1 -- 172.21.15.44:0/823623692 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0158009870 con 0x7f016406de40 2024-05-16T23:36:39.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.211+0000 7f016a384640 1 -- 172.21.15.44:0/823623692 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01641e8270 con 0x7f016406de40 2024-05-16T23:36:39.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.212+0000 7f016a384640 1 -- 172.21.15.44:0/823623692 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f01641e7ae0 con 0x7f016406de40 2024-05-16T23:36:39.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.213+0000 7f0160ff9640 1 -- 172.21.15.44:0/823623692 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f015801b070 con 0x7f016406de40 2024-05-16T23:36:39.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.213+0000 7f0160ff9640 1 --2- 172.21.15.44:0/823623692 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0150076300 0x7f0150078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:39.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.213+0000 7f0160ff9640 1 -- 172.21.15.44:0/823623692 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5029+0+0 (secure 0 0 0) 0x7f0158097f00 con 0x7f016406de40 2024-05-16T23:36:39.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.214+0000 7f0160ff9640 1 --2- 172.21.15.44:0/823623692 >> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] conn(0x7f015007c2b0 0x7f015007e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:39.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.214+0000 7f0163fff640 1 --2- 172.21.15.44:0/823623692 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0150076300 0x7f0150078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:39.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.214+0000 7f0160ff9640 1 -- 172.21.15.44:0/823623692 --> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f015007edd0 con 0x7f015007c2b0 2024-05-16T23:36:39.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.214+0000 7f0160ff9640 1 -- 172.21.15.44:0/823623692 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f0158098390 con 0x7f016406de40 2024-05-16T23:36:39.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.214+0000 7f0168921640 1 --2- 172.21.15.44:0/823623692 >> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] conn(0x7f015007c2b0 0x7f015007e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:39.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.214+0000 7f0163fff640 1 --2- 172.21.15.44:0/823623692 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0150076300 0x7f0150078810 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0154034000 tx=0x7f015402e000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:39.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.214+0000 7f0168921640 1 --2- 172.21.15.44:0/823623692 >> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] conn(0x7f015007c2b0 0x7f015007e700 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:39.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.215+0000 7f0160ff9640 1 -- 172.21.15.44:0/823623692 <== osd.7 v2:172.21.15.70:6816/3619691281 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f015007edd0 con 0x7f015007c2b0 2024-05-16T23:36:39.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.228+0000 7f016a384640 1 -- 172.21.15.44:0/823623692 --> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0164050940 con 0x7f015007c2b0 2024-05-16T23:36:39.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.229+0000 7f0160ff9640 1 -- 172.21.15.44:0/823623692 <== osd.7 v2:172.21.15.70:6816/3619691281 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f0164050940 con 0x7f015007c2b0 2024-05-16T23:36:39.920 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-05-16T23:36:39.929 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-16T23:36:39.937 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-05-16T23:36:39.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.229+0000 7f016a384640 1 -- 172.21.15.44:0/823623692 >> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] conn(0x7f015007c2b0 msgr2=0x7f015007e700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:39.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.229+0000 7f016a384640 1 --2- 172.21.15.44:0/823623692 >> [v2:172.21.15.70:6816/3619691281,v1:172.21.15.70:6817/3619691281] conn(0x7f015007c2b0 0x7f015007e700 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:39.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.229+0000 7f016a384640 1 -- 172.21.15.44:0/823623692 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0150076300 msgr2=0x7f0150078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:39.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.229+0000 7f016a384640 1 --2- 172.21.15.44:0/823623692 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0150076300 0x7f0150078810 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0154034000 tx=0x7f015402e000 comp rx=0 tx=0).stop 2024-05-16T23:36:40.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.229+0000 7f016a384640 1 -- 172.21.15.44:0/823623692 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f016406de40 msgr2=0x7f0164148a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:40.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.229+0000 7f016a384640 1 --2- 172.21.15.44:0/823623692 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f016406de40 0x7f0164148a50 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f015800d800 tx=0x7f015800dcc0 comp rx=0 tx=0).stop 2024-05-16T23:36:40.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.229+0000 7f0168921640 1 -- 172.21.15.44:0/823623692 reap_dead start 2024-05-16T23:36:40.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.229+0000 7f016a384640 1 -- 172.21.15.44:0/823623692 shutdown_connections 2024-05-16T23:36:40.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.229+0000 7f016a384640 1 -- 172.21.15.44:0/823623692 >> 172.21.15.44:0/823623692 conn(0x7f01640c3d20 msgr2=0x7f01640c16e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T23:36:40.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.230+0000 7f016a384640 1 -- 172.21.15.44:0/823623692 shutdown_connections 2024-05-16T23:36:40.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:39.230+0000 7f016a384640 1 -- 172.21.15.44:0/823623692 wait complete. 2024-05-16T23:36:40.130 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-16T23:36:40.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.266+0000 7fbde98f0640 1 Processor -- start 2024-05-16T23:36:40.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.266+0000 7fbde98f0640 1 -- start start 2024-05-16T23:36:40.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.267+0000 7fbde98f0640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbde414e360 0x7fbde41522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:40.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.267+0000 7fbde98f0640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbde40c1390 con 0x7fbde4148770 2024-05-16T23:36:40.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.267+0000 7fbde98f0640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbde40c0620 con 0x7fbde40bf9b0 2024-05-16T23:36:40.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.267+0000 7fbde98f0640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fbde4151e40 con 0x7fbde414e360 2024-05-16T23:36:40.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.267+0000 7fbde2ffd640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbde414e360 0x7fbde41522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:40.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.267+0000 7fbde27fc640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fbde4148770 0x7fbde40c0c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52074/0 (socket says 172.21.15.44:52074) 2024-05-16T23:36:40.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.267+0000 7fbde27fc640 1 -- 172.21.15.44:0/2055565594 learned_addr learned my addr 172.21.15.44:0/2055565594 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T23:36:40.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.268+0000 7fbde2ffd640 1 -- 172.21.15.44:0/2055565594 >> v1:172.21.15.70:6789/0 conn(0x7fbde40bf9b0 legacy=0x7fbde40bfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T23:36:40.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.268+0000 7fbde2ffd640 1 -- 172.21.15.44:0/2055565594 >> v1:172.21.15.44:6789/0 conn(0x7fbde4148770 legacy=0x7fbde40c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:40.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.268+0000 7fbde2ffd640 1 -- 172.21.15.44:0/2055565594 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbde4151ad0 con 0x7fbde414e360 2024-05-16T23:36:40.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.268+0000 7fbde2ffd640 1 --2- 172.21.15.44:0/2055565594 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbde414e360 0x7fbde41522d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fbddc0097d0 tx=0x7fbddc02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af988f1e5358bba0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:40.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.268+0000 7fbde1ffb640 1 -- 172.21.15.44:0/2055565594 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbddc037070 con 0x7fbde414e360 2024-05-16T23:36:40.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.269+0000 7fbde1ffb640 1 -- 172.21.15.44:0/2055565594 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbddc032440 con 0x7fbde414e360 2024-05-16T23:36:40.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.269+0000 7fbde1ffb640 1 -- 172.21.15.44:0/2055565594 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbddc032810 con 0x7fbde414e360 2024-05-16T23:36:40.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.269+0000 7fbde98f0640 1 -- 172.21.15.44:0/2055565594 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbde414e360 msgr2=0x7fbde41522d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:40.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.269+0000 7fbde98f0640 1 --2- 172.21.15.44:0/2055565594 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbde414e360 0x7fbde41522d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fbddc0097d0 tx=0x7fbddc02a250 comp rx=0 tx=0).stop 2024-05-16T23:36:40.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.269+0000 7fbde98f0640 1 -- 172.21.15.44:0/2055565594 shutdown_connections 2024-05-16T23:36:40.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.269+0000 7fbde98f0640 1 --2- 172.21.15.44:0/2055565594 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbde414e360 0x7fbde41522d0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:40.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.269+0000 7fbde98f0640 1 -- 172.21.15.44:0/2055565594 >> 172.21.15.44:0/2055565594 conn(0x7fbde40c17c0 msgr2=0x7fbde40c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T23:36:40.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.269+0000 7fbde98f0640 1 -- 172.21.15.44:0/2055565594 shutdown_connections 2024-05-16T23:36:40.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.269+0000 7fbde98f0640 1 -- 172.21.15.44:0/2055565594 wait complete. 2024-05-16T23:36:40.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.271+0000 7fbde98f0640 1 Processor -- start 2024-05-16T23:36:40.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.271+0000 7fbde98f0640 1 -- start start 2024-05-16T23:36:40.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.272+0000 7fbde98f0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbde40bf9b0 0x7fbde40a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:40.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.272+0000 7fbde98f0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbde4148770 0x7fbde4141110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:40.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.272+0000 7fbde98f0640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbde414e360 0x7fbde40b7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:40.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.272+0000 7fbde98f0640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbde4159e50 con 0x7fbde40bf9b0 2024-05-16T23:36:40.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.272+0000 7fbde98f0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbde4159cd0 con 0x7fbde4148770 2024-05-16T23:36:40.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.272+0000 7fbde98f0640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fbde4159fd0 con 0x7fbde414e360 2024-05-16T23:36:40.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.272+0000 7fbde2ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbde40bf9b0 0x7fbde40a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:40.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.272+0000 7fbde2ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbde40bf9b0 0x7fbde40a6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57684/0 (socket says 172.21.15.44:57684) 2024-05-16T23:36:40.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.272+0000 7fbde2ffd640 1 -- 172.21.15.44:0/3084182132 learned_addr learned my addr 172.21.15.44:0/3084182132 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T23:36:40.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.273+0000 7fbde27fc640 1 --2- 172.21.15.44:0/3084182132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbde4148770 0x7fbde4141110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:40.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.273+0000 7fbde37fe640 1 --2- 172.21.15.44:0/3084182132 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbde414e360 0x7fbde40b7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:40.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.273+0000 7fbde2ffd640 1 -- 172.21.15.44:0/3084182132 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbde414e360 msgr2=0x7fbde40b7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:40.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.273+0000 7fbde2ffd640 1 --2- 172.21.15.44:0/3084182132 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbde414e360 0x7fbde40b7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:40.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.273+0000 7fbde2ffd640 1 -- 172.21.15.44:0/3084182132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbde4148770 msgr2=0x7fbde4141110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:40.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.273+0000 7fbde2ffd640 1 --2- 172.21.15.44:0/3084182132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbde4148770 0x7fbde4141110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:40.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.273+0000 7fbde2ffd640 1 -- 172.21.15.44:0/3084182132 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbde4142980 con 0x7fbde40bf9b0 2024-05-16T23:36:40.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.273+0000 7fbde2ffd640 1 --2- 172.21.15.44:0/3084182132 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbde40bf9b0 0x7fbde40a6270 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fbddc0098f0 tx=0x7fbddc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:40.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.273+0000 7fbddbfff640 1 -- 172.21.15.44:0/3084182132 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbddc041070 con 0x7fbde40bf9b0 2024-05-16T23:36:40.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.273+0000 7fbddbfff640 1 -- 172.21.15.44:0/3084182132 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbddc03c930 con 0x7fbde40bf9b0 2024-05-16T23:36:40.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.273+0000 7fbddbfff640 1 -- 172.21.15.44:0/3084182132 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbddc037040 con 0x7fbde40bf9b0 2024-05-16T23:36:40.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.273+0000 7fbde98f0640 1 -- 172.21.15.44:0/3084182132 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbde40a67b0 con 0x7fbde40bf9b0 2024-05-16T23:36:40.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.273+0000 7fbde98f0640 1 -- 172.21.15.44:0/3084182132 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbde4140c30 con 0x7fbde40bf9b0 2024-05-16T23:36:40.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.274+0000 7fbde98f0640 1 -- 172.21.15.44:0/3084182132 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbde414f2b0 con 0x7fbde40bf9b0 2024-05-16T23:36:40.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.275+0000 7fbddbfff640 1 -- 172.21.15.44:0/3084182132 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbddc044070 con 0x7fbde40bf9b0 2024-05-16T23:36:40.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.275+0000 7fbddbfff640 1 --2- 172.21.15.44:0/3084182132 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fbdc40762d0 0x7fbdc40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:40.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.276+0000 7fbddbfff640 1 -- 172.21.15.44:0/3084182132 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5029+0+0 (secure 0 0 0) 0x7fbddc0b7f60 con 0x7fbde40bf9b0 2024-05-16T23:36:40.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.276+0000 7fbde27fc640 1 --2- 172.21.15.44:0/3084182132 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fbdc40762d0 0x7fbdc40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:40.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.276+0000 7fbde27fc640 1 --2- 172.21.15.44:0/3084182132 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fbdc40762d0 0x7fbdc40787e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc000f60 tx=0x7fbdcc009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:40.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.280+0000 7fbddbfff640 1 -- 172.21.15.44:0/3084182132 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbde40a67b0 con 0x7fbde40bf9b0 2024-05-16T23:36:40.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.469+0000 7fbde98f0640 1 -- 172.21.15.44:0/3084182132 --> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fbde4050940 con 0x7fbdc40762d0 2024-05-16T23:36:40.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.470+0000 7fbddbfff640 1 -- 172.21.15.44:0/3084182132 <== mgr.4114 v2:172.21.15.70:6832/4049588098 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fbde4050940 con 0x7fbdc40762d0 2024-05-16T23:36:40.842 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 7 to deep-scrub 2024-05-16T23:36:40.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.472+0000 7fbde98f0640 1 -- 172.21.15.44:0/3084182132 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fbdc40762d0 msgr2=0x7fbdc40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:40.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.472+0000 7fbde98f0640 1 --2- 172.21.15.44:0/3084182132 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fbdc40762d0 0x7fbdc40787e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc000f60 tx=0x7fbdcc009040 comp rx=0 tx=0).stop 2024-05-16T23:36:40.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.472+0000 7fbde98f0640 1 -- 172.21.15.44:0/3084182132 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbde40bf9b0 msgr2=0x7fbde40a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:40.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.472+0000 7fbde98f0640 1 --2- 172.21.15.44:0/3084182132 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbde40bf9b0 0x7fbde40a6270 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fbddc0098f0 tx=0x7fbddc0046c0 comp rx=0 tx=0).stop 2024-05-16T23:36:40.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.472+0000 7fbde98f0640 1 -- 172.21.15.44:0/3084182132 shutdown_connections 2024-05-16T23:36:40.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.472+0000 7fbde98f0640 1 --2- 172.21.15.44:0/3084182132 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7fbdc40762d0 0x7fbdc40787e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:40.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.472+0000 7fbde98f0640 1 --2- 172.21.15.44:0/3084182132 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbde414e360 0x7fbde40b7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:40.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.472+0000 7fbde98f0640 1 --2- 172.21.15.44:0/3084182132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbde4148770 0x7fbde4141110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:40.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.472+0000 7fbde98f0640 1 --2- 172.21.15.44:0/3084182132 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbde40bf9b0 0x7fbde40a6270 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:40.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.472+0000 7fbde98f0640 1 -- 172.21.15.44:0/3084182132 >> 172.21.15.44:0/3084182132 conn(0x7fbde40c17c0 msgr2=0x7fbde413f830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T23:36:40.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.472+0000 7fbde98f0640 1 -- 172.21.15.44:0/3084182132 shutdown_connections 2024-05-16T23:36:40.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:40.472+0000 7fbde98f0640 1 -- 172.21.15.44:0/3084182132 wait complete. 2024-05-16T23:36:40.970 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-16T23:36:41.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.096+0000 7f42ff172640 1 Processor -- start 2024-05-16T23:36:41.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.097+0000 7f42ff172640 1 -- start start 2024-05-16T23:36:41.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.098+0000 7f42ff172640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f42f8146270 0x7f42f80736a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:41.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.098+0000 7f42ff172640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f42f806d6f0 0x7f42f814f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:41.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.098+0000 7f42ff172640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42f8073be0 con 0x7f42f806db00 2024-05-16T23:36:41.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.098+0000 7f42ff172640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f42f80bbd40 con 0x7f42f8146270 2024-05-16T23:36:41.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.098+0000 7f42ff172640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f42f80bc020 con 0x7f42f806d6f0 2024-05-16T23:36:41.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.098+0000 7f42fcf0e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f42f8146270 0x7f42f80736a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:41.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.098+0000 7f42fcf0e640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f42f8146270 0x7f42f80736a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57692/0 (socket says 172.21.15.44:57692) 2024-05-16T23:36:41.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.098+0000 7f42fcf0e640 1 -- 172.21.15.44:0/86976266 learned_addr learned my addr 172.21.15.44:0/86976266 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T23:36:41.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.098+0000 7f42f7fff640 1 --2- 172.21.15.44:0/86976266 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f42f806d6f0 0x7f42f814f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:41.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.098+0000 7f42fcf0e640 1 -- 172.21.15.44:0/86976266 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f42f806d6f0 msgr2=0x7f42f814f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T23:36:41.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.098+0000 7f42fcf0e640 1 --2- 172.21.15.44:0/86976266 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f42f806d6f0 0x7f42f814f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:41.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.098+0000 7f42fcf0e640 1 -- 172.21.15.44:0/86976266 >> v1:172.21.15.70:6789/0 conn(0x7f42f806db00 legacy=0x7f42f80ba910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:41.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.098+0000 7f42fcf0e640 1 -- 172.21.15.44:0/86976266 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42f80bc300 con 0x7f42f8146270 2024-05-16T23:36:41.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.099+0000 7f42fcf0e640 1 --2- 172.21.15.44:0/86976266 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42f8146270 0x7f42f80736a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f42f0009e50 tx=0x7f42f002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=499cfcd59cc3a852 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:41.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.099+0000 7f42f77fe640 1 -- 172.21.15.44:0/86976266 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f0036070 con 0x7f42f8146270 2024-05-16T23:36:41.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.099+0000 7f42f77fe640 1 -- 172.21.15.44:0/86976266 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42f0031600 con 0x7f42f8146270 2024-05-16T23:36:41.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.099+0000 7f42f77fe640 1 -- 172.21.15.44:0/86976266 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f00319d0 con 0x7f42f8146270 2024-05-16T23:36:41.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.100+0000 7f42ff172640 1 -- 172.21.15.44:0/86976266 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42f8146270 msgr2=0x7f42f80736a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:41.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.100+0000 7f42ff172640 1 --2- 172.21.15.44:0/86976266 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42f8146270 0x7f42f80736a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f42f0009e50 tx=0x7f42f002a680 comp rx=0 tx=0).stop 2024-05-16T23:36:41.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.100+0000 7f42ff172640 1 -- 172.21.15.44:0/86976266 shutdown_connections 2024-05-16T23:36:41.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.100+0000 7f42ff172640 1 --2- 172.21.15.44:0/86976266 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f42f806d6f0 0x7f42f814f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:41.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.100+0000 7f42ff172640 1 --2- 172.21.15.44:0/86976266 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42f8146270 0x7f42f80736a0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:41.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.100+0000 7f42ff172640 1 -- 172.21.15.44:0/86976266 >> 172.21.15.44:0/86976266 conn(0x7f42f806f2c0 msgr2=0x7f42f806f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T23:36:41.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.100+0000 7f42ff172640 1 -- 172.21.15.44:0/86976266 shutdown_connections 2024-05-16T23:36:41.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.100+0000 7f42ff172640 1 -- 172.21.15.44:0/86976266 wait complete. 2024-05-16T23:36:41.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.101+0000 7f42ff172640 1 Processor -- start 2024-05-16T23:36:41.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.101+0000 7f42ff172640 1 -- start start 2024-05-16T23:36:41.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.103+0000 7f42ff172640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42f806d6f0 0x7f42f8147330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:41.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.103+0000 7f42ff172640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f42f806db00 0x7f42f81488c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:41.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.103+0000 7f42ff172640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42f8146270 0x7f42f8147b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:41.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.103+0000 7f42ff172640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f42f80729f0 con 0x7f42f806d6f0 2024-05-16T23:36:41.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.103+0000 7f42ff172640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f42f8072870 con 0x7f42f8146270 2024-05-16T23:36:41.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.103+0000 7f42ff172640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f42f814fd50 con 0x7f42f806db00 2024-05-16T23:36:41.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.103+0000 7f42fcf0e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42f806d6f0 0x7f42f8147330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:41.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.103+0000 7f42fcf0e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42f806d6f0 0x7f42f8147330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57702/0 (socket says 172.21.15.44:57702) 2024-05-16T23:36:41.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.103+0000 7f42fcf0e640 1 -- 172.21.15.44:0/3733712987 learned_addr learned my addr 172.21.15.44:0/3733712987 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T23:36:41.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.103+0000 7f42f7fff640 1 --2- 172.21.15.44:0/3733712987 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f42f806db00 0x7f42f81488c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:41.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.103+0000 7f42fd70f640 1 --2- 172.21.15.44:0/3733712987 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42f8146270 0x7f42f8147b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:41.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.103+0000 7f42fcf0e640 1 -- 172.21.15.44:0/3733712987 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f42f806db00 msgr2=0x7f42f81488c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:41.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.103+0000 7f42fcf0e640 1 --2- 172.21.15.44:0/3733712987 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f42f806db00 0x7f42f81488c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:41.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.103+0000 7f42fcf0e640 1 -- 172.21.15.44:0/3733712987 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42f8146270 msgr2=0x7f42f8147b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:41.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.103+0000 7f42fcf0e640 1 --2- 172.21.15.44:0/3733712987 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42f8146270 0x7f42f8147b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:41.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.103+0000 7f42fcf0e640 1 -- 172.21.15.44:0/3733712987 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42f81480b0 con 0x7f42f806d6f0 2024-05-16T23:36:41.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.103+0000 7f42fcf0e640 1 --2- 172.21.15.44:0/3733712987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42f806d6f0 0x7f42f8147330 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f42f0034040 tx=0x7f42f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:41.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.103+0000 7f42f57fa640 1 -- 172.21.15.44:0/3733712987 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f0036050 con 0x7f42f806d6f0 2024-05-16T23:36:41.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.103+0000 7f42f57fa640 1 -- 172.21.15.44:0/3733712987 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42f0042070 con 0x7f42f806d6f0 2024-05-16T23:36:41.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.103+0000 7f42ff172640 1 -- 172.21.15.44:0/3733712987 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42f8149010 con 0x7f42f806d6f0 2024-05-16T23:36:41.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.103+0000 7f42f57fa640 1 -- 172.21.15.44:0/3733712987 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f0009510 con 0x7f42f806d6f0 2024-05-16T23:36:41.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.104+0000 7f42ff172640 1 -- 172.21.15.44:0/3733712987 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42f80a2510 con 0x7f42f806d6f0 2024-05-16T23:36:41.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.105+0000 7f42ff172640 1 -- 172.21.15.44:0/3733712987 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42f80747c0 con 0x7f42f806d6f0 2024-05-16T23:36:41.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.105+0000 7f42f57fa640 1 -- 172.21.15.44:0/3733712987 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f42f0007c50 con 0x7f42f806d6f0 2024-05-16T23:36:41.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.105+0000 7f42f57fa640 1 --2- 172.21.15.44:0/3733712987 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f42e40762d0 0x7f42e40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:36:41.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.106+0000 7f42f57fa640 1 -- 172.21.15.44:0/3733712987 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5029+0+0 (secure 0 0 0) 0x7f42f00b8080 con 0x7f42f806d6f0 2024-05-16T23:36:41.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.106+0000 7f42f7fff640 1 --2- 172.21.15.44:0/3733712987 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f42e40762d0 0x7f42e40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:36:41.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.106+0000 7f42f7fff640 1 --2- 172.21.15.44:0/3733712987 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f42e40762d0 0x7f42e40787e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f42f814e480 tx=0x7f42ec008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:36:41.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.110+0000 7f42f57fa640 1 -- 172.21.15.44:0/3733712987 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f42f00816c0 con 0x7f42f806d6f0 2024-05-16T23:36:41.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.300+0000 7f42ff172640 1 -- 172.21.15.44:0/3733712987 --> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f42f80a1810 con 0x7f42e40762d0 2024-05-16T23:36:41.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.301+0000 7f42f57fa640 1 -- 172.21.15.44:0/3733712987 <== mgr.4114 v2:172.21.15.70:6832/4049588098 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13341 (secure 0 0 0) 0x7f42f80a1810 con 0x7f42e40762d0 2024-05-16T23:36:41.783 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T23:36:41.792 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-05-16T23:36:41.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.303+0000 7f42ff172640 1 -- 172.21.15.44:0/3733712987 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f42e40762d0 msgr2=0x7f42e40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:41.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.303+0000 7f42ff172640 1 --2- 172.21.15.44:0/3733712987 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f42e40762d0 0x7f42e40787e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f42f814e480 tx=0x7f42ec008040 comp rx=0 tx=0).stop 2024-05-16T23:36:41.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.303+0000 7f42ff172640 1 -- 172.21.15.44:0/3733712987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42f806d6f0 msgr2=0x7f42f8147330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:36:41.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.303+0000 7f42ff172640 1 --2- 172.21.15.44:0/3733712987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42f806d6f0 0x7f42f8147330 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f42f0034040 tx=0x7f42f0004a40 comp rx=0 tx=0).stop 2024-05-16T23:36:41.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.304+0000 7f42ff172640 1 -- 172.21.15.44:0/3733712987 shutdown_connections 2024-05-16T23:36:41.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.304+0000 7f42ff172640 1 --2- 172.21.15.44:0/3733712987 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f42e40762d0 0x7f42e40787e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:41.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.304+0000 7f42ff172640 1 --2- 172.21.15.44:0/3733712987 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f42f806db00 0x7f42f81488c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:41.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.304+0000 7f42ff172640 1 --2- 172.21.15.44:0/3733712987 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42f8146270 0x7f42f8147b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:41.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.304+0000 7f42ff172640 1 --2- 172.21.15.44:0/3733712987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42f806d6f0 0x7f42f8147330 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:36:41.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.304+0000 7f42ff172640 1 -- 172.21.15.44:0/3733712987 >> 172.21.15.44:0/3733712987 conn(0x7f42f806f2c0 msgr2=0x7f42f806f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T23:36:41.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.304+0000 7f42ff172640 1 -- 172.21.15.44:0/3733712987 shutdown_connections 2024-05-16T23:36:41.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:36:41.304+0000 7f42ff172640 1 -- 172.21.15.44:0/3733712987 wait complete. 2024-05-16T23:36:41.941 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":2130,"stamp":"2024-05-16T23:36:39.521034+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":263976,"kb_used_data":6216,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754710744,"statfs":{"total":773094113280,"available":772823801856,"internally_reserved":0,"allocated":6365184,"data_stored":3314944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":263835185},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002533"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":206,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-16T23:33:29.708492+0000","last_change":"2024-05-16T22:27:15.950850+0000","last_active":"2024-05-16T23:33:29.708492+0000","last_peered":"2024-05-16T23:33:29.708492+0000","last_clean":"2024-05-16T23:33:29.708492+0000","last_became_active":"2024-05-16T22:27:15.949553+0000","last_became_peered":"2024-05-16T22:27:15.949553+0000","last_unstale":"2024-05-16T23:33:29.708492+0000","last_undegraded":"2024-05-16T23:33:29.708492+0000","last_fullsized":"2024-05-16T23:33:29.708492+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-16T22:27:14.702385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-16T22:27:14.702385+0000","last_clean_scrub_stamp":"2024-05-16T22:27:14.702385+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T01:46:07.495562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542980,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36552,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335288,"statfs":{"total":96636764160,"available":96599334912,"internally_reserved":0,"allocated":1241088,"data_stored":857144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575684,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31812,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":647168,"data_stored":266776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575684,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35972,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335868,"statfs":{"total":96636764160,"available":96599928832,"internally_reserved":0,"allocated":647168,"data_stored":266776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575684,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31812,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":647168,"data_stored":266776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575684,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31812,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":647168,"data_stored":266776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575684,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31812,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":647168,"data_stored":266776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575683,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31812,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":647168,"data_stored":266776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575684,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32392,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339448,"statfs":{"total":96636764160,"available":96603594752,"internally_reserved":0,"allocated":1241088,"data_stored":857144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-16T23:36:41.954 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-16T22:27:14.702385+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=16, tm_hour=22, tm_min=27, tm_sec=14, tm_wday=3, tm_yday=137, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=16, tm_hour=23, tm_min=36, tm_sec=23, tm_wday=3, tm_yday=137, tm_isdst=0) 2024-05-16T23:36:41.962 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-16T23:36:42.873 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:36:42.883 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:36:42.895 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:37:01.976 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-16T23:37:02.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.128+0000 7f1a5c4c8640 1 Processor -- start 2024-05-16T23:37:02.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.128+0000 7f1a5c4c8640 1 -- start start 2024-05-16T23:37:02.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.129+0000 7f1a5c4c8640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f1a5414d0f0 0x7f1a54157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:37:02.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.129+0000 7f1a5c4c8640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a540720d0 con 0x7f1a540be4f0 2024-05-16T23:37:02.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.129+0000 7f1a5c4c8640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a540bf6f0 con 0x7f1a5414cce0 2024-05-16T23:37:02.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.129+0000 7f1a5c4c8640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f1a540bfa60 con 0x7f1a5414d0f0 2024-05-16T23:37:02.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.129+0000 7f1a5a264640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f1a540be4f0 0x7f1a540bfef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:36208/0 (socket says 172.21.15.44:36208) 2024-05-16T23:37:02.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.129+0000 7f1a5a264640 1 -- 172.21.15.44:0/3950431967 learned_addr learned my addr 172.21.15.44:0/3950431967 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T23:37:02.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.129+0000 7f1a5aa65640 1 --2- 172.21.15.44:0/3950431967 >> v2:172.21.15.70:3300/0 conn(0x7f1a5414d0f0 0x7f1a54157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:37:02.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.129+0000 7f1a59262640 1 -- 172.21.15.44:0/3950431967 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1666383707 0 0) 0x7f1a540720d0 con 0x7f1a540be4f0 2024-05-16T23:37:02.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.129+0000 7f1a59262640 1 -- 172.21.15.44:0/3950431967 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a40003520 con 0x7f1a540be4f0 2024-05-16T23:37:02.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.130+0000 7f1a59262640 1 -- 172.21.15.44:0/3950431967 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 993417760 0 0) 0x7f1a40003520 con 0x7f1a540be4f0 2024-05-16T23:37:02.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.130+0000 7f1a59262640 1 -- 172.21.15.44:0/3950431967 >> v2:172.21.15.70:3300/0 conn(0x7f1a5414d0f0 msgr2=0x7f1a54157cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T23:37:02.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.130+0000 7f1a59262640 1 --2- 172.21.15.44:0/3950431967 >> v2:172.21.15.70:3300/0 conn(0x7f1a5414d0f0 0x7f1a54157cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:37:02.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.130+0000 7f1a59262640 1 -- 172.21.15.44:0/3950431967 >> v1:172.21.15.70:6789/0 conn(0x7f1a5414cce0 legacy=0x7f1a540716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:37:02.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.130+0000 7f1a59262640 1 -- 172.21.15.44:0/3950431967 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a540be900 con 0x7f1a540be4f0 2024-05-16T23:37:02.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.130+0000 7f1a59262640 1 -- 172.21.15.44:0/3950431967 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 568431863 0 0) 0x7f1a500016f0 con 0x7f1a540be4f0 2024-05-16T23:37:02.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.130+0000 7f1a59262640 1 -- 172.21.15.44:0/3950431967 >> v1:172.21.15.44:6789/0 conn(0x7f1a540be4f0 legacy=0x7f1a540bfef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:37:02.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.130+0000 7f1a59262640 1 --2- 172.21.15.44:0/3950431967 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a40003a50 0x7f1a40003ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:37:02.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.130+0000 7f1a59262640 1 --2- 172.21.15.44:0/3950431967 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a40004800 0x7f1a40004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:37:02.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.130+0000 7f1a59262640 1 --2- 172.21.15.44:0/3950431967 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1a40005350 0x7f1a4000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:37:02.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.130+0000 7f1a59262640 1 -- 172.21.15.44:0/3950431967 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1a540bfa60 con 0x7f1a40004800 2024-05-16T23:37:02.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.130+0000 7f1a59262640 1 -- 172.21.15.44:0/3950431967 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1a4000c2a0 con 0x7f1a40003a50 2024-05-16T23:37:02.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.130+0000 7f1a59262640 1 -- 172.21.15.44:0/3950431967 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f1a4000c4a0 con 0x7f1a40005350 2024-05-16T23:37:02.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.130+0000 7f1a59a63640 1 --2- 172.21.15.44:0/3950431967 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a40004800 0x7f1a40004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:37:02.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.130+0000 7f1a5a264640 1 --2- 172.21.15.44:0/3950431967 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a40003a50 0x7f1a40003ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:37:02.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.130+0000 7f1a5aa65640 1 --2- 172.21.15.44:0/3950431967 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1a40005350 0x7f1a4000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:37:02.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.130+0000 7f1a59a63640 1 -- 172.21.15.44:0/3950431967 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1a40005350 msgr2=0x7f1a4000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T23:37:02.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.130+0000 7f1a59a63640 1 --2- 172.21.15.44:0/3950431967 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1a40005350 0x7f1a4000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:37:02.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.130+0000 7f1a59a63640 1 -- 172.21.15.44:0/3950431967 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a40003a50 msgr2=0x7f1a40003ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T23:37:02.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.130+0000 7f1a59a63640 1 --2- 172.21.15.44:0/3950431967 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a40003a50 0x7f1a40003ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:37:02.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.130+0000 7f1a59a63640 1 -- 172.21.15.44:0/3950431967 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a40003520 con 0x7f1a40004800 2024-05-16T23:37:02.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.130+0000 7f1a5aa65640 1 -- 172.21.15.44:0/3950431967 reap_dead start 2024-05-16T23:37:02.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.131+0000 7f1a59a63640 1 --2- 172.21.15.44:0/3950431967 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a40004800 0x7f1a40004c10 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f1a540741b0 tx=0x7f1a40005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c14e288adf7b030 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:37:02.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.131+0000 7f1a59262640 1 -- 172.21.15.44:0/3950431967 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a440013b0 con 0x7f1a40004800 2024-05-16T23:37:02.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.131+0000 7f1a59262640 1 -- 172.21.15.44:0/3950431967 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a440052d0 con 0x7f1a40004800 2024-05-16T23:37:02.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.131+0000 7f1a59262640 1 -- 172.21.15.44:0/3950431967 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a4402aa20 con 0x7f1a40004800 2024-05-16T23:37:02.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.132+0000 7f1a5c4c8640 1 -- 172.21.15.44:0/3950431967 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a40004800 msgr2=0x7f1a40004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:37:02.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.132+0000 7f1a5c4c8640 1 --2- 172.21.15.44:0/3950431967 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a40004800 0x7f1a40004c10 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f1a540741b0 tx=0x7f1a40005830 comp rx=0 tx=0).stop 2024-05-16T23:37:02.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.132+0000 7f1a5c4c8640 1 -- 172.21.15.44:0/3950431967 shutdown_connections 2024-05-16T23:37:02.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.132+0000 7f1a5c4c8640 1 --2- 172.21.15.44:0/3950431967 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a40004800 0x7f1a40004c10 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:37:02.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.132+0000 7f1a5c4c8640 1 -- 172.21.15.44:0/3950431967 >> 172.21.15.44:0/3950431967 conn(0x7f1a540c17c0 msgr2=0x7f1a540c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T23:37:02.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.132+0000 7f1a5c4c8640 1 -- 172.21.15.44:0/3950431967 shutdown_connections 2024-05-16T23:37:02.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.132+0000 7f1a5c4c8640 1 -- 172.21.15.44:0/3950431967 wait complete. 2024-05-16T23:37:02.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.134+0000 7f1a5c4c8640 1 Processor -- start 2024-05-16T23:37:02.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.134+0000 7f1a5c4c8640 1 -- start start 2024-05-16T23:37:02.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.135+0000 7f1a5c4c8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a40004800 0x7f1a5409c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:37:02.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.135+0000 7f1a5c4c8640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1a5409fa90 0x7f1a5409fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:37:02.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.135+0000 7f1a5c4c8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a5409cd20 0x7f1a5409d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:37:02.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.135+0000 7f1a5c4c8640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1a540723b0 con 0x7f1a5409cd20 2024-05-16T23:37:02.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.135+0000 7f1a5c4c8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1a54071310 con 0x7f1a40004800 2024-05-16T23:37:02.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.135+0000 7f1a5c4c8640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f1a540bc1c0 con 0x7f1a5409fa90 2024-05-16T23:37:02.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.135+0000 7f1a5aa65640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a5409cd20 0x7f1a5409d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:37:02.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.135+0000 7f1a5a264640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a40004800 0x7f1a5409c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:37:02.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.135+0000 7f1a5aa65640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a5409cd20 0x7f1a5409d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59640/0 (socket says 172.21.15.44:59640) 2024-05-16T23:37:02.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.135+0000 7f1a5aa65640 1 -- 172.21.15.44:0/2078287231 learned_addr learned my addr 172.21.15.44:0/2078287231 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T23:37:02.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.135+0000 7f1a59a63640 1 --2- 172.21.15.44:0/2078287231 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1a5409fa90 0x7f1a5409fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:37:02.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.135+0000 7f1a5aa65640 1 -- 172.21.15.44:0/2078287231 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1a5409fa90 msgr2=0x7f1a5409fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:37:02.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.135+0000 7f1a5aa65640 1 --2- 172.21.15.44:0/2078287231 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1a5409fa90 0x7f1a5409fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:37:02.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.135+0000 7f1a5aa65640 1 -- 172.21.15.44:0/2078287231 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a40004800 msgr2=0x7f1a5409c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:37:02.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.135+0000 7f1a5aa65640 1 --2- 172.21.15.44:0/2078287231 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a40004800 0x7f1a5409c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:37:02.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.135+0000 7f1a5aa65640 1 -- 172.21.15.44:0/2078287231 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a540bbbb0 con 0x7f1a5409cd20 2024-05-16T23:37:02.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.135+0000 7f1a5aa65640 1 --2- 172.21.15.44:0/2078287231 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a5409cd20 0x7f1a5409d130 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f1a540739d0 tx=0x7f1a4c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:37:02.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.136+0000 7f1a4affd640 1 -- 172.21.15.44:0/2078287231 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c00fd80 con 0x7f1a5409cd20 2024-05-16T23:37:02.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.136+0000 7f1a4affd640 1 -- 172.21.15.44:0/2078287231 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a4c015430 con 0x7f1a5409cd20 2024-05-16T23:37:03.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.136+0000 7f1a5c4c8640 1 -- 172.21.15.44:0/2078287231 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a5409b940 con 0x7f1a5409cd20 2024-05-16T23:37:03.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.136+0000 7f1a4affd640 1 -- 172.21.15.44:0/2078287231 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c015820 con 0x7f1a5409cd20 2024-05-16T23:37:03.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.136+0000 7f1a5c4c8640 1 -- 172.21.15.44:0/2078287231 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a540a0790 con 0x7f1a5409cd20 2024-05-16T23:37:03.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.137+0000 7f1a5c4c8640 1 -- 172.21.15.44:0/2078287231 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a540bf020 con 0x7f1a5409cd20 2024-05-16T23:37:03.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.138+0000 7f1a4affd640 1 -- 172.21.15.44:0/2078287231 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1a4c0159c0 con 0x7f1a5409cd20 2024-05-16T23:37:03.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.138+0000 7f1a4affd640 1 --2- 172.21.15.44:0/2078287231 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f1a380762d0 0x7f1a380787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:37:03.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.138+0000 7f1a4affd640 1 -- 172.21.15.44:0/2078287231 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5029+0+0 (secure 0 0 0) 0x7f1a4c0980c0 con 0x7f1a5409cd20 2024-05-16T23:37:03.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.138+0000 7f1a5a264640 1 --2- 172.21.15.44:0/2078287231 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f1a380762d0 0x7f1a380787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:37:03.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.139+0000 7f1a5a264640 1 --2- 172.21.15.44:0/2078287231 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f1a380762d0 0x7f1a380787e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1a540771f0 tx=0x7f1a50001e70 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:37:03.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.143+0000 7f1a4affd640 1 -- 172.21.15.44:0/2078287231 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1a5409b940 con 0x7f1a5409cd20 2024-05-16T23:37:03.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.329+0000 7f1a5c4c8640 1 -- 172.21.15.44:0/2078287231 --> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1a54050940 con 0x7f1a380762d0 2024-05-16T23:37:03.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.330+0000 7f1a4affd640 1 -- 172.21.15.44:0/2078287231 <== mgr.4114 v2:172.21.15.70:6832/4049588098 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13345 (secure 0 0 0) 0x7f1a54050940 con 0x7f1a380762d0 2024-05-16T23:37:03.149 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T23:37:03.160 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-05-16T23:37:03.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.332+0000 7f1a5c4c8640 1 -- 172.21.15.44:0/2078287231 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f1a380762d0 msgr2=0x7f1a380787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:37:03.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.332+0000 7f1a5c4c8640 1 --2- 172.21.15.44:0/2078287231 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f1a380762d0 0x7f1a380787e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1a540771f0 tx=0x7f1a50001e70 comp rx=0 tx=0).stop 2024-05-16T23:37:03.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.332+0000 7f1a5c4c8640 1 -- 172.21.15.44:0/2078287231 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a5409cd20 msgr2=0x7f1a5409d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:37:03.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.332+0000 7f1a5c4c8640 1 --2- 172.21.15.44:0/2078287231 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a5409cd20 0x7f1a5409d130 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f1a540739d0 tx=0x7f1a4c00f580 comp rx=0 tx=0).stop 2024-05-16T23:37:03.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.332+0000 7f1a5c4c8640 1 -- 172.21.15.44:0/2078287231 shutdown_connections 2024-05-16T23:37:03.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.332+0000 7f1a5c4c8640 1 --2- 172.21.15.44:0/2078287231 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f1a380762d0 0x7f1a380787e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:37:03.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.332+0000 7f1a5c4c8640 1 --2- 172.21.15.44:0/2078287231 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1a5409fa90 0x7f1a5409fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:37:03.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.332+0000 7f1a5c4c8640 1 --2- 172.21.15.44:0/2078287231 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a5409cd20 0x7f1a5409d130 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:37:03.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.332+0000 7f1a5c4c8640 1 --2- 172.21.15.44:0/2078287231 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a40004800 0x7f1a5409c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:37:03.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.332+0000 7f1a5c4c8640 1 -- 172.21.15.44:0/2078287231 >> 172.21.15.44:0/2078287231 conn(0x7f1a540c17c0 msgr2=0x7f1a54071660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T23:37:03.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.333+0000 7f1a5c4c8640 1 -- 172.21.15.44:0/2078287231 shutdown_connections 2024-05-16T23:37:03.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:02.333+0000 7f1a5c4c8640 1 -- 172.21.15.44:0/2078287231 wait complete. 2024-05-16T23:37:03.332 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":2141,"stamp":"2024-05-16T23:37:01.526290+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":263968,"kb_used_data":6216,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754710752,"statfs":{"total":773094113280,"available":772823810048,"internally_reserved":0,"allocated":6365184,"data_stored":3314944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":263835185},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002894"},"pg_stats":[{"pgid":"1.0","version":"54'74","reported_seq":217,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-16T23:36:41.303843+0000","last_change":"2024-05-16T23:36:41.303900+0000","last_active":"2024-05-16T23:36:41.303843+0000","last_peered":"2024-05-16T23:36:41.303843+0000","last_clean":"2024-05-16T23:36:41.303843+0000","last_became_active":"2024-05-16T22:27:15.949553+0000","last_became_peered":"2024-05-16T22:27:15.949553+0000","last_unstale":"2024-05-16T23:36:41.303843+0000","last_undegraded":"2024-05-16T23:36:41.303843+0000","last_fullsized":"2024-05-16T23:36:41.303843+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'74","last_scrub_stamp":"2024-05-16T23:36:41.303747+0000","last_deep_scrub":"54'74","last_deep_scrub_stamp":"2024-05-16T23:36:41.303747+0000","last_clean_scrub_stamp":"2024-05-16T23:36:41.303747+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-18T05:11:47.066639+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542985,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36548,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335292,"statfs":{"total":96636764160,"available":96599339008,"internally_reserved":0,"allocated":1241088,"data_stored":857144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575688,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31812,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":647168,"data_stored":266776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575688,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35972,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335868,"statfs":{"total":96636764160,"available":96599928832,"internally_reserved":0,"allocated":647168,"data_stored":266776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575688,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31812,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":647168,"data_stored":266776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575688,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31812,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":647168,"data_stored":266776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575688,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31812,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":647168,"data_stored":266776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575687,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31812,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":647168,"data_stored":266776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575688,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32388,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1241088,"data_stored":857144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-16T23:37:03.341 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-16T23:37:03.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.475+0000 7f0e7e5c7640 1 Processor -- start 2024-05-16T23:37:03.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.476+0000 7f0e7e5c7640 1 -- start start 2024-05-16T23:37:03.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.477+0000 7f0e7e5c7640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0e78148770 0x7f0e780c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:37:03.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.477+0000 7f0e7e5c7640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0e780bf9b0 0x7f0e780bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:37:03.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.477+0000 7f0e7e5c7640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e780c0620 con 0x7f0e7814e360 2024-05-16T23:37:03.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.477+0000 7f0e7e5c7640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f0e78151e40 con 0x7f0e780bf9b0 2024-05-16T23:37:03.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.477+0000 7f0e7e5c7640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f0e78151ad0 con 0x7f0e78148770 2024-05-16T23:37:03.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.477+0000 7f0e7cb64640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0e780bf9b0 0x7f0e780bfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:37:03.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.477+0000 7f0e7cb64640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0e780bf9b0 0x7f0e780bfdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59652/0 (socket says 172.21.15.44:59652) 2024-05-16T23:37:03.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.477+0000 7f0e7cb64640 1 -- 172.21.15.44:0/3962646167 learned_addr learned my addr 172.21.15.44:0/3962646167 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T23:37:03.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.477+0000 7f0e777fe640 1 --2- 172.21.15.44:0/3962646167 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0e78148770 0x7f0e780c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:37:03.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.477+0000 7f0e7cb64640 1 -- 172.21.15.44:0/3962646167 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0e78148770 msgr2=0x7f0e780c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T23:37:03.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.477+0000 7f0e7cb64640 1 --2- 172.21.15.44:0/3962646167 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0e78148770 0x7f0e780c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:37:03.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.477+0000 7f0e7cb64640 1 -- 172.21.15.44:0/3962646167 >> v1:172.21.15.70:6789/0 conn(0x7f0e7814e360 legacy=0x7f0e781522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T23:37:03.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.477+0000 7f0e7cb64640 1 -- 172.21.15.44:0/3962646167 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e780c0300 con 0x7f0e780bf9b0 2024-05-16T23:37:03.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.478+0000 7f0e7cb64640 1 --2- 172.21.15.44:0/3962646167 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e780bf9b0 0x7f0e780bfdc0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0e78073130 tx=0x7f0e7002a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f826a8cd83955bb server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:37:03.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.478+0000 7f0e76ffd640 1 -- 172.21.15.44:0/3962646167 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e70036070 con 0x7f0e780bf9b0 2024-05-16T23:37:03.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.478+0000 7f0e76ffd640 1 -- 172.21.15.44:0/3962646167 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e70031600 con 0x7f0e780bf9b0 2024-05-16T23:37:03.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.478+0000 7f0e76ffd640 1 -- 172.21.15.44:0/3962646167 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e700319d0 con 0x7f0e780bf9b0 2024-05-16T23:37:03.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.479+0000 7f0e7e5c7640 1 -- 172.21.15.44:0/3962646167 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e780bf9b0 msgr2=0x7f0e780bfdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:37:03.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.479+0000 7f0e7e5c7640 1 --2- 172.21.15.44:0/3962646167 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e780bf9b0 0x7f0e780bfdc0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0e78073130 tx=0x7f0e7002a6d0 comp rx=0 tx=0).stop 2024-05-16T23:37:03.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.479+0000 7f0e7e5c7640 1 -- 172.21.15.44:0/3962646167 shutdown_connections 2024-05-16T23:37:03.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.479+0000 7f0e7e5c7640 1 --2- 172.21.15.44:0/3962646167 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e780bf9b0 0x7f0e780bfdc0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:37:03.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.479+0000 7f0e7e5c7640 1 --2- 172.21.15.44:0/3962646167 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0e78148770 0x7f0e780c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:37:03.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.479+0000 7f0e7e5c7640 1 -- 172.21.15.44:0/3962646167 >> 172.21.15.44:0/3962646167 conn(0x7f0e780c17c0 msgr2=0x7f0e780c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T23:37:03.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.479+0000 7f0e7e5c7640 1 -- 172.21.15.44:0/3962646167 shutdown_connections 2024-05-16T23:37:03.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.479+0000 7f0e7e5c7640 1 -- 172.21.15.44:0/3962646167 wait complete. 2024-05-16T23:37:03.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.480+0000 7f0e7e5c7640 1 Processor -- start 2024-05-16T23:37:03.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.481+0000 7f0e7e5c7640 1 -- start start 2024-05-16T23:37:03.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.482+0000 7f0e7e5c7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e780bf9b0 0x7f0e781e8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:37:03.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.482+0000 7f0e7e5c7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e78148770 0x7f0e7813fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:37:03.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.482+0000 7f0e7e5c7640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0e7814e360 0x7f0e7806d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:37:03.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.482+0000 7f0e7e5c7640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0e78158cc0 con 0x7f0e78148770 2024-05-16T23:37:03.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.482+0000 7f0e7e5c7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0e780c13d0 con 0x7f0e780bf9b0 2024-05-16T23:37:03.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.482+0000 7f0e7e5c7640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f0e78158e40 con 0x7f0e7814e360 2024-05-16T23:37:03.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.482+0000 7f0e777fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e78148770 0x7f0e7813fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:37:03.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.482+0000 7f0e777fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e78148770 0x7f0e7813fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59654/0 (socket says 172.21.15.44:59654) 2024-05-16T23:37:03.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.482+0000 7f0e777fe640 1 -- 172.21.15.44:0/1441526950 learned_addr learned my addr 172.21.15.44:0/1441526950 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T23:37:03.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.482+0000 7f0e77fff640 1 --2- 172.21.15.44:0/1441526950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e780bf9b0 0x7f0e781e8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:37:03.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.482+0000 7f0e7cb64640 1 --2- 172.21.15.44:0/1441526950 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0e7814e360 0x7f0e7806d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:37:03.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.482+0000 7f0e777fe640 1 -- 172.21.15.44:0/1441526950 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0e7814e360 msgr2=0x7f0e7806d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:37:03.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.482+0000 7f0e777fe640 1 --2- 172.21.15.44:0/1441526950 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0e7814e360 0x7f0e7806d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:37:03.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.482+0000 7f0e777fe640 1 -- 172.21.15.44:0/1441526950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e780bf9b0 msgr2=0x7f0e781e8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:37:03.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.482+0000 7f0e777fe640 1 --2- 172.21.15.44:0/1441526950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e780bf9b0 0x7f0e781e8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:37:04.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.482+0000 7f0e777fe640 1 -- 172.21.15.44:0/1441526950 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e78140000 con 0x7f0e78148770 2024-05-16T23:37:04.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.483+0000 7f0e777fe640 1 --2- 172.21.15.44:0/1441526950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e78148770 0x7f0e7813fac0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0e6000d5f0 tx=0x7f0e6000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:37:04.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.483+0000 7f0e74ff9640 1 -- 172.21.15.44:0/1441526950 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e600125f0 con 0x7f0e78148770 2024-05-16T23:37:04.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.483+0000 7f0e74ff9640 1 -- 172.21.15.44:0/1441526950 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e60019070 con 0x7f0e78148770 2024-05-16T23:37:04.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.483+0000 7f0e74ff9640 1 -- 172.21.15.44:0/1441526950 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e600129d0 con 0x7f0e78148770 2024-05-16T23:37:04.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.483+0000 7f0e7e5c7640 1 -- 172.21.15.44:0/1441526950 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e781421f0 con 0x7f0e78148770 2024-05-16T23:37:04.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.483+0000 7f0e7e5c7640 1 -- 172.21.15.44:0/1441526950 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e781e7d70 con 0x7f0e78148770 2024-05-16T23:37:04.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.484+0000 7f0e7e5c7640 1 -- 172.21.15.44:0/1441526950 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e78069c60 con 0x7f0e78148770 2024-05-16T23:37:04.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.484+0000 7f0e74ff9640 1 -- 172.21.15.44:0/1441526950 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0e60012b70 con 0x7f0e78148770 2024-05-16T23:37:04.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.485+0000 7f0e74ff9640 1 --2- 172.21.15.44:0/1441526950 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0e58076300 0x7f0e58078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:37:04.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.485+0000 7f0e74ff9640 1 -- 172.21.15.44:0/1441526950 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5029+0+0 (secure 0 0 0) 0x7f0e60097580 con 0x7f0e78148770 2024-05-16T23:37:04.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.485+0000 7f0e77fff640 1 --2- 172.21.15.44:0/1441526950 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0e58076300 0x7f0e58078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:37:04.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.486+0000 7f0e77fff640 1 --2- 172.21.15.44:0/1441526950 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0e58076300 0x7f0e58078810 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0e68006fd0 tx=0x7f0e68009060 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:37:04.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.490+0000 7f0e74ff9640 1 -- 172.21.15.44:0/1441526950 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0e60060bc0 con 0x7f0e78148770 2024-05-16T23:37:04.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.681+0000 7f0e7e5c7640 1 -- 172.21.15.44:0/1441526950 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f0e78050940 con 0x7f0e78148770 2024-05-16T23:37:04.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.684+0000 7f0e74ff9640 1 -- 172.21.15.44:0/1441526950 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v14)=0 v14) ==== 123+0+0 (secure 0 0 0) 0x7f0e60069030 con 0x7f0e78148770 2024-05-16T23:37:04.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.685+0000 7f0e74ff9640 1 -- 172.21.15.44:0/1441526950 <== mon.0 v2:172.21.15.44:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f0e600606d0 con 0x7f0e78148770 2024-05-16T23:37:04.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.687+0000 7f0e7e5c7640 1 -- 172.21.15.44:0/1441526950 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0e58076300 msgr2=0x7f0e58078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:37:04.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.687+0000 7f0e7e5c7640 1 --2- 172.21.15.44:0/1441526950 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0e58076300 0x7f0e58078810 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0e68006fd0 tx=0x7f0e68009060 comp rx=0 tx=0).stop 2024-05-16T23:37:04.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.687+0000 7f0e7e5c7640 1 -- 172.21.15.44:0/1441526950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e78148770 msgr2=0x7f0e7813fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:37:04.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.687+0000 7f0e7e5c7640 1 --2- 172.21.15.44:0/1441526950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e78148770 0x7f0e7813fac0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0e6000d5f0 tx=0x7f0e6000dab0 comp rx=0 tx=0).stop 2024-05-16T23:37:04.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.687+0000 7f0e7e5c7640 1 -- 172.21.15.44:0/1441526950 shutdown_connections 2024-05-16T23:37:04.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.687+0000 7f0e7e5c7640 1 --2- 172.21.15.44:0/1441526950 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f0e58076300 0x7f0e58078810 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:37:04.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.687+0000 7f0e7e5c7640 1 --2- 172.21.15.44:0/1441526950 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0e7814e360 0x7f0e7806d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:37:04.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.687+0000 7f0e7e5c7640 1 --2- 172.21.15.44:0/1441526950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e78148770 0x7f0e7813fac0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:37:04.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.687+0000 7f0e7e5c7640 1 --2- 172.21.15.44:0/1441526950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e780bf9b0 0x7f0e781e8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:37:04.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.687+0000 7f0e7e5c7640 1 -- 172.21.15.44:0/1441526950 >> 172.21.15.44:0/1441526950 conn(0x7f0e780c17c0 msgr2=0x7f0e78140710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T23:37:04.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.688+0000 7f0e7e5c7640 1 -- 172.21.15.44:0/1441526950 shutdown_connections 2024-05-16T23:37:04.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:03.688+0000 7f0e7e5c7640 1 -- 172.21.15.44:0/1441526950 wait complete. 2024-05-16T23:37:04.306 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-16T23:37:04.317 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-16T23:37:04.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.448+0000 7f982374d640 1 Processor -- start 2024-05-16T23:37:04.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.448+0000 7f982374d640 1 -- start start 2024-05-16T23:37:04.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.449+0000 7f982374d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f981c0bf050 0x7f981c159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:37:04.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.449+0000 7f982374d640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f981c06e140 con 0x7f981c151fc0 2024-05-16T23:37:04.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.449+0000 7f982374d640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f981c0c36f0 con 0x7f981c0bd6d0 2024-05-16T23:37:04.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.449+0000 7f982374d640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f981c152530 con 0x7f981c0bf050 2024-05-16T23:37:04.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.449+0000 7f98214e9640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f981c151fc0 0x7f981c06da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:36224/0 (socket says 172.21.15.44:36224) 2024-05-16T23:37:04.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.449+0000 7f98214e9640 1 -- 172.21.15.44:0/1222039966 learned_addr learned my addr 172.21.15.44:0/1222039966 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-05-16T23:37:04.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.449+0000 7f9821cea640 1 --2- 172.21.15.44:0/1222039966 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f981c0bf050 0x7f981c159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:37:04.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.449+0000 7f980ffff640 1 -- 172.21.15.44:0/1222039966 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 391600608 0 0) 0x7f9810001110 con 0x7f981c151fc0 2024-05-16T23:37:04.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.449+0000 7f980ffff640 1 -- 172.21.15.44:0/1222039966 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9808003520 con 0x7f981c151fc0 2024-05-16T23:37:04.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.450+0000 7f980ffff640 1 -- 172.21.15.44:0/1222039966 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2222998908 0 0) 0x7f981c0c36f0 con 0x7f981c0bd6d0 2024-05-16T23:37:04.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.450+0000 7f980ffff640 1 -- 172.21.15.44:0/1222039966 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9810001110 con 0x7f981c0bd6d0 2024-05-16T23:37:04.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.450+0000 7f980ffff640 1 -- 172.21.15.44:0/1222039966 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1233862427 0 0) 0x7f9808003520 con 0x7f981c151fc0 2024-05-16T23:37:04.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.450+0000 7f980ffff640 1 -- 172.21.15.44:0/1222039966 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f981c0bf050 msgr2=0x7f981c159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T23:37:04.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.450+0000 7f980ffff640 1 --2- 172.21.15.44:0/1222039966 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f981c0bf050 0x7f981c159ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:37:04.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.450+0000 7f980ffff640 1 -- 172.21.15.44:0/1222039966 >> v1:172.21.15.70:6789/0 conn(0x7f981c0bd6d0 legacy=0x7f981c0be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:37:04.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.450+0000 7f980ffff640 1 -- 172.21.15.44:0/1222039966 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f981c152810 con 0x7f981c151fc0 2024-05-16T23:37:04.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.450+0000 7f980ffff640 1 -- 172.21.15.44:0/1222039966 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 568431863 0 0) 0x7f98100018c0 con 0x7f981c151fc0 2024-05-16T23:37:04.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.450+0000 7f9821cea640 1 --2- 172.21.15.44:0/1222039966 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f981c0bf050 0x7f981c159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-16T23:37:04.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.450+0000 7f980ffff640 1 -- 172.21.15.44:0/1222039966 >> v1:172.21.15.44:6789/0 conn(0x7f981c151fc0 legacy=0x7f981c06da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:37:04.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.450+0000 7f980ffff640 1 --2- 172.21.15.44:0/1222039966 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9808003c10 0x7f9808004060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:37:04.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.450+0000 7f980ffff640 1 --2- 172.21.15.44:0/1222039966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9808004800 0x7f9808004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:37:04.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.450+0000 7f980ffff640 1 --2- 172.21.15.44:0/1222039966 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f981c0bf050 0x7f980800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:37:04.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.450+0000 7f980ffff640 1 -- 172.21.15.44:0/1222039966 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f981c152530 con 0x7f9808004800 2024-05-16T23:37:04.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.450+0000 7f980ffff640 1 -- 172.21.15.44:0/1222039966 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9808005520 con 0x7f9808003c10 2024-05-16T23:37:04.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.450+0000 7f980ffff640 1 -- 172.21.15.44:0/1222039966 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f980800bf00 con 0x7f981c0bf050 2024-05-16T23:37:04.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.450+0000 7f9820ce8640 1 --2- 172.21.15.44:0/1222039966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9808004800 0x7f9808004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:37:04.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.450+0000 7f98214e9640 1 --2- 172.21.15.44:0/1222039966 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9808003c10 0x7f9808004060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:37:04.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.450+0000 7f9821cea640 1 --2- 172.21.15.44:0/1222039966 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f981c0bf050 0x7f980800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:37:04.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.450+0000 7f9820ce8640 1 -- 172.21.15.44:0/1222039966 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f981c0bf050 msgr2=0x7f980800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T23:37:04.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.450+0000 7f9820ce8640 1 --2- 172.21.15.44:0/1222039966 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f981c0bf050 0x7f980800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:37:04.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.450+0000 7f9820ce8640 1 -- 172.21.15.44:0/1222039966 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9808003c10 msgr2=0x7f9808004060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-16T23:37:04.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.450+0000 7f9820ce8640 1 --2- 172.21.15.44:0/1222039966 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9808003c10 0x7f9808004060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:37:04.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.450+0000 7f9820ce8640 1 -- 172.21.15.44:0/1222039966 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9808003520 con 0x7f9808004800 2024-05-16T23:37:04.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.451+0000 7f9820ce8640 1 --2- 172.21.15.44:0/1222039966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9808004800 0x7f9808004c10 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f981c06e3d0 tx=0x7f9808005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0865c8b68353726 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:37:04.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.451+0000 7f980ffff640 1 -- 172.21.15.44:0/1222039966 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9818001520 con 0x7f9808004800 2024-05-16T23:37:04.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.451+0000 7f980ffff640 1 -- 172.21.15.44:0/1222039966 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f98180052f0 con 0x7f9808004800 2024-05-16T23:37:04.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.451+0000 7f980ffff640 1 -- 172.21.15.44:0/1222039966 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f981802ace0 con 0x7f9808004800 2024-05-16T23:37:04.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.452+0000 7f982374d640 1 -- 172.21.15.44:0/1222039966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9808004800 msgr2=0x7f9808004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:37:04.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.452+0000 7f982374d640 1 --2- 172.21.15.44:0/1222039966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9808004800 0x7f9808004c10 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f981c06e3d0 tx=0x7f9808005830 comp rx=0 tx=0).stop 2024-05-16T23:37:04.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.452+0000 7f9821cea640 1 -- 172.21.15.44:0/1222039966 reap_dead start 2024-05-16T23:37:04.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.452+0000 7f982374d640 1 -- 172.21.15.44:0/1222039966 shutdown_connections 2024-05-16T23:37:04.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.452+0000 7f982374d640 1 -- 172.21.15.44:0/1222039966 >> 172.21.15.44:0/1222039966 conn(0x7f981c0c3d20 msgr2=0x7f981c0c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T23:37:04.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.452+0000 7f982374d640 1 -- 172.21.15.44:0/1222039966 shutdown_connections 2024-05-16T23:37:04.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.452+0000 7f982374d640 1 -- 172.21.15.44:0/1222039966 wait complete. 2024-05-16T23:37:04.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.454+0000 7f982374d640 1 Processor -- start 2024-05-16T23:37:04.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.454+0000 7f982374d640 1 -- start start 2024-05-16T23:37:04.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.455+0000 7f982374d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9808004800 0x7f981c1e4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:37:04.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.455+0000 7f982374d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f981c1db290 0x7f981c0b5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:37:04.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.455+0000 7f982374d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f981c0b6240 0x7f981c14f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:37:05.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.455+0000 7f982374d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f981c0a2ed0 con 0x7f9808004800 2024-05-16T23:37:05.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.455+0000 7f982374d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f981c0bdae0 con 0x7f981c0b6240 2024-05-16T23:37:05.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.455+0000 7f982374d640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f981c0a3050 con 0x7f981c1db290 2024-05-16T23:37:05.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.455+0000 7f98214e9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9808004800 0x7f981c1e4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:37:05.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.455+0000 7f98214e9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9808004800 0x7f981c1e4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59674/0 (socket says 172.21.15.44:59674) 2024-05-16T23:37:05.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.455+0000 7f98214e9640 1 -- 172.21.15.44:0/4151040606 learned_addr learned my addr 172.21.15.44:0/4151040606 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-16T23:37:05.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.455+0000 7f9820ce8640 1 --2- 172.21.15.44:0/4151040606 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f981c1db290 0x7f981c0b5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:37:05.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.455+0000 7f9821cea640 1 --2- 172.21.15.44:0/4151040606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f981c0b6240 0x7f981c14f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:37:05.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.455+0000 7f98214e9640 1 -- 172.21.15.44:0/4151040606 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f981c1db290 msgr2=0x7f981c0b5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:37:05.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.455+0000 7f98214e9640 1 --2- 172.21.15.44:0/4151040606 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f981c1db290 0x7f981c0b5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:37:05.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.455+0000 7f98214e9640 1 -- 172.21.15.44:0/4151040606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f981c0b6240 msgr2=0x7f981c14f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:37:05.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.455+0000 7f98214e9640 1 --2- 172.21.15.44:0/4151040606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f981c0b6240 0x7f981c14f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:37:05.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.455+0000 7f98214e9640 1 -- 172.21.15.44:0/4151040606 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f981c0b9f90 con 0x7f9808004800 2024-05-16T23:37:05.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.455+0000 7f9820ce8640 1 --2- 172.21.15.44:0/4151040606 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f981c1db290 0x7f981c0b5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-16T23:37:05.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.455+0000 7f98214e9640 1 --2- 172.21.15.44:0/4151040606 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9808004800 0x7f981c1e4670 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9810001a30 tx=0x7f9810007570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:37:05.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.455+0000 7f980dffb640 1 -- 172.21.15.44:0/4151040606 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f981000f9c0 con 0x7f9808004800 2024-05-16T23:37:05.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.456+0000 7f980dffb640 1 -- 172.21.15.44:0/4151040606 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9810018070 con 0x7f9808004800 2024-05-16T23:37:05.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.456+0000 7f982374d640 1 -- 172.21.15.44:0/4151040606 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f981c1e4bb0 con 0x7f9808004800 2024-05-16T23:37:05.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.456+0000 7f980dffb640 1 -- 172.21.15.44:0/4151040606 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f981000fe00 con 0x7f9808004800 2024-05-16T23:37:05.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.456+0000 7f982374d640 1 -- 172.21.15.44:0/4151040606 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f981c1e7ea0 con 0x7f9808004800 2024-05-16T23:37:05.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.457+0000 7f982374d640 1 -- 172.21.15.44:0/4151040606 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f981c0c1170 con 0x7f9808004800 2024-05-16T23:37:05.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.457+0000 7f980dffb640 1 -- 172.21.15.44:0/4151040606 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f981001d460 con 0x7f9808004800 2024-05-16T23:37:05.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.458+0000 7f980dffb640 1 --2- 172.21.15.44:0/4151040606 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f98000762d0 0x7f98000787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-16T23:37:05.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.458+0000 7f980dffb640 1 -- 172.21.15.44:0/4151040606 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5029+0+0 (secure 0 0 0) 0x7f9810097550 con 0x7f9808004800 2024-05-16T23:37:05.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.458+0000 7f9820ce8640 1 --2- 172.21.15.44:0/4151040606 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f98000762d0 0x7f98000787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-16T23:37:05.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.459+0000 7f9820ce8640 1 --2- 172.21.15.44:0/4151040606 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f98000762d0 0x7f98000787e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9818031000 tx=0x7f981802e000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-16T23:37:05.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.463+0000 7f980dffb640 1 -- 172.21.15.44:0/4151040606 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f981c0c1170 con 0x7f9808004800 2024-05-16T23:37:05.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.691+0000 7f982374d640 1 -- 172.21.15.44:0/4151040606 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f981c050940 con 0x7f9808004800 2024-05-16T23:37:05.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.691+0000 7f980dffb640 1 -- 172.21.15.44:0/4151040606 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+3041 (secure 0 0 0) 0x7f981c06e140 con 0x7f9808004800 2024-05-16T23:37:05.385 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-16T23:37:05.394 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":36,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4954,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2432336323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2432336323},{"type":"v1","addr":"172.21.15.70:6835","nonce":2432336323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4972,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/454770375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":454770375},{"type":"v1","addr":"172.21.15.44:6835","nonce":454770375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5343,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/3310237529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3310237529},{"type":"v1","addr":"172.21.15.44:6834","nonce":3310237529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[]} 2024-05-16T23:37:05.405 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 36 2024-05-16T23:37:05.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.693+0000 7f982374d640 1 -- 172.21.15.44:0/4151040606 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f98000762d0 msgr2=0x7f98000787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:37:05.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.693+0000 7f982374d640 1 --2- 172.21.15.44:0/4151040606 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f98000762d0 0x7f98000787e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9818031000 tx=0x7f981802e000 comp rx=0 tx=0).stop 2024-05-16T23:37:05.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.694+0000 7f982374d640 1 -- 172.21.15.44:0/4151040606 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9808004800 msgr2=0x7f981c1e4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-16T23:37:05.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.694+0000 7f982374d640 1 --2- 172.21.15.44:0/4151040606 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9808004800 0x7f981c1e4670 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9810001a30 tx=0x7f9810007570 comp rx=0 tx=0).stop 2024-05-16T23:37:05.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.694+0000 7f982374d640 1 -- 172.21.15.44:0/4151040606 shutdown_connections 2024-05-16T23:37:05.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.694+0000 7f982374d640 1 --2- 172.21.15.44:0/4151040606 >> [v2:172.21.15.70:6832/4049588098,v1:172.21.15.70:6833/4049588098] conn(0x7f98000762d0 0x7f98000787e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:37:05.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.694+0000 7f982374d640 1 --2- 172.21.15.44:0/4151040606 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f981c1db290 0x7f981c0b5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:37:05.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.694+0000 7f982374d640 1 --2- 172.21.15.44:0/4151040606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f981c0b6240 0x7f981c14f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:37:05.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.694+0000 7f982374d640 1 --2- 172.21.15.44:0/4151040606 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9808004800 0x7f981c1e4670 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-16T23:37:05.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.694+0000 7f982374d640 1 -- 172.21.15.44:0/4151040606 >> 172.21.15.44:0/4151040606 conn(0x7f981c0c3d20 msgr2=0x7f981c0c0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-16T23:37:05.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.694+0000 7f982374d640 1 -- 172.21.15.44:0/4151040606 shutdown_connections 2024-05-16T23:37:05.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-16T23:37:04.694+0000 7f982374d640 1 -- 172.21.15.44:0/4151040606 wait complete. 2024-05-16T23:37:05.573 DEBUG:tasks.cephfs.filesystem:already dead... 2024-05-16T23:37:05.580 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-16T23:37:05.587 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-16T23:37:05.596 INFO:teuthology.orchestra.run:waiting for 300 2024-05-16T23:37:05.605 INFO:tasks.ceph.mds.a:Stopped 2024-05-16T23:37:05.614 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-16T23:37:05.623 INFO:teuthology.orchestra.run:waiting for 300 2024-05-16T23:37:05.658 INFO:tasks.ceph.mds.c:Stopped 2024-05-16T23:37:05.677 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-16T23:37:05.722 INFO:teuthology.orchestra.run:waiting for 300 2024-05-16T23:37:05.731 INFO:tasks.ceph.mds.b:Stopped 2024-05-16T23:37:05.740 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-16T23:37:05.750 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-16T23:37:05.758 INFO:teuthology.orchestra.run:waiting for 300 2024-05-16T23:37:05.789 INFO:tasks.ceph.osd.0:Stopped 2024-05-16T23:37:05.798 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-16T23:37:05.807 INFO:teuthology.orchestra.run:waiting for 300 2024-05-16T23:37:05.867 INFO:tasks.ceph.osd.1:Stopped 2024-05-16T23:37:05.883 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-16T23:37:05.894 INFO:teuthology.orchestra.run:waiting for 300 2024-05-16T23:37:05.940 INFO:tasks.ceph.osd.2:Stopped 2024-05-16T23:37:05.959 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-16T23:37:05.967 INFO:teuthology.orchestra.run:waiting for 300 2024-05-16T23:37:06.014 INFO:tasks.ceph.osd.3:Stopped 2024-05-16T23:37:06.024 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-16T23:37:06.068 INFO:teuthology.orchestra.run:waiting for 300 2024-05-16T23:37:06.143 INFO:tasks.ceph.osd.4:Stopped 2024-05-16T23:37:06.152 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-16T23:37:06.161 INFO:teuthology.orchestra.run:waiting for 300 2024-05-16T23:37:06.218 INFO:tasks.ceph.osd.5:Stopped 2024-05-16T23:37:06.228 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-16T23:37:06.252 INFO:teuthology.orchestra.run:waiting for 300 2024-05-16T23:37:06.296 INFO:tasks.ceph.osd.6:Stopped 2024-05-16T23:37:06.304 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-16T23:37:06.314 INFO:teuthology.orchestra.run:waiting for 300 2024-05-16T23:37:06.368 INFO:tasks.ceph.osd.7:Stopped 2024-05-16T23:37:06.376 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-16T23:37:06.385 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-16T23:37:06.393 INFO:teuthology.orchestra.run:waiting for 300 2024-05-16T23:37:06.414 INFO:tasks.ceph.mgr.y:Stopped 2024-05-16T23:37:06.423 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-16T23:37:06.431 INFO:teuthology.orchestra.run:waiting for 300 2024-05-16T23:37:06.454 INFO:tasks.ceph.mgr.x:Stopped 2024-05-16T23:37:06.514 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-16T23:37:06.523 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-16T23:37:06.531 INFO:teuthology.orchestra.run:waiting for 300 2024-05-16T23:37:06.540 INFO:tasks.ceph.mon.a:Stopped 2024-05-16T23:37:06.549 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-16T23:37:06.576 INFO:teuthology.orchestra.run:waiting for 300 2024-05-16T23:37:06.586 INFO:tasks.ceph.mon.b:Stopped 2024-05-16T23:37:06.595 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-16T23:37:06.605 INFO:teuthology.orchestra.run:waiting for 300 2024-05-16T23:37:06.642 INFO:tasks.ceph.mon.c:Stopped 2024-05-16T23:37:06.648 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-16T23:37:06.657 DEBUG:teuthology.orchestra.run.smithi044:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-05-16T23:37:06.706 INFO:teuthology.orchestra.run.smithi044.stdout:2024-05-16T22:35:15.111980+0000 mds.a (mds.0) 1 : cluster [ERR] bad backtrace on directory inode 0x10000000001 2024-05-16T23:37:06.718 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2024-05-16T23:37:06.727 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi044.front.sepia.ceph.com 2024-05-16T23:37:06.736 DEBUG:teuthology.orchestra.run.smithi044:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-16T23:37:06.914 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi044.front.sepia.ceph.com 2024-05-16T23:37:06.942 DEBUG:teuthology.orchestra.run.smithi044:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-16T23:37:07.012 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi044.front.sepia.ceph.com 2024-05-16T23:37:07.022 DEBUG:teuthology.orchestra.run.smithi044:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-16T23:37:07.095 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi044.front.sepia.ceph.com 2024-05-16T23:37:07.105 DEBUG:teuthology.orchestra.run.smithi044:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-16T23:37:07.169 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi070.front.sepia.ceph.com 2024-05-16T23:37:07.178 DEBUG:teuthology.orchestra.run.smithi070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-16T23:37:07.304 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi070.front.sepia.ceph.com 2024-05-16T23:37:07.314 DEBUG:teuthology.orchestra.run.smithi070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-16T23:37:07.392 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi070.front.sepia.ceph.com 2024-05-16T23:37:07.402 DEBUG:teuthology.orchestra.run.smithi070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-16T23:37:07.472 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi070.front.sepia.ceph.com 2024-05-16T23:37:07.482 DEBUG:teuthology.orchestra.run.smithi070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-16T23:37:07.541 INFO:tasks.ceph:Archiving mon data... 2024-05-16T23:37:07.562 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-05-16_22:05:38-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7709888/data/mon.a.tgz 2024-05-16T23:37:07.572 DEBUG:teuthology.orchestra.run.smithi044:> mktemp 2024-05-16T23:37:07.622 INFO:teuthology.orchestra.run.smithi044.stdout:/tmp/tmp.bQ2LS5N2Qk 2024-05-16T23:37:07.679 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.bQ2LS5N2Qk 2024-05-16T23:37:07.773 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0666 /tmp/tmp.bQ2LS5N2Qk 2024-05-16T23:37:07.867 DEBUG:teuthology.orchestra.remote:smithi044:/tmp/tmp.bQ2LS5N2Qk is 247KB 2024-05-16T23:37:07.944 DEBUG:teuthology.orchestra.run.smithi044:> rm -fr /tmp/tmp.bQ2LS5N2Qk 2024-05-16T23:37:07.967 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-05-16_22:05:38-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7709888/data/mon.b.tgz 2024-05-16T23:37:07.985 DEBUG:teuthology.orchestra.run.smithi070:> mktemp 2024-05-16T23:37:08.012 INFO:teuthology.orchestra.run.smithi070.stdout:/tmp/tmp.XUIsg3Lt98 2024-05-16T23:37:08.022 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.XUIsg3Lt98 2024-05-16T23:37:08.146 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0666 /tmp/tmp.XUIsg3Lt98 2024-05-16T23:37:08.239 DEBUG:teuthology.orchestra.remote:smithi070:/tmp/tmp.XUIsg3Lt98 is 252KB 2024-05-16T23:37:08.316 DEBUG:teuthology.orchestra.run.smithi070:> rm -fr /tmp/tmp.XUIsg3Lt98 2024-05-16T23:37:08.340 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-05-16_22:05:38-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7709888/data/mon.c.tgz 2024-05-16T23:37:08.349 DEBUG:teuthology.orchestra.run.smithi070:> mktemp 2024-05-16T23:37:08.394 INFO:teuthology.orchestra.run.smithi070.stdout:/tmp/tmp.mnqiwQsVG6 2024-05-16T23:37:08.422 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.mnqiwQsVG6 2024-05-16T23:37:08.501 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0666 /tmp/tmp.mnqiwQsVG6 2024-05-16T23:37:08.593 DEBUG:teuthology.orchestra.remote:smithi070:/tmp/tmp.mnqiwQsVG6 is 251KB 2024-05-16T23:37:08.683 DEBUG:teuthology.orchestra.run.smithi070:> rm -fr /tmp/tmp.mnqiwQsVG6 2024-05-16T23:37:08.707 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-16T23:37:08.714 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-16T23:37:08.725 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-16T23:37:08.749 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-16T23:37:08.886 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-16T23:37:08.907 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-16T23:37:08.974 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-16T23:37:08.983 INFO:tasks.ceph:Archiving crash dumps... 2024-05-16T23:37:08.994 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-05-16_22:05:38-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7709888/remote/smithi044/crash 2024-05-16T23:37:09.003 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-16T23:37:09.041 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-05-16_22:05:38-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7709888/remote/smithi070/crash 2024-05-16T23:37:09.051 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-16T23:37:09.084 DEBUG:teuthology.misc:Transferring archived files from smithi196:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-05-16_22:05:38-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7709888/remote/smithi196/crash 2024-05-16T23:37:09.092 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-16T23:37:09.210 INFO:tasks.ceph:Shutting down logrotate 2024-05-16T23:37:09.227 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:37:09.292 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:37:09.305 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-16T23:37:09.475 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-16T23:37:09.513 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-16T23:37:09.546 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-16T23:37:09.644 INFO:tasks.ceph:Compressing logs... 2024-05-16T23:37:09.651 DEBUG:teuthology.orchestra.run.smithi044:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-16T23:37:09.660 DEBUG:teuthology.orchestra.run.smithi070:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-16T23:37:09.671 DEBUG:teuthology.orchestra.run.smithi196:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-16T23:37:09.686 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50205.log 2024-05-16T23:37:09.713 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-16T23:37:09.719 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-16T23:37:09.728 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37588.log 2024-05-16T23:37:09.736 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-05-16T23:37:09.743 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.37588.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-05-16T23:37:09.765 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-osd.7.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37588.log.gz 2024-05-16T23:37:09.785 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-05-16T23:37:09.849 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37708.log 2024-05-16T23:37:09.859 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-mds.b.log: /var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-05-16T23:37:09.868 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.37708.log: gzip 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-16T23:37:09.878 INFO:teuthology.orchestra.run.smithi070.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.37668.log 2024-05-16T23:37:09.886 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-osd.4.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37708.log.gz 2024-05-16T23:37:09.896 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37628.log 2024-05-16T23:37:09.904 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.37668.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37668.log.gz 2024-05-16T23:37:09.913 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-05-16T23:37:09.922 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.37628.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-05-16T23:37:09.931 INFO:teuthology.orchestra.run.smithi070.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37628.log.gz 2024-05-16T23:37:09.939 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37457.log 2024-05-16T23:37:09.947 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-05-16T23:37:09.956 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.37457.log: /var/log/ceph/ceph-mon.c.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37457.log.gz 2024-05-16T23:37:09.964 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37748.log 2024-05-16T23:37:09.973 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-osd.6.log: 94.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-16T23:37:09.981 INFO:teuthology.orchestra.run.smithi070.stderr: 94.1% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-05-16T23:37:09.998 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37537.log 2024-05-16T23:37:10.034 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.37748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37497.log 2024-05-16T23:37:10.043 INFO:teuthology.orchestra.run.smithi070.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37748.log.gz 2024-05-16T23:37:10.056 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.37537.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-05-16T23:37:10.114 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.37497.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37537.log.gz 2024-05-16T23:37:10.122 INFO:teuthology.orchestra.run.smithi070.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.37497.log.gz 2024-05-16T23:37:10.135 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31990.log 2024-05-16T23:37:10.143 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31232.log 2024-05-16T23:37:10.150 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.31990.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.31990.log.gz 2024-05-16T23:37:10.158 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30761.log 2024-05-16T23:37:10.166 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.31232.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.31232.log.gz 2024-05-16T23:37:10.174 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31236.log 2024-05-16T23:37:10.182 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.30761.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.30761.log.gz 2024-05-16T23:37:10.191 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30780.log 2024-05-16T23:37:10.199 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.31236.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.31236.log.gz 2024-05-16T23:37:10.208 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31986.log 2024-05-16T23:37:10.236 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.30780.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.30780.log.gz 2024-05-16T23:37:10.270 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.0.31986.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.31986.log.gz 2024-05-16T23:37:10.306 INFO:teuthology.orchestra.run.smithi196.stderr: 2024-05-16T23:37:10.314 INFO:teuthology.orchestra.run.smithi196.stderr:real 0m0.040s 2024-05-16T23:37:10.323 INFO:teuthology.orchestra.run.smithi196.stderr:user 0m0.015s 2024-05-16T23:37:10.332 INFO:teuthology.orchestra.run.smithi196.stderr:sys 0m0.062s 2024-05-16T23:37:10.350 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-mon.b.log: 91.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-16T23:37:10.387 INFO:teuthology.orchestra.run.smithi070.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-05-16T23:37:10.433 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44769.log 2024-05-16T23:37:10.476 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49414.log 2024-05-16T23:37:10.484 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44769.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50205.log.gz 2024-05-16T23:37:10.492 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49996.log 2024-05-16T23:37:10.500 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49414.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44769.log.gz 2024-05-16T23:37:10.508 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49306.log 2024-05-16T23:37:10.516 INFO:teuthology.orchestra.run.smithi044.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49414.log.gz 2024-05-16T23:37:10.525 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43730.log 2024-05-16T23:37:10.533 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49996.log.gz 2024-05-16T23:37:10.553 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46122.log 2024-05-16T23:37:10.615 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49306.log.gz 2024-05-16T23:37:10.624 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.43730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49348.log 2024-05-16T23:37:10.632 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46122.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43730.log.gz 2024-05-16T23:37:10.641 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46825.log 2024-05-16T23:37:10.649 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46122.log.gz 2024-05-16T23:37:10.668 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44183.log 2024-05-16T23:37:10.677 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44446.log 2024-05-16T23:37:10.686 INFO:teuthology.orchestra.run.smithi044.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.49348.log.gz 2024-05-16T23:37:10.694 INFO:teuthology.orchestra.run.smithi044.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46825.log.gz 2024-05-16T23:37:10.702 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5/var/log/ceph/ceph-client.admin.44183.log: --verbose -- /var/log/ceph/ceph-client.admin.49474.log 2024-05-16T23:37:10.720 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44183.log.gz 2024-05-16T23:37:10.727 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37796.log 2024-05-16T23:37:10.734 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49474.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44446.log.gz 2024-05-16T23:37:10.742 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48502.log 2024-05-16T23:37:10.749 INFO:teuthology.orchestra.run.smithi044.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49474.log.gz 2024-05-16T23:37:10.757 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.37796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48253.log 2024-05-16T23:37:10.769 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37796.log.gz 2024-05-16T23:37:10.797 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50121.log 2024-05-16T23:37:10.803 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48253.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48502.log.gz 2024-05-16T23:37:10.810 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48295.log 2024-05-16T23:37:10.817 INFO:teuthology.orchestra.run.smithi044.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48253.log.gz 2024-05-16T23:37:10.824 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48855.log 2024-05-16T23:37:10.838 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48295.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50121.log.gz 2024-05-16T23:37:10.845 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-16T23:37:10.853 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48295.log.gz 2024-05-16T23:37:10.860 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45113.log 2024-05-16T23:37:10.867 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48855.log.gz 2024-05-16T23:37:10.874 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44443.log 2024-05-16T23:37:10.881 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52965.log 2024-05-16T23:37:10.888 INFO:teuthology.orchestra.run.smithi044.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45113.log.gz 2024-05-16T23:37:10.895 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45359.log 2024-05-16T23:37:10.903 INFO:teuthology.orchestra.run.smithi044.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44443.log.gz/var/log/ceph/ceph-client.admin.52965.log: 2024-05-16T23:37:10.909 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50579.log 2024-05-16T23:37:10.928 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45359.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52965.log.gz 2024-05-16T23:37:10.967 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-16T23:37:11.140 INFO:teuthology.orchestra.run.smithi044.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45359.log.gz 2024-05-16T23:37:11.154 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44057.log 2024-05-16T23:37:11.177 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50579.log.gz 2024-05-16T23:37:11.189 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44449.log 2024-05-16T23:37:11.253 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50537.log 2024-05-16T23:37:11.261 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44449.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44057.log.gz 2024-05-16T23:37:11.274 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53637.log 2024-05-16T23:37:11.282 INFO:teuthology.orchestra.run.smithi044.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44449.log.gz 2024-05-16T23:37:11.297 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37693.log 2024-05-16T23:37:11.307 INFO:teuthology.orchestra.run.smithi044.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50537.log.gz 2024-05-16T23:37:11.316 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.53637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47448.log 2024-05-16T23:37:11.325 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53637.log.gz 2024-05-16T23:37:11.333 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45569.log 2024-05-16T23:37:11.342 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.37693.log: /var/log/ceph/ceph-client.admin.47448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48006.log 2024-05-16T23:37:11.351 INFO:teuthology.orchestra.run.smithi044.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.37693.log.gz 2024-05-16T23:37:11.395 INFO:teuthology.orchestra.run.smithi044.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47448.log.gz 2024-05-16T23:37:11.457 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45569.log: 90.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-16T23:37:11.466 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-16T23:37:11.474 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45569.log.gz 2024-05-16T23:37:11.484 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53175.log 2024-05-16T23:37:11.491 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48006.log: /var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44440.log 2024-05-16T23:37:11.517 INFO:teuthology.orchestra.run.smithi044.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48006.log.gz 2024-05-16T23:37:11.525 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.53175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46657.log 2024-05-16T23:37:11.535 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44440.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53175.log.gz 2024-05-16T23:37:11.548 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43520.log 2024-05-16T23:37:11.557 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44440.log.gz 2024-05-16T23:37:11.566 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45118.log 2024-05-16T23:37:11.575 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46657.log: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-16T23:37:11.583 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.43520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47280.log 2024-05-16T23:37:11.592 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46657.log.gz 2024-05-16T23:37:11.601 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43520.log.gz 2024-05-16T23:37:11.609 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44267.log 2024-05-16T23:37:11.628 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45118.log.gz 2024-05-16T23:37:11.669 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47754.log 2024-05-16T23:37:11.678 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47280.log.gz 2024-05-16T23:37:11.687 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47154.log 2024-05-16T23:37:11.695 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47754.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44267.log.gzgzip 2024-05-16T23:37:11.704 INFO:teuthology.orchestra.run.smithi044.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50079.log 2024-05-16T23:37:11.724 INFO:teuthology.orchestra.run.smithi044.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47754.log.gz 2024-05-16T23:37:11.733 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50392.log 2024-05-16T23:37:11.741 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47154.log.gz 2024-05-16T23:37:11.757 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47094.log 2024-05-16T23:37:11.766 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50392.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50079.log.gz 2024-05-16T23:37:11.774 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43424.log 2024-05-16T23:37:11.783 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50392.log.gz 2024-05-16T23:37:11.792 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46393.log 2024-05-16T23:37:11.800 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47094.log.gz 2024-05-16T23:37:11.809 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.43424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46867.log 2024-05-16T23:37:11.817 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46393.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43424.log.gz 2024-05-16T23:37:11.848 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43774.log 2024-05-16T23:37:11.875 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46393.log.gz 2024-05-16T23:37:11.884 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46867.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-16T23:37:11.893 INFO:teuthology.orchestra.run.smithi044.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46867.log.gz 2024-05-16T23:37:11.902 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.43774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48952.log 2024-05-16T23:37:11.911 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-osd.3.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43774.log.gz 2024-05-16T23:37:11.931 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44099.log 2024-05-16T23:37:11.940 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53821.log 2024-05-16T23:37:11.948 INFO:teuthology.orchestra.run.smithi044.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48952.log.gz 2024-05-16T23:37:11.956 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49680.log 2024-05-16T23:37:11.965 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.53821.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44099.log.gz 2024-05-16T23:37:11.973 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50308.log 2024-05-16T23:37:11.982 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53821.log.gz 2024-05-16T23:37:11.989 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48665.log 2024-05-16T23:37:11.996 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45443.log 2024-05-16T23:37:12.003 INFO:teuthology.orchestra.run.smithi044.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.49680.log.gz 2024-05-16T23:37:12.011 INFO:teuthology.orchestra.run.smithi044.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50308.log.gz 2024-05-16T23:37:12.029 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53679.log 2024-05-16T23:37:12.070 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47196.log 2024-05-16T23:37:12.078 INFO:teuthology.orchestra.run.smithi044.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48665.log.gz 2024-05-16T23:37:12.086 INFO:teuthology.orchestra.run.smithi044.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45443.log.gz 2024-05-16T23:37:12.093 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.53679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45929.log 2024-05-16T23:37:12.100 INFO:teuthology.orchestra.run.smithi044.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53679.log.gz 2024-05-16T23:37:12.131 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49747.log 2024-05-16T23:37:12.139 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47196.log: /var/log/ceph/ceph-client.admin.45929.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47196.log.gz 2024-05-16T23:37:12.147 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45121.log 2024-05-16T23:37:12.154 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45929.log.gz 2024-05-16T23:37:12.162 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.49747.log: /var/log/ceph/ceph-mds.c.log 2024-05-16T23:37:12.169 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53343.log 2024-05-16T23:37:12.177 INFO:teuthology.orchestra.run.smithi044.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49747.log.gz 2024-05-16T23:37:12.184 INFO:teuthology.orchestra.run.smithi044.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45121.log.gz 2024-05-16T23:37:12.192 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48811.log 2024-05-16T23:37:12.200 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.53343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52923.log 2024-05-16T23:37:12.207 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48811.log: gzip 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53343.log.gz 2024-05-16T23:37:12.237 INFO:teuthology.orchestra.run.smithi044.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44781.log 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48811.log.gz 2024-05-16T23:37:12.301 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-05-16T23:37:12.317 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.52923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45001.log 2024-05-16T23:37:12.325 INFO:teuthology.orchestra.run.smithi044.stderr: 87.3%/var/log/ceph/ceph-client.admin.44781.log: -- replaced with /var/log/ceph/ceph-client.admin.52923.log.gz 2024-05-16T23:37:12.332 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46080.log 2024-05-16T23:37:12.339 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44781.log.gz 2024-05-16T23:37:12.356 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45001.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-16T23:37:12.363 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46080.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45001.log.gz 2024-05-16T23:37:12.370 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-05-16T23:37:12.376 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46080.log.gz 2024-05-16T23:37:12.382 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44447.log 2024-05-16T23:37:12.389 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-16T23:37:12.397 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45719.log 2024-05-16T23:37:12.404 INFO:teuthology.orchestra.run.smithi044.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44447.log.gz 2024-05-16T23:37:12.410 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44141.log 2024-05-16T23:37:12.419 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48421.log 2024-05-16T23:37:12.425 INFO:teuthology.orchestra.run.smithi044.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45719.log.gz 2024-05-16T23:37:12.446 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44141.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44141.log.gz 2024-05-16T23:37:12.488 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43955.log 2024-05-16T23:37:12.495 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47039.log 2024-05-16T23:37:12.503 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.43955.log: /var/log/ceph/ceph-client.admin.48421.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48421.log.gz 2024-05-16T23:37:12.512 INFO:teuthology.orchestra.run.smithi044.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43955.log.gz 2024-05-16T23:37:12.519 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48749.log 2024-05-16T23:37:12.540 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50453.log 2024-05-16T23:37:12.547 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48749.log: /var/log/ceph/ceph-client.admin.47039.log: 89.3% 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47039.log.gz 2024-05-16T23:37:12.556 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48749.log.gz 2024-05-16T23:37:12.565 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53133.log 2024-05-16T23:37:12.574 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49222.log 2024-05-16T23:37:12.582 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.53133.log: /var/log/ceph/ceph-client.admin.50453.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50453.log.gz 2024-05-16T23:37:12.590 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53133.log.gz 2024-05-16T23:37:12.599 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53385.log 2024-05-16T23:37:12.608 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46332.log 2024-05-16T23:37:12.617 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49222.log: /var/log/ceph/ceph-client.admin.53385.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49222.log.gz 2024-05-16T23:37:12.625 INFO:teuthology.orchestra.run.smithi044.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53385.log.gz 2024-05-16T23:37:12.638 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46206.log 2024-05-16T23:37:12.669 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46332.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46332.log.gz 2024-05-16T23:37:12.679 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50163.log 2024-05-16T23:37:12.688 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48707.log 2024-05-16T23:37:12.698 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50163.log: /var/log/ceph/ceph-client.admin.46206.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46206.log.gz 2024-05-16T23:37:12.706 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50163.log.gz 2024-05-16T23:37:12.723 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46248.log 2024-05-16T23:37:12.732 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49888.log 2024-05-16T23:37:12.741 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48707.log: /var/log/ceph/ceph-client.admin.46248.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48707.log.gz 2024-05-16T23:37:12.750 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46248.log.gz 2024-05-16T23:37:12.758 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53511.log 2024-05-16T23:37:12.767 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49888.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.49888.log.gz 2024-05-16T23:37:12.777 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47534.log 2024-05-16T23:37:12.785 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48085.log 2024-05-16T23:37:12.794 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47534.log: /var/log/ceph/ceph-client.admin.53511.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53511.log.gz 2024-05-16T23:37:12.803 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47796.log 2024-05-16T23:37:12.812 INFO:teuthology.orchestra.run.smithi044.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.47534.log.gz 2024-05-16T23:37:12.829 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48085.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48085.log.gz 2024-05-16T23:37:12.868 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46995.log 2024-05-16T23:37:12.879 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53553.log 2024-05-16T23:37:12.888 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46995.log: /var/log/ceph/ceph-client.admin.47796.log: 87.9% 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47796.log.gz 2024-05-16T23:37:12.897 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46995.log.gz 2024-05-16T23:37:12.905 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43909.log 2024-05-16T23:37:12.933 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44783.log 2024-05-16T23:37:12.942 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.53553.log: /var/log/ceph/ceph-client.admin.43909.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53553.log.gz 2024-05-16T23:37:12.950 INFO:teuthology.orchestra.run.smithi044.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43909.log.gz 2024-05-16T23:37:12.960 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45611.log 2024-05-16T23:37:12.974 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44783.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44783.log.gz 2024-05-16T23:37:12.984 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-16T23:37:12.993 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46595.log 2024-05-16T23:37:13.002 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45611.log: /var/log/ceph/ceph-mon.a.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.45611.log.gz 2024-05-16T23:37:13.011 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52881.log 2024-05-16T23:37:13.020 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46595.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46595.log.gz 2024-05-16T23:37:13.029 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47922.log 2024-05-16T23:37:13.046 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.52881.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52881.log.gz 2024-05-16T23:37:13.099 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46164.log 2024-05-16T23:37:13.108 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47922.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47922.log.gz 2024-05-16T23:37:13.117 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.31577.log 2024-05-16T23:37:13.125 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46164.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46164.log.gz 2024-05-16T23:37:13.134 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48910.log 2024-05-16T23:37:13.158 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph.tmp-client.admin.31577.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.31577.log.gz 2024-05-16T23:37:13.169 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46741.log 2024-05-16T23:37:13.177 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48910.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48910.log.gz 2024-05-16T23:37:13.186 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48169.log 2024-05-16T23:37:13.195 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46741.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46741.log.gz 2024-05-16T23:37:13.204 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50621.log 2024-05-16T23:37:13.213 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48169.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48169.log.gz 2024-05-16T23:37:13.221 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47630.log 2024-05-16T23:37:13.229 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50621.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50621.log.gz 2024-05-16T23:37:13.238 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47491.log 2024-05-16T23:37:13.248 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47630.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47630.log.gz 2024-05-16T23:37:13.271 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43644.log 2024-05-16T23:37:13.303 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47491.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47491.log.gz 2024-05-16T23:37:13.313 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49954.log 2024-05-16T23:37:13.321 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.43644.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43644.log.gz 2024-05-16T23:37:13.329 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44444.log 2024-05-16T23:37:13.338 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49954.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49954.log.gz 2024-05-16T23:37:13.366 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47406.log 2024-05-16T23:37:13.375 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44444.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44444.log.gz 2024-05-16T23:37:13.383 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44768.log 2024-05-16T23:37:13.392 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47406.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47406.log.gz 2024-05-16T23:37:13.401 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46951.log 2024-05-16T23:37:13.410 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44768.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44768.log.gz 2024-05-16T23:37:13.424 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48337.log 2024-05-16T23:37:13.432 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46951.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46951.log.gz 2024-05-16T23:37:13.438 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50495.log 2024-05-16T23:37:13.445 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48337.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48337.log.gz 2024-05-16T23:37:13.452 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47364.log 2024-05-16T23:37:13.472 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50495.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50495.log.gz 2024-05-16T23:37:13.506 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37429.log 2024-05-16T23:37:13.520 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47364.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47364.log.gz 2024-05-16T23:37:13.528 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44782.log 2024-05-16T23:37:13.534 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.37429.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37429.log.gz 2024-05-16T23:37:13.542 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49036.log 2024-05-16T23:37:13.567 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44782.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44782.log.gz 2024-05-16T23:37:13.575 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53259.log 2024-05-16T23:37:13.588 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49036.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49036.log.gz 2024-05-16T23:37:13.597 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45485.log 2024-05-16T23:37:13.604 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.53259.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53259.log.gz 2024-05-16T23:37:13.611 INFO:teuthology.orchestra.run.smithi044.stderr: 95.1% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-05-16T23:37:13.618 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49078.log 2024-05-16T23:37:13.627 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48621.log 2024-05-16T23:37:13.634 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45485.log: /var/log/ceph/ceph-client.admin.49078.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45485.log.gz 2024-05-16T23:37:13.641 INFO:teuthology.orchestra.run.smithi044.stderr: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45677.log 2024-05-16T23:37:13.648 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49078.log.gz 2024-05-16T23:37:13.666 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48621.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48621.log.gz 2024-05-16T23:37:13.703 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43602.log 2024-05-16T23:37:13.710 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45119.log 2024-05-16T23:37:13.718 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45677.log: /var/log/ceph/ceph-client.admin.43602.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45677.log.gz 2024-05-16T23:37:13.726 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43602.log.gzgzip 2024-05-16T23:37:13.733 INFO:teuthology.orchestra.run.smithi044.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45996.log 2024-05-16T23:37:13.751 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45119.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45119.log.gz 2024-05-16T23:37:13.758 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46909.log 2024-05-16T23:37:13.765 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44445.log 2024-05-16T23:37:13.773 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45996.log: /var/log/ceph/ceph-client.admin.46909.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45996.log.gz 2024-05-16T23:37:13.780 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46909.log.gz 2024-05-16T23:37:13.788 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45120.log 2024-05-16T23:37:13.796 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44785.log 2024-05-16T23:37:13.803 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44445.log: /var/log/ceph/ceph-client.admin.45120.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44445.log.gz 2024-05-16T23:37:13.810 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45120.log.gz 2024-05-16T23:37:13.817 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45527.log 2024-05-16T23:37:13.824 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44780.log 2024-05-16T23:37:13.860 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44785.log: /var/log/ceph/ceph-client.admin.45527.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44785.log.gz 2024-05-16T23:37:13.889 INFO:teuthology.orchestra.run.smithi044.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45527.log.gz 2024-05-16T23:37:13.897 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49800.log 2024-05-16T23:37:13.904 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44780.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44780.log.gz 2024-05-16T23:37:13.911 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53781.log 2024-05-16T23:37:13.919 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44784.log 2024-05-16T23:37:13.934 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49800.log: /var/log/ceph/ceph-client.admin.53781.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49800.log.gz 2024-05-16T23:37:13.943 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53781.log.gz 2024-05-16T23:37:13.951 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47838.log 2024-05-16T23:37:13.959 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44784.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44784.log.gz 2024-05-16T23:37:13.968 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46699.log 2024-05-16T23:37:13.977 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53863.log 2024-05-16T23:37:13.986 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47838.log: /var/log/ceph/ceph-client.admin.46699.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47838.log.gz 2024-05-16T23:37:13.994 INFO:teuthology.orchestra.run.smithi044.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46699.log.gz 2024-05-16T23:37:14.004 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46515.log 2024-05-16T23:37:14.012 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.53863.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53863.log.gz 2024-05-16T23:37:14.021 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53721.log 2024-05-16T23:37:14.041 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44015.log 2024-05-16T23:37:14.086 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46515.log: /var/log/ceph/ceph-client.admin.53721.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46515.log.gz 2024-05-16T23:37:14.095 INFO:teuthology.orchestra.run.smithi044.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53721.log.gz 2024-05-16T23:37:14.102 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53301.log 2024-05-16T23:37:14.111 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44015.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44015.log.gz 2024-05-16T23:37:14.120 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48127.log 2024-05-16T23:37:14.143 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43343.log 2024-05-16T23:37:14.152 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.53301.log: /var/log/ceph/ceph-client.admin.48127.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53301.log.gz 2024-05-16T23:37:14.161 INFO:teuthology.orchestra.run.smithi044.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48127.log.gz 2024-05-16T23:37:14.169 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46783.log 2024-05-16T23:37:14.178 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.43343.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43343.log.gz 2024-05-16T23:37:14.190 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50266.log 2024-05-16T23:37:14.204 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45887.log 2024-05-16T23:37:14.213 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46783.log: /var/log/ceph/ceph-client.admin.50266.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46783.log.gz 2024-05-16T23:37:14.222 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50266.log.gz 2024-05-16T23:37:14.231 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49620.log 2024-05-16T23:37:14.239 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45887.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45887.log.gz 2024-05-16T23:37:14.258 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43867.log 2024-05-16T23:37:14.338 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44448.log 2024-05-16T23:37:14.348 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49620.log: /var/log/ceph/ceph-client.admin.43867.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43867.log.gz 2024-05-16T23:37:14.357 INFO:teuthology.orchestra.run.smithi044.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.49620.log.gz 2024-05-16T23:37:14.366 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49516.log 2024-05-16T23:37:14.375 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53217.log 2024-05-16T23:37:14.393 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44448.log: /var/log/ceph/ceph-client.admin.49516.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44448.log.gz 2024-05-16T23:37:14.402 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49516.log.gz 2024-05-16T23:37:14.410 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46290.log 2024-05-16T23:37:14.419 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45401.log 2024-05-16T23:37:14.428 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.53217.log: /var/log/ceph/ceph-client.admin.46290.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53217.log.gz 2024-05-16T23:37:14.437 INFO:teuthology.orchestra.run.smithi044.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46290.log.gz 2024-05-16T23:37:14.446 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53091.log 2024-05-16T23:37:14.454 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45401.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45401.log.gz 2024-05-16T23:37:14.465 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49264.log 2024-05-16T23:37:14.474 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49846.log 2024-05-16T23:37:14.483 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.53091.log: /var/log/ceph/ceph-client.admin.49264.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53091.log.gz 2024-05-16T23:37:14.500 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49264.log.gz 2024-05-16T23:37:14.585 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53469.log 2024-05-16T23:37:14.615 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49120.log 2024-05-16T23:37:14.628 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49846.log: /var/log/ceph/ceph-client.admin.53469.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49846.log.gz 2024-05-16T23:37:14.636 INFO:teuthology.orchestra.run.smithi044.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53469.log.gz 2024-05-16T23:37:14.645 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-05-16T23:37:14.677 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49120.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49120.log.gz 2024-05-16T23:37:14.686 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47712.log 2024-05-16T23:37:14.695 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47880.log 2024-05-16T23:37:14.704 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.47712.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47712.log.gz 2024-05-16T23:37:14.712 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50350.log 2024-05-16T23:37:14.721 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47880.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47880.log.gz 2024-05-16T23:37:14.730 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45761.log 2024-05-16T23:37:14.739 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50350.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50350.log.gz 2024-05-16T23:37:14.748 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46435.log 2024-05-16T23:37:14.757 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45761.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45761.log.gz 2024-05-16T23:37:14.765 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48211.log 2024-05-16T23:37:14.792 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46435.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46435.log.gz 2024-05-16T23:37:14.834 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45115.log 2024-05-16T23:37:14.843 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48211.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48211.log.gz 2024-05-16T23:37:14.852 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53595.log 2024-05-16T23:37:14.861 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45115.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45115.log.gz 2024-05-16T23:37:14.870 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46038.log 2024-05-16T23:37:14.886 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.53595.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53595.log.gz 2024-05-16T23:37:14.898 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49578.log 2024-05-16T23:37:14.906 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46038.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46038.log.gz 2024-05-16T23:37:14.925 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53049.log 2024-05-16T23:37:14.957 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49578.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49578.log.gz 2024-05-16T23:37:14.967 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44225.log 2024-05-16T23:37:14.976 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.53049.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53049.log.gz 2024-05-16T23:37:14.983 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43825.log 2024-05-16T23:37:14.990 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44225.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44225.log.gz 2024-05-16T23:37:14.998 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47238.log 2024-05-16T23:37:15.005 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.43825.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43825.log.gz 2024-05-16T23:37:15.034 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45317.log 2024-05-16T23:37:15.082 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47238.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47238.log.gz 2024-05-16T23:37:15.090 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48379.log 2024-05-16T23:37:15.098 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45317.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45317.log.gz 2024-05-16T23:37:15.105 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45000.log 2024-05-16T23:37:15.112 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48379.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48379.log.gz 2024-05-16T23:37:15.139 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53007.log 2024-05-16T23:37:15.148 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45000.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45000.log.gz 2024-05-16T23:37:15.155 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53427.log 2024-05-16T23:37:15.162 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.53007.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53007.log.gz 2024-05-16T23:37:15.170 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43686.log 2024-05-16T23:37:15.177 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.53427.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53427.log.gz 2024-05-16T23:37:15.185 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45845.log 2024-05-16T23:37:15.192 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.43686.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43686.log.gz 2024-05-16T23:37:15.199 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49180.log 2024-05-16T23:37:15.206 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45845.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45845.log.gz 2024-05-16T23:37:15.213 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48994.log 2024-05-16T23:37:15.242 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49180.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49180.log.gz 2024-05-16T23:37:15.298 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45803.log 2024-05-16T23:37:15.305 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48994.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48994.log.gz 2024-05-16T23:37:15.313 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47322.log 2024-05-16T23:37:15.321 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45803.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45803.log.gz 2024-05-16T23:37:15.328 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47964.log 2024-05-16T23:37:15.345 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47322.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47322.log.gz 2024-05-16T23:37:15.351 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47964.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47964.log.gz 2024-05-16T23:37:15.358 INFO:teuthology.orchestra.run.smithi044.stderr: 93.1% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-05-16T23:37:15.368 INFO:teuthology.orchestra.run.smithi070.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-05-16T23:37:15.375 INFO:teuthology.orchestra.run.smithi070.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-05-16T23:37:15.382 INFO:teuthology.orchestra.run.smithi070.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-05-16T23:37:15.389 INFO:teuthology.orchestra.run.smithi070.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-05-16T23:37:15.396 INFO:teuthology.orchestra.run.smithi070.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-05-16T23:37:15.403 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-05-16T23:37:15.410 INFO:teuthology.orchestra.run.smithi070.stderr:real 0m2.244s 2024-05-16T23:37:15.418 INFO:teuthology.orchestra.run.smithi070.stderr:user 0m10.303s 2024-05-16T23:37:15.434 INFO:teuthology.orchestra.run.smithi070.stderr:sys 0m0.360s 2024-05-16T23:37:15.495 INFO:teuthology.orchestra.run.smithi044.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-16T23:37:15.505 INFO:teuthology.orchestra.run.smithi044.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-16T23:37:15.514 INFO:teuthology.orchestra.run.smithi044.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-16T23:37:15.523 INFO:teuthology.orchestra.run.smithi044.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-16T23:37:15.532 INFO:teuthology.orchestra.run.smithi044.stderr: 90.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-16T23:37:15.545 INFO:teuthology.orchestra.run.smithi044.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-05-16T23:37:15.554 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-05-16T23:37:15.563 INFO:teuthology.orchestra.run.smithi044.stderr:real 0m4.843s 2024-05-16T23:37:15.571 INFO:teuthology.orchestra.run.smithi044.stderr:user 0m15.519s 2024-05-16T23:37:15.580 INFO:teuthology.orchestra.run.smithi044.stderr:sys 0m0.576s 2024-05-16T23:37:15.589 INFO:tasks.ceph:Archiving logs... 2024-05-16T23:37:15.598 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-16_22:05:38-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7709888/remote/smithi044/log 2024-05-16T23:37:15.608 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-16T23:37:17.779 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-16_22:05:38-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7709888/remote/smithi070/log 2024-05-16T23:37:17.785 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-16T23:37:19.124 DEBUG:teuthology.misc:Transferring archived files from smithi196:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-16_22:05:38-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7709888/remote/smithi196/log 2024-05-16T23:37:19.146 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-16T23:37:19.325 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-16T23:37:19.357 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-16T23:37:19.366 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-16T23:37:19.379 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-16T23:37:19.390 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-16T23:37:19.562 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-16T23:37:19.580 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-16T23:37:19.589 DEBUG:teuthology.orchestra.run.smithi044:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-16T23:37:19.601 DEBUG:teuthology.orchestra.run.smithi070:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-16T23:37:19.613 DEBUG:teuthology.orchestra.run.smithi196:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-16T23:37:19.623 INFO:teuthology.orchestra.run.smithi044.stderr:bash: line 1: ntpq: command not found 2024-05-16T23:37:19.632 INFO:teuthology.orchestra.run.smithi044.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-16T23:37:19.641 INFO:teuthology.orchestra.run.smithi044.stdout:=============================================================================== 2024-05-16T23:37:19.649 INFO:teuthology.orchestra.run.smithi044.stdout:^* hv01.front.sepia.ceph.com 3 6 377 43 +800us[ +822us] +/- 41ms 2024-05-16T23:37:19.704 INFO:teuthology.orchestra.run.smithi044.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 45 -1124us[-1102us] +/- 68ms 2024-05-16T23:37:19.771 INFO:teuthology.orchestra.run.smithi044.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 37 +146us[ +146us] +/- 73ms 2024-05-16T23:37:19.780 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-05-16T23:37:19.789 INFO:teuthology.orchestra.run.smithi070.stderr:bash: line 1: ntpq: command not found 2024-05-16T23:37:19.799 INFO:teuthology.orchestra.run.smithi070.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-16T23:37:19.808 INFO:teuthology.orchestra.run.smithi070.stdout:=============================================================================== 2024-05-16T23:37:19.817 INFO:teuthology.orchestra.run.smithi070.stdout:^* hv01.front.sepia.ceph.com 3 6 377 46 +776us[ +782us] +/- 41ms 2024-05-16T23:37:19.826 INFO:teuthology.orchestra.run.smithi070.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 39 -1161us[-1161us] +/- 68ms 2024-05-16T23:37:19.835 INFO:teuthology.orchestra.run.smithi070.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 41 +88us[ +88us] +/- 73ms 2024-05-16T23:37:19.843 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-05-16T23:37:19.852 INFO:teuthology.orchestra.run.smithi196.stderr:bash: line 1: ntpq: command not found 2024-05-16T23:37:19.862 INFO:teuthology.orchestra.run.smithi196.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-16T23:37:19.870 INFO:teuthology.orchestra.run.smithi196.stdout:=============================================================================== 2024-05-16T23:37:19.879 INFO:teuthology.orchestra.run.smithi196.stdout:^* hv01.front.sepia.ceph.com 3 6 377 34 +783us[ +802us] +/- 41ms 2024-05-16T23:37:19.888 INFO:teuthology.orchestra.run.smithi196.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 41 -1148us[-1129us] +/- 68ms 2024-05-16T23:37:19.897 INFO:teuthology.orchestra.run.smithi196.stdout:^+ hv03.front.sepia.ceph.com 3 8 377 108 +121us[ +159us] +/- 72ms 2024-05-16T23:37:19.906 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-05-16T23:37:19.942 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-16T23:37:19.977 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-16T23:37:20.005 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-16T23:37:20.024 DEBUG:teuthology.orchestra.run.smithi044:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-16T23:37:20.107 DEBUG:teuthology.orchestra.run.smithi070:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-16T23:37:20.183 DEBUG:teuthology.orchestra.run.smithi196:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-16T23:37:20.363 DEBUG:teuthology.orchestra.run.smithi044:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-16T23:37:20.406 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-16T23:37:20.417 DEBUG:teuthology.orchestra.run.smithi070:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-16T23:37:20.456 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-16T23:37:20.467 DEBUG:teuthology.orchestra.run.smithi196:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-16T23:37:20.573 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-16T23:37:20.583 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-16T23:37:20.601 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-16T23:37:20.667 INFO:teuthology.task.internal:Duration was 4741.177752 seconds 2024-05-16T23:37:20.689 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-16T23:37:20.706 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-16T23:37:20.716 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-16T23:37:20.728 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-16T23:37:20.737 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-16T23:37:20.771 INFO:teuthology.orchestra.run.smithi044.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-16T23:37:20.779 INFO:teuthology.orchestra.run.smithi070.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-16T23:37:20.892 INFO:teuthology.orchestra.run.smithi196.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-16T23:37:21.301 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-16T23:37:21.318 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi044.front.sepia.ceph.com 2024-05-16T23:37:21.332 DEBUG:teuthology.orchestra.run.smithi044:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-16T23:37:21.367 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi070.front.sepia.ceph.com 2024-05-16T23:37:21.378 DEBUG:teuthology.orchestra.run.smithi070:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-16T23:37:21.422 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi196.front.sepia.ceph.com 2024-05-16T23:37:21.459 DEBUG:teuthology.orchestra.run.smithi196:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-16T23:37:21.540 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-16T23:37:21.558 DEBUG:teuthology.orchestra.run.smithi044:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-16T23:37:21.571 DEBUG:teuthology.orchestra.run.smithi070:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-16T23:37:21.586 DEBUG:teuthology.orchestra.run.smithi196:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-16T23:37:21.688 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-16T23:37:21.696 DEBUG:teuthology.orchestra.run.smithi044:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-16T23:37:21.706 DEBUG:teuthology.orchestra.run.smithi070:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-16T23:37:21.717 DEBUG:teuthology.orchestra.run.smithi196:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-16T23:37:21.931 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-16T23:37:21.951 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-16T23:37:21.961 DEBUG:teuthology.orchestra.run.smithi044:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-16T23:37:21.995 DEBUG:teuthology.orchestra.run.smithi070:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-16T23:37:22.029 DEBUG:teuthology.orchestra.run.smithi196:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-16T23:37:22.127 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-16T23:37:22.146 DEBUG:teuthology.orchestra.run.smithi044:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-16T23:37:22.176 DEBUG:teuthology.orchestra.run.smithi070:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-16T23:37:22.232 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern = core 2024-05-16T23:37:22.244 DEBUG:teuthology.orchestra.run.smithi196:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-16T23:37:22.255 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern = core 2024-05-16T23:37:22.363 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern = core 2024-05-16T23:37:22.406 DEBUG:teuthology.orchestra.run.smithi044:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-16T23:37:22.429 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-16T23:37:22.441 DEBUG:teuthology.orchestra.run.smithi070:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-16T23:37:22.468 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-16T23:37:22.478 DEBUG:teuthology.orchestra.run.smithi196:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-16T23:37:22.543 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-16T23:37:22.568 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-16T23:37:22.588 INFO:teuthology.task.internal:Transferring archived files... 2024-05-16T23:37:22.598 DEBUG:teuthology.misc:Transferring archived files from smithi044:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-16_22:05:38-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7709888/remote/smithi044 2024-05-16T23:37:22.608 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-16T23:37:22.654 DEBUG:teuthology.misc:Transferring archived files from smithi070:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-16_22:05:38-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7709888/remote/smithi070 2024-05-16T23:37:22.687 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-16T23:37:22.790 DEBUG:teuthology.misc:Transferring archived files from smithi196:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-16_22:05:38-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7709888/remote/smithi196 2024-05-16T23:37:22.797 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-16T23:37:22.904 INFO:teuthology.task.internal:Removing archive directory... 2024-05-16T23:37:22.917 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-16T23:37:22.933 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-16T23:37:22.945 DEBUG:teuthology.orchestra.run.smithi196:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-16T23:37:23.012 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-16T23:37:23.032 INFO:teuthology.task.internal:Not uploading archives. 2024-05-16T23:37:23.041 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-16T23:37:23.060 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-16T23:37:23.072 DEBUG:teuthology.orchestra.run.smithi044:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-16T23:37:23.091 DEBUG:teuthology.orchestra.run.smithi070:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-16T23:37:23.103 DEBUG:teuthology.orchestra.run.smithi196:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-16T23:37:23.114 INFO:teuthology.orchestra.run.smithi044.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 16 23:37 /home/ubuntu/cephtest 2024-05-16T23:37:23.180 INFO:teuthology.orchestra.run.smithi070.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 16 23:37 /home/ubuntu/cephtest 2024-05-16T23:37:23.251 INFO:teuthology.orchestra.run.smithi196.stdout: 393522 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 16 23:37 /home/ubuntu/cephtest 2024-05-16T23:37:23.264 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-16T23:37:23.284 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-16T23:37:23.315 INFO:teuthology.nuke:Checking targets against current locks 2024-05-16T23:37:23.350 DEBUG:teuthology.nuke:shortname: smithi044 2024-05-16T23:37:23.360 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-16T23:37:23.397 DEBUG:teuthology.nuke:shortname: smithi070 2024-05-16T23:37:23.407 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-16T23:37:23.425 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi044.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-16_22:05:38-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7709888', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-16 22:09:59.393927', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAt5rcUO4Y7SferHnsS0xP4UK1u8AcDvnsU3NbSFYtsAlZnr3NsT5mWskvl8O+kjXaJQNqYGpgdM5kfJK3hO6WQ='} 2024-05-16T23:37:23.447 DEBUG:teuthology.nuke:shortname: smithi196 2024-05-16T23:37:23.457 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-16T23:37:23.469 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi070.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-16_22:05:38-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7709888', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-16 22:09:59.395568', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDIXx6UZPtPph7S+DeRygWR+koZsxIHdJq7YABiIz+4yDx3pjYMMeRPWCVJVaU0fBVs04k4oN9uXnKFJCrJU0pY='} 2024-05-16T23:37:23.509 INFO:teuthology.orchestra.console.smithi044:Power off 2024-05-16T23:37:23.536 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-16T23:37:23.607 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi196.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-16_22:05:38-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7709888', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-16 22:09:59.396889', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCc/414NTDfFM39WmJCX7+FMCG01VdK0WrgTsS7qdBV17NP6D6e5c3R2XPeHh/CUFQOdO5usm+glmupjtMzVU1g='} 2024-05-16T23:37:23.621 DEBUG:teuthology.orchestra.console.smithi044:power off output: Chassis Power Control: Down/Off 2024-05-16T23:37:23.630 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-16T23:37:23.654 INFO:teuthology.orchestra.console.smithi070:Power off 2024-05-16T23:37:23.686 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-16T23:37:23.707 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on 2024-05-16T23:37:23.720 DEBUG:teuthology.orchestra.console.smithi070:power off output: Chassis Power Control: Down/Off 2024-05-16T23:37:23.729 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-16T23:37:23.756 INFO:teuthology.orchestra.console.smithi196:Power off 2024-05-16T23:37:23.766 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-16T23:37:23.785 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is on 2024-05-16T23:37:23.798 DEBUG:teuthology.orchestra.console.smithi196:power off output: Chassis Power Control: Down/Off 2024-05-16T23:37:23.809 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-16T23:37:23.841 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2024-05-16T23:37:27.717 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-16T23:37:27.793 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-16T23:37:27.854 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-16T23:37:27.869 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on 2024-05-16T23:37:27.911 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is on 2024-05-16T23:37:27.969 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2024-05-16T23:37:31.880 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-16T23:37:31.920 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-16T23:37:31.979 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-16T23:37:32.013 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on 2024-05-16T23:37:32.042 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is off 2024-05-16T23:37:32.098 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off 2024-05-16T23:37:32.152 INFO:teuthology.orchestra.console.smithi070:Power off completed 2024-05-16T23:37:32.208 INFO:teuthology.orchestra.console.smithi196:Power off completed 2024-05-16T23:37:36.024 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-16T23:37:36.153 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off 2024-05-16T23:37:36.262 INFO:teuthology.orchestra.console.smithi044:Power off completed 2024-05-16T23:37:36.428 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 42e114f04cb046558abf08b436bd2a0497043042 description: fs:fscrypt/{begin/{0-install 1-ceph 2-logrotate 3-modules} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down osd pg-warn pg_health} tasks/{0-client 1-tests/fscrypt-common}} duration: 4741.177752494812 failure_reason: 'Test failure: test_fscrypt_journal_recovery (tasks.cephfs.test_fscrypt.TestFSCryptRecovery)' flavor: default owner: scheduled_pdonnell@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=218c144c0aa5444ab63abfed2bccb8a7 status: fail success: false 2024-05-16T23:37:36.468 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-16T23:37:36.558 INFO:teuthology.run:FAIL